2024-09-16T01:03:48.514 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T01:03:48.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T01:03:48.630 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsstress}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906448' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK1ZpL7GaYVc86vKbomENQb0t6LZrkv41bMg0xkaDouIbFlR1237cbHBuY3mWob3U2oQs82gt4LQcKNq3y6BtKM= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCD07DPwFCij1kX0O5uUmbZzHiGBMjIY3Mi/WRSOHOYBZCL+sSu5mTZG2nGn9sAWkq+5GP9WJRRXB+WbvrYfoP4= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCejN+GeqS2ghoobfvNvAaMM+LVAsIE47l6p8cmRm/i5hGsYZnC7zRQ2d4uGGcBP0a5wT11L8ZmCSLW2ohzZiBg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T01:03:48.630 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-16T01:03:48.631 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-16T01:03:48.631 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T01:03:48.634 INFO:teuthology.task.internal:Checking packages... 2024-09-16T01:03:48.655 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-16T01:03:48.655 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T01:03:48.656 INFO:teuthology.packaging:ref: None 2024-09-16T01:03:48.656 INFO:teuthology.packaging:tag: None 2024-09-16T01:03:48.656 INFO:teuthology.packaging:branch: squid 2024-09-16T01:03:48.656 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:03:48.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T01:03:48.893 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-16T01:03:48.898 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T01:03:48.905 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T01:03:48.905 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T01:03:48.941 INFO:teuthology.task.internal:Saving configuration 2024-09-16T01:03:48.960 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T01:03:48.965 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T01:03:48.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:58:35.491467', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK1ZpL7GaYVc86vKbomENQb0t6LZrkv41bMg0xkaDouIbFlR1237cbHBuY3mWob3U2oQs82gt4LQcKNq3y6BtKM='} 2024-09-16T01:03:49.011 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:58:35.493037', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCD07DPwFCij1kX0O5uUmbZzHiGBMjIY3Mi/WRSOHOYBZCL+sSu5mTZG2nGn9sAWkq+5GP9WJRRXB+WbvrYfoP4='} 2024-09-16T01:03:49.032 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 00:58:35.489462', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCejN+GeqS2ghoobfvNvAaMM+LVAsIE47l6p8cmRm/i5hGsYZnC7zRQ2d4uGGcBP0a5wT11L8ZmCSLW2ohzZiBg='} 2024-09-16T01:03:49.032 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T01:03:49.038 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-16T01:03:49.038 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-16T01:03:49.038 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-16T01:03:49.038 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T01:03:49.143 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f53b97abbe0>, signals=[15]) 2024-09-16T01:03:49.143 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T01:03:49.150 INFO:teuthology.task.internal:Opening connections... 2024-09-16T01:03:49.150 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-09-16T01:03:49.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:03:49.240 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-16T01:03:49.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:03:49.317 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-09-16T01:03:49.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:03:49.391 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T01:03:49.398 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-09-16T01:03:49.416 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-09-16T01:03:49.416 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-09-16T01:03:49.473 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-09-16T01:03:49.473 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-09-16T01:03:49.473 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T01:03:49.474 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T01:03:49.475 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-09-16T01:03:49.499 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-16T01:03:49.517 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-16T01:03:49.518 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-16T01:03:49.575 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-16T01:03:49.575 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-16T01:03:49.575 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-16T01:03:49.575 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-16T01:03:49.575 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-16T01:03:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-16T01:03:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T01:03:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-16T01:03:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-16T01:03:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T01:03:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-16T01:03:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T01:03:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T01:03:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T01:03:49.576 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-16T01:03:49.590 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-09-16T01:03:49.609 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-09-16T01:03:49.610 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-09-16T01:03:49.667 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-09-16T01:03:49.667 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T01:03:49.668 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T01:03:49.669 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-09-16T01:03:49.736 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T01:03:49.746 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T01:03:49.766 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T01:03:49.766 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-09-16T01:03:49.768 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-16T01:03:49.771 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-09-16T01:03:49.788 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T01:03:49.793 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T01:03:49.794 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-09-16T01:03:49.825 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-16T01:03:49.828 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-09-16T01:03:49.923 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T01:03:50.037 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T01:03:50.051 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T01:03:50.051 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T01:03:50.052 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T01:03:50.052 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T01:03:50.053 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T01:03:50.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:03:50.070 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-16T01:03:50.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:03:50.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:03:50.071 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-16T01:03:50.072 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-16T01:03:50.127 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-503.el9.x86_64 2024-09-16T01:03:50.127 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.14.0-503.el9.x86_64 2024-09-16T01:03:50.128 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y kernel 2024-09-16T01:03:50.129 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-503.el9.x86_64 2024-09-16T01:03:50.129 INFO:teuthology.task.kernel:Running kernel on smithi192: 5.14.0-503.el9.x86_64 2024-09-16T01:03:50.129 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2024-09-16T01:03:50.130 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-503.el9.x86_64 2024-09-16T01:03:50.131 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.14.0-503.el9.x86_64 2024-09-16T01:03:50.131 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum install -y kernel 2024-09-16T01:03:52.526 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-16T01:03:53.712 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-16T01:03:54.088 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.2 MB 00:02 2024-09-16T01:03:55.310 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-16T01:03:58.762 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 20 MB 00:03 2024-09-16T01:03:59.620 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-16T01:04:01.345 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-16T01:04:02.341 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-16T01:04:03.813 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.5 MB 00:01 2024-09-16T01:04:04.570 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 20 MB 00:09 2024-09-16T01:04:05.297 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-16T01:04:06.219 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-16T01:04:07.947 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-16T01:04:09.079 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-16T01:04:10.204 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T01:04:10.204 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T01:04:10.310 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-09-16T01:04:10.316 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout:Install 4 Packages 2024-09-16T01:04:10.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 79 M 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 126 M 2024-09-16T01:04:10.318 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-16T01:04:10.530 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-16T01:04:10.748 INFO:teuthology.orchestra.run.smithi063.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 132 kB/s | 23 kB 00:00 2024-09-16T01:04:11.350 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-16T01:04:11.616 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-16T01:04:13.639 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T01:04:13.639 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T01:04:13.728 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-16T01:04:13.739 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-16T01:04:13.739 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2024-09-16T01:04:13.739 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-16T01:04:13.739 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-16T01:04:13.739 INFO:teuthology.orchestra.run.smithi192.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T01:04:13.739 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-16T01:04:13.739 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T01:04:13.739 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T01:04:13.739 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T01:04:13.740 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:04:13.740 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-16T01:04:13.740 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-16T01:04:13.740 INFO:teuthology.orchestra.run.smithi192.stdout:Install 4 Packages 2024-09-16T01:04:13.740 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:04:13.740 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 79 M 2024-09-16T01:04:13.741 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 126 M 2024-09-16T01:04:13.741 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-16T01:04:13.859 INFO:teuthology.orchestra.run.smithi192.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 314 kB/s | 23 kB 00:00 2024-09-16T01:04:15.426 INFO:teuthology.orchestra.run.smithi192.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 18 MB/s | 29 MB 00:01 2024-09-16T01:04:15.726 INFO:teuthology.orchestra.run.smithi192.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 8.1 MB/s | 16 MB 00:01 2024-09-16T01:04:16.186 INFO:teuthology.orchestra.run.smithi192.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 14 MB/s | 35 MB 00:02 2024-09-16T01:04:16.186 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:04:16.186 INFO:teuthology.orchestra.run.smithi192.stdout:Total 32 MB/s | 79 MB 00:02 2024-09-16T01:04:16.798 INFO:teuthology.orchestra.run.smithi063.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.5 MB/s | 16 MB 00:06 2024-09-16T01:04:16.872 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-16T01:04:16.906 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T01:04:17.237 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-16T01:04:17.237 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-16T01:04:17.898 INFO:teuthology.orchestra.run.smithi063.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.0 MB/s | 29 MB 00:07 2024-09-16T01:04:18.195 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-16T01:04:18.196 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-16T01:04:18.937 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T01:04:18.937 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T01:04:19.022 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-16T01:04:19.034 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-16T01:04:19.034 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-09-16T01:04:19.035 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:04:19.036 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 79 M 2024-09-16T01:04:19.036 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 126 M 2024-09-16T01:04:19.036 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-16T01:04:19.207 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 184 kB/s | 23 kB 00:00 2024-09-16T01:04:19.749 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-16T01:04:20.382 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-16T01:04:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-16T01:04:20.766 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 21 MB/s | 35 MB 00:01 2024-09-16T01:04:20.766 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:04:20.766 INFO:teuthology.orchestra.run.smithi162.stdout:Total 46 MB/s | 79 MB 00:01 2024-09-16T01:04:21.388 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:04:21.445 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-16T01:04:21.470 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:04:21.673 INFO:teuthology.orchestra.run.smithi063.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.1 MB/s | 35 MB 00:11 2024-09-16T01:04:21.673 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:04:21.674 INFO:teuthology.orchestra.run.smithi063.stdout:Total 6.9 MB/s | 79 MB 00:11 2024-09-16T01:04:21.808 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-16T01:04:21.808 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-16T01:04:22.385 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-16T01:04:22.765 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-16T01:04:22.765 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-16T01:04:22.778 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-16T01:04:22.779 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-16T01:04:23.731 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-16T01:04:23.731 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-16T01:04:24.287 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:04:24.424 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:04:25.265 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-16T01:04:25.936 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:04:26.079 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:04:26.313 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-16T01:04:26.993 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:04:27.075 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:04:28.929 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:04:29.075 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:04:29.228 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:04:29.266 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:04:29.873 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:04:29.994 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:04:33.926 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:04:33.968 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:04:34.104 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:04:35.121 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:04:35.162 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:04:38.793 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:04:40.297 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:12.359 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:12.399 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:12.721 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:12.721 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:05:12.721 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:05:12.721 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:05:13.594 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:13.595 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:05:13.595 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-16T01:05:13.595 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T01:05:13.595 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T01:05:13.595 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T01:05:13.595 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T01:05:13.595 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:05:13.595 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-16T01:05:13.931 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:05:14.016 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:05:14.016 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:05:14.016 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T01:05:14.016 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T01:05:14.017 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T01:05:14.017 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-16T01:05:14.017 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T01:05:14.017 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:05:14.076 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:05:14.077 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:05:14.077 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -qi grub2-tools 2024-09-16T01:05:14.116 INFO:teuthology.orchestra.run.smithi192.stdout:Name : grub2-tools 2024-09-16T01:05:14.116 INFO:teuthology.orchestra.run.smithi192.stdout:Epoch : 1 2024-09-16T01:05:14.116 INFO:teuthology.orchestra.run.smithi192.stdout:Version : 2.06 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Release : 82.el9 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: x86_64 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Group : Unspecified 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Size : 8274670 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:License : GPLv3+ 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Packager : builder@centos.org 2024-09-16T01:05:14.117 INFO:teuthology.orchestra.run.smithi192.stdout:Vendor : CentOS 2024-09-16T01:05:14.118 INFO:teuthology.orchestra.run.smithi192.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T01:05:14.118 INFO:teuthology.orchestra.run.smithi192.stdout:Summary : Support tools for GRUB. 2024-09-16T01:05:14.118 INFO:teuthology.orchestra.run.smithi192.stdout:Description : 2024-09-16T01:05:14.118 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:05:14.118 INFO:teuthology.orchestra.run.smithi192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T01:05:14.118 INFO:teuthology.orchestra.run.smithi192.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T01:05:14.118 INFO:teuthology.orchestra.run.smithi192.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T01:05:14.118 INFO:teuthology.orchestra.run.smithi192.stdout:hardware devices. 2024-09-16T01:05:14.118 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:05:14.118 INFO:teuthology.orchestra.run.smithi192.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T01:05:14.119 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T01:05:14.119 INFO:teuthology.task.kernel:Updating grub on smithi192 to boot 5.14.0-505.el9.x86_64 2024-09-16T01:05:14.119 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T01:05:14.767 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2024-09-16T01:05:16.054 INFO:teuthology.orchestra.run.smithi192.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T01:05:16.077 INFO:teuthology.orchestra.run.smithi192.stderr:done 2024-09-16T01:05:16.080 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-16T01:05:16.095 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.LSJ4xXcXEb 2024-09-16T01:05:16.095 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LSJ4xXcXEb 2024-09-16T01:05:16.161 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.LSJ4xXcXEb 2024-09-16T01:05:16.301 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.LSJ4xXcXEb is 6KB 2024-09-16T01:05:16.349 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.LSJ4xXcXEb 2024-09-16T01:05:16.364 DEBUG:teuthology.orchestra.run.smithi192:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T01:05:16.433 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T01:05:16.433 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T01:05:16.434 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T01:05:16.434 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T01:05:16.435 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T01:05:16.604 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2024-09-16T01:05:17.026 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:17.066 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:17.382 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:17.382 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:05:17.382 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:05:17.383 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:05:18.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:18.270 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:05:18.271 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-16T01:05:18.271 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T01:05:18.271 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T01:05:18.271 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T01:05:18.271 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T01:05:18.271 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:05:18.271 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-16T01:05:18.617 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:05:18.710 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:05:18.710 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:05:18.711 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T01:05:18.711 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T01:05:18.711 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T01:05:18.711 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-16T01:05:18.711 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T01:05:18.711 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:05:18.769 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:05:18.770 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:05:18.770 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-09-16T01:05:18.804 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-09-16T01:05:18.804 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 82.el9 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8274670 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-09-16T01:05:18.805 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-09-16T01:05:18.806 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T01:05:18.806 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-09-16T01:05:18.806 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-09-16T01:05:18.806 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:05:18.806 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T01:05:18.806 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T01:05:18.806 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T01:05:18.806 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-09-16T01:05:18.806 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:05:18.806 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T01:05:18.807 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T01:05:18.807 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 5.14.0-505.el9.x86_64 2024-09-16T01:05:18.808 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T01:05:19.151 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:19.192 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:19.445 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-09-16T01:05:19.483 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:19.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:05:19.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:05:19.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:05:20.369 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:05:20.369 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:05:20.370 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-16T01:05:20.370 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T01:05:20.370 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T01:05:20.370 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T01:05:20.370 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T01:05:20.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:05:20.370 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-16T01:05:20.709 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:05:20.712 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T01:05:20.747 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-09-16T01:05:20.749 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-16T01:05:20.764 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.QuZCoSd3QB 2024-09-16T01:05:20.765 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QuZCoSd3QB 2024-09-16T01:05:20.795 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:05:20.795 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:05:20.795 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T01:05:20.795 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T01:05:20.795 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T01:05:20.795 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T01:05:20.796 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T01:05:20.796 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:05:20.836 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.QuZCoSd3QB 2024-09-16T01:05:20.853 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:05:20.854 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:05:20.854 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2024-09-16T01:05:20.893 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2024-09-16T01:05:20.893 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2024-09-16T01:05:20.893 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.06 2024-09-16T01:05:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 82.el9 2024-09-16T01:05:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2024-09-16T01:05:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T01:05:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:Group : Unspecified 2024-09-16T01:05:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 8274670 2024-09-16T01:05:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2024-09-16T01:05:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T01:05:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T01:05:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T01:05:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : builder@centos.org 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:05:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T01:05:20.896 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T01:05:20.896 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 5.14.0-505.el9.x86_64 2024-09-16T01:05:20.897 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T01:05:20.974 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.QuZCoSd3QB is 6KB 2024-09-16T01:05:21.022 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.QuZCoSd3QB 2024-09-16T01:05:21.037 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T01:05:21.101 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T01:05:21.101 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T01:05:21.101 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T01:05:21.101 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T01:05:21.102 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T01:05:21.249 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-09-16T01:05:21.610 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-09-16T01:05:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T01:05:22.925 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-09-16T01:05:22.927 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-16T01:05:22.942 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.Mmimxw4DMg 2024-09-16T01:05:22.942 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Mmimxw4DMg 2024-09-16T01:05:23.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.Mmimxw4DMg 2024-09-16T01:05:23.157 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.Mmimxw4DMg is 6KB 2024-09-16T01:05:23.204 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.Mmimxw4DMg 2024-09-16T01:05:23.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T01:05:23.281 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T01:05:23.281 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T01:05:23.281 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T01:05:23.281 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T01:05:23.283 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T01:05:23.423 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-09-16T01:05:46.630 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-16T01:05:46.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-16T01:05:46.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:05:51.257 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-16T01:05:51.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-16T01:05:51.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:05:53.428 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T01:05:53.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-16T01:05:53.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:06:21.117 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-16T01:06:25.725 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-16T01:06:28.029 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-16T01:06:30.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-16T01:06:30.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:06:34.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-16T01:06:34.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:06:37.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-16T01:06:37.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:06:48.509 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-16T01:06:55.421 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-16T01:07:00.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-16T01:07:00.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:07:00.863 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-16T01:07:01.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-16T01:07:01.246 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-505.el9.x86_64"... 2024-09-16T01:07:01.246 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-16T01:07:01.261 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-505.el9.x86_64 2024-09-16T01:07:01.261 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T01:07:01.261 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T01:07:01.261 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T01:07:02.262 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-16T01:07:02.262 DEBUG:teuthology.orchestra.run.smithi192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T01:07:02.336 INFO:teuthology.orchestra.run.smithi192.stdout:ttyS1 2024-09-16T01:07:02.360 DEBUG:teuthology.parallel:result is None 2024-09-16T01:07:06.530 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-16T01:07:06.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-16T01:07:06.976 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-16T01:07:06.976 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-16T01:07:06.994 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-505.el9.x86_64 2024-09-16T01:07:06.995 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T01:07:06.995 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T01:07:06.995 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T01:07:07.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-16T01:07:07.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:07:07.867 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-16T01:07:07.995 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-16T01:07:07.996 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T01:07:08.089 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2024-09-16T01:07:08.106 DEBUG:teuthology.parallel:result is None 2024-09-16T01:07:08.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-16T01:07:08.346 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T01:07:08.347 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-16T01:07:08.362 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-505.el9.x86_64 2024-09-16T01:07:08.362 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T01:07:08.362 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T01:07:08.362 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T01:07:09.363 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T01:07:09.364 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T01:07:09.462 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2024-09-16T01:07:09.492 DEBUG:teuthology.parallel:result is None 2024-09-16T01:07:09.493 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T01:07:09.502 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T01:07:09.502 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T01:07:09.505 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T01:07:09.508 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T01:07:09.528 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T01:07:09.544 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T01:07:09.572 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T01:07:09.573 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T01:07:09.575 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T01:07:09.578 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T01:07:09.700 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T01:07:09.708 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T01:07:09.709 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T01:07:09.711 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T01:07:09.714 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T01:07:09.742 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:07:09.746 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:07:09.752 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:07:09.758 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:07:09.872 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:07:09.882 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:07:09.884 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T01:07:09.894 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T01:07:09.894 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T01:07:09.897 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T01:07:09.899 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T01:07:09.928 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T01:07:09.943 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T01:07:09.944 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T01:07:09.966 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T01:07:09.969 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T01:07:09.986 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:07:10.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:07:10.131 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:07:10.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:07:10.262 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:07:10.263 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T01:07:10.344 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:07:10.387 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:07:10.435 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:07:10.521 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:07:10.558 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:07:10.558 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T01:07:10.631 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:07:10.674 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:07:10.734 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:07:10.820 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:07:10.863 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:07:10.863 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T01:07:10.932 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-09-16T01:07:10.934 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-16T01:07:10.939 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-09-16T01:07:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:07:10.992 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:07:11.029 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:07:11.539 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T01:07:11.547 INFO:teuthology.task.internal:Starting timer... 2024-09-16T01:07:11.548 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T01:07:11.574 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T01:07:11.607 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-16T01:07:11.607 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-09-16T01:07:11.656 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-09-16T01:07:11.658 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-16T01:07:11.711 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-16T01:07:11.713 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2024-09-16T01:07:11.775 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2024-09-16T01:07:11.777 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T01:07:11.777 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-09-16T01:07:11.802 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-09-16T01:07:11.803 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-16T01:07:11.821 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-16T01:07:11.822 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2024-09-16T01:07:11.845 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2024-09-16T01:07:11.845 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2024-09-16T01:07:11.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:07:11.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:07:11.874 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:07:11.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:07:11.900 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:07:11.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:07:11.931 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T01:07:11.931 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-09-16T01:07:12.013 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-16T01:07:12.052 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2024-09-16T01:07:12.092 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T01:07:12.101 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T01:07:12.113 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T01:07:12.114 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi162.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T01:11:01.083 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2024-09-16T01:11:01.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-16T01:11:01.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:11:01.180 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-16T01:11:01.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-16T01:11:01.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-16T01:11:01.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:11:01.349 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-16T01:11:01.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-16T01:11:01.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-16T01:11:01.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:11:01.512 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-16T01:11:01.594 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-16T01:11:01.595 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T01:11:01.605 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T01:11:01.606 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T01:11:01.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:11:01.609 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T01:11:01.609 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:11:01.612 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T01:11:01.612 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:11:01.641 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T01:11:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T01:11:01.656 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T01:11:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T01:11:01.667 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T01:11:01.681 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-16T01:11:01.682 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T01:11:01.686 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-09-16T01:11:01.692 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-16T01:11:01.699 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-09-16T01:11:01.708 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2024-09-16T01:11:01.708 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T01:11:01.715 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T01:11:01.719 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2024-09-16T01:11:01.721 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T01:11:01.730 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T01:11:01.734 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T01:11:01.748 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T01:11:01.780 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:11:01.784 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:11:01.784 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-16T01:11:01.784 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.784 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.784 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.785 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.794 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:11:01.798 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:11:01.798 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-16T01:11:01.798 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.798 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.798 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.798 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.802 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:11:01.807 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:11:01.808 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-16T01:11:01.808 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.808 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.808 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.810 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:11:01.810 INFO:teuthology.run_tasks:Running task install... 2024-09-16T01:11:01.818 DEBUG:teuthology.task.install:project ceph 2024-09-16T01:11:01.819 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-16T01:11:01.819 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T01:11:01.819 INFO:teuthology.task.install:Using flavor: default 2024-09-16T01:11:01.825 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T01:11:01.825 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-16T01:11:01.826 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T01:11:01.827 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:11:01.829 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T01:11:01.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:11:01.830 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T01:11:01.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:11:01.980 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T01:11:01.980 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T01:11:02.000 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T01:11:02.000 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T01:11:02.004 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T01:11:02.004 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T01:11:02.096 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T01:11:02.097 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:11:02.097 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T01:11:02.113 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T01:11:02.114 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:11:02.114 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T01:11:02.123 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T01:11:02.123 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:11:02.124 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T01:11:02.125 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T01:11:02.125 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T01:11:02.139 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T01:11:02.140 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T01:11:02.152 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T01:11:02.152 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T01:11:02.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T01:11:02.205 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T01:11:02.219 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T01:11:02.269 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T01:11:02.280 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T01:11:02.297 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T01:11:02.335 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2024-09-16T01:11:02.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2024-09-16T01:11:02.345 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2024-09-16T01:11:02.346 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2024-09-16T01:11:02.361 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-16T01:11:02.363 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-16T01:11:02.569 INFO:teuthology.orchestra.run.smithi063.stdout:45 files removed 2024-09-16T01:11:02.583 INFO:teuthology.orchestra.run.smithi192.stdout:45 files removed 2024-09-16T01:11:02.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T01:11:02.606 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-16T01:11:02.610 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T01:11:02.633 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T01:11:03.173 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 301 kB/s | 83 kB 00:00 2024-09-16T01:11:03.179 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 298 kB/s | 83 kB 00:00 2024-09-16T01:11:03.189 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 314 kB/s | 83 kB 00:00 2024-09-16T01:11:03.457 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-16T01:11:03.463 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-16T01:11:03.481 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-16T01:11:03.733 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-16T01:11:03.738 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-16T01:11:03.757 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-16T01:11:04.237 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-16T01:11:04.522 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-16T01:11:04.532 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-16T01:11:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-16T01:11:06.525 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-16T01:11:08.815 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 20 MB 00:03 2024-09-16T01:11:10.535 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-16T01:11:11.583 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.5 MB 00:01 2024-09-16T01:11:11.977 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 110 kB/s | 19 kB 00:00 2024-09-16T01:11:12.765 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-16T01:11:13.175 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 19 kB 00:00 2024-09-16T01:11:13.382 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.5 MB 00:00 2024-09-16T01:11:14.021 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-16T01:11:14.925 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-16T01:11:15.704 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-16T01:11:18.354 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-16T01:11:19.410 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-16T01:11:20.775 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:11:20.776 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:11:20.792 INFO:teuthology.orchestra.run.smithi063.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T01:11:20.792 INFO:teuthology.orchestra.run.smithi063.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T01:11:20.792 INFO:teuthology.orchestra.run.smithi063.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T01:11:20.794 INFO:teuthology.orchestra.run.smithi063.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T01:11:20.795 INFO:teuthology.orchestra.run.smithi063.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T01:11:20.797 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T01:11:20.798 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T01:11:20.867 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-16T01:11:20.890 INFO:teuthology.orchestra.run.smithi063.stdout:====================================================================================== 2024-09-16T01:11:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-16T01:11:20.891 INFO:teuthology.orchestra.run.smithi063.stdout:====================================================================================== 2024-09-16T01:11:20.891 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-16T01:11:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T01:11:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T01:11:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T01:11:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T01:11:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T01:11:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T01:11:20.891 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T01:11:20.892 INFO:teuthology.orchestra.run.smithi063.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T01:11:20.893 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T01:11:20.894 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T01:11:20.895 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T01:11:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T01:11:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T01:11:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T01:11:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T01:11:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T01:11:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T01:11:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T01:11:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T01:11:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T01:11:20.896 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T01:11:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T01:11:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T01:11:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T01:11:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T01:11:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T01:11:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T01:11:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T01:11:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T01:11:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T01:11:20.897 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T01:11:20.898 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T01:11:20.899 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T01:11:20.900 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T01:11:20.901 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T01:11:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T01:11:20.903 INFO:teuthology.orchestra.run.smithi063.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T01:11:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T01:11:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T01:11:20.904 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-09-16T01:11:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T01:11:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:11:20.904 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-16T01:11:20.904 INFO:teuthology.orchestra.run.smithi063.stdout:====================================================================================== 2024-09-16T01:11:20.904 INFO:teuthology.orchestra.run.smithi063.stdout:Install 148 Packages 2024-09-16T01:11:20.904 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 8 Packages 2024-09-16T01:11:20.904 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:11:20.905 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 226 M 2024-09-16T01:11:20.905 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-16T01:11:21.251 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-09-16T01:11:21.473 INFO:teuthology.orchestra.run.smithi063.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-16T01:11:21.775 INFO:teuthology.orchestra.run.smithi063.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 4.6 MB/s | 896 kB 00:00 2024-09-16T01:11:21.775 INFO:teuthology.orchestra.run.smithi063.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.8 MB/s | 145 kB 00:00 2024-09-16T01:11:21.776 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:11:21.776 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:11:21.776 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T01:11:21.776 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T01:11:21.776 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T01:11:21.776 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T01:11:21.776 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T01:11:21.777 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T01:11:21.777 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T01:11:21.819 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-16T01:11:21.834 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-16T01:11:21.834 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-16T01:11:21.834 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-16T01:11:21.834 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T01:11:21.835 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T01:11:21.836 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T01:11:21.837 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T01:11:21.838 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T01:11:21.839 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T01:11:21.840 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T01:11:21.841 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T01:11:21.841 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T01:11:21.841 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T01:11:21.841 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T01:11:21.841 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T01:11:21.841 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T01:11:21.841 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T01:11:21.841 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T01:11:21.841 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T01:11:21.841 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T01:11:21.842 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T01:11:21.843 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T01:11:21.844 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T01:11:21.845 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T01:11:21.846 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T01:11:21.847 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T01:11:21.848 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-16T01:11:21.848 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T01:11:21.848 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:11:21.848 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-16T01:11:21.848 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-16T01:11:21.848 INFO:teuthology.orchestra.run.smithi162.stdout:Install 148 Packages 2024-09-16T01:11:21.848 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 8 Packages 2024-09-16T01:11:21.848 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:11:21.849 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 226 M 2024-09-16T01:11:21.849 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-16T01:11:21.915 INFO:teuthology.orchestra.run.smithi063.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 9.4 MB/s | 5.4 MB 00:00 2024-09-16T01:11:21.973 INFO:teuthology.orchestra.run.smithi063.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 9.2 MB/s | 2.4 MB 00:00 2024-09-16T01:11:22.074 INFO:teuthology.orchestra.run.smithi063.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 9.6 MB/s | 1.5 MB 00:00 2024-09-16T01:11:22.374 INFO:teuthology.orchestra.run.smithi063.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-16T01:11:22.432 INFO:teuthology.orchestra.run.smithi162.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 29 kB/s | 6.5 kB 00:00 2024-09-16T01:11:22.791 INFO:teuthology.orchestra.run.smithi063.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 21 MB 00:01 2024-09-16T01:11:22.832 INFO:teuthology.orchestra.run.smithi063.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 611 kB/s | 25 kB 00:00 2024-09-16T01:11:22.861 INFO:teuthology.orchestra.run.smithi162.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 2.0 MB/s | 896 kB 00:00 2024-09-16T01:11:23.012 INFO:teuthology.orchestra.run.smithi162.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 967 kB/s | 145 kB 00:00 2024-09-16T01:11:23.091 INFO:teuthology.orchestra.run.smithi063.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 17 MB/s | 17 MB 00:01 2024-09-16T01:11:23.216 INFO:teuthology.orchestra.run.smithi063.stdout:(11/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 13 MB/s | 11 MB 00:00 2024-09-16T01:11:23.241 INFO:teuthology.orchestra.run.smithi063.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.5 MB/s | 228 kB 00:00 2024-09-16T01:11:23.259 INFO:teuthology.orchestra.run.smithi063.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 649 kB/s | 27 kB 00:00 2024-09-16T01:11:23.284 INFO:teuthology.orchestra.run.smithi063.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 756 kB/s | 32 kB 00:00 2024-09-16T01:11:23.326 INFO:teuthology.orchestra.run.smithi063.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 751 kB 00:00 2024-09-16T01:11:23.351 INFO:teuthology.orchestra.run.smithi063.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-16T01:11:23.376 INFO:teuthology.orchestra.run.smithi063.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-16T01:11:23.412 INFO:teuthology.orchestra.run.smithi162.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 4.5 MB/s | 5.4 MB 00:01 2024-09-16T01:11:23.418 INFO:teuthology.orchestra.run.smithi063.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 7.4 MB/s | 506 kB 00:00 2024-09-16T01:11:23.471 INFO:teuthology.orchestra.run.smithi162.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 5.2 MB/s | 2.4 MB 00:00 2024-09-16T01:11:23.485 INFO:teuthology.orchestra.run.smithi063.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 677 kB/s | 45 kB 00:00 2024-09-16T01:11:23.578 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:11:23.579 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:11:23.585 INFO:teuthology.orchestra.run.smithi063.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.3 MB/s | 136 kB 00:00 2024-09-16T01:11:23.590 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T01:11:23.590 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T01:11:23.591 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T01:11:23.592 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T01:11:23.594 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T01:11:23.596 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T01:11:23.597 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T01:11:23.658 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-16T01:11:23.661 INFO:teuthology.orchestra.run.smithi063.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T01:11:23.678 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T01:11:23.679 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T01:11:23.680 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T01:11:23.681 INFO:teuthology.orchestra.run.smithi192.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T01:11:23.682 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T01:11:23.682 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-16T01:11:23.682 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T01:11:23.682 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T01:11:23.682 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T01:11:23.682 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T01:11:23.682 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T01:11:23.682 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T01:11:23.682 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T01:11:23.683 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T01:11:23.683 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T01:11:23.683 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T01:11:23.683 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T01:11:23.683 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T01:11:23.683 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T01:11:23.683 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T01:11:23.684 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T01:11:23.685 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T01:11:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T01:11:23.687 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T01:11:23.688 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T01:11:23.689 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T01:11:23.690 INFO:teuthology.orchestra.run.smithi192.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout:Install 148 Packages 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 8 Packages 2024-09-16T01:11:23.691 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:11:23.692 INFO:teuthology.orchestra.run.smithi063.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.6 MB/s | 161 kB 00:00 2024-09-16T01:11:23.693 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 226 M 2024-09-16T01:11:23.693 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-16T01:11:23.696 INFO:teuthology.orchestra.run.smithi162.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 5.4 MB/s | 1.5 MB 00:00 2024-09-16T01:11:23.728 INFO:teuthology.orchestra.run.smithi063.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 4.7 MB/s | 320 kB 00:00 2024-09-16T01:11:23.753 INFO:teuthology.orchestra.run.smithi063.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 4.4 MB/s | 300 kB 00:00 2024-09-16T01:11:23.803 INFO:teuthology.orchestra.run.smithi063.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.3 MB/s | 99 kB 00:00 2024-09-16T01:11:23.829 INFO:teuthology.orchestra.run.smithi063.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-16T01:11:24.087 INFO:teuthology.orchestra.run.smithi063.stdout:(27/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-16T01:11:24.136 INFO:teuthology.orchestra.run.smithi192.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 31 kB/s | 6.5 kB 00:00 2024-09-16T01:11:24.155 INFO:teuthology.orchestra.run.smithi063.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 478 kB/s | 32 kB 00:00 2024-09-16T01:11:24.221 INFO:teuthology.orchestra.run.smithi063.stdout:(29/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.1 MB/s | 146 kB 00:00 2024-09-16T01:11:24.447 INFO:teuthology.orchestra.run.smithi063.stdout:(30/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 276 kB/s | 170 kB 00:00 2024-09-16T01:11:24.504 INFO:teuthology.orchestra.run.smithi162.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 4.6 MB/s | 4.7 MB 00:01 2024-09-16T01:11:24.539 INFO:teuthology.orchestra.run.smithi063.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 11 MB/s | 3.6 MB 00:00 2024-09-16T01:11:24.631 INFO:teuthology.orchestra.run.smithi063.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.7 MB/s | 249 kB 00:00 2024-09-16T01:11:24.698 INFO:teuthology.orchestra.run.smithi063.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 740 kB/s | 49 kB 00:00 2024-09-16T01:11:24.761 INFO:teuthology.orchestra.run.smithi192.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.4 MB/s | 896 kB 00:00 2024-09-16T01:11:24.764 INFO:teuthology.orchestra.run.smithi063.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 248 kB/s | 16 kB 00:00 2024-09-16T01:11:24.848 INFO:teuthology.orchestra.run.smithi063.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 3.3 MB/s | 285 kB 00:00 2024-09-16T01:11:24.862 INFO:teuthology.orchestra.run.smithi192.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.4 MB/s | 145 kB 00:00 2024-09-16T01:11:24.871 INFO:teuthology.orchestra.run.smithi162.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 8.0 MB/s | 21 MB 00:02 2024-09-16T01:11:24.932 INFO:teuthology.orchestra.run.smithi063.stdout:(36/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-16T01:11:24.947 INFO:teuthology.orchestra.run.smithi162.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 337 kB/s | 25 kB 00:00 2024-09-16T01:11:25.007 INFO:teuthology.orchestra.run.smithi063.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 243 kB/s | 18 kB 00:00 2024-09-16T01:11:25.037 INFO:teuthology.orchestra.run.smithi192.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 4.9 MB/s | 5.4 MB 00:01 2024-09-16T01:11:25.237 INFO:teuthology.orchestra.run.smithi192.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 7.6 MB/s | 1.5 MB 00:00 2024-09-16T01:11:25.541 INFO:teuthology.orchestra.run.smithi063.stdout:(38/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 18 MB/s | 49 MB 00:02 2024-09-16T01:11:25.704 INFO:teuthology.orchestra.run.smithi192.stdout:(6/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-16T01:11:25.746 INFO:teuthology.orchestra.run.smithi192.stdout:(7/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 2.7 MB/s | 2.4 MB 00:00 2024-09-16T01:11:26.033 INFO:teuthology.orchestra.run.smithi063.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 78 kB/s | 80 kB 00:01 2024-09-16T01:11:26.346 INFO:teuthology.orchestra.run.smithi162.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 6.4 MB/s | 17 MB 00:02 2024-09-16T01:11:26.413 INFO:teuthology.orchestra.run.smithi162.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.4 MB/s | 228 kB 00:00 2024-09-16T01:11:26.433 INFO:teuthology.orchestra.run.smithi063.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 899 kB/s | 801 kB 00:00 2024-09-16T01:11:26.497 INFO:teuthology.orchestra.run.smithi162.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 324 kB/s | 27 kB 00:00 2024-09-16T01:11:26.533 INFO:teuthology.orchestra.run.smithi063.stdout:(41/156): ceph-mgr-diskprediction-local-19.1.1- 3.6 MB/s | 7.4 MB 00:02 2024-09-16T01:11:26.581 INFO:teuthology.orchestra.run.smithi162.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 382 kB/s | 32 kB 00:00 2024-09-16T01:11:26.765 INFO:teuthology.orchestra.run.smithi162.stdout:(14/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 4.7 MB/s | 11 MB 00:02 2024-09-16T01:11:26.798 INFO:teuthology.orchestra.run.smithi162.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 3.4 MB/s | 751 kB 00:00 2024-09-16T01:11:26.817 INFO:teuthology.orchestra.run.smithi063.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 244 kB/s | 191 kB 00:00 2024-09-16T01:11:26.832 INFO:teuthology.orchestra.run.smithi162.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-16T01:11:26.857 INFO:teuthology.orchestra.run.smithi162.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.1 MB/s | 127 kB 00:00 2024-09-16T01:11:26.957 INFO:teuthology.orchestra.run.smithi162.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 4.0 MB/s | 506 kB 00:00 2024-09-16T01:11:27.016 INFO:teuthology.orchestra.run.smithi162.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 773 kB/s | 45 kB 00:00 2024-09-16T01:11:27.226 INFO:teuthology.orchestra.run.smithi063.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 320 kB/s | 253 kB 00:00 2024-09-16T01:11:27.230 INFO:teuthology.orchestra.run.smithi192.stdout:(8/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86_ 11 MB/s | 17 MB 00:01 2024-09-16T01:11:27.263 INFO:teuthology.orchestra.run.smithi192.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 762 kB/s | 25 kB 00:00 2024-09-16T01:11:27.449 INFO:teuthology.orchestra.run.smithi162.stdout:(20/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 19 MB/s | 49 MB 00:02 2024-09-16T01:11:27.467 INFO:teuthology.orchestra.run.smithi063.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-16T01:11:27.474 INFO:teuthology.orchestra.run.smithi162.stdout:(21/156): python3-ceph-common-19.1.1-326.g8921c 297 kB/s | 136 kB 00:00 2024-09-16T01:11:27.501 INFO:teuthology.orchestra.run.smithi063.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 156 kB/s | 106 kB 00:00 2024-09-16T01:11:27.508 INFO:teuthology.orchestra.run.smithi162.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.7 MB/s | 161 kB 00:00 2024-09-16T01:11:27.584 INFO:teuthology.orchestra.run.smithi162.stdout:(23/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 7.4 MB/s | 5.3 MB 00:00 2024-09-16T01:11:27.609 INFO:teuthology.orchestra.run.smithi162.stdout:(24/156): python3-rados-19.1.1-326.g8921c8ef.el 2.3 MB/s | 320 kB 00:00 2024-09-16T01:11:27.634 INFO:teuthology.orchestra.run.smithi162.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-16T01:11:27.659 INFO:teuthology.orchestra.run.smithi162.stdout:(26/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 300 kB 00:00 2024-09-16T01:11:27.685 INFO:teuthology.orchestra.run.smithi162.stdout:(27/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-16T01:11:27.718 INFO:teuthology.orchestra.run.smithi162.stdout:(28/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-16T01:11:27.735 INFO:teuthology.orchestra.run.smithi162.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 636 kB/s | 32 kB 00:00 2024-09-16T01:11:27.785 INFO:teuthology.orchestra.run.smithi162.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.1 MB/s | 146 kB 00:00 2024-09-16T01:11:27.788 INFO:teuthology.orchestra.run.smithi192.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 5.2 MB/s | 11 MB 00:02 2024-09-16T01:11:27.863 INFO:teuthology.orchestra.run.smithi192.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.0 MB/s | 228 kB 00:00 2024-09-16T01:11:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 360 kB/s | 27 kB 00:00 2024-09-16T01:11:27.952 INFO:teuthology.orchestra.run.smithi162.stdout:(31/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 9.8 MB/s | 3.1 MB 00:00 2024-09-16T01:11:27.989 INFO:teuthology.orchestra.run.smithi192.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 634 kB/s | 32 kB 00:00 2024-09-16T01:11:28.010 INFO:teuthology.orchestra.run.smithi063.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 172 kB/s | 135 kB 00:00 2024-09-16T01:11:28.053 INFO:teuthology.orchestra.run.smithi162.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.4 MB/s | 249 kB 00:00 2024-09-16T01:11:28.181 INFO:teuthology.orchestra.run.smithi192.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 3.8 MB/s | 751 kB 00:00 2024-09-16T01:11:28.194 INFO:teuthology.orchestra.run.smithi162.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-16T01:11:28.210 INFO:teuthology.orchestra.run.smithi063.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 170 kB/s | 125 kB 00:00 2024-09-16T01:11:28.211 INFO:teuthology.orchestra.run.smithi162.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 311 kB/s | 49 kB 00:00 2024-09-16T01:11:28.228 INFO:teuthology.orchestra.run.smithi162.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 492 kB/s | 16 kB 00:00 2024-09-16T01:11:28.234 INFO:teuthology.orchestra.run.smithi063.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-16T01:11:28.239 INFO:teuthology.orchestra.run.smithi192.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.7 MB/s | 163 kB 00:00 2024-09-16T01:11:28.260 INFO:teuthology.orchestra.run.smithi063.stdout:(49/156): python3-urllib3-1.26.5-6.el9.noarch.r 283 kB/s | 215 kB 00:00 2024-09-16T01:11:28.262 INFO:teuthology.orchestra.run.smithi162.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.5 MB/s | 285 kB 00:00 2024-09-16T01:11:28.310 INFO:teuthology.orchestra.run.smithi063.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-09-16T01:11:28.320 INFO:teuthology.orchestra.run.smithi162.stdout:(37/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 6.1 MB/s | 3.6 MB 00:00 2024-09-16T01:11:28.334 INFO:teuthology.orchestra.run.smithi192.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 1.3 MB/s | 127 kB 00:00 2024-09-16T01:11:28.337 INFO:teuthology.orchestra.run.smithi162.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 243 kB/s | 18 kB 00:00 2024-09-16T01:11:28.352 INFO:teuthology.orchestra.run.smithi063.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-09-16T01:11:28.377 INFO:teuthology.orchestra.run.smithi063.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 751 kB/s | 107 kB 00:00 2024-09-16T01:11:28.379 INFO:teuthology.orchestra.run.smithi162.stdout:(39/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-16T01:11:28.403 INFO:teuthology.orchestra.run.smithi063.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-16T01:11:28.407 INFO:teuthology.orchestra.run.smithi192.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 6.8 MB/s | 506 kB 00:00 2024-09-16T01:11:28.428 INFO:teuthology.orchestra.run.smithi063.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-16T01:11:28.453 INFO:teuthology.orchestra.run.smithi063.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-16T01:11:28.478 INFO:teuthology.orchestra.run.smithi063.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-16T01:11:28.504 INFO:teuthology.orchestra.run.smithi063.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-16T01:11:28.513 INFO:teuthology.orchestra.run.smithi162.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 415 kB/s | 80 kB 00:00 2024-09-16T01:11:28.546 INFO:teuthology.orchestra.run.smithi063.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-09-16T01:11:28.563 INFO:teuthology.orchestra.run.smithi162.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-16T01:11:28.596 INFO:teuthology.orchestra.run.smithi063.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-16T01:11:28.605 INFO:teuthology.orchestra.run.smithi162.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-16T01:11:28.615 INFO:teuthology.orchestra.run.smithi192.stdout:(18/156): ceph-common-19.1.1-326.g8921c8ef.el9. 4.5 MB/s | 21 MB 00:04 2024-09-16T01:11:28.630 INFO:teuthology.orchestra.run.smithi162.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-16T01:11:28.638 INFO:teuthology.orchestra.run.smithi063.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 591 kB/s | 24 kB 00:00 2024-09-16T01:11:28.656 INFO:teuthology.orchestra.run.smithi162.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-16T01:11:28.666 INFO:teuthology.orchestra.run.smithi192.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 908 kB/s | 45 kB 00:00 2024-09-16T01:11:28.680 INFO:teuthology.orchestra.run.smithi063.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-16T01:11:28.689 INFO:teuthology.orchestra.run.smithi162.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-16T01:11:28.715 INFO:teuthology.orchestra.run.smithi162.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-16T01:11:28.725 INFO:teuthology.orchestra.run.smithi192.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.3 MB/s | 136 kB 00:00 2024-09-16T01:11:28.730 INFO:teuthology.orchestra.run.smithi063.stdout:(62/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-16T01:11:28.748 INFO:teuthology.orchestra.run.smithi162.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-09-16T01:11:28.773 INFO:teuthology.orchestra.run.smithi162.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-16T01:11:28.783 INFO:teuthology.orchestra.run.smithi192.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.7 MB/s | 161 kB 00:00 2024-09-16T01:11:28.789 INFO:teuthology.orchestra.run.smithi063.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-16T01:11:28.856 INFO:teuthology.orchestra.run.smithi063.stdout:(64/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.3 MB/s | 3.0 MB 00:00 2024-09-16T01:11:28.867 INFO:teuthology.orchestra.run.smithi192.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 3.8 MB/s | 320 kB 00:00 2024-09-16T01:11:28.881 INFO:teuthology.orchestra.run.smithi063.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-16T01:11:28.890 INFO:teuthology.orchestra.run.smithi162.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 917 kB/s | 107 kB 00:00 2024-09-16T01:11:28.906 INFO:teuthology.orchestra.run.smithi063.stdout:(66/156): libtool-2.4.6-46.el9.x86_64.rpm 1.6 MB/s | 581 kB 00:00 2024-09-16T01:11:28.916 INFO:teuthology.orchestra.run.smithi162.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-16T01:11:28.941 INFO:teuthology.orchestra.run.smithi162.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-16T01:11:28.951 INFO:teuthology.orchestra.run.smithi192.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 3.5 MB/s | 300 kB 00:00 2024-09-16T01:11:28.969 INFO:teuthology.orchestra.run.smithi162.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.8 MB/s | 313 kB 00:00 2024-09-16T01:11:28.985 INFO:teuthology.orchestra.run.smithi162.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 742 kB/s | 33 kB 00:00 2024-09-16T01:11:29.015 INFO:teuthology.orchestra.run.smithi063.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-16T01:11:29.017 INFO:teuthology.orchestra.run.smithi192.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.5 MB/s | 99 kB 00:00 2024-09-16T01:11:29.019 INFO:teuthology.orchestra.run.smithi162.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-16T01:11:29.036 INFO:teuthology.orchestra.run.smithi162.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-16T01:11:29.053 INFO:teuthology.orchestra.run.smithi162.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-09-16T01:11:29.074 INFO:teuthology.orchestra.run.smithi063.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 15 MB/s | 910 kB 00:00 2024-09-16T01:11:29.078 INFO:teuthology.orchestra.run.smithi162.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-09-16T01:11:29.092 INFO:teuthology.orchestra.run.smithi192.stdout:(25/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-16T01:11:29.095 INFO:teuthology.orchestra.run.smithi162.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-16T01:11:29.124 INFO:teuthology.orchestra.run.smithi063.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-16T01:11:29.137 INFO:teuthology.orchestra.run.smithi162.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-16T01:11:29.171 INFO:teuthology.orchestra.run.smithi162.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 735 kB/s | 24 kB 00:00 2024-09-16T01:11:29.221 INFO:teuthology.orchestra.run.smithi162.stdout:(61/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-16T01:11:29.234 INFO:teuthology.orchestra.run.smithi192.stdout:(26/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 6.5 MB/s | 5.3 MB 00:00 2024-09-16T01:11:29.238 INFO:teuthology.orchestra.run.smithi162.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 712 kB/s | 47 kB 00:00 2024-09-16T01:11:29.249 INFO:teuthology.orchestra.run.smithi063.stdout:(70/156): postgresql-server-13.16-1.el9.x86_64. 46 MB/s | 5.8 MB 00:00 2024-09-16T01:11:29.272 INFO:teuthology.orchestra.run.smithi162.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-16T01:11:29.293 INFO:teuthology.orchestra.run.smithi192.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-16T01:11:29.296 INFO:teuthology.orchestra.run.smithi162.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-16T01:11:29.316 INFO:teuthology.orchestra.run.smithi063.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-16T01:11:29.322 INFO:teuthology.orchestra.run.smithi162.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-16T01:11:29.339 INFO:teuthology.orchestra.run.smithi162.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 918 kB/s | 38 kB 00:00 2024-09-16T01:11:29.349 INFO:teuthology.orchestra.run.smithi063.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-16T01:11:29.351 INFO:teuthology.orchestra.run.smithi192.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 547 kB/s | 32 kB 00:00 2024-09-16T01:11:29.375 INFO:teuthology.orchestra.run.smithi063.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-16T01:11:29.398 INFO:teuthology.orchestra.run.smithi162.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-16T01:11:29.425 INFO:teuthology.orchestra.run.smithi063.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-16T01:11:29.473 INFO:teuthology.orchestra.run.smithi162.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-16T01:11:29.507 INFO:teuthology.orchestra.run.smithi162.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-16T01:11:29.517 INFO:teuthology.orchestra.run.smithi063.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-09-16T01:11:29.532 INFO:teuthology.orchestra.run.smithi162.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-16T01:11:29.568 INFO:teuthology.orchestra.run.smithi063.stdout:(76/156): postgresql-13.16-1.el9.x86_64.rpm 2.4 MB/s | 1.6 MB 00:00 2024-09-16T01:11:29.592 INFO:teuthology.orchestra.run.smithi063.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-16T01:11:29.599 INFO:teuthology.orchestra.run.smithi162.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-16T01:11:29.626 INFO:teuthology.orchestra.run.smithi063.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-09-16T01:11:29.632 INFO:teuthology.orchestra.run.smithi162.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-16T01:11:29.651 INFO:teuthology.orchestra.run.smithi063.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 306 kB/s | 26 kB 00:00 2024-09-16T01:11:29.658 INFO:teuthology.orchestra.run.smithi162.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-16T01:11:29.677 INFO:teuthology.orchestra.run.smithi063.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 228 kB/s | 19 kB 00:00 2024-09-16T01:11:29.700 INFO:teuthology.orchestra.run.smithi162.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-16T01:11:29.702 INFO:teuthology.orchestra.run.smithi063.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-16T01:11:29.727 INFO:teuthology.orchestra.run.smithi063.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-16T01:11:29.761 INFO:teuthology.orchestra.run.smithi063.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-16T01:11:29.775 INFO:teuthology.orchestra.run.smithi162.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-16T01:11:29.777 INFO:teuthology.orchestra.run.smithi192.stdout:(29/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 19 MB/s | 49 MB 00:02 2024-09-16T01:11:29.800 INFO:teuthology.orchestra.run.smithi162.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-16T01:11:29.802 INFO:teuthology.orchestra.run.smithi192.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 325 kB/s | 146 kB 00:00 2024-09-16T01:11:29.802 INFO:teuthology.orchestra.run.smithi063.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-16T01:11:29.825 INFO:teuthology.orchestra.run.smithi162.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-16T01:11:29.828 INFO:teuthology.orchestra.run.smithi063.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-16T01:11:29.851 INFO:teuthology.orchestra.run.smithi162.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-16T01:11:29.853 INFO:teuthology.orchestra.run.smithi063.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-16T01:11:29.876 INFO:teuthology.orchestra.run.smithi162.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-16T01:11:29.887 INFO:teuthology.orchestra.run.smithi063.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-16T01:11:29.901 INFO:teuthology.orchestra.run.smithi162.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-16T01:11:29.902 INFO:teuthology.orchestra.run.smithi192.stdout:(31/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 3.8 MB/s | 3.1 MB 00:00 2024-09-16T01:11:29.912 INFO:teuthology.orchestra.run.smithi063.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-16T01:11:29.927 INFO:teuthology.orchestra.run.smithi162.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 689 kB/s | 35 kB 00:00 2024-09-16T01:11:29.946 INFO:teuthology.orchestra.run.smithi063.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-16T01:11:29.971 INFO:teuthology.orchestra.run.smithi063.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-09-16T01:11:30.003 INFO:teuthology.orchestra.run.smithi162.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-16T01:11:30.005 INFO:teuthology.orchestra.run.smithi063.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 913 kB/s | 54 kB 00:00 2024-09-16T01:11:30.036 INFO:teuthology.orchestra.run.smithi162.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-16T01:11:30.055 INFO:teuthology.orchestra.run.smithi063.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-16T01:11:30.061 INFO:teuthology.orchestra.run.smithi192.stdout:(32/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 13 MB/s | 3.6 MB 00:00 2024-09-16T01:11:30.061 INFO:teuthology.orchestra.run.smithi162.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-16T01:11:30.086 INFO:teuthology.orchestra.run.smithi192.stdout:(33/156): ceph-mgr-modules-core-19.1.1-326.g892 1.3 MB/s | 249 kB 00:00 2024-09-16T01:11:30.095 INFO:teuthology.orchestra.run.smithi162.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-16T01:11:30.103 INFO:teuthology.orchestra.run.smithi192.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 1.2 MB/s | 49 kB 00:00 2024-09-16T01:11:30.105 INFO:teuthology.orchestra.run.smithi063.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 887 kB/s | 44 kB 00:00 2024-09-16T01:11:30.120 INFO:teuthology.orchestra.run.smithi162.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-09-16T01:11:30.129 INFO:teuthology.orchestra.run.smithi192.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 395 kB/s | 16 kB 00:00 2024-09-16T01:11:30.145 INFO:teuthology.orchestra.run.smithi162.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-16T01:11:30.153 INFO:teuthology.orchestra.run.smithi192.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-16T01:11:30.171 INFO:teuthology.orchestra.run.smithi162.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-16T01:11:30.172 INFO:teuthology.orchestra.run.smithi063.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-09-16T01:11:30.195 INFO:teuthology.orchestra.run.smithi192.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 440 kB/s | 18 kB 00:00 2024-09-16T01:11:30.204 INFO:teuthology.orchestra.run.smithi162.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-16T01:11:30.229 INFO:teuthology.orchestra.run.smithi192.stdout:(38/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 7.4 MB/s | 765 kB 00:00 2024-09-16T01:11:30.230 INFO:teuthology.orchestra.run.smithi162.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 875 kB/s | 51 kB 00:00 2024-09-16T01:11:30.255 INFO:teuthology.orchestra.run.smithi162.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-16T01:11:30.338 INFO:teuthology.orchestra.run.smithi192.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-16T01:11:30.356 INFO:teuthology.orchestra.run.smithi063.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-09-16T01:11:30.360 INFO:teuthology.orchestra.run.smithi162.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-16T01:11:30.381 INFO:teuthology.orchestra.run.smithi063.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 172 kB/s | 36 kB 00:00 2024-09-16T01:11:30.389 INFO:teuthology.orchestra.run.smithi162.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 312 kB/s | 42 kB 00:00 2024-09-16T01:11:30.389 INFO:teuthology.orchestra.run.smithi192.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.9 MB/s | 801 kB 00:00 2024-09-16T01:11:30.406 INFO:teuthology.orchestra.run.smithi063.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 953 kB/s | 47 kB 00:00 2024-09-16T01:11:30.414 INFO:teuthology.orchestra.run.smithi162.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 823 kB/s | 44 kB 00:00 2024-09-16T01:11:30.430 INFO:teuthology.orchestra.run.smithi192.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-16T01:11:30.439 INFO:teuthology.orchestra.run.smithi162.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-16T01:11:30.448 INFO:teuthology.orchestra.run.smithi063.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-16T01:11:30.463 INFO:teuthology.orchestra.run.smithi192.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-16T01:11:30.464 INFO:teuthology.orchestra.run.smithi162.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-16T01:11:30.474 INFO:teuthology.orchestra.run.smithi063.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-09-16T01:11:30.490 INFO:teuthology.orchestra.run.smithi162.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-16T01:11:30.499 INFO:teuthology.orchestra.run.smithi063.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-16T01:11:30.515 INFO:teuthology.orchestra.run.smithi162.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-16T01:11:30.516 INFO:teuthology.orchestra.run.smithi063.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-16T01:11:30.540 INFO:teuthology.orchestra.run.smithi162.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-16T01:11:30.541 INFO:teuthology.orchestra.run.smithi063.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-16T01:11:30.548 INFO:teuthology.orchestra.run.smithi192.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-16T01:11:30.566 INFO:teuthology.orchestra.run.smithi162.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-16T01:11:30.581 INFO:teuthology.orchestra.run.smithi192.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-09-16T01:11:30.591 INFO:teuthology.orchestra.run.smithi162.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T01:11:30.592 INFO:teuthology.orchestra.run.smithi063.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-16T01:11:30.616 INFO:teuthology.orchestra.run.smithi162.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-16T01:11:30.631 INFO:teuthology.orchestra.run.smithi192.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-16T01:11:30.641 INFO:teuthology.orchestra.run.smithi063.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-16T01:11:30.675 INFO:teuthology.orchestra.run.smithi063.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-16T01:11:30.692 INFO:teuthology.orchestra.run.smithi162.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-16T01:11:30.701 INFO:teuthology.orchestra.run.smithi063.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-16T01:11:30.723 INFO:teuthology.orchestra.run.smithi192.stdout:(46/156): ceph-mgr-diskprediction-local-19.1.1- 8.0 MB/s | 7.4 MB 00:00 2024-09-16T01:11:30.748 INFO:teuthology.orchestra.run.smithi192.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 747 kB/s | 125 kB 00:00 2024-09-16T01:11:30.774 INFO:teuthology.orchestra.run.smithi192.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-09-16T01:11:30.775 INFO:teuthology.orchestra.run.smithi063.stdout:(107/156): python3-numpy-1.20.1-5.el9.x86_64.rp 4.6 MB/s | 5.1 MB 00:01 2024-09-16T01:11:30.826 INFO:teuthology.orchestra.run.smithi063.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-16T01:11:30.860 INFO:teuthology.orchestra.run.smithi063.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-09-16T01:11:30.867 INFO:teuthology.orchestra.run.smithi162.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-16T01:11:30.885 INFO:teuthology.orchestra.run.smithi063.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 861 kB/s | 49 kB 00:00 2024-09-16T01:11:30.909 INFO:teuthology.orchestra.run.smithi162.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.5 MB/s | 548 kB 00:00 2024-09-16T01:11:30.910 INFO:teuthology.orchestra.run.smithi063.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-16T01:11:30.936 INFO:teuthology.orchestra.run.smithi063.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-16T01:11:30.940 INFO:teuthology.orchestra.run.smithi192.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 642 kB/s | 107 kB 00:00 2024-09-16T01:11:30.942 INFO:teuthology.orchestra.run.smithi162.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-16T01:11:30.968 INFO:teuthology.orchestra.run.smithi162.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 344 kB/s | 19 kB 00:00 2024-09-16T01:11:30.986 INFO:teuthology.orchestra.run.smithi063.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-16T01:11:30.990 INFO:teuthology.orchestra.run.smithi192.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 436 kB/s | 22 kB 00:00 2024-09-16T01:11:31.001 INFO:teuthology.orchestra.run.smithi162.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-16T01:11:31.016 INFO:teuthology.orchestra.run.smithi192.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-16T01:11:31.027 INFO:teuthology.orchestra.run.smithi162.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-16T01:11:31.027 INFO:teuthology.orchestra.run.smithi063.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-16T01:11:31.049 INFO:teuthology.orchestra.run.smithi192.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-16T01:11:31.052 INFO:teuthology.orchestra.run.smithi162.stdout:(110/156): gperftools-libs-2.9.1-3.el9.x86_64.r 1.6 MB/s | 308 kB 00:00 2024-09-16T01:11:31.053 INFO:teuthology.orchestra.run.smithi063.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 650 kB/s | 43 kB 00:00 2024-09-16T01:11:31.075 INFO:teuthology.orchestra.run.smithi192.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-16T01:11:31.077 INFO:teuthology.orchestra.run.smithi162.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-16T01:11:31.078 INFO:teuthology.orchestra.run.smithi063.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-16T01:11:31.103 INFO:teuthology.orchestra.run.smithi162.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-16T01:11:31.103 INFO:teuthology.orchestra.run.smithi063.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-16T01:11:31.108 INFO:teuthology.orchestra.run.smithi192.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-16T01:11:31.129 INFO:teuthology.orchestra.run.smithi063.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-16T01:11:31.133 INFO:teuthology.orchestra.run.smithi192.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-16T01:11:31.153 INFO:teuthology.orchestra.run.smithi162.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-16T01:11:31.162 INFO:teuthology.orchestra.run.smithi063.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-16T01:11:31.167 INFO:teuthology.orchestra.run.smithi192.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-16T01:11:31.170 INFO:teuthology.orchestra.run.smithi162.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-16T01:11:31.188 INFO:teuthology.orchestra.run.smithi063.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-16T01:11:31.192 INFO:teuthology.orchestra.run.smithi192.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-16T01:11:31.204 INFO:teuthology.orchestra.run.smithi162.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-16T01:11:31.217 INFO:teuthology.orchestra.run.smithi192.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-09-16T01:11:31.229 INFO:teuthology.orchestra.run.smithi162.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-09-16T01:11:31.230 INFO:teuthology.orchestra.run.smithi063.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-16T01:11:31.254 INFO:teuthology.orchestra.run.smithi162.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-16T01:11:31.263 INFO:teuthology.orchestra.run.smithi063.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-16T01:11:31.279 INFO:teuthology.orchestra.run.smithi162.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-16T01:11:31.284 INFO:teuthology.orchestra.run.smithi192.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-16T01:11:31.305 INFO:teuthology.orchestra.run.smithi063.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 259 kB/s | 11 kB 00:00 2024-09-16T01:11:31.310 INFO:teuthology.orchestra.run.smithi192.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-16T01:11:31.313 INFO:teuthology.orchestra.run.smithi162.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-16T01:11:31.331 INFO:teuthology.orchestra.run.smithi063.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 704 kB/s | 18 kB 00:00 2024-09-16T01:11:31.335 INFO:teuthology.orchestra.run.smithi192.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-16T01:11:31.338 INFO:teuthology.orchestra.run.smithi162.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-16T01:11:31.361 INFO:teuthology.orchestra.run.smithi192.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 323 kB/s | 24 kB 00:00 2024-09-16T01:11:31.365 INFO:teuthology.orchestra.run.smithi063.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 727 kB/s | 23 kB 00:00 2024-09-16T01:11:31.372 INFO:teuthology.orchestra.run.smithi162.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-16T01:11:31.386 INFO:teuthology.orchestra.run.smithi192.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-16T01:11:31.388 INFO:teuthology.orchestra.run.smithi063.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-16T01:11:31.397 INFO:teuthology.orchestra.run.smithi162.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-16T01:11:31.420 INFO:teuthology.orchestra.run.smithi192.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-16T01:11:31.423 INFO:teuthology.orchestra.run.smithi162.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-16T01:11:31.445 INFO:teuthology.orchestra.run.smithi192.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 657 kB/s | 38 kB 00:00 2024-09-16T01:11:31.448 INFO:teuthology.orchestra.run.smithi162.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-16T01:11:31.455 INFO:teuthology.orchestra.run.smithi063.stdout:(127/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-09-16T01:11:31.470 INFO:teuthology.orchestra.run.smithi192.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-16T01:11:31.474 INFO:teuthology.orchestra.run.smithi162.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 922 kB/s | 23 kB 00:00 2024-09-16T01:11:31.480 INFO:teuthology.orchestra.run.smithi063.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-09-16T01:11:31.506 INFO:teuthology.orchestra.run.smithi063.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T01:11:31.507 INFO:teuthology.orchestra.run.smithi162.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 585 kB/s | 19 kB 00:00 2024-09-16T01:11:31.531 INFO:teuthology.orchestra.run.smithi063.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T01:11:31.554 INFO:teuthology.orchestra.run.smithi192.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-16T01:11:31.556 INFO:teuthology.orchestra.run.smithi063.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-16T01:11:31.574 INFO:teuthology.orchestra.run.smithi162.stdout:(127/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-09-16T01:11:31.590 INFO:teuthology.orchestra.run.smithi063.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-16T01:11:31.599 INFO:teuthology.orchestra.run.smithi162.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-09-16T01:11:31.624 INFO:teuthology.orchestra.run.smithi063.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-16T01:11:31.625 INFO:teuthology.orchestra.run.smithi162.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T01:11:31.637 INFO:teuthology.orchestra.run.smithi192.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-16T01:11:31.649 INFO:teuthology.orchestra.run.smithi063.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-16T01:11:31.650 INFO:teuthology.orchestra.run.smithi162.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T01:11:31.674 INFO:teuthology.orchestra.run.smithi063.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-16T01:11:31.675 INFO:teuthology.orchestra.run.smithi162.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-16T01:11:31.696 INFO:teuthology.orchestra.run.smithi192.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-16T01:11:31.699 INFO:teuthology.orchestra.run.smithi063.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-09-16T01:11:31.709 INFO:teuthology.orchestra.run.smithi162.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-16T01:11:31.725 INFO:teuthology.orchestra.run.smithi063.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-16T01:11:31.735 INFO:teuthology.orchestra.run.smithi162.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-09-16T01:11:31.760 INFO:teuthology.orchestra.run.smithi162.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-16T01:11:31.762 INFO:teuthology.orchestra.run.smithi192.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-16T01:11:31.766 INFO:teuthology.orchestra.run.smithi063.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-16T01:11:31.785 INFO:teuthology.orchestra.run.smithi162.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-16T01:11:31.792 INFO:teuthology.orchestra.run.smithi063.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 882 kB/s | 59 kB 00:00 2024-09-16T01:11:31.810 INFO:teuthology.orchestra.run.smithi162.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 558 kB/s | 28 kB 00:00 2024-09-16T01:11:31.817 INFO:teuthology.orchestra.run.smithi063.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-16T01:11:31.829 INFO:teuthology.orchestra.run.smithi192.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 12 MB/s | 4.9 MB 00:00 2024-09-16T01:11:31.842 INFO:teuthology.orchestra.run.smithi063.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-16T01:11:31.852 INFO:teuthology.orchestra.run.smithi162.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-16T01:11:31.863 INFO:teuthology.orchestra.run.smithi192.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-16T01:11:31.868 INFO:teuthology.orchestra.run.smithi063.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-16T01:11:31.878 INFO:teuthology.orchestra.run.smithi162.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 332 kB/s | 31 kB 00:00 2024-09-16T01:11:31.888 INFO:teuthology.orchestra.run.smithi192.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-16T01:11:31.901 INFO:teuthology.orchestra.run.smithi063.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-16T01:11:31.903 INFO:teuthology.orchestra.run.smithi162.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-16T01:11:31.927 INFO:teuthology.orchestra.run.smithi063.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-16T01:11:31.928 INFO:teuthology.orchestra.run.smithi162.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-16T01:11:31.953 INFO:teuthology.orchestra.run.smithi162.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-16T01:11:31.960 INFO:teuthology.orchestra.run.smithi063.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-16T01:11:31.972 INFO:teuthology.orchestra.run.smithi192.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-16T01:11:31.979 INFO:teuthology.orchestra.run.smithi162.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-16T01:11:31.985 INFO:teuthology.orchestra.run.smithi063.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-16T01:11:31.989 INFO:teuthology.orchestra.run.smithi192.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 611 kB/s | 61 kB 00:00 2024-09-16T01:11:32.004 INFO:teuthology.orchestra.run.smithi162.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-16T01:11:32.019 INFO:teuthology.orchestra.run.smithi063.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-16T01:11:32.029 INFO:teuthology.orchestra.run.smithi162.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-09-16T01:11:32.031 INFO:teuthology.orchestra.run.smithi192.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-16T01:11:32.055 INFO:teuthology.orchestra.run.smithi162.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-16T01:11:32.056 INFO:teuthology.orchestra.run.smithi192.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-16T01:11:32.078 INFO:teuthology.orchestra.run.smithi063.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-16T01:11:32.080 INFO:teuthology.orchestra.run.smithi162.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-16T01:11:32.105 INFO:teuthology.orchestra.run.smithi162.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-16T01:11:32.131 INFO:teuthology.orchestra.run.smithi192.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-16T01:11:32.148 INFO:teuthology.orchestra.run.smithi192.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-16T01:11:32.164 INFO:teuthology.orchestra.run.smithi162.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-16T01:11:32.165 INFO:teuthology.orchestra.run.smithi192.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-16T01:11:32.190 INFO:teuthology.orchestra.run.smithi192.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-16T01:11:32.216 INFO:teuthology.orchestra.run.smithi192.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-16T01:11:32.258 INFO:teuthology.orchestra.run.smithi192.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.6 MB/s | 250 kB 00:00 2024-09-16T01:11:32.283 INFO:teuthology.orchestra.run.smithi192.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-16T01:11:32.295 INFO:teuthology.orchestra.run.smithi063.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-16T01:11:32.366 INFO:teuthology.orchestra.run.smithi192.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-09-16T01:11:32.381 INFO:teuthology.orchestra.run.smithi162.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-16T01:11:32.383 INFO:teuthology.orchestra.run.smithi192.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-09-16T01:11:32.408 INFO:teuthology.orchestra.run.smithi192.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 513 kB/s | 77 kB 00:00 2024-09-16T01:11:32.412 INFO:teuthology.orchestra.run.smithi063.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 8.1 MB/s | 3.2 MB 00:00 2024-09-16T01:11:32.434 INFO:teuthology.orchestra.run.smithi192.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-16T01:11:32.459 INFO:teuthology.orchestra.run.smithi192.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-16T01:11:32.484 INFO:teuthology.orchestra.run.smithi192.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-16T01:11:32.510 INFO:teuthology.orchestra.run.smithi192.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-16T01:11:32.535 INFO:teuthology.orchestra.run.smithi192.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-16T01:11:32.585 INFO:teuthology.orchestra.run.smithi192.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-16T01:11:32.598 INFO:teuthology.orchestra.run.smithi162.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 5.5 MB/s | 2.3 MB 00:00 2024-09-16T01:11:32.611 INFO:teuthology.orchestra.run.smithi192.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 584 kB/s | 44 kB 00:00 2024-09-16T01:11:32.653 INFO:teuthology.orchestra.run.smithi192.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-16T01:11:32.673 INFO:teuthology.orchestra.run.smithi162.stdout:(151/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 5.6 MB/s | 3.2 MB 00:00 2024-09-16T01:11:32.678 INFO:teuthology.orchestra.run.smithi192.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-09-16T01:11:32.698 INFO:teuthology.orchestra.run.smithi162.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 407 kB/s | 41 kB 00:00 2024-09-16T01:11:32.712 INFO:teuthology.orchestra.run.smithi192.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-09-16T01:11:32.745 INFO:teuthology.orchestra.run.smithi192.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-09-16T01:11:32.770 INFO:teuthology.orchestra.run.smithi192.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 991 kB/s | 58 kB 00:00 2024-09-16T01:11:32.782 INFO:teuthology.orchestra.run.smithi162.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 4.5 MB/s | 1.8 MB 00:00 2024-09-16T01:11:32.787 INFO:teuthology.orchestra.run.smithi192.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-16T01:11:32.821 INFO:teuthology.orchestra.run.smithi192.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T01:11:32.854 INFO:teuthology.orchestra.run.smithi192.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 668 kB/s | 45 kB 00:00 2024-09-16T01:11:32.907 INFO:teuthology.orchestra.run.smithi162.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 1.4 MB 00:00 2024-09-16T01:11:32.932 INFO:teuthology.orchestra.run.smithi162.stdout:(155/156): NetworkManager-tui-1.49.90-1.el9.x86 961 kB/s | 249 kB 00:00 2024-09-16T01:11:32.987 INFO:teuthology.orchestra.run.smithi063.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 72 kB/s | 41 kB 00:00 2024-09-16T01:11:33.007 INFO:teuthology.orchestra.run.smithi162.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-16T01:11:33.014 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:11:33.014 INFO:teuthology.orchestra.run.smithi162.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-16T01:11:33.021 INFO:teuthology.orchestra.run.smithi192.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-16T01:11:33.047 INFO:teuthology.orchestra.run.smithi192.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 99 kB/s | 22 kB 00:00 2024-09-16T01:11:33.097 INFO:teuthology.orchestra.run.smithi192.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-16T01:11:33.122 INFO:teuthology.orchestra.run.smithi192.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-16T01:11:33.148 INFO:teuthology.orchestra.run.smithi192.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-16T01:11:33.173 INFO:teuthology.orchestra.run.smithi192.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-16T01:11:33.198 INFO:teuthology.orchestra.run.smithi192.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-16T01:11:33.223 INFO:teuthology.orchestra.run.smithi192.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-09-16T01:11:33.265 INFO:teuthology.orchestra.run.smithi192.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-16T01:11:33.279 INFO:teuthology.orchestra.run.smithi063.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 1.9 MB/s | 2.3 MB 00:01 2024-09-16T01:11:33.299 INFO:teuthology.orchestra.run.smithi192.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-09-16T01:11:33.329 INFO:teuthology.orchestra.run.smithi063.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-16T01:11:33.349 INFO:teuthology.orchestra.run.smithi192.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 10 MB/s | 839 kB 00:00 2024-09-16T01:11:33.374 INFO:teuthology.orchestra.run.smithi192.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-16T01:11:33.400 INFO:teuthology.orchestra.run.smithi192.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-16T01:11:33.425 INFO:teuthology.orchestra.run.smithi192.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-16T01:11:33.450 INFO:teuthology.orchestra.run.smithi192.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-16T01:11:33.476 INFO:teuthology.orchestra.run.smithi192.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-16T01:11:33.526 INFO:teuthology.orchestra.run.smithi192.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-16T01:11:33.552 INFO:teuthology.orchestra.run.smithi192.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-16T01:11:33.576 INFO:teuthology.orchestra.run.smithi192.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-16T01:11:33.610 INFO:teuthology.orchestra.run.smithi192.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-16T01:11:33.668 INFO:teuthology.orchestra.run.smithi192.stdout:(123/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2024-09-16T01:11:33.694 INFO:teuthology.orchestra.run.smithi192.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-09-16T01:11:33.719 INFO:teuthology.orchestra.run.smithi192.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 349 kB/s | 18 kB 00:00 2024-09-16T01:11:33.744 INFO:teuthology.orchestra.run.smithi192.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-16T01:11:33.746 INFO:teuthology.orchestra.run.smithi063.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 328 kB/s | 249 kB 00:00 2024-09-16T01:11:33.770 INFO:teuthology.orchestra.run.smithi192.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-16T01:11:33.795 INFO:teuthology.orchestra.run.smithi192.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-16T01:11:33.820 INFO:teuthology.orchestra.run.smithi192.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T01:11:33.845 INFO:teuthology.orchestra.run.smithi192.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T01:11:33.871 INFO:teuthology.orchestra.run.smithi192.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-16T01:11:33.913 INFO:teuthology.orchestra.run.smithi192.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-16T01:11:33.938 INFO:teuthology.orchestra.run.smithi192.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-16T01:11:33.963 INFO:teuthology.orchestra.run.smithi192.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-16T01:11:33.980 INFO:teuthology.orchestra.run.smithi192.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-16T01:11:34.005 INFO:teuthology.orchestra.run.smithi192.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 677 kB/s | 28 kB 00:00 2024-09-16T01:11:34.030 INFO:teuthology.orchestra.run.smithi192.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-16T01:11:34.056 INFO:teuthology.orchestra.run.smithi192.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T01:11:34.081 INFO:teuthology.orchestra.run.smithi192.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-16T01:11:34.123 INFO:teuthology.orchestra.run.smithi192.stdout:(140/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-16T01:11:34.148 INFO:teuthology.orchestra.run.smithi192.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-09-16T01:11:34.174 INFO:teuthology.orchestra.run.smithi192.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 810 kB/s | 74 kB 00:00 2024-09-16T01:11:34.199 INFO:teuthology.orchestra.run.smithi192.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-16T01:11:34.212 INFO:teuthology.orchestra.run.smithi063.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.5 MB/s | 1.4 MB 00:00 2024-09-16T01:11:34.224 INFO:teuthology.orchestra.run.smithi192.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-16T01:11:34.249 INFO:teuthology.orchestra.run.smithi192.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-16T01:11:34.266 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-16T01:11:34.274 INFO:teuthology.orchestra.run.smithi192.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-16T01:11:34.300 INFO:teuthology.orchestra.run.smithi192.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-16T01:11:34.346 INFO:teuthology.orchestra.run.smithi063.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:01 2024-09-16T01:11:34.350 INFO:teuthology.orchestra.run.smithi192.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-16T01:11:34.353 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:11:34.353 INFO:teuthology.orchestra.run.smithi063.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-16T01:11:34.416 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-16T01:11:34.416 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-16T01:11:34.509 INFO:teuthology.orchestra.run.smithi192.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-09-16T01:11:34.667 INFO:teuthology.orchestra.run.smithi192.stdout:(150/156): librados2-19.1.1-326.g8921c8ef.el9.x 8.7 MB/s | 3.4 MB 00:00 2024-09-16T01:11:34.709 INFO:teuthology.orchestra.run.smithi192.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 9.0 MB/s | 1.8 MB 00:00 2024-09-16T01:11:34.743 INFO:teuthology.orchestra.run.smithi192.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 543 kB/s | 41 kB 00:00 2024-09-16T01:11:34.793 INFO:teuthology.orchestra.run.smithi192.stdout:(153/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 6.4 MB/s | 3.2 MB 00:00 2024-09-16T01:11:34.818 INFO:teuthology.orchestra.run.smithi192.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 2.2 MB/s | 249 kB 00:00 2024-09-16T01:11:34.935 INFO:teuthology.orchestra.run.smithi192.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 7.1 MB/s | 1.4 MB 00:00 2024-09-16T01:11:35.043 INFO:teuthology.orchestra.run.smithi192.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 2.4 MB 00:00 2024-09-16T01:11:35.049 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:11:35.049 INFO:teuthology.orchestra.run.smithi192.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-16T01:11:35.625 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-16T01:11:35.798 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-16T01:11:35.798 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-16T01:11:36.272 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-16T01:11:36.423 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-16T01:11:36.423 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-16T01:11:36.615 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-16T01:11:36.615 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-16T01:11:38.161 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-16T01:11:38.162 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-16T01:11:38.666 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-16T01:11:38.666 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-16T01:11:43.186 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-16T01:11:43.303 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T01:11:43.352 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T01:11:43.404 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T01:11:43.437 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T01:11:43.463 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T01:11:43.510 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T01:11:43.842 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T01:11:43.947 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:11:44.086 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:11:44.123 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:11:44.198 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:11:44.243 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:11:44.427 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T01:11:44.488 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T01:11:44.516 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:11:44.620 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:11:44.642 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:11:44.705 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:11:44.728 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:11:44.748 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:11:44.749 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-16T01:11:44.834 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T01:11:44.873 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T01:11:44.936 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T01:11:44.977 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T01:11:45.010 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T01:11:45.042 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-16T01:11:45.064 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T01:11:45.165 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T01:11:45.208 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T01:11:45.255 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:11:45.280 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T01:11:45.314 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T01:11:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T01:11:45.393 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T01:11:45.424 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:11:45.437 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T01:11:45.542 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T01:11:45.577 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:11:45.666 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:11:45.769 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:11:45.843 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T01:11:45.905 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:11:45.936 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:11:45.949 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:11:46.007 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:11:46.030 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:11:46.064 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:11:46.071 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:11:46.092 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:11:46.120 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T01:11:46.184 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:11:46.216 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T01:11:46.222 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:11:46.258 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T01:11:46.258 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T01:11:46.293 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T01:11:46.314 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T01:11:46.341 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:11:46.368 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T01:11:46.407 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T01:11:46.419 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T01:11:46.447 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:11:46.459 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T01:11:46.475 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:11:46.485 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T01:11:46.502 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T01:11:46.513 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:11:46.530 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:11:46.535 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T01:11:46.559 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:11:46.563 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T01:11:46.582 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:11:46.617 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:11:46.633 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T01:11:46.639 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:11:46.694 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T01:11:46.702 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:11:46.733 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:11:46.733 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T01:11:46.754 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:11:46.777 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T01:11:46.779 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:11:46.854 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T01:11:46.887 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T01:11:46.930 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T01:11:46.942 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:11:46.959 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T01:11:46.962 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:11:47.030 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T01:11:47.074 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T01:11:47.091 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T01:11:47.126 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:11:47.150 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T01:11:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:11:47.247 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T01:11:47.284 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:11:47.295 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T01:11:47.355 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:11:47.361 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T01:11:47.415 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:11:47.533 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:11:47.645 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T01:11:47.649 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:11:47.747 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T01:11:47.760 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T01:11:47.789 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T01:11:47.825 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T01:11:47.871 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T01:11:47.900 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T01:11:47.905 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T01:11:47.907 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T01:11:47.946 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T01:11:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T01:11:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T01:11:48.000 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T01:11:48.010 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T01:11:48.042 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T01:11:48.043 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T01:11:48.055 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T01:11:48.075 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T01:11:48.086 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T01:11:48.088 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T01:11:48.102 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T01:11:48.125 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T01:11:48.131 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T01:11:48.164 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T01:11:48.174 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T01:11:48.175 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T01:11:48.191 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T01:11:48.235 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T01:11:48.260 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T01:11:48.264 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T01:11:48.308 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T01:11:48.313 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T01:11:48.338 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T01:11:48.345 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T01:11:48.386 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T01:11:48.389 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T01:11:48.412 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T01:11:48.417 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T01:11:48.462 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T01:11:48.463 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T01:11:48.467 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T01:11:48.490 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T01:11:48.498 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T01:11:48.541 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T01:11:48.542 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T01:11:48.570 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T01:11:48.572 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T01:11:48.579 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T01:11:48.616 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T01:11:48.638 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T01:11:48.640 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T01:11:48.663 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T01:11:48.685 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T01:11:48.698 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T01:11:48.717 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T01:11:48.742 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T01:11:48.759 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T01:11:48.792 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T01:11:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T01:11:48.900 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T01:11:48.917 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T01:11:48.941 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T01:11:48.954 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T01:11:48.994 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T01:11:49.036 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T01:11:49.377 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T01:11:49.411 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T01:11:49.459 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T01:11:49.474 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T01:11:49.475 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T01:11:49.493 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T01:11:49.518 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T01:11:49.558 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T01:11:49.564 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T01:11:49.587 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T01:11:49.598 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T01:11:49.616 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T01:11:49.630 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T01:11:49.641 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T01:11:49.668 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T01:11:49.679 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T01:11:49.710 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T01:11:49.722 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T01:11:49.746 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T01:11:49.784 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T01:11:49.829 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T01:11:49.869 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T01:11:49.870 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T01:11:49.904 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T01:11:49.911 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T01:11:49.938 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T01:11:49.951 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T01:11:49.982 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T01:11:49.992 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T01:11:49.997 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T01:11:50.041 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T01:11:50.047 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T01:11:50.065 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T01:11:50.082 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T01:11:50.105 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T01:11:50.121 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T01:11:50.124 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T01:11:50.141 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T01:11:50.158 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T01:11:50.159 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T01:11:50.188 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T01:11:50.194 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T01:11:50.241 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T01:11:50.242 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T01:11:50.268 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T01:11:50.276 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T01:11:50.283 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T01:11:50.319 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T01:11:50.320 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T01:11:50.326 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T01:11:50.349 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T01:11:50.366 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T01:11:50.454 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T01:11:50.460 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T01:11:50.510 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T01:11:50.511 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T01:11:50.518 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T01:11:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T01:11:50.566 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T01:11:50.609 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T01:11:50.662 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T01:11:50.694 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T01:11:50.717 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T01:11:50.748 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T01:11:50.758 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T01:11:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T01:11:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T01:11:50.807 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T01:11:50.840 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T01:11:50.864 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T01:11:50.953 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T01:11:51.066 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T01:11:51.193 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T01:11:51.242 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T01:11:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T01:11:51.271 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T01:11:51.274 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T01:11:51.305 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T01:11:51.307 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T01:11:51.314 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T01:11:51.342 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T01:11:51.343 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T01:11:51.348 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T01:11:51.374 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T01:11:51.393 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T01:11:51.404 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T01:11:51.432 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T01:11:51.439 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T01:11:51.448 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T01:11:51.472 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T01:11:51.472 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T01:11:51.501 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T01:11:51.504 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T01:11:51.513 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T01:11:51.536 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T01:11:51.548 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T01:11:51.557 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T01:11:51.569 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T01:11:51.620 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T01:11:51.633 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T01:11:51.646 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T01:11:51.662 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T01:11:51.678 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T01:11:51.693 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T01:11:51.709 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T01:11:51.752 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T01:11:51.801 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T01:11:51.811 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T01:11:51.839 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T01:11:51.863 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T01:11:51.880 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T01:11:51.924 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T01:11:51.948 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T01:11:52.004 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T01:11:52.127 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T01:11:52.580 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T01:11:52.627 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T01:11:52.666 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T01:11:52.790 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T01:11:52.790 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T01:11:52.813 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T01:11:52.824 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T01:11:52.869 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T01:11:52.956 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T01:11:52.989 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T01:11:53.098 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T01:11:53.145 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T01:11:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T01:11:53.187 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T01:11:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T01:11:53.280 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T01:11:53.291 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T01:11:53.343 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T01:11:53.390 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T01:11:53.480 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T01:11:53.516 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T01:11:53.710 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T01:11:53.738 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T01:11:53.827 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T01:11:53.911 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T01:11:54.046 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T01:11:54.124 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T01:11:54.227 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T01:11:54.263 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T01:11:54.304 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T01:11:54.535 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T01:11:54.613 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T01:11:54.651 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:11:54.658 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T01:11:54.824 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:11:54.856 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T01:11:54.892 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T01:11:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T01:11:55.342 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T01:11:55.361 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T01:11:55.374 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T01:11:55.386 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T01:11:55.404 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:11:55.467 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:11:55.506 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T01:11:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T01:11:55.807 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:11:55.898 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:11:55.929 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T01:11:55.988 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T01:11:55.990 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T01:11:56.075 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T01:11:56.103 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T01:11:56.136 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T01:11:56.462 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T01:11:56.498 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:11:56.582 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:11:56.612 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T01:11:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T01:11:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T01:11:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:11:56.731 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:11:56.762 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T01:11:57.156 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T01:11:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:11:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:11:57.295 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T01:11:57.795 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:11:57.828 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:11:58.381 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:11:58.423 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:11:58.514 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:11:58.514 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T01:11:58.514 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T01:11:58.515 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:11:58.549 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:11:59.073 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:11:59.108 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:11:59.668 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:11:59.703 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:11:59.715 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:11:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:11:59.795 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:11:59.795 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T01:11:59.795 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T01:11:59.796 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:11:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:12:00.328 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:12:00.369 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:12:00.460 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:12:00.461 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T01:12:00.461 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T01:12:00.461 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:00.495 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:12:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:12:10.662 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-16T01:12:10.662 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-16T01:12:10.662 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-16T01:12:10.662 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-16T01:12:10.662 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-16T01:12:10.662 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-16T01:12:10.662 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-16T01:12:10.662 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:10.848 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:12:10.864 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:12:10.865 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:10.865 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T01:12:10.865 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:11.592 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:12:11.592 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2024-09-16T01:12:11.592 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2024-09-16T01:12:11.593 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2024-09-16T01:12:11.593 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2024-09-16T01:12:11.593 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2024-09-16T01:12:11.593 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /root 2024-09-16T01:12:11.593 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2024-09-16T01:12:11.593 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:11.765 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:12:11.781 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:12:11.781 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:11.781 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T01:12:11.781 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:12.361 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:12:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:12:12.388 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:12.388 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T01:12:12.388 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:12:12.388 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:12:12.388 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:12.628 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:12:12.652 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:12:12.653 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:12.653 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T01:12:12.653 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:12:12.653 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:12:12.653 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:12.783 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:12:12.783 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2024-09-16T01:12:12.783 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2024-09-16T01:12:12.783 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2024-09-16T01:12:12.783 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2024-09-16T01:12:12.783 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2024-09-16T01:12:12.784 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2024-09-16T01:12:12.784 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2024-09-16T01:12:12.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:12.962 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:12:12.979 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:12:12.979 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:12.979 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T01:12:12.979 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:13.088 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:12:13.112 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:12:13.112 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:13.112 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T01:12:13.112 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:12:13.112 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:12:13.112 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:13.218 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T01:12:13.260 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:12:13.276 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T01:12:13.287 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:12:13.287 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:13.287 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T01:12:13.287 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:12:13.287 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:12:13.287 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:13.340 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T01:12:13.511 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:12:13.534 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:12:13.534 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:13.534 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T01:12:13.534 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:12:13.534 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:12:13.534 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:13.544 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T01:12:13.590 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T01:12:13.669 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T01:12:13.758 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T01:12:13.908 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T01:12:13.966 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T01:12:13.978 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:12:14.002 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:12:14.002 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:14.002 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T01:12:14.002 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:12:14.002 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:12:14.002 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:14.005 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T01:12:14.032 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T01:12:14.116 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T01:12:14.165 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T01:12:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T01:12:14.404 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T01:12:14.420 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:12:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:12:14.464 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T01:12:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T01:12:14.515 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:12:14.539 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T01:12:14.543 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T01:12:14.544 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:12:14.544 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:14.544 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T01:12:14.544 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:12:14.544 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:12:14.544 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:14.571 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:12:14.627 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T01:12:14.758 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T01:12:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:12:14.799 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T01:12:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:12:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T01:12:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:12:14.809 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:12:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:14.835 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T01:12:14.863 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T01:12:15.268 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:12:15.293 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:12:15.293 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:15.293 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T01:12:15.293 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:12:15.294 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:12:15.294 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:15.317 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:12:15.345 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:12:15.377 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T01:12:15.407 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T01:12:15.439 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T01:12:15.465 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T01:12:15.468 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:12:15.529 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T01:12:15.635 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:12:15.673 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:12:15.733 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T01:12:15.789 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T01:12:15.867 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T01:12:15.964 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T01:12:16.116 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T01:12:16.166 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T01:12:16.201 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T01:12:16.228 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T01:12:16.516 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:12:16.553 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:12:16.648 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:12:16.682 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:12:16.700 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:12:16.726 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:12:16.758 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T01:12:16.789 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:12:16.823 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T01:12:16.849 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:12:16.975 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T01:12:17.000 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:12:17.025 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:12:17.025 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:17.025 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T01:12:17.026 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:12:17.026 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:12:17.026 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:17.076 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:12:17.088 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:12:17.189 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T01:12:17.247 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T01:12:17.516 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:12:17.545 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:12:17.647 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:12:17.824 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T01:12:17.855 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:12:17.879 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:12:17.879 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:17.879 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T01:12:17.880 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:12:17.880 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:12:17.880 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:17.931 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:12:17.943 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:12:17.960 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:12:18.001 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:12:18.041 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T01:12:18.091 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T01:12:18.180 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T01:12:18.212 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:12:18.236 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:12:18.236 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:18.236 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T01:12:18.236 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:12:18.236 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:12:18.237 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:18.280 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:12:18.303 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:12:18.304 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:18.304 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T01:12:18.304 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:18.356 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:12:18.379 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:12:18.379 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:18.379 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T01:12:18.379 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:12:18.380 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:12:18.380 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:18.690 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:12:18.714 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:12:18.714 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:18.714 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T01:12:18.714 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:12:18.714 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:12:18.715 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:19.015 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T01:12:19.017 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:12:19.043 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:12:19.050 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:12:19.074 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:12:19.075 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:19.075 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T01:12:19.075 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:12:19.075 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:12:19.075 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:19.118 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:12:19.141 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:12:19.141 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:19.141 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T01:12:19.141 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:19.151 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:12:19.185 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:12:19.208 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:12:19.208 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:19.209 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T01:12:19.209 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:12:19.209 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:12:19.209 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:19.328 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T01:12:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:12:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:12:19.379 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:19.379 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T01:12:19.379 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:12:19.379 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:12:19.379 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:19.429 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:12:19.441 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:12:19.510 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:12:19.534 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:12:19.534 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:19.534 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T01:12:19.535 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:12:19.535 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:12:19.535 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:19.542 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T01:12:19.600 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T01:12:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T01:12:20.614 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:12:20.639 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:12:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T01:12:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:12:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:12:20.640 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:20.682 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:12:20.706 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:12:20.706 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:20.706 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T01:12:20.706 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:20.757 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:12:20.782 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:12:20.782 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:20.782 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T01:12:20.783 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:12:20.783 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:12:20.783 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:21.099 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:12:21.124 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:12:21.125 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:12:21.125 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T01:12:21.125 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:12:21.125 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:12:21.125 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T01:12:23.359 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T01:12:23.402 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T01:12:23.433 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T01:12:23.460 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T01:12:23.664 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T01:12:23.716 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T01:12:23.746 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T01:12:23.776 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T01:12:23.822 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T01:12:24.106 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T01:12:24.148 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T01:12:24.353 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T01:12:24.353 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T01:12:24.354 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T01:12:24.402 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:12:24.446 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:12:24.467 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:12:24.479 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T01:12:24.519 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T01:12:24.550 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T01:12:24.579 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T01:12:24.625 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T01:12:25.231 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:12:25.264 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:12:25.285 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:12:25.321 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T01:12:25.418 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T01:12:25.470 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T01:12:25.573 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T01:12:25.605 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T01:12:25.630 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T01:12:25.656 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T01:12:25.656 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:12:25.749 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:12:25.749 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:12:25.841 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:12:25.866 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T01:12:25.872 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:12:25.872 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:12:25.953 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T01:12:25.995 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T01:12:26.036 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T01:12:26.051 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:12:26.051 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:12:26.067 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T01:12:26.095 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T01:12:26.114 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T01:12:26.136 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:12:26.185 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T01:12:26.200 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:12:26.237 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T01:12:26.295 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T01:12:26.335 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T01:12:26.341 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T01:12:26.363 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T01:12:26.372 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T01:12:26.389 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T01:12:26.401 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T01:12:26.415 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T01:12:26.415 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:12:26.439 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T01:12:26.490 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:12:26.491 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:12:26.583 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:12:26.608 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T01:12:26.615 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:12:26.615 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:12:26.794 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:12:26.794 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:12:26.886 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:12:26.950 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:12:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:12:27.094 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:12:27.116 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:12:28.038 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T01:12:28.132 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T01:12:28.177 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T01:12:28.276 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T01:12:28.309 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T01:12:28.335 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T01:12:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T01:12:28.361 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:12:28.453 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:12:28.454 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:12:28.537 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:12:28.562 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T01:12:28.568 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:12:28.568 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:12:28.756 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:12:28.756 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:12:28.841 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:12:28.917 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:12:31.983 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:12:31.983 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T01:12:31.983 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T01:12:31.983 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T01:12:31.984 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T01:12:31.985 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T01:12:31.986 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T01:12:31.986 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T01:12:31.986 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T01:12:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T01:12:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T01:12:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T01:12:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T01:12:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T01:12:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T01:12:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T01:12:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T01:12:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T01:12:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T01:12:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T01:12:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T01:12:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T01:12:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T01:12:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T01:12:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T01:12:32.008 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T01:12:32.009 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T01:12:32.009 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T01:12:32.634 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:12:32.634 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T01:12:32.634 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T01:12:32.634 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T01:12:32.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T01:12:32.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T01:12:32.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T01:12:32.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T01:12:32.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T01:12:32.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T01:12:32.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T01:12:32.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T01:12:32.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T01:12:32.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T01:12:32.636 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T01:12:32.649 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T01:12:32.649 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T01:12:32.649 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T01:12:32.649 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T01:12:32.649 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T01:12:32.649 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T01:12:32.649 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T01:12:32.649 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T01:12:32.649 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T01:12:32.650 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T01:12:32.651 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T01:12:32.652 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T01:12:32.653 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T01:12:32.654 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T01:12:32.655 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T01:12:32.656 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T01:12:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T01:12:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T01:12:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T01:12:32.660 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T01:12:32.660 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T01:12:32.660 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T01:12:32.660 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T01:12:32.660 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T01:12:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:12:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T01:12:34.397 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:12:34.398 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T01:12:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T01:12:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T01:12:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T01:12:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T01:12:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T01:12:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T01:12:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T01:12:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T01:12:34.399 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T01:12:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T01:12:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T01:12:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T01:12:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T01:12:34.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T01:12:34.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T01:12:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T01:12:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T01:12:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T01:12:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T01:12:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T01:12:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T01:12:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T01:12:34.414 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T01:12:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T01:12:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T01:12:34.417 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T01:12:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T01:12:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T01:12:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T01:12:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T01:12:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T01:12:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T01:12:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T01:12:34.418 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T01:12:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T01:12:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T01:12:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T01:12:34.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T01:12:34.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T01:12:34.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T01:12:34.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T01:12:34.425 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T01:12:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T01:12:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T01:12:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T01:12:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T01:12:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T01:12:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T01:12:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T01:12:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T01:12:34.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T01:12:34.706 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:12:34.706 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:34.706 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-16T01:12:34.707 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:34.707 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:34.707 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:34.707 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:34.707 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.707 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.707 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T01:12:34.707 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T01:12:34.707 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-16T01:12:34.707 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T01:12:34.708 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T01:12:34.708 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T01:12:34.708 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T01:12:34.708 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.708 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.708 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.708 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.708 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:34.708 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.708 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.709 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.709 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:34.709 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:34.709 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:34.709 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:34.709 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:34.709 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.709 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.709 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T01:12:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T01:12:34.711 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T01:12:34.711 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T01:12:34.711 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T01:12:34.711 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T01:12:34.711 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T01:12:34.711 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T01:12:34.711 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T01:12:34.711 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.711 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.712 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T01:12:34.713 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T01:12:34.714 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T01:12:34.715 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T01:12:34.716 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T01:12:34.717 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T01:12:34.718 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T01:12:34.719 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T01:12:34.720 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T01:12:34.721 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T01:12:34.721 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T01:12:34.721 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T01:12:34.721 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:12:34.721 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-16T01:12:35.147 DEBUG:teuthology.parallel:result is None 2024-09-16T01:12:35.211 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:12:35.211 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:35.211 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2024-09-16T01:12:35.211 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:35.211 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:35.211 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:35.211 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:35.211 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.211 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.212 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:35.213 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T01:12:35.214 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T01:12:35.215 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T01:12:35.216 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T01:12:35.217 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T01:12:35.218 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T01:12:35.219 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T01:12:35.220 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T01:12:35.221 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T01:12:35.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T01:12:35.223 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T01:12:35.224 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T01:12:35.224 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:12:35.224 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-16T01:12:35.652 DEBUG:teuthology.parallel:result is None 2024-09-16T01:12:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:12:37.331 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:37.331 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T01:12:37.332 INFO:teuthology.orchestra.run.smithi063.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:37.333 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.334 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.335 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T01:12:37.336 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T01:12:37.337 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T01:12:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T01:12:37.339 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T01:12:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T01:12:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T01:12:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T01:12:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T01:12:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T01:12:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T01:12:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T01:12:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T01:12:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T01:12:37.341 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T01:12:37.342 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T01:12:37.343 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T01:12:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:12:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T01:12:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T01:12:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T01:12:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T01:12:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T01:12:37.344 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T01:12:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T01:12:37.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:12:37.345 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-16T01:12:37.727 DEBUG:teuthology.parallel:result is None 2024-09-16T01:12:37.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:12:37.870 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T01:12:37.894 INFO:teuthology.orchestra.run.smithi063.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T01:12:37.895 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T01:12:37.895 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T01:12:37.897 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:12:38.042 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T01:12:38.069 INFO:teuthology.orchestra.run.smithi162.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T01:12:38.069 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T01:12:38.069 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T01:12:38.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:12:38.210 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T01:12:38.236 INFO:teuthology.orchestra.run.smithi192.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T01:12:38.237 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T01:12:38.237 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T01:12:38.239 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T01:12:38.239 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:12:38.239 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T01:12:38.269 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:12:38.270 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T01:12:38.302 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:12:38.302 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T01:12:38.333 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T01:12:38.333 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:12:38.333 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T01:12:38.360 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T01:12:38.426 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:12:38.426 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T01:12:38.456 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T01:12:38.525 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:12:38.526 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T01:12:38.555 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T01:12:38.622 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T01:12:38.623 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:12:38.623 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T01:12:38.650 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T01:12:38.717 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:12:38.717 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T01:12:38.745 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T01:12:38.812 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:12:38.812 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T01:12:38.841 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T01:12:38.908 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T01:12:38.909 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:12:38.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T01:12:38.936 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T01:12:39.002 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:12:39.003 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T01:12:39.030 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T01:12:39.098 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:12:39.098 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T01:12:39.126 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T01:12:39.194 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-16T01:12:39.308 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-16T01:12:39.309 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:12:39.309 INFO:tasks.cephadm:Cluster fsid is c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:12:39.309 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-16T01:12:39.309 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.63', 'mon.b': '172.21.15.162', 'mon.c': '172.21.15.192'} 2024-09-16T01:12:39.310 INFO:tasks.cephadm:First mon is mon.a on smithi063 2024-09-16T01:12:39.310 INFO:tasks.cephadm:First mgr is x 2024-09-16T01:12:39.310 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-16T01:12:39.310 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname $(hostname -s) 2024-09-16T01:12:39.338 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-09-16T01:12:39.368 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname $(hostname -s) 2024-09-16T01:12:39.397 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-16T01:12:39.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:12:39.539 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-16T01:12:39.676 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:12:39.677 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-16T01:12:39.677 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-16T01:12:39.678 DEBUG:teuthology.orchestra.run.smithi063:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T01:12:40.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 16 01:12 /home/ubuntu/cephtest/cephadm 2024-09-16T01:12:40.037 DEBUG:teuthology.orchestra.run.smithi162:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T01:12:40.420 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 16 01:12 /home/ubuntu/cephtest/cephadm 2024-09-16T01:12:40.420 DEBUG:teuthology.orchestra.run.smithi192:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T01:12:40.782 INFO:teuthology.orchestra.run.smithi192.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 16 01:12 /home/ubuntu/cephtest/cephadm 2024-09-16T01:12:40.782 DEBUG:teuthology.orchestra.run.smithi063:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T01:12:40.803 DEBUG:teuthology.orchestra.run.smithi162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T01:12:40.823 DEBUG:teuthology.orchestra.run.smithi192:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T01:12:40.859 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-16T01:12:40.859 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T01:12:40.862 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T01:12:40.866 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-16T01:12:42.575 INFO:teuthology.orchestra.run.smithi063.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T01:12:42.635 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T01:12:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T01:13:15.267 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:13:15.267 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T01:13:15.267 INFO:teuthology.orchestra.run.smithi063.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T01:13:15.267 INFO:teuthology.orchestra.run.smithi063.stdout: "repo_digests": [ 2024-09-16T01:13:15.267 INFO:teuthology.orchestra.run.smithi063.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T01:13:15.268 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-16T01:13:15.268 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:13:31.107 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-16T01:13:31.108 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T01:13:31.108 INFO:teuthology.orchestra.run.smithi192.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T01:13:31.108 INFO:teuthology.orchestra.run.smithi192.stdout: "repo_digests": [ 2024-09-16T01:13:31.108 INFO:teuthology.orchestra.run.smithi192.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T01:13:31.108 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-16T01:13:31.108 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-16T01:13:31.427 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-16T01:13:31.427 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T01:13:31.427 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-16T01:13:31.428 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-09-16T01:13:31.428 INFO:teuthology.orchestra.run.smithi162.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-16T01:13:31.428 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-16T01:13:31.428 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-16T01:13:31.453 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph 2024-09-16T01:13:31.489 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-09-16T01:13:31.516 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph 2024-09-16T01:13:31.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /etc/ceph 2024-09-16T01:13:31.577 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-09-16T01:13:31.601 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /etc/ceph 2024-09-16T01:13:31.626 INFO:tasks.cephadm:Writing seed config... 2024-09-16T01:13:31.627 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-16T01:13:31.627 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-16T01:13:31.627 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-16T01:13:31.627 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-16T01:13:31.627 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-16T01:13:31.628 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-16T01:13:31.629 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-16T01:13:31.630 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-16T01:13:31.631 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-16T01:13:31.631 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:13:31.631 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-16T01:13:31.649 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c42394ec-73c8-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-16T01:13:31.650 DEBUG:teuthology.orchestra.run.smithi063:mon.a> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.a.service 2024-09-16T01:13:31.692 DEBUG:teuthology.orchestra.run.smithi063:mgr.x> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.x.service 2024-09-16T01:13:31.736 INFO:tasks.cephadm:Bootstrapping... 2024-09-16T01:13:31.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid c42394ec-73c8-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.63 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:13:31.949 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:13:31.949 INFO:teuthology.orchestra.run.smithi063.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', 'c42394ec-73c8-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.63', '--skip-admin-label'] 2024-09-16T01:13:31.949 INFO:teuthology.orchestra.run.smithi063.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-16T01:13:31.950 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying podman|docker is present... 2024-09-16T01:13:31.974 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout 5.2.2 2024-09-16T01:13:31.975 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying lvm2 is present... 2024-09-16T01:13:31.975 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying time synchronization is in place... 2024-09-16T01:13:31.983 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T01:13:31.983 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T01:13:31.989 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T01:13:31.989 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-16T01:13:31.996 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout enabled 2024-09-16T01:13:32.003 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout active 2024-09-16T01:13:32.003 INFO:teuthology.orchestra.run.smithi063.stdout:Unit chronyd.service is enabled and running 2024-09-16T01:13:32.003 INFO:teuthology.orchestra.run.smithi063.stdout:Repeating the final host check... 2024-09-16T01:13:32.027 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout 5.2.2 2024-09-16T01:13:32.027 INFO:teuthology.orchestra.run.smithi063.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-16T01:13:32.027 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl is present 2024-09-16T01:13:32.027 INFO:teuthology.orchestra.run.smithi063.stdout:lvcreate is present 2024-09-16T01:13:32.034 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T01:13:32.034 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T01:13:32.040 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T01:13:32.040 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-16T01:13:32.047 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout enabled 2024-09-16T01:13:32.054 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout active 2024-09-16T01:13:32.054 INFO:teuthology.orchestra.run.smithi063.stdout:Unit chronyd.service is enabled and running 2024-09-16T01:13:32.054 INFO:teuthology.orchestra.run.smithi063.stdout:Host looks OK 2024-09-16T01:13:32.054 INFO:teuthology.orchestra.run.smithi063.stdout:Cluster fsid: c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:13:32.054 INFO:teuthology.orchestra.run.smithi063.stdout:Acquiring lock 140348126970880 on /run/cephadm/c42394ec-73c8-11ef-bceb-c7b262605968.lock 2024-09-16T01:13:32.055 INFO:teuthology.orchestra.run.smithi063.stdout:Lock 140348126970880 acquired on /run/cephadm/c42394ec-73c8-11ef-bceb-c7b262605968.lock 2024-09-16T01:13:32.055 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying IP 172.21.15.63 port 3300 ... 2024-09-16T01:13:32.055 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying IP 172.21.15.63 port 6789 ... 2024-09-16T01:13:32.055 INFO:teuthology.orchestra.run.smithi063.stdout:Base mon IP(s) is [172.21.15.63:3300, 172.21.15.63:6789], mon addrv is [v2:172.21.15.63:3300,v1:172.21.15.63:6789] 2024-09-16T01:13:32.059 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.63 metric 100 2024-09-16T01:13:32.059 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.63 metric 100 2024-09-16T01:13:32.061 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-16T01:13:32.061 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-16T01:13:32.062 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-16T01:13:32.064 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-16T01:13:32.064 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-16T01:13:32.064 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T01:13:32.064 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-16T01:13:32.064 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link noprefixroute 2024-09-16T01:13:32.064 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T01:13:32.065 INFO:teuthology.orchestra.run.smithi063.stdout:Mon IP `172.21.15.63` is in CIDR network `172.21.0.0/20` 2024-09-16T01:13:32.065 INFO:teuthology.orchestra.run.smithi063.stdout:Mon IP `172.21.15.63` is in CIDR network `172.21.0.0/20` 2024-09-16T01:13:32.065 INFO:teuthology.orchestra.run.smithi063.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-16T01:13:32.066 INFO:teuthology.orchestra.run.smithi063.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-16T01:13:32.066 INFO:teuthology.orchestra.run.smithi063.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T01:13:32.542 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stdout f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-16T01:13:32.542 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-16T01:13:32.543 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Getting image source signatures 2024-09-16T01:13:32.543 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying blob sha256:c0574da0c3174f3dc49daa274908f97d06456bd6a3cfab87e94022c1369a83a6 2024-09-16T01:13:32.543 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-16T01:13:32.543 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Copying config sha256:f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-16T01:13:32.543 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-16T01:13:33.406 INFO:teuthology.orchestra.run.smithi063.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-16T01:13:33.406 INFO:teuthology.orchestra.run.smithi063.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-16T01:13:33.406 INFO:teuthology.orchestra.run.smithi063.stdout:Extracting ceph user uid/gid from container image... 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi063.stdout:stat: stdout 167 167 2024-09-16T01:13:34.386 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial keys... 2024-09-16T01:13:38.777 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQA+hudmrKX5JxAAPs83XGSEB5aNVtbISUZVtg== 2024-09-16T01:13:46.230 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQBFhudmhvbvLhAAeHIlj1OmdBanC/mmS41VTg== 2024-09-16T01:13:47.569 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph-authtool: stdout AQBKhudm3FxjOhAA3lHg1kdlf4eDZHgh/jNOrQ== 2024-09-16T01:13:47.570 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial monmap... 2024-09-16T01:13:48.583 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T01:13:48.584 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-16T01:13:48.584 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:13:48.584 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T01:13:48.584 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool for a [v2:172.21.15.63:3300,v1:172.21.15.63:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T01:13:48.584 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = quincy 2024-09-16T01:13:48.584 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: set fsid to c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:13:48.584 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T01:13:48.584 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:13:48.584 INFO:teuthology.orchestra.run.smithi063.stdout:Creating mon... 2024-09-16T01:13:49.531 INFO:teuthology.orchestra.run.smithi063.stdout:create mon.a on 2024-09-16T01:13:49.739 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-16T01:13:49.911 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-16T01:13:50.100 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c42394ec-73c8-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-c42394ec-73c8-11ef-bceb-c7b262605968.target. 2024-09-16T01:13:50.101 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c42394ec-73c8-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-c42394ec-73c8-11ef-bceb-c7b262605968.target. 2024-09-16T01:13:50.367 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.a 2024-09-16T01:13:50.367 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-16T01:13:50.556 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c42394ec-73c8-11ef-bceb-c7b262605968.target.wants/ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c42394ec-73c8-11ef-bceb-c7b262605968@.service. 2024-09-16T01:13:50.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:50 smithi063 systemd[1]: Starting Ceph mon.a for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:13:50.955 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:50 smithi063 podman[30689]: 2024-09-16 01:13:50.713010413 +0000 UTC m=+0.017988257 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:13:50.956 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:50 smithi063 podman[30689]: 2024-09-16 01:13:50.846947547 +0000 UTC m=+0.151925377 container create 43de9a85b4a31af951d2294c83c6e6646dfe054a9f492013504b74b4d1e7fd8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-16T01:13:51.156 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T01:13:51.156 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2024-09-16T01:13:51.164 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T01:13:51.164 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-16T01:13:51.164 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2024-09-16T01:13:51.164 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T01:13:51.165 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mon to start... 2024-09-16T01:13:51.165 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mon... 2024-09-16T01:13:51.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:51 smithi063 podman[30689]: 2024-09-16 01:13:51.057578582 +0000 UTC m=+0.362556405 container init 43de9a85b4a31af951d2294c83c6e6646dfe054a9f492013504b74b4d1e7fd8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:13:51.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:51 smithi063 podman[30689]: 2024-09-16 01:13:51.061040533 +0000 UTC m=+0.366018355 container start 43de9a85b4a31af951d2294c83c6e6646dfe054a9f492013504b74b4d1e7fd8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-16T01:13:51.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:51 smithi063 ceph-mon[30708]: mkfs c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:13:51.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:51 smithi063 ceph-mon[30708]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-16T01:13:51.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:51 smithi063 bash[30689]: 43de9a85b4a31af951d2294c83c6e6646dfe054a9f492013504b74b4d1e7fd8b 2024-09-16T01:13:51.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:51 smithi063 systemd[1]: Started Ceph mon.a for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:13:52.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-16T01:13:52.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: monmap epoch 1 2024-09-16T01:13:52.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:13:52.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: last_changed 2024-09-16T01:13:47.917127+0000 2024-09-16T01:13:52.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: created 2024-09-16T01:13:47.917127+0000 2024-09-16T01:13:52.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: min_mon_release 19 (squid) 2024-09-16T01:13:52.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: election_strategy: 1 2024-09-16T01:13:52.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-16T01:13:52.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: fsmap 2024-09-16T01:13:52.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T01:13:52.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:52 smithi063 ceph-mon[30708]: mgrmap e1: no daemons active 2024-09-16T01:13:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout cluster: 2024-09-16T01:13:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout id: c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:13:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-16T01:13:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:13:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout services: 2024-09-16T01:13:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 1.30221s) 2024-09-16T01:13:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-16T01:13:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-16T01:13:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:13:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout data: 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout pgs: 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.327+0000 7f296db69640 1 Processor -- start 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.327+0000 7f296db69640 1 -- start start 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.327+0000 7f296db69640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296810a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.327+0000 7f296db69640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f296807bd80 con 0x7f2968108030 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.328+0000 7f29677fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296810a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.328+0000 7f29677fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296810a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45392/0 (socket says 172.21.15.63:45392) 2024-09-16T01:13:52.898 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.328+0000 7f29677fe640 1 -- 172.21.15.63:0/2251118165 learned_addr learned my addr 172.21.15.63:0/2251118165 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.328+0000 7f29677fe640 1 -- 172.21.15.63:0/2251118165 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296810a960 con 0x7f2968108030 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.330+0000 7f29677fe640 1 --2- 172.21.15.63:0/2251118165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296810a420 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2958009820 tx=0x7f295802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6a151b9378d58a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.330+0000 7f29667fc640 1 -- 172.21.15.63:0/2251118165 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2958037070 con 0x7f2968108030 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.330+0000 7f29667fc640 1 -- 172.21.15.63:0/2251118165 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2958032440 con 0x7f2968108030 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.330+0000 7f29667fc640 1 -- 172.21.15.63:0/2251118165 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2958032740 con 0x7f2968108030 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.331+0000 7f296db69640 1 -- 172.21.15.63:0/2251118165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 msgr2=0x7f296810a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.331+0000 7f296db69640 1 --2- 172.21.15.63:0/2251118165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296810a420 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2958009820 tx=0x7f295802a270 comp rx=0 tx=0).stop 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.331+0000 7f296db69640 1 -- 172.21.15.63:0/2251118165 shutdown_connections 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.331+0000 7f296db69640 1 --2- 172.21.15.63:0/2251118165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296810a420 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.331+0000 7f296db69640 1 -- 172.21.15.63:0/2251118165 >> 172.21.15.63:0/2251118165 conn(0x7f2968101bb0 msgr2=0x7f2968103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.331+0000 7f296db69640 1 -- 172.21.15.63:0/2251118165 shutdown_connections 2024-09-16T01:13:52.899 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.331+0000 7f296db69640 1 -- 172.21.15.63:0/2251118165 wait complete. 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.332+0000 7f296db69640 1 Processor -- start 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.332+0000 7f296db69640 1 -- start start 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.332+0000 7f296db69640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296819afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.332+0000 7f296db69640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f296810ad70 con 0x7f2968108030 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.332+0000 7f29677fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296819afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.332+0000 7f29677fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296819afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45394/0 (socket says 172.21.15.63:45394) 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.332+0000 7f29677fe640 1 -- 172.21.15.63:0/3930507195 learned_addr learned my addr 172.21.15.63:0/3930507195 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.333+0000 7f29677fe640 1 -- 172.21.15.63:0/3930507195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296819b4e0 con 0x7f2968108030 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.333+0000 7f29677fe640 1 --2- 172.21.15.63:0/3930507195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296819afa0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f29580090b0 tx=0x7f29580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.333+0000 7f2964ff9640 1 -- 172.21.15.63:0/3930507195 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2958041070 con 0x7f2968108030 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.333+0000 7f2964ff9640 1 -- 172.21.15.63:0/3930507195 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f295803c7a0 con 0x7f2968108030 2024-09-16T01:13:52.900 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.333+0000 7f296db69640 1 -- 172.21.15.63:0/3930507195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f296819b770 con 0x7f2968108030 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.333+0000 7f2964ff9640 1 -- 172.21.15.63:0/3930507195 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2958037040 con 0x7f2968108030 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.333+0000 7f296db69640 1 -- 172.21.15.63:0/3930507195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f296819e460 con 0x7f2968108030 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.334+0000 7f2964ff9640 1 -- 172.21.15.63:0/3930507195 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2958044070 con 0x7f2968108030 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.334+0000 7f2964ff9640 1 -- 172.21.15.63:0/3930507195 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f295803d3f0 con 0x7f2968108030 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.334+0000 7f296db69640 1 -- 172.21.15.63:0/3930507195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2968108490 con 0x7f2968108030 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.337+0000 7f2964ff9640 1 -- 172.21.15.63:0/3930507195 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2958046450 con 0x7f2968108030 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.399+0000 7f296db69640 1 -- 172.21.15.63:0/3930507195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f296802d7c0 con 0x7f2968108030 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.399+0000 7f2964ff9640 1 -- 172.21.15.63:0/3930507195 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7f2958046630 con 0x7f2968108030 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.400+0000 7f296db69640 1 -- 172.21.15.63:0/3930507195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 msgr2=0x7f296819afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.400+0000 7f296db69640 1 --2- 172.21.15.63:0/3930507195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296819afa0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f29580090b0 tx=0x7f29580046c0 comp rx=0 tx=0).stop 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.400+0000 7f296db69640 1 -- 172.21.15.63:0/3930507195 shutdown_connections 2024-09-16T01:13:52.901 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.400+0000 7f296db69640 1 --2- 172.21.15.63:0/3930507195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2968108030 0x7f296819afa0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:52.902 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.400+0000 7f296db69640 1 -- 172.21.15.63:0/3930507195 >> 172.21.15.63:0/3930507195 conn(0x7f2968101bb0 msgr2=0x7f29681032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:52.902 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.400+0000 7f296db69640 1 -- 172.21.15.63:0/3930507195 shutdown_connections 2024-09-16T01:13:52.902 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:52.400+0000 7f296db69640 1 -- 172.21.15.63:0/3930507195 wait complete. 2024-09-16T01:13:52.902 INFO:teuthology.orchestra.run.smithi063.stdout:mon is available 2024-09-16T01:13:52.902 INFO:teuthology.orchestra.run.smithi063.stdout:Assimilating anything we can from ceph.conf... 2024-09-16T01:13:53.199 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:53 smithi063 ceph-mon[30708]: from='client.? 172.21.15.63:0/3930507195' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-16T01:13:53.911 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:13:53.911 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout fsid = c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.63:3300,v1:172.21.15.63:6789] 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T01:13:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.276+0000 7f092afaa640 1 Processor -- start 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.276+0000 7f092afaa640 1 -- start start 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.276+0000 7f092afaa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092410a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.276+0000 7f092afaa640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f092407be30 con 0x7f0924107fb0 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.277+0000 7f0928d46640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092410a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.277+0000 7f0928d46640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092410a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45406/0 (socket says 172.21.15.63:45406) 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.277+0000 7f0928d46640 1 -- 172.21.15.63:0/4002165600 learned_addr learned my addr 172.21.15.63:0/4002165600 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:13:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.277+0000 7f0928d46640 1 -- 172.21.15.63:0/4002165600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092410a8e0 con 0x7f0924107fb0 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.278+0000 7f0928d46640 1 --2- 172.21.15.63:0/4002165600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092410a3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f091c009e80 tx=0x7f091c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d136bce17c7d64c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.278+0000 7f09237fe640 1 -- 172.21.15.63:0/4002165600 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f091c036070 con 0x7f0924107fb0 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.278+0000 7f09237fe640 1 -- 172.21.15.63:0/4002165600 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f091c031400 con 0x7f0924107fb0 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.278+0000 7f09237fe640 1 -- 172.21.15.63:0/4002165600 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f091c031700 con 0x7f0924107fb0 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.278+0000 7f092afaa640 1 -- 172.21.15.63:0/4002165600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 msgr2=0x7f092410a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.278+0000 7f092afaa640 1 --2- 172.21.15.63:0/4002165600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092410a3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f091c009e80 tx=0x7f091c02a7a0 comp rx=0 tx=0).stop 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.278+0000 7f092afaa640 1 -- 172.21.15.63:0/4002165600 shutdown_connections 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.278+0000 7f092afaa640 1 --2- 172.21.15.63:0/4002165600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092410a3a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.278+0000 7f092afaa640 1 -- 172.21.15.63:0/4002165600 >> 172.21.15.63:0/4002165600 conn(0x7f0924101bb0 msgr2=0x7f0924103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.278+0000 7f092afaa640 1 -- 172.21.15.63:0/4002165600 shutdown_connections 2024-09-16T01:13:53.914 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.279+0000 7f092afaa640 1 -- 172.21.15.63:0/4002165600 wait complete. 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.279+0000 7f092afaa640 1 Processor -- start 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.279+0000 7f092afaa640 1 -- start start 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.279+0000 7f092afaa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092419af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.279+0000 7f092afaa640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f092410ad50 con 0x7f0924107fb0 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.279+0000 7f0928d46640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092419af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.279+0000 7f0928d46640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092419af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45418/0 (socket says 172.21.15.63:45418) 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.279+0000 7f0928d46640 1 -- 172.21.15.63:0/3529297442 learned_addr learned my addr 172.21.15.63:0/3529297442 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.280+0000 7f0928d46640 1 -- 172.21.15.63:0/3529297442 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092419b460 con 0x7f0924107fb0 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.280+0000 7f0928d46640 1 --2- 172.21.15.63:0/3529297442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092419af20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f091c034040 tx=0x7f091c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.280+0000 7f0921ffb640 1 -- 172.21.15.63:0/3529297442 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f091c041070 con 0x7f0924107fb0 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.280+0000 7f0921ffb640 1 -- 172.21.15.63:0/3529297442 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f091c03c650 con 0x7f0924107fb0 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.280+0000 7f092afaa640 1 -- 172.21.15.63:0/3529297442 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092419b6f0 con 0x7f0924107fb0 2024-09-16T01:13:53.915 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.280+0000 7f0921ffb640 1 -- 172.21.15.63:0/3529297442 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f091c036040 con 0x7f0924107fb0 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.280+0000 7f092afaa640 1 -- 172.21.15.63:0/3529297442 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f092419e3e0 con 0x7f0924107fb0 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.280+0000 7f0921ffb640 1 -- 172.21.15.63:0/3529297442 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f091c044070 con 0x7f0924107fb0 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.280+0000 7f0921ffb640 1 -- 172.21.15.63:0/3529297442 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f091c046c10 con 0x7f0924107fb0 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.281+0000 7f092afaa640 1 -- 172.21.15.63:0/3529297442 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0924108410 con 0x7f0924107fb0 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.283+0000 7f0921ffb640 1 -- 172.21.15.63:0/3529297442 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f091c03c950 con 0x7f0924107fb0 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.343+0000 7f092afaa640 1 -- 172.21.15.63:0/3529297442 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f0924193880 con 0x7f0924107fb0 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.346+0000 7f0921ffb640 1 -- 172.21.15.63:0/3529297442 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f091c03cb30 con 0x7f0924107fb0 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.346+0000 7f0921ffb640 1 -- 172.21.15.63:0/3529297442 <== mon.0 v2:172.21.15.63:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f091c056070 con 0x7f0924107fb0 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.347+0000 7f092afaa640 1 -- 172.21.15.63:0/3529297442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 msgr2=0x7f092419af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.347+0000 7f092afaa640 1 --2- 172.21.15.63:0/3529297442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092419af20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f091c034040 tx=0x7f091c004a40 comp rx=0 tx=0).stop 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.347+0000 7f092afaa640 1 -- 172.21.15.63:0/3529297442 shutdown_connections 2024-09-16T01:13:53.916 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.347+0000 7f092afaa640 1 --2- 172.21.15.63:0/3529297442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0924107fb0 0x7f092419af20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:53.917 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.347+0000 7f092afaa640 1 -- 172.21.15.63:0/3529297442 >> 172.21.15.63:0/3529297442 conn(0x7f0924101bb0 msgr2=0x7f0924102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:53.917 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.347+0000 7f092afaa640 1 -- 172.21.15.63:0/3529297442 shutdown_connections 2024-09-16T01:13:53.917 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:53.347+0000 7f092afaa640 1 -- 172.21.15.63:0/3529297442 wait complete. 2024-09-16T01:13:53.917 INFO:teuthology.orchestra.run.smithi063.stdout:Generating new minimal ceph.conf... 2024-09-16T01:13:54.285 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:54 smithi063 ceph-mon[30708]: from='client.? 172.21.15.63:0/3529297442' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T01:13:54.285 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:54 smithi063 ceph-mon[30708]: from='client.? 172.21.15.63:0/3529297442' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-16T01:13:54.840 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.283+0000 7fb6920bf640 1 Processor -- start 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.284+0000 7fb6920bf640 1 -- start start 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.284+0000 7fb6920bf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c10a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.284+0000 7fb6920bf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c07be50 con 0x7fb68c107f30 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.284+0000 7fb68b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c10a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.284+0000 7fb68b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c10a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45422/0 (socket says 172.21.15.63:45422) 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.284+0000 7fb68b7fe640 1 -- 172.21.15.63:0/4088839822 learned_addr learned my addr 172.21.15.63:0/4088839822 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.284+0000 7fb68b7fe640 1 -- 172.21.15.63:0/4088839822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68c10a860 con 0x7fb68c107f30 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.285+0000 7fb68b7fe640 1 --2- 172.21.15.63:0/4088839822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c10a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009820 tx=0x7fb67c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fd9dbf5b09a07f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.285+0000 7fb68a7fc640 1 -- 172.21.15.63:0/4088839822 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb67c037070 con 0x7fb68c107f30 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.285+0000 7fb68a7fc640 1 -- 172.21.15.63:0/4088839822 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb67c0328d0 con 0x7fb68c107f30 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.285+0000 7fb68a7fc640 1 -- 172.21.15.63:0/4088839822 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb67c0307d0 con 0x7fb68c107f30 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.286+0000 7fb6920bf640 1 -- 172.21.15.63:0/4088839822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 msgr2=0x7fb68c10a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:54.841 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.286+0000 7fb6920bf640 1 --2- 172.21.15.63:0/4088839822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c10a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009820 tx=0x7fb67c02a270 comp rx=0 tx=0).stop 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.286+0000 7fb6920bf640 1 -- 172.21.15.63:0/4088839822 shutdown_connections 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.286+0000 7fb6920bf640 1 --2- 172.21.15.63:0/4088839822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c10a320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.286+0000 7fb6920bf640 1 -- 172.21.15.63:0/4088839822 >> 172.21.15.63:0/4088839822 conn(0x7fb68c101b10 msgr2=0x7fb68c103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.286+0000 7fb6920bf640 1 -- 172.21.15.63:0/4088839822 shutdown_connections 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.286+0000 7fb6920bf640 1 -- 172.21.15.63:0/4088839822 wait complete. 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.286+0000 7fb6920bf640 1 Processor -- start 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb6920bf640 1 -- start start 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb6920bf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb6920bf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c10b840 con 0x7fb68c107f30 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb68b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb68b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c19b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45436/0 (socket says 172.21.15.63:45436) 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb68b7fe640 1 -- 172.21.15.63:0/131747561 learned_addr learned my addr 172.21.15.63:0/131747561 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:13:54.842 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb68b7fe640 1 -- 172.21.15.63:0/131747561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68c19bcf0 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb68b7fe640 1 --2- 172.21.15.63:0/131747561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c19b7b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0097f0 tx=0x7fb67c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb688ff9640 1 -- 172.21.15.63:0/131747561 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb67c037040 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb688ff9640 1 -- 172.21.15.63:0/131747561 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb67c03b3f0 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.287+0000 7fb6920bf640 1 -- 172.21.15.63:0/131747561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68c19bf80 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.288+0000 7fb688ff9640 1 -- 172.21.15.63:0/131747561 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb67c03a520 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.288+0000 7fb6920bf640 1 -- 172.21.15.63:0/131747561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68c19ec70 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.288+0000 7fb688ff9640 1 -- 172.21.15.63:0/131747561 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb67c03a6c0 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.288+0000 7fb688ff9640 1 -- 172.21.15.63:0/131747561 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb67c044b00 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.289+0000 7fb6920bf640 1 -- 172.21.15.63:0/131747561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb68c108390 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.291+0000 7fb688ff9640 1 -- 172.21.15.63:0/131747561 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb67c03b980 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.351+0000 7fb6920bf640 1 -- 172.21.15.63:0/131747561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fb68c02d7c0 con 0x7fb68c107f30 2024-09-16T01:13:54.843 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.351+0000 7fb688ff9640 1 -- 172.21.15.63:0/131747561 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fb67c03b5a0 con 0x7fb68c107f30 2024-09-16T01:13:54.844 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.352+0000 7fb6920bf640 1 -- 172.21.15.63:0/131747561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 msgr2=0x7fb68c19b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:54.844 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.352+0000 7fb6920bf640 1 --2- 172.21.15.63:0/131747561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c19b7b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0097f0 tx=0x7fb67c030d00 comp rx=0 tx=0).stop 2024-09-16T01:13:54.844 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.352+0000 7fb6920bf640 1 -- 172.21.15.63:0/131747561 shutdown_connections 2024-09-16T01:13:54.844 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.352+0000 7fb6920bf640 1 --2- 172.21.15.63:0/131747561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb68c107f30 0x7fb68c19b7b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:54.844 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.352+0000 7fb6920bf640 1 -- 172.21.15.63:0/131747561 >> 172.21.15.63:0/131747561 conn(0x7fb68c101b10 msgr2=0x7fb68c1029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:54.844 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.352+0000 7fb6920bf640 1 -- 172.21.15.63:0/131747561 shutdown_connections 2024-09-16T01:13:54.844 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:54.352+0000 7fb6920bf640 1 -- 172.21.15.63:0/131747561 wait complete. 2024-09-16T01:13:54.844 INFO:teuthology.orchestra.run.smithi063.stdout:Restarting the monitor... 2024-09-16T01:13:55.096 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:54 smithi063 systemd[1]: Stopping Ceph mon.a for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:13:55.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:55 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a[30704]: 2024-09-16T01:13:55.094+0000 7f7897125640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:13:55.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:55 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a[30704]: 2024-09-16T01:13:55.094+0000 7f7897125640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-16T01:13:55.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:55 smithi063 podman[30950]: 2024-09-16 01:13:55.2180682 +0000 UTC m=+0.213723006 container died 43de9a85b4a31af951d2294c83c6e6646dfe054a9f492013504b74b4d1e7fd8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:13:55.729 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:55 smithi063 podman[30950]: 2024-09-16 01:13:55.486269431 +0000 UTC m=+0.481924236 container cleanup 43de9a85b4a31af951d2294c83c6e6646dfe054a9f492013504b74b4d1e7fd8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-8921c8e) 2024-09-16T01:13:55.729 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:55 smithi063 bash[30950]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a 2024-09-16T01:13:56.090 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:55 smithi063 podman[30962]: 2024-09-16 01:13:55.728812595 +0000 UTC m=+0.504959451 container remove 43de9a85b4a31af951d2294c83c6e6646dfe054a9f492013504b74b4d1e7fd8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-16T01:13:56.090 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:55 smithi063 systemd[1]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-16T01:13:56.090 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:55 smithi063 systemd[1]: Stopped Ceph mon.a for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:13:56.090 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:55 smithi063 systemd[1]: Starting Ceph mon.a for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:13:56.340 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 podman[31052]: 2024-09-16 01:13:55.993104478 +0000 UTC m=+0.016461337 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:13:56.340 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 podman[31052]: 2024-09-16 01:13:56.115095133 +0000 UTC m=+0.138452035 container create e7f7588f496820f800005998a850385fd5115cabc787b9754aad5cf0af97378c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-16T01:13:56.340 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 podman[31052]: 2024-09-16 01:13:56.31539325 +0000 UTC m=+0.338750108 container init e7f7588f496820f800005998a850385fd5115cabc787b9754aad5cf0af97378c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:13:56.340 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 podman[31052]: 2024-09-16 01:13:56.318493883 +0000 UTC m=+0.341850736 container start e7f7588f496820f800005998a850385fd5115cabc787b9754aad5cf0af97378c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:13:56.421 INFO:teuthology.orchestra.run.smithi063.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-16T01:13:56.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: pidfile_write: ignore empty --pid-file 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: load: jerasure load: lrc 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: RocksDB version: 7.9.2 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Git sha 0 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: DB SUMMARY 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: DB Session ID: ND9YT9B0FGBVPEOCGH4O 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: CURRENT file: CURRENT 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T01:13:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 103768 ; 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.error_if_exists: 0 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.create_if_missing: 0 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.paranoid_checks: 1 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.env: 0x55ea5affe940 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.info_log: 0x55ea5c40d6e0 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T01:13:56.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.statistics: (nil) 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.use_fsync: 0 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_log_file_size: 0 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.allow_fallocate: 1 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.use_direct_reads: 0 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T01:13:56.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.db_log_dir: 2024-09-16T01:13:56.613 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.wal_dir: 2024-09-16T01:13:56.613 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T01:13:56.614 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T01:13:56.614 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T01:13:56.614 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T01:13:56.614 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.write_buffer_manager: 0x55ea5c41cdc0 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T01:13:56.615 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.unordered_write: 0 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.row_cache: None 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.wal_filter: None 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.two_write_queues: 0 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.wal_compression: 0 2024-09-16T01:13:56.616 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.atomic_flush: 0 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.log_readahead_size: 0 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_background_jobs: 2 2024-09-16T01:13:56.617 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_background_compactions: -1 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_subcompactions: 1 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_open_files: -1 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T01:13:56.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T01:13:56.619 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_background_flushes: -1 2024-09-16T01:13:56.619 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Compression algorithms supported: 2024-09-16T01:13:56.619 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: kZSTD supported: 0 2024-09-16T01:13:56.619 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: kXpressCompression supported: 0 2024-09-16T01:13:56.619 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: kBZip2Compression supported: 0 2024-09-16T01:13:56.619 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T01:13:56.619 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: kLZ4Compression supported: 1 2024-09-16T01:13:56.619 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: kZlibCompression supported: 1 2024-09-16T01:13:56.619 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: kSnappyCompression supported: 1 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.merge_operator: 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_filter: None 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T01:13:56.620 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ea5c40d320) 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: cache_index_and_filter_blocks: 1 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: pin_top_level_index_and_filter: 1 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: index_type: 0 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: data_block_index_type: 0 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: index_shortening: 1 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: checksum: 4 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: no_block_cache: 0 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_cache: 0x55ea5c4011f0 2024-09-16T01:13:56.621 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_cache_name: BinnedLRUCache 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_cache_options: 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: capacity : 536870912 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: num_shard_bits : 4 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: strict_capacity_limit : 0 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: high_pri_pool_ratio: 0.000 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_cache_compressed: (nil) 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: persistent_cache: (nil) 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_size: 4096 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_size_deviation: 10 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_restart_interval: 16 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: index_block_restart_interval: 1 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: metadata_block_size: 4096 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: partition_filters: 0 2024-09-16T01:13:56.622 INFO:journalctl@ceph.mon.a.smithi063.stdout: use_delta_encoding: 1 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: filter_policy: bloomfilter 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: whole_key_filtering: 1 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: verify_compression: 0 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: read_amp_bytes_per_bit: 0 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: format_version: 5 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: enable_index_compression: 1 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: block_align: 0 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: max_auto_readahead_size: 262144 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: prepopulate_block_cache: 0 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: initial_auto_readahead_size: 8192 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T01:13:56.623 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compression: NoCompression 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.num_levels: 7 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T01:13:56.624 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T01:13:56.625 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T01:13:56.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T01:13:56.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.inplace_update_support: 0 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T01:13:56.628 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.bloom_locality: 0 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.max_successive_merges: 0 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.ttl: 2592000 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.enable_blob_files: false 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.min_blob_size: 0 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T01:13:56.629 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 10cad277-091a-4457-adff-00ab056bfc5a 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726449236345474, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726449236346538, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 98868, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 325, "table_properties": {"data_size": 96770, "index_size": 290, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14150, "raw_average_key_size": 49, "raw_value_size": 89119, "raw_average_value_size": 313, "num_data_blocks": 11, "num_entries": 284, "num_filter_entries": 284, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726449236, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "10cad277-091a-4457-adff-00ab056bfc5a", "db_session_id": "ND9YT9B0FGBVPEOCGH4O", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-16T01:13:56.630 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726449236346637, "job": 1, "event": "recovery_finished"} 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ea5c42ee00 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: DB pointer 0x55ea5c52a000 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout: ** DB Stats ** 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T01:13:56.631 INFO:journalctl@ceph.mon.a.smithi063.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T01:13:56.632 INFO:journalctl@ceph.mon.a.smithi063.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T01:13:56.632 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-16T01:13:56.632 INFO:journalctl@ceph.mon.a.smithi063.stdout: ** Compaction Stats [default] ** 2024-09-16T01:13:56.632 INFO:journalctl@ceph.mon.a.smithi063.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T01:13:56.632 INFO:journalctl@ceph.mon.a.smithi063.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T01:13:56.632 INFO:journalctl@ceph.mon.a.smithi063.stdout: L0 2/0 98.41 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T01:13:56.632 INFO:journalctl@ceph.mon.a.smithi063.stdout: Sum 2/0 98.41 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T01:13:56.632 INFO:journalctl@ceph.mon.a.smithi063.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: ** Compaction Stats [default] ** 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 144.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T01:13:56.633 INFO:journalctl@ceph.mon.a.smithi063.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T01:13:56.634 INFO:journalctl@ceph.mon.a.smithi063.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T01:13:56.634 INFO:journalctl@ceph.mon.a.smithi063.stdout: Cumulative compaction: 0.00 GB write, 28.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T01:13:56.634 INFO:journalctl@ceph.mon.a.smithi063.stdout: Interval compaction: 0.00 GB write, 28.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T01:13:56.634 INFO:journalctl@ceph.mon.a.smithi063.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T01:13:56.634 INFO:journalctl@ceph.mon.a.smithi063.stdout: Block cache BinnedLRUCache@0x55ea5c4011f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-16T01:13:56.634 INFO:journalctl@ceph.mon.a.smithi063.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-16T01:13:56.634 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-16T01:13:56.634 INFO:journalctl@ceph.mon.a.smithi063.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T01:13:56.634 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: starting mon.a rank 0 at public addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] at bind addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: mon.a@-1(???) e1 preinit fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: mon.a@-1(???).mds e1 new map 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: mon.a@-1(???).mds e1 print_map 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout: e1 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout: btime 2024-09-16T01:13:51:098754+0000 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout: legacy client fscid: -1 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout: 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout: No filesystems configured 2024-09-16T01:13:56.635 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: monmap epoch 1 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: last_changed 2024-09-16T01:13:47.917127+0000 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: created 2024-09-16T01:13:47.917127+0000 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: min_mon_release 19 (squid) 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: election_strategy: 1 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-16T01:13:56.636 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: fsmap 2024-09-16T01:13:56.637 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T01:13:56.637 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 ceph-mon[31070]: mgrmap e1: no daemons active 2024-09-16T01:13:56.637 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 bash[31052]: e7f7588f496820f800005998a850385fd5115cabc787b9754aad5cf0af97378c 2024-09-16T01:13:56.637 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:56 smithi063 systemd[1]: Started Ceph mon.a for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:13:57.504 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.801+0000 7f3eda162640 1 Processor -- start 2024-09-16T01:13:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.801+0000 7f3eda162640 1 -- start start 2024-09-16T01:13:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.802+0000 7f3eda162640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed41078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.802+0000 7f3eda162640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed4107e90 con 0x7f3ed41074c0 2024-09-16T01:13:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.802+0000 7f3ed37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed41078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.802+0000 7f3ed37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed41078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45452/0 (socket says 172.21.15.63:45452) 2024-09-16T01:13:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.802+0000 7f3ed37fe640 1 -- 172.21.15.63:0/2452674293 learned_addr learned my addr 172.21.15.63:0/2452674293 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:13:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.802+0000 7f3ed37fe640 1 -- 172.21.15.63:0/2452674293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed41086c0 con 0x7f3ed41074c0 2024-09-16T01:13:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.804+0000 7f3ed37fe640 1 --2- 172.21.15.63:0/2452674293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed41078c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009820 tx=0x7f3ec402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792c79ad4920b931 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.805+0000 7f3ed27fc640 1 -- 172.21.15.63:0/2452674293 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec4037070 con 0x7f3ed41074c0 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.805+0000 7f3ed27fc640 1 -- 172.21.15.63:0/2452674293 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3ec40328d0 con 0x7f3ed41074c0 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.805+0000 7f3ed27fc640 1 -- 172.21.15.63:0/2452674293 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec40307d0 con 0x7f3ed41074c0 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.805+0000 7f3eda162640 1 -- 172.21.15.63:0/2452674293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 msgr2=0x7f3ed41078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.805+0000 7f3eda162640 1 --2- 172.21.15.63:0/2452674293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed41078c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009820 tx=0x7f3ec402a270 comp rx=0 tx=0).stop 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.805+0000 7f3eda162640 1 -- 172.21.15.63:0/2452674293 shutdown_connections 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.805+0000 7f3eda162640 1 --2- 172.21.15.63:0/2452674293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed41078c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.805+0000 7f3eda162640 1 -- 172.21.15.63:0/2452674293 >> 172.21.15.63:0/2452674293 conn(0x7f3ed4102c50 msgr2=0x7f3ed4105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.805+0000 7f3eda162640 1 -- 172.21.15.63:0/2452674293 shutdown_connections 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.805+0000 7f3eda162640 1 -- 172.21.15.63:0/2452674293 wait complete. 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.806+0000 7f3eda162640 1 Processor -- start 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.806+0000 7f3eda162640 1 -- start start 2024-09-16T01:13:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.806+0000 7f3eda162640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed419d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:57.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.806+0000 7f3eda162640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed410ba70 con 0x7f3ed41074c0 2024-09-16T01:13:57.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.806+0000 7f3ed37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed419d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:57.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.806+0000 7f3ed37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed419d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45454/0 (socket says 172.21.15.63:45454) 2024-09-16T01:13:57.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.806+0000 7f3ed37fe640 1 -- 172.21.15.63:0/814581444 learned_addr learned my addr 172.21.15.63:0/814581444 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:13:57.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.807+0000 7f3ed37fe640 1 -- 172.21.15.63:0/814581444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed419dec0 con 0x7f3ed41074c0 2024-09-16T01:13:57.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.807+0000 7f3ed37fe640 1 --2- 172.21.15.63:0/814581444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed419d980 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009940 tx=0x7f3ec4032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:57.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.807+0000 7f3ed0ff9640 1 -- 172.21.15.63:0/814581444 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec4042070 con 0x7f3ed41074c0 2024-09-16T01:13:57.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.807+0000 7f3ed0ff9640 1 -- 172.21.15.63:0/814581444 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3ec4030c80 con 0x7f3ed41074c0 2024-09-16T01:13:57.507 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.807+0000 7f3ed0ff9640 1 -- 172.21.15.63:0/814581444 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec4037040 con 0x7f3ed41074c0 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.807+0000 7f3eda162640 1 -- 172.21.15.63:0/814581444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed419e150 con 0x7f3ed41074c0 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.807+0000 7f3eda162640 1 -- 172.21.15.63:0/814581444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed41a0e40 con 0x7f3ed41074c0 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.807+0000 7f3ed0ff9640 1 -- 172.21.15.63:0/814581444 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3ec4045070 con 0x7f3ed41074c0 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.808+0000 7f3ed0ff9640 1 -- 172.21.15.63:0/814581444 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3ec40479e0 con 0x7f3ed41074c0 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.808+0000 7f3eda162640 1 -- 172.21.15.63:0/814581444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed410bbf0 con 0x7f3ed41074c0 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.811+0000 7f3ed0ff9640 1 -- 172.21.15.63:0/814581444 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3ec403c5f0 con 0x7f3ed41074c0 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.869+0000 7f3eda162640 1 -- 172.21.15.63:0/814581444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f3ed4107940 con 0x7f3ed41074c0 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.874+0000 7f3ed0ff9640 1 -- 172.21.15.63:0/814581444 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f3ec4047be0 con 0x7f3ed41074c0 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.875+0000 7f3eda162640 1 -- 172.21.15.63:0/814581444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 msgr2=0x7f3ed419d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.875+0000 7f3eda162640 1 --2- 172.21.15.63:0/814581444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed419d980 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009940 tx=0x7f3ec4032e10 comp rx=0 tx=0).stop 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.875+0000 7f3eda162640 1 -- 172.21.15.63:0/814581444 shutdown_connections 2024-09-16T01:13:57.508 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.875+0000 7f3eda162640 1 --2- 172.21.15.63:0/814581444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3ed41074c0 0x7f3ed419d980 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:57.509 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.875+0000 7f3eda162640 1 -- 172.21.15.63:0/814581444 >> 172.21.15.63:0/814581444 conn(0x7f3ed4102c50 msgr2=0x7f3ed4103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:57.509 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.875+0000 7f3eda162640 1 -- 172.21.15.63:0/814581444 shutdown_connections 2024-09-16T01:13:57.509 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:56.875+0000 7f3eda162640 1 -- 172.21.15.63:0/814581444 wait complete. 2024-09-16T01:13:57.509 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-16T01:13:57.730 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:13:57.730 INFO:teuthology.orchestra.run.smithi063.stdout:Creating mgr... 2024-09-16T01:13:57.731 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-16T01:13:57.732 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-16T01:13:57.999 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.x 2024-09-16T01:13:57.999 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-16T01:13:58.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:57 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/814581444' entity='client.admin' 2024-09-16T01:13:58.159 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c42394ec-73c8-11ef-bceb-c7b262605968.target.wants/ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c42394ec-73c8-11ef-bceb-c7b262605968@.service. 2024-09-16T01:13:58.685 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T01:13:58.685 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2024-09-16T01:13:58.693 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T01:13:58.693 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-16T01:13:58.694 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2024-09-16T01:13:58.694 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T01:13:58.705 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T01:13:58.705 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2024-09-16T01:13:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T01:13:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-16T01:13:58.713 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2024-09-16T01:13:58.714 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-16T01:13:58.714 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr to start... 2024-09-16T01:13:58.714 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr... 2024-09-16T01:13:58.784 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:13:58 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:13:58.721+0000 7f9a27137040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:13:58.784 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:13:58 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:13:58.783+0000 7f9a27137040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:13:59.095 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:13:58 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:13:58.945+0000 7f9a27137040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:13:59.095 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:13:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:13:59.015+0000 7f9a27137040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:13:59.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:13:59 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/999654722' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T01:13:59.359 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:13:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:13:59.175+0000 7f9a27137040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:13:59.359 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:13:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:13:59.324+0000 7f9a27137040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:13:59.686 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "c42394ec-73c8-11ef-bceb-c7b262605968", 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:13:59.696 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T01:13:59.697 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T01:13:59.698 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T01:13:51:098754+0000", 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T01:13:59.699 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T01:13:51.099452+0000", 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:13:59.700 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.093+0000 7f80605c4640 1 Processor -- start 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.093+0000 7f80605c4640 1 -- start start 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.094+0000 7f80605c4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f8058106780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.094+0000 7f80605c4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8058106d50 con 0x7f8058106380 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.094+0000 7f805e360640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f8058106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.094+0000 7f805e360640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f8058106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44064/0 (socket says 172.21.15.63:44064) 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.094+0000 7f805e360640 1 -- 172.21.15.63:0/1922069798 learned_addr learned my addr 172.21.15.63:0/1922069798 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.094+0000 7f805e360640 1 -- 172.21.15.63:0/1922069798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8058107580 con 0x7f8058106380 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.095+0000 7f805e360640 1 --2- 172.21.15.63:0/1922069798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f8058106780 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8054009820 tx=0x7f805402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174a25eeacd89da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.095+0000 7f805d35e640 1 -- 172.21.15.63:0/1922069798 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8054037070 con 0x7f8058106380 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.096+0000 7f805d35e640 1 -- 172.21.15.63:0/1922069798 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f80540328d0 con 0x7f8058106380 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.096+0000 7f805d35e640 1 -- 172.21.15.63:0/1922069798 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80540307d0 con 0x7f8058106380 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.096+0000 7f80605c4640 1 -- 172.21.15.63:0/1922069798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 msgr2=0x7f8058106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:59.701 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.096+0000 7f80605c4640 1 --2- 172.21.15.63:0/1922069798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f8058106780 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8054009820 tx=0x7f805402a270 comp rx=0 tx=0).stop 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.096+0000 7f80605c4640 1 -- 172.21.15.63:0/1922069798 shutdown_connections 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.096+0000 7f80605c4640 1 --2- 172.21.15.63:0/1922069798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f8058106780 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.096+0000 7f80605c4640 1 -- 172.21.15.63:0/1922069798 >> 172.21.15.63:0/1922069798 conn(0x7f8058101b10 msgr2=0x7f8058103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.096+0000 7f80605c4640 1 -- 172.21.15.63:0/1922069798 shutdown_connections 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.096+0000 7f80605c4640 1 -- 172.21.15.63:0/1922069798 wait complete. 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.097+0000 7f80605c4640 1 Processor -- start 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.097+0000 7f80605c4640 1 -- start start 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.097+0000 7f80605c4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f805819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f80605c4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f805810a930 con 0x7f8058106380 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f805e360640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f805819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f805e360640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f805819a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44078/0 (socket says 172.21.15.63:44078) 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f805e360640 1 -- 172.21.15.63:0/999654722 learned_addr learned my addr 172.21.15.63:0/999654722 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:13:59.702 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f805e360640 1 -- 172.21.15.63:0/999654722 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805819ac00 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f805e360640 1 --2- 172.21.15.63:0/999654722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f805819a6c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f80540097f0 tx=0x7f8054030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f804f7fe640 1 -- 172.21.15.63:0/999654722 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8054037040 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f80605c4640 1 -- 172.21.15.63:0/999654722 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f805819ae90 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f804f7fe640 1 -- 172.21.15.63:0/999654722 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f8054032bb0 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f804f7fe640 1 -- 172.21.15.63:0/999654722 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805403a390 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f80605c4640 1 -- 172.21.15.63:0/999654722 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f805819db80 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f804f7fe640 1 -- 172.21.15.63:0/999654722 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f805403a5d0 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.098+0000 7f804f7fe640 1 -- 172.21.15.63:0/999654722 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8054044b50 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.099+0000 7f80605c4640 1 -- 172.21.15.63:0/999654722 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f805810aab0 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.101+0000 7f804f7fe640 1 -- 172.21.15.63:0/999654722 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8054044df0 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.163+0000 7f80605c4640 1 -- 172.21.15.63:0/999654722 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8058106800 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.164+0000 7f804f7fe640 1 -- 172.21.15.63:0/999654722 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f8058106800 con 0x7f8058106380 2024-09-16T01:13:59.703 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.165+0000 7f80605c4640 1 -- 172.21.15.63:0/999654722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 msgr2=0x7f805819a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:13:59.704 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.165+0000 7f80605c4640 1 --2- 172.21.15.63:0/999654722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f805819a6c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f80540097f0 tx=0x7f8054030d00 comp rx=0 tx=0).stop 2024-09-16T01:13:59.704 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.165+0000 7f80605c4640 1 -- 172.21.15.63:0/999654722 shutdown_connections 2024-09-16T01:13:59.704 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.165+0000 7f80605c4640 1 --2- 172.21.15.63:0/999654722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8058106380 0x7f805819a6c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:13:59.704 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.165+0000 7f80605c4640 1 -- 172.21.15.63:0/999654722 >> 172.21.15.63:0/999654722 conn(0x7f8058101b10 msgr2=0x7f80581028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:13:59.704 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.165+0000 7f80605c4640 1 -- 172.21.15.63:0/999654722 shutdown_connections 2024-09-16T01:13:59.704 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:13:59.165+0000 7f80605c4640 1 -- 172.21.15.63:0/999654722 wait complete. 2024-09-16T01:13:59.704 INFO:teuthology.orchestra.run.smithi063.stdout:mgr not available, waiting (1/15)... 2024-09-16T01:13:59.728 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:13:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:13:59.662+0000 7f9a27137040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:14:00.109 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:13:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:13:59.727+0000 7f9a27137040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:14:00.109 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:13:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:13:59.920+0000 7f9a27137040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:14:00.920 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:00 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:00.848+0000 7f9a27137040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:14:00.920 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:00 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:00.919+0000 7f9a27137040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:14:01.959 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:01 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:01.699+0000 7f9a27137040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:14:01.959 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:01 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:01.824+0000 7f9a27137040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:14:02.211 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:01 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:01.978+0000 7f9a27137040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:14:02.211 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:02.044+0000 7f9a27137040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:14:02.211 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:02.209+0000 7f9a27137040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:14:02.530 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/477729210' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T01:14:02.531 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:02.293+0000 7f9a27137040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:14:02.531 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:02.357+0000 7f9a27137040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:14:02.531 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:02.529+0000 7f9a27137040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:14:02.823 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:02.599+0000 7f9a27137040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:14:02.823 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:02.670+0000 7f9a27137040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:14:02.823 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:02.759+0000 7f9a27137040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:14:02.823 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:02.821+0000 7f9a27137040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:14:02.871 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:14:02.871 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:14:02.871 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "c42394ec-73c8-11ef-bceb-c7b262605968", 2024-09-16T01:14:02.871 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T01:14:02.871 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-16T01:14:02.872 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T01:14:02.873 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:14:02.873 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T01:14:02.873 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T01:14:02.873 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:02.873 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T01:14:02.873 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:14:02.873 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T01:14:02.873 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T01:14:02.873 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T01:14:02.881 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T01:14:02.881 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T01:14:02.881 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T01:14:02.881 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:02.881 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T01:14:02.881 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T01:14:02.881 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T01:14:02.881 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T01:14:02.881 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T01:13:51:098754+0000", 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T01:14:02.882 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T01:13:51.099452+0000", 2024-09-16T01:14:02.883 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.167+0000 7f18caf99640 1 Processor -- start 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.167+0000 7f18caf99640 1 -- start start 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.167+0000 7f18caf99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c410a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.167+0000 7f18caf99640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f18c407be90 con 0x7f18c4107ef0 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.168+0000 7f18c8d35640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c410a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.168+0000 7f18c8d35640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c410a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44092/0 (socket says 172.21.15.63:44092) 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.168+0000 7f18c8d35640 1 -- 172.21.15.63:0/4069910705 learned_addr learned my addr 172.21.15.63:0/4069910705 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.168+0000 7f18c8d35640 1 -- 172.21.15.63:0/4069910705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c410a820 con 0x7f18c4107ef0 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.169+0000 7f18c8d35640 1 --2- 172.21.15.63:0/4069910705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c410a2e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009820 tx=0x7f18b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e698ab36caa8c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:02.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.169+0000 7f18c37fe640 1 -- 172.21.15.63:0/4069910705 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8037070 con 0x7f18c4107ef0 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.170+0000 7f18c37fe640 1 -- 172.21.15.63:0/4069910705 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f18b80328d0 con 0x7f18c4107ef0 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.170+0000 7f18c37fe640 1 -- 172.21.15.63:0/4069910705 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b80307d0 con 0x7f18c4107ef0 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.170+0000 7f18caf99640 1 -- 172.21.15.63:0/4069910705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 msgr2=0x7f18c410a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.170+0000 7f18caf99640 1 --2- 172.21.15.63:0/4069910705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c410a2e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009820 tx=0x7f18b802a270 comp rx=0 tx=0).stop 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.170+0000 7f18caf99640 1 -- 172.21.15.63:0/4069910705 shutdown_connections 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.170+0000 7f18caf99640 1 --2- 172.21.15.63:0/4069910705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c410a2e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.170+0000 7f18caf99640 1 -- 172.21.15.63:0/4069910705 >> 172.21.15.63:0/4069910705 conn(0x7f18c4101b10 msgr2=0x7f18c4103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.170+0000 7f18caf99640 1 -- 172.21.15.63:0/4069910705 shutdown_connections 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.171+0000 7f18caf99640 1 -- 172.21.15.63:0/4069910705 wait complete. 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.171+0000 7f18caf99640 1 Processor -- start 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.171+0000 7f18caf99640 1 -- start start 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.171+0000 7f18caf99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c419b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:02.885 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.172+0000 7f18caf99640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f18c410b860 con 0x7f18c4107ef0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.172+0000 7f18c8d35640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c419b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.172+0000 7f18c8d35640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c419b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44096/0 (socket says 172.21.15.63:44096) 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.172+0000 7f18c8d35640 1 -- 172.21.15.63:0/477729210 learned_addr learned my addr 172.21.15.63:0/477729210 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.172+0000 7f18c8d35640 1 -- 172.21.15.63:0/477729210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c419bca0 con 0x7f18c4107ef0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.172+0000 7f18c8d35640 1 --2- 172.21.15.63:0/477729210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c419b760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18b8030520 tx=0x7f18b8032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.172+0000 7f18c1ffb640 1 -- 172.21.15.63:0/477729210 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8042070 con 0x7f18c4107ef0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.172+0000 7f18caf99640 1 -- 172.21.15.63:0/477729210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c419bf30 con 0x7f18c4107ef0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.173+0000 7f18c1ffb640 1 -- 172.21.15.63:0/477729210 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f18b8030cc0 con 0x7f18c4107ef0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.173+0000 7f18c1ffb640 1 -- 172.21.15.63:0/477729210 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18b8037040 con 0x7f18c4107ef0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.173+0000 7f18caf99640 1 -- 172.21.15.63:0/477729210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c419ec20 con 0x7f18c4107ef0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.173+0000 7f18c1ffb640 1 -- 172.21.15.63:0/477729210 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f18b8045070 con 0x7f18c4107ef0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.173+0000 7f18c1ffb640 1 -- 172.21.15.63:0/477729210 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f18b8047990 con 0x7f18c4107ef0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.174+0000 7f18caf99640 1 -- 172.21.15.63:0/477729210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c4108350 con 0x7f18c4107ef0 2024-09-16T01:14:02.886 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.178+0000 7f18c1ffb640 1 -- 172.21.15.63:0/477729210 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f18b803d430 con 0x7f18c4107ef0 2024-09-16T01:14:02.887 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.244+0000 7f18caf99640 1 -- 172.21.15.63:0/477729210 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f18c402d7c0 con 0x7f18c4107ef0 2024-09-16T01:14:02.887 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.245+0000 7f18c1ffb640 1 -- 172.21.15.63:0/477729210 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f18b803d610 con 0x7f18c4107ef0 2024-09-16T01:14:02.887 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.246+0000 7f18caf99640 1 -- 172.21.15.63:0/477729210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 msgr2=0x7f18c419b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:02.887 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.246+0000 7f18caf99640 1 --2- 172.21.15.63:0/477729210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c419b760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18b8030520 tx=0x7f18b8032dd0 comp rx=0 tx=0).stop 2024-09-16T01:14:02.887 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.246+0000 7f18caf99640 1 -- 172.21.15.63:0/477729210 shutdown_connections 2024-09-16T01:14:02.887 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.246+0000 7f18caf99640 1 --2- 172.21.15.63:0/477729210 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18c4107ef0 0x7f18c419b760 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:02.887 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.246+0000 7f18caf99640 1 -- 172.21.15.63:0/477729210 >> 172.21.15.63:0/477729210 conn(0x7f18c4101b10 msgr2=0x7f18c4102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:02.887 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.246+0000 7f18caf99640 1 -- 172.21.15.63:0/477729210 shutdown_connections 2024-09-16T01:14:02.887 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:02.246+0000 7f18caf99640 1 -- 172.21.15.63:0/477729210 wait complete. 2024-09-16T01:14:02.887 INFO:teuthology.orchestra.run.smithi063.stdout:mgr not available, waiting (2/15)... 2024-09-16T01:14:03.109 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:02.885+0000 7f9a27137040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:14:04.109 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:03.734+0000 7f9a27137040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:14:04.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: Activating manager daemon x 2024-09-16T01:14:04.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: mgrmap e2: x(active, starting, since 0.00316763s) 2024-09-16T01:14:04.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: from='mgr.14100 172.21.15.63:0/3405526718' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T01:14:04.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: from='mgr.14100 172.21.15.63:0/3405526718' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T01:14:04.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: from='mgr.14100 172.21.15.63:0/3405526718' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T01:14:04.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: from='mgr.14100 172.21.15.63:0/3405526718' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:14:04.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: from='mgr.14100 172.21.15.63:0/3405526718' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T01:14:04.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: Manager daemon x is now available 2024-09-16T01:14:04.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: from='mgr.14100 172.21.15.63:0/3405526718' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T01:14:04.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: from='mgr.14100 172.21.15.63:0/3405526718' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T01:14:04.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: from='mgr.14100 172.21.15.63:0/3405526718' entity='mgr.x' 2024-09-16T01:14:04.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: from='mgr.14100 172.21.15.63:0/3405526718' entity='mgr.x' 2024-09-16T01:14:04.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:03 smithi063 ceph-mon[31070]: from='mgr.14100 172.21.15.63:0/3405526718' entity='mgr.x' 2024-09-16T01:14:05.846 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:05 smithi063 ceph-mon[31070]: mgrmap e3: x(active, since 1.00764s) 2024-09-16T01:14:05.847 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:05 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2064333365' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T01:14:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsid": "c42394ec-73c8-11ef-bceb-c7b262605968", 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 0 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:14:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "a" 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T01:14:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T01:14:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T01:14:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T01:14:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T01:14:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T01:13:51:098754+0000", 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T01:14:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ], 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T01:13:51.099452+0000", 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout }, 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.307+0000 7f77875c2640 1 Processor -- start 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.307+0000 7f77875c2640 1 -- start start 2024-09-16T01:14:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.307+0000 7f77875c2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f77801061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.307+0000 7f77875c2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f778007bdc0 con 0x7f7780105de0 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.308+0000 7f778535e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f77801061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.308+0000 7f778535e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f77801061e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44148/0 (socket says 172.21.15.63:44148) 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.308+0000 7f778535e640 1 -- 172.21.15.63:0/3485350988 learned_addr learned my addr 172.21.15.63:0/3485350988 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.308+0000 7f778535e640 1 -- 172.21.15.63:0/3485350988 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7780106720 con 0x7f7780105de0 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.309+0000 7f778535e640 1 --2- 172.21.15.63:0/3485350988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f77801061e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f777c009820 tx=0x7f777c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87de7b351f5e133b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.309+0000 7f7777fff640 1 -- 172.21.15.63:0/3485350988 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f777c037070 con 0x7f7780105de0 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.309+0000 7f7777fff640 1 -- 172.21.15.63:0/3485350988 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f777c0328d0 con 0x7f7780105de0 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.309+0000 7f7777fff640 1 -- 172.21.15.63:0/3485350988 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f777c0307d0 con 0x7f7780105de0 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.310+0000 7f77875c2640 1 -- 172.21.15.63:0/3485350988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 msgr2=0x7f77801061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.310+0000 7f77875c2640 1 --2- 172.21.15.63:0/3485350988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f77801061e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f777c009820 tx=0x7f777c02a270 comp rx=0 tx=0).stop 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.310+0000 7f77875c2640 1 -- 172.21.15.63:0/3485350988 shutdown_connections 2024-09-16T01:14:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.310+0000 7f77875c2640 1 --2- 172.21.15.63:0/3485350988 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f77801061e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.310+0000 7f77875c2640 1 -- 172.21.15.63:0/3485350988 >> 172.21.15.63:0/3485350988 conn(0x7f7780101bb0 msgr2=0x7f7780103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.310+0000 7f77875c2640 1 -- 172.21.15.63:0/3485350988 shutdown_connections 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.310+0000 7f77875c2640 1 -- 172.21.15.63:0/3485350988 wait complete. 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.310+0000 7f77875c2640 1 Processor -- start 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.310+0000 7f77875c2640 1 -- start start 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.311+0000 7f77875c2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f778019d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.311+0000 7f77875c2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7780107640 con 0x7f7780105de0 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.311+0000 7f778535e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f778019d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.311+0000 7f778535e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f778019d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44162/0 (socket says 172.21.15.63:44162) 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.311+0000 7f778535e640 1 -- 172.21.15.63:0/2064333365 learned_addr learned my addr 172.21.15.63:0/2064333365 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.311+0000 7f778535e640 1 -- 172.21.15.63:0/2064333365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778019de10 con 0x7f7780105de0 2024-09-16T01:14:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.311+0000 7f778535e640 1 --2- 172.21.15.63:0/2064333365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f778019d8d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f777c032e10 tx=0x7f777c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.311+0000 7f77767fc640 1 -- 172.21.15.63:0/2064333365 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f777c042070 con 0x7f7780105de0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.312+0000 7f77767fc640 1 -- 172.21.15.63:0/2064333365 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f777c030c80 con 0x7f7780105de0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.312+0000 7f77875c2640 1 -- 172.21.15.63:0/2064333365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778019e0a0 con 0x7f7780105de0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.312+0000 7f77767fc640 1 -- 172.21.15.63:0/2064333365 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f777c037040 con 0x7f7780105de0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.312+0000 7f77875c2640 1 -- 172.21.15.63:0/2064333365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77801a0d90 con 0x7f7780105de0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.313+0000 7f77767fc640 1 -- 172.21.15.63:0/2064333365 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f777c045070 con 0x7f7780105de0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.313+0000 7f77875c2640 1 -- 172.21.15.63:0/2064333365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7780107d10 con 0x7f7780105de0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.313+0000 7f77767fc640 1 --2- 172.21.15.63:0/2064333365 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f776c039050 0x7f776c03b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.313+0000 7f77767fc640 1 -- 172.21.15.63:0/2064333365 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f777c06bf90 con 0x7f7780105de0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.313+0000 7f7784b5d640 1 --2- 172.21.15.63:0/2064333365 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f776c039050 0x7f776c03b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.314+0000 7f7784b5d640 1 --2- 172.21.15.63:0/2064333365 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f776c039050 0x7f776c03b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77700098c0 tx=0x7f7770006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.318+0000 7f77767fc640 1 -- 172.21.15.63:0/2064333365 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f777c04b170 con 0x7f7780105de0 2024-09-16T01:14:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.563+0000 7f77875c2640 1 -- 172.21.15.63:0/2064333365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f778002d7c0 con 0x7f7780105de0 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.563+0000 7f77767fc640 1 -- 172.21.15.63:0/2064333365 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f777c031ad0 con 0x7f7780105de0 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.566+0000 7f77875c2640 1 -- 172.21.15.63:0/2064333365 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f776c039050 msgr2=0x7f776c03b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.566+0000 7f77875c2640 1 --2- 172.21.15.63:0/2064333365 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f776c039050 0x7f776c03b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f77700098c0 tx=0x7f7770006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.566+0000 7f77875c2640 1 -- 172.21.15.63:0/2064333365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 msgr2=0x7f778019d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.566+0000 7f77875c2640 1 --2- 172.21.15.63:0/2064333365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f778019d8d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f777c032e10 tx=0x7f777c032e40 comp rx=0 tx=0).stop 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.566+0000 7f77875c2640 1 -- 172.21.15.63:0/2064333365 shutdown_connections 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.566+0000 7f77875c2640 1 --2- 172.21.15.63:0/2064333365 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f776c039050 0x7f776c03b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.566+0000 7f77875c2640 1 --2- 172.21.15.63:0/2064333365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7780105de0 0x7f778019d8d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.566+0000 7f77875c2640 1 -- 172.21.15.63:0/2064333365 >> 172.21.15.63:0/2064333365 conn(0x7f7780101bb0 msgr2=0x7f77801942a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.566+0000 7f77875c2640 1 -- 172.21.15.63:0/2064333365 shutdown_connections 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:05.566+0000 7f77875c2640 1 -- 172.21.15.63:0/2064333365 wait complete. 2024-09-16T01:14:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:mgr is available 2024-09-16T01:14:07.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:06 smithi063 ceph-mon[31070]: mgrmap e4: x(active, since 2s) 2024-09-16T01:14:07.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:06 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3003265841' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T01:14:07.213 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout fsid = c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.63:3300,v1:172.21.15.63:6789] 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 2024-09-16T01:14:07.214 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.455+0000 7fba87c5a640 1 Processor -- start 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.455+0000 7fba87c5a640 1 -- start start 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.455+0000 7fba87c5a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba801078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.455+0000 7fba87c5a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fba80107e80 con 0x7fba801074b0 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.455+0000 7fba859f6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba801078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.455+0000 7fba859f6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba801078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44168/0 (socket says 172.21.15.63:44168) 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.455+0000 7fba859f6640 1 -- 172.21.15.63:0/2462690762 learned_addr learned my addr 172.21.15.63:0/2462690762 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:07.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.456+0000 7fba859f6640 1 -- 172.21.15.63:0/2462690762 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba801086b0 con 0x7fba801074b0 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.456+0000 7fba859f6640 1 --2- 172.21.15.63:0/2462690762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba801078b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009820 tx=0x7fba7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d82416a2f2358c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.456+0000 7fba849f4640 1 -- 172.21.15.63:0/2462690762 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7c037070 con 0x7fba801074b0 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.456+0000 7fba849f4640 1 -- 172.21.15.63:0/2462690762 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fba7c0328d0 con 0x7fba801074b0 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.456+0000 7fba849f4640 1 -- 172.21.15.63:0/2462690762 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7c0307d0 con 0x7fba801074b0 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.457+0000 7fba87c5a640 1 -- 172.21.15.63:0/2462690762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 msgr2=0x7fba801078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.457+0000 7fba87c5a640 1 --2- 172.21.15.63:0/2462690762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba801078b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009820 tx=0x7fba7c02a270 comp rx=0 tx=0).stop 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.457+0000 7fba87c5a640 1 -- 172.21.15.63:0/2462690762 shutdown_connections 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.457+0000 7fba87c5a640 1 --2- 172.21.15.63:0/2462690762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba801078b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.457+0000 7fba87c5a640 1 -- 172.21.15.63:0/2462690762 >> 172.21.15.63:0/2462690762 conn(0x7fba80102c20 msgr2=0x7fba80105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.457+0000 7fba87c5a640 1 -- 172.21.15.63:0/2462690762 shutdown_connections 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.457+0000 7fba87c5a640 1 -- 172.21.15.63:0/2462690762 wait complete. 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.458+0000 7fba87c5a640 1 Processor -- start 2024-09-16T01:14:07.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.458+0000 7fba87c5a640 1 -- start start 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.458+0000 7fba87c5a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba8019b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.458+0000 7fba87c5a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fba8010ba60 con 0x7fba801074b0 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.458+0000 7fba859f6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba8019b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.458+0000 7fba859f6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba8019b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44176/0 (socket says 172.21.15.63:44176) 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.458+0000 7fba859f6640 1 -- 172.21.15.63:0/3003265841 learned_addr learned my addr 172.21.15.63:0/3003265841 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.458+0000 7fba859f6640 1 -- 172.21.15.63:0/3003265841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8019bc90 con 0x7fba801074b0 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.458+0000 7fba859f6640 1 --2- 172.21.15.63:0/3003265841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba8019b750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009940 tx=0x7fba7c032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.459+0000 7fba72ffd640 1 -- 172.21.15.63:0/3003265841 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7c042070 con 0x7fba801074b0 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.459+0000 7fba72ffd640 1 -- 172.21.15.63:0/3003265841 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fba7c030c80 con 0x7fba801074b0 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.459+0000 7fba87c5a640 1 -- 172.21.15.63:0/3003265841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8019bf20 con 0x7fba801074b0 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.459+0000 7fba72ffd640 1 -- 172.21.15.63:0/3003265841 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7c037040 con 0x7fba801074b0 2024-09-16T01:14:07.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.459+0000 7fba87c5a640 1 -- 172.21.15.63:0/3003265841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8019ec10 con 0x7fba801074b0 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.460+0000 7fba72ffd640 1 -- 172.21.15.63:0/3003265841 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fba7c045070 con 0x7fba801074b0 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.460+0000 7fba87c5a640 1 -- 172.21.15.63:0/3003265841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8010bbe0 con 0x7fba801074b0 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.460+0000 7fba72ffd640 1 --2- 172.21.15.63:0/3003265841 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fba6c039160 0x7fba6c03b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.460+0000 7fba72ffd640 1 -- 172.21.15.63:0/3003265841 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fba7c06c060 con 0x7fba801074b0 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.460+0000 7fba851f5640 1 --2- 172.21.15.63:0/3003265841 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fba6c039160 0x7fba6c03b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.460+0000 7fba851f5640 1 --2- 172.21.15.63:0/3003265841 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fba6c039160 0x7fba6c03b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fba740098c0 tx=0x7fba74006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.465+0000 7fba72ffd640 1 -- 172.21.15.63:0/3003265841 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba7c045360 con 0x7fba801074b0 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.642+0000 7fba87c5a640 1 -- 172.21.15.63:0/3003265841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fba80107930 con 0x7fba801074b0 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.643+0000 7fba72ffd640 1 -- 172.21.15.63:0/3003265841 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fba7c03c5f0 con 0x7fba801074b0 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.645+0000 7fba87c5a640 1 -- 172.21.15.63:0/3003265841 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fba6c039160 msgr2=0x7fba6c03b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.645+0000 7fba87c5a640 1 --2- 172.21.15.63:0/3003265841 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fba6c039160 0x7fba6c03b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fba740098c0 tx=0x7fba74006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.645+0000 7fba87c5a640 1 -- 172.21.15.63:0/3003265841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 msgr2=0x7fba8019b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:07.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.645+0000 7fba87c5a640 1 --2- 172.21.15.63:0/3003265841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba8019b750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009940 tx=0x7fba7c032e10 comp rx=0 tx=0).stop 2024-09-16T01:14:07.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.645+0000 7fba87c5a640 1 -- 172.21.15.63:0/3003265841 shutdown_connections 2024-09-16T01:14:07.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.645+0000 7fba87c5a640 1 --2- 172.21.15.63:0/3003265841 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fba6c039160 0x7fba6c03b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:07.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.646+0000 7fba87c5a640 1 --2- 172.21.15.63:0/3003265841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba801074b0 0x7fba8019b750 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:07.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.646+0000 7fba87c5a640 1 -- 172.21.15.63:0/3003265841 >> 172.21.15.63:0/3003265841 conn(0x7fba80102c20 msgr2=0x7fba80103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:07.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.646+0000 7fba87c5a640 1 -- 172.21.15.63:0/3003265841 shutdown_connections 2024-09-16T01:14:07.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:06.646+0000 7fba87c5a640 1 -- 172.21.15.63:0/3003265841 wait complete. 2024-09-16T01:14:07.219 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling cephadm module... 2024-09-16T01:14:08.130 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:07 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1431414643' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-16T01:14:08.130 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:07 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:08.130 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:07 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:08.130 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:08.068+0000 7fc1f3844040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:14:08.130 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:08.127+0000 7fc1f3844040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:14:08.485 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:08.284+0000 7fc1f3844040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:14:08.485 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:08.353+0000 7fc1f3844040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.637+0000 7f62f7643640 1 Processor -- start 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.637+0000 7f62f7643640 1 -- start start 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.637+0000 7f62f7643640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f0107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.637+0000 7f62f7643640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f62f0107ee0 con 0x7f62f0107510 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.637+0000 7f62f53df640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f0107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.637+0000 7f62f53df640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f0107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44188/0 (socket says 172.21.15.63:44188) 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.637+0000 7f62f53df640 1 -- 172.21.15.63:0/1612321707 learned_addr learned my addr 172.21.15.63:0/1612321707 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.638+0000 7f62f53df640 1 -- 172.21.15.63:0/1612321707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f01086c0 con 0x7f62f0107510 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.638+0000 7f62f53df640 1 --2- 172.21.15.63:0/1612321707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f0107910 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009820 tx=0x7f62ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570d533efb74ad1a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.639+0000 7f62e7fff640 1 -- 172.21.15.63:0/1612321707 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62ec037070 con 0x7f62f0107510 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.639+0000 7f62e7fff640 1 -- 172.21.15.63:0/1612321707 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f62ec0328d0 con 0x7f62f0107510 2024-09-16T01:14:08.493 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.639+0000 7f62e7fff640 1 -- 172.21.15.63:0/1612321707 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62ec0307d0 con 0x7f62f0107510 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.639+0000 7f62f7643640 1 -- 172.21.15.63:0/1612321707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 msgr2=0x7f62f0107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.639+0000 7f62f7643640 1 --2- 172.21.15.63:0/1612321707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f0107910 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009820 tx=0x7f62ec02a270 comp rx=0 tx=0).stop 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.639+0000 7f62f7643640 1 -- 172.21.15.63:0/1612321707 shutdown_connections 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.639+0000 7f62f7643640 1 --2- 172.21.15.63:0/1612321707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f0107910 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.639+0000 7f62f7643640 1 -- 172.21.15.63:0/1612321707 >> 172.21.15.63:0/1612321707 conn(0x7f62f0102ca0 msgr2=0x7f62f01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.639+0000 7f62f7643640 1 -- 172.21.15.63:0/1612321707 shutdown_connections 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.640+0000 7f62f7643640 1 -- 172.21.15.63:0/1612321707 wait complete. 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.640+0000 7f62f7643640 1 Processor -- start 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.640+0000 7f62f7643640 1 -- start start 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.640+0000 7f62f7643640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f007db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.640+0000 7f62f7643640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f62f010ba70 con 0x7f62f0107510 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.641+0000 7f62f53df640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f007db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.641+0000 7f62f53df640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f007db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44196/0 (socket says 172.21.15.63:44196) 2024-09-16T01:14:08.494 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.641+0000 7f62f53df640 1 -- 172.21.15.63:0/1431414643 learned_addr learned my addr 172.21.15.63:0/1431414643 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.641+0000 7f62f53df640 1 -- 172.21.15.63:0/1431414643 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f007e090 con 0x7f62f0107510 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.641+0000 7f62f53df640 1 --2- 172.21.15.63:0/1431414643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f007db50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0097f0 tx=0x7f62ec030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.641+0000 7f62e67fc640 1 -- 172.21.15.63:0/1431414643 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62ec037040 con 0x7f62f0107510 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.641+0000 7f62e67fc640 1 -- 172.21.15.63:0/1431414643 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f62ec032bb0 con 0x7f62f0107510 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.641+0000 7f62f7643640 1 -- 172.21.15.63:0/1431414643 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f007c280 con 0x7f62f0107510 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.641+0000 7f62e67fc640 1 -- 172.21.15.63:0/1431414643 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62ec03a390 con 0x7f62f0107510 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.641+0000 7f62f7643640 1 -- 172.21.15.63:0/1431414643 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f007c7c0 con 0x7f62f0107510 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.642+0000 7f62e67fc640 1 -- 172.21.15.63:0/1431414643 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f62ec03a580 con 0x7f62f0107510 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.643+0000 7f62f7643640 1 -- 172.21.15.63:0/1431414643 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f010bbf0 con 0x7f62f0107510 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.643+0000 7f62e67fc640 1 --2- 172.21.15.63:0/1431414643 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f62dc0391b0 0x7f62dc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.643+0000 7f62e67fc640 1 -- 172.21.15.63:0/1431414643 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f62ec06c620 con 0x7f62f0107510 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.643+0000 7f62f4bde640 1 --2- 172.21.15.63:0/1431414643 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f62dc0391b0 0x7f62dc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.643+0000 7f62f4bde640 1 --2- 172.21.15.63:0/1431414643 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f62dc0391b0 0x7f62dc03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62e00098c0 tx=0x7f62e0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:08.495 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.648+0000 7f62e67fc640 1 -- 172.21.15.63:0/1431414643 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62ec032dd0 con 0x7f62f0107510 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.874+0000 7f62f7643640 1 -- 172.21.15.63:0/1431414643 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f62f0104110 con 0x7f62f0107510 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.925+0000 7f62e67fc640 1 -- 172.21.15.63:0/1431414643 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f62ec031560 con 0x7f62f0107510 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.927+0000 7f62e67fc640 1 -- 172.21.15.63:0/1431414643 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f62ec042c20 con 0x7f62f0107510 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.928+0000 7f62f7643640 1 -- 172.21.15.63:0/1431414643 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f62dc0391b0 msgr2=0x7f62dc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.928+0000 7f62f7643640 1 --2- 172.21.15.63:0/1431414643 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f62dc0391b0 0x7f62dc03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62e00098c0 tx=0x7f62e0006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.928+0000 7f62f7643640 1 -- 172.21.15.63:0/1431414643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 msgr2=0x7f62f007db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.928+0000 7f62f7643640 1 --2- 172.21.15.63:0/1431414643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f007db50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0097f0 tx=0x7f62ec030d00 comp rx=0 tx=0).stop 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.928+0000 7f62f7643640 1 -- 172.21.15.63:0/1431414643 shutdown_connections 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.928+0000 7f62f7643640 1 --2- 172.21.15.63:0/1431414643 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f62dc0391b0 0x7f62dc03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.928+0000 7f62f7643640 1 --2- 172.21.15.63:0/1431414643 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f62f0107510 0x7f62f007db50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.928+0000 7f62f7643640 1 -- 172.21.15.63:0/1431414643 >> 172.21.15.63:0/1431414643 conn(0x7f62f0102ca0 msgr2=0x7f62f01037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:08.496 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.928+0000 7f62f7643640 1 -- 172.21.15.63:0/1431414643 shutdown_connections 2024-09-16T01:14:08.497 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:07.928+0000 7f62f7643640 1 -- 172.21.15.63:0/1431414643 wait complete. 2024-09-16T01:14:08.770 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:08.510+0000 7fc1f3844040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:14:08.770 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:08.658+0000 7fc1f3844040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:14:09.057 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:08 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1431414643' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-16T01:14:09.058 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:08 smithi063 ceph-mon[31070]: mgrmap e5: x(active, since 4s) 2024-09-16T01:14:09.058 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:08.991+0000 7fc1f3844040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:14:09.058 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:09.055+0000 7fc1f3844040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:14:09.359 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:09.252+0000 7fc1f3844040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:14:09.743 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:14:09.743 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-16T01:14:09.743 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T01:14:09.743 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-16T01:14:09.743 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T01:14:09.743 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:14:09.743 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.966+0000 7f99a00e0640 1 Processor -- start 2024-09-16T01:14:09.743 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.967+0000 7f99a00e0640 1 -- start start 2024-09-16T01:14:09.743 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.967+0000 7f99a00e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f9998106780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:09.743 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.967+0000 7f99a00e0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9998106d50 con 0x7f9998106380 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.967+0000 7f999de7c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f9998106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.967+0000 7f999de7c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f9998106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52306/0 (socket says 172.21.15.63:52306) 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.967+0000 7f999de7c640 1 -- 172.21.15.63:0/1926742336 learned_addr learned my addr 172.21.15.63:0/1926742336 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.967+0000 7f999de7c640 1 -- 172.21.15.63:0/1926742336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9998107580 con 0x7f9998106380 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.968+0000 7f999de7c640 1 --2- 172.21.15.63:0/1926742336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f9998106780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9994009820 tx=0x7f999402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699adbaa452d31b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.968+0000 7f999ce7a640 1 -- 172.21.15.63:0/1926742336 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9994037070 con 0x7f9998106380 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.968+0000 7f999ce7a640 1 -- 172.21.15.63:0/1926742336 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f99940328d0 con 0x7f9998106380 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.968+0000 7f999ce7a640 1 -- 172.21.15.63:0/1926742336 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99940307d0 con 0x7f9998106380 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.969+0000 7f99a00e0640 1 -- 172.21.15.63:0/1926742336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 msgr2=0x7f9998106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.969+0000 7f99a00e0640 1 --2- 172.21.15.63:0/1926742336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f9998106780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9994009820 tx=0x7f999402a270 comp rx=0 tx=0).stop 2024-09-16T01:14:09.744 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.969+0000 7f99a00e0640 1 -- 172.21.15.63:0/1926742336 shutdown_connections 2024-09-16T01:14:09.745 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.969+0000 7f99a00e0640 1 --2- 172.21.15.63:0/1926742336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f9998106780 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:09.745 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.969+0000 7f99a00e0640 1 -- 172.21.15.63:0/1926742336 >> 172.21.15.63:0/1926742336 conn(0x7f9998101b10 msgr2=0x7f9998103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:09.745 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.969+0000 7f99a00e0640 1 -- 172.21.15.63:0/1926742336 shutdown_connections 2024-09-16T01:14:09.745 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.969+0000 7f99a00e0640 1 -- 172.21.15.63:0/1926742336 wait complete. 2024-09-16T01:14:09.745 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.970+0000 7f99a00e0640 1 Processor -- start 2024-09-16T01:14:09.745 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.970+0000 7f99a00e0640 1 -- start start 2024-09-16T01:14:09.746 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.970+0000 7f99a00e0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f99981915b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:09.746 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.970+0000 7f99a00e0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f999810a930 con 0x7f9998106380 2024-09-16T01:14:09.746 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.970+0000 7f999de7c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f99981915b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:09.746 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.970+0000 7f999de7c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f99981915b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52320/0 (socket says 172.21.15.63:52320) 2024-09-16T01:14:09.746 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.970+0000 7f999de7c640 1 -- 172.21.15.63:0/672752948 learned_addr learned my addr 172.21.15.63:0/672752948 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:09.747 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.970+0000 7f999de7c640 1 -- 172.21.15.63:0/672752948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9998191af0 con 0x7f9998106380 2024-09-16T01:14:09.747 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.971+0000 7f999de7c640 1 --2- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f99981915b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9994030520 tx=0x7f9994032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:09.747 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.971+0000 7f998effd640 1 -- 172.21.15.63:0/672752948 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9994042070 con 0x7f9998106380 2024-09-16T01:14:09.747 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.971+0000 7f998effd640 1 -- 172.21.15.63:0/672752948 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9994030cc0 con 0x7f9998106380 2024-09-16T01:14:09.747 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.971+0000 7f998effd640 1 -- 172.21.15.63:0/672752948 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9994037040 con 0x7f9998106380 2024-09-16T01:14:09.748 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.971+0000 7f99a00e0640 1 -- 172.21.15.63:0/672752948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999818fce0 con 0x7f9998106380 2024-09-16T01:14:09.748 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.971+0000 7f99a00e0640 1 -- 172.21.15.63:0/672752948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9998190220 con 0x7f9998106380 2024-09-16T01:14:09.748 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.972+0000 7f998effd640 1 -- 172.21.15.63:0/672752948 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f9994045070 con 0x7f9998106380 2024-09-16T01:14:09.748 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.972+0000 7f99a00e0640 1 -- 172.21.15.63:0/672752948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999810aab0 con 0x7f9998106380 2024-09-16T01:14:09.748 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.972+0000 7f998effd640 1 --2- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f9984039200 0x7f998403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:09.749 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.972+0000 7f998effd640 1 -- 172.21.15.63:0/672752948 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f999406cd70 con 0x7f9998106380 2024-09-16T01:14:09.749 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.972+0000 7f999d67b640 1 -- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f9984039200 msgr2=0x7f998403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/843312492 2024-09-16T01:14:09.749 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.972+0000 7f999d67b640 1 --2- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f9984039200 0x7f998403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:14:09.749 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:08.977+0000 7f998effd640 1 -- 172.21.15.63:0/672752948 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9994045360 con 0x7f9998106380 2024-09-16T01:14:09.749 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.173+0000 7f999d67b640 1 -- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f9984039200 msgr2=0x7f998403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/843312492 2024-09-16T01:14:09.750 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.173+0000 7f999d67b640 1 --2- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f9984039200 0x7f998403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:14:09.750 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.203+0000 7f99a00e0640 1 -- 172.21.15.63:0/672752948 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f9998075d10 con 0x7f9998106380 2024-09-16T01:14:09.750 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.204+0000 7f998effd640 1 -- 172.21.15.63:0/672752948 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f9998075d10 con 0x7f9998106380 2024-09-16T01:14:09.750 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.206+0000 7f99a00e0640 1 -- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f9984039200 msgr2=0x7f998403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:14:09.750 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.206+0000 7f99a00e0640 1 --2- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f9984039200 0x7f998403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:09.751 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.206+0000 7f99a00e0640 1 -- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 msgr2=0x7f99981915b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:09.751 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.206+0000 7f99a00e0640 1 --2- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f99981915b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9994030520 tx=0x7f9994032dd0 comp rx=0 tx=0).stop 2024-09-16T01:14:09.751 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.206+0000 7f99a00e0640 1 -- 172.21.15.63:0/672752948 shutdown_connections 2024-09-16T01:14:09.751 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.206+0000 7f99a00e0640 1 --2- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7f9984039200 0x7f998403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:09.751 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.206+0000 7f99a00e0640 1 --2- 172.21.15.63:0/672752948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9998106380 0x7f99981915b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:09.752 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.206+0000 7f99a00e0640 1 -- 172.21.15.63:0/672752948 >> 172.21.15.63:0/672752948 conn(0x7f9998101b10 msgr2=0x7f9998102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:09.752 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.206+0000 7f99a00e0640 1 -- 172.21.15.63:0/672752948 shutdown_connections 2024-09-16T01:14:09.752 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:09.206+0000 7f99a00e0640 1 -- 172.21.15.63:0/672752948 wait complete. 2024-09-16T01:14:09.752 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for the mgr to restart... 2024-09-16T01:14:09.752 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr epoch 5... 2024-09-16T01:14:10.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:09 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/672752948' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T01:14:10.609 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:10 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:10.201+0000 7fc1f3844040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:14:10.609 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:10 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:10.271+0000 7fc1f3844040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:14:11.294 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:11.021+0000 7fc1f3844040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:14:11.294 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:11.142+0000 7fc1f3844040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:14:11.544 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:11.292+0000 7fc1f3844040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:14:11.544 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:11.356+0000 7fc1f3844040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:14:11.544 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:11.512+0000 7fc1f3844040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:14:11.814 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:11.583+0000 7fc1f3844040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:14:11.814 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:11.646+0000 7fc1f3844040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:14:11.814 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:11.812+0000 7fc1f3844040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:14:12.100 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:11.880+0000 7fc1f3844040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:14:12.100 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:11.949+0000 7fc1f3844040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:14:12.101 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:12.036+0000 7fc1f3844040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:14:12.101 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:12.098+0000 7fc1f3844040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:14:12.359 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:12.160+0000 7fc1f3844040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:14:13.329 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:12.992+0000 7fc1f3844040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:14:13.329 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: Active manager daemon x restarted 2024-09-16T01:14:13.329 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: Activating manager daemon x 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: osdmap e2: 0 total, 0 up, 0 in 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: mgrmap e6: x(active, starting, since 0.00413002s) 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: Manager daemon x is now available 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:14:13.330 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:14:13.331 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T01:14:13.331 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:13 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T01:14:14.300 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:14 smithi063 ceph-mon[31070]: Found migration_current of "None". Setting to last migration. 2024-09-16T01:14:14.300 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:14 smithi063 ceph-mon[31070]: mgrmap e7: x(active, since 1.00582s) 2024-09-16T01:14:14.568 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:14:14.568 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-16T01:14:14.568 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T01:14:14.568 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:14:14.568 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.134+0000 7fcd0d926640 1 Processor -- start 2024-09-16T01:14:14.568 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.134+0000 7fcd0d926640 1 -- start start 2024-09-16T01:14:14.568 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.134+0000 7fcd0d926640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd08106780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:14.568 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.134+0000 7fcd0d926640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcd08106d50 con 0x7fcd08106380 2024-09-16T01:14:14.569 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.134+0000 7fcd06ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd08106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:14.569 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.134+0000 7fcd06ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd08106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52334/0 (socket says 172.21.15.63:52334) 2024-09-16T01:14:14.569 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.134+0000 7fcd06ffd640 1 -- 172.21.15.63:0/641534463 learned_addr learned my addr 172.21.15.63:0/641534463 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:14.569 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.135+0000 7fcd06ffd640 1 -- 172.21.15.63:0/641534463 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd08107580 con 0x7fcd08106380 2024-09-16T01:14:14.569 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.135+0000 7fcd06ffd640 1 --2- 172.21.15.63:0/641534463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd08106780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009820 tx=0x7fccf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8c4101cfd13dba server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:14.569 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.135+0000 7fcd05ffb640 1 -- 172.21.15.63:0/641534463 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccf8037070 con 0x7fcd08106380 2024-09-16T01:14:14.569 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.135+0000 7fcd05ffb640 1 -- 172.21.15.63:0/641534463 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fccf80328d0 con 0x7fcd08106380 2024-09-16T01:14:14.569 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.136+0000 7fcd05ffb640 1 -- 172.21.15.63:0/641534463 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccf80307d0 con 0x7fcd08106380 2024-09-16T01:14:14.569 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.136+0000 7fcd0d926640 1 -- 172.21.15.63:0/641534463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 msgr2=0x7fcd08106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.136+0000 7fcd0d926640 1 --2- 172.21.15.63:0/641534463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd08106780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009820 tx=0x7fccf802a270 comp rx=0 tx=0).stop 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.136+0000 7fcd0d926640 1 -- 172.21.15.63:0/641534463 shutdown_connections 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.136+0000 7fcd0d926640 1 --2- 172.21.15.63:0/641534463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd08106780 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.136+0000 7fcd0d926640 1 -- 172.21.15.63:0/641534463 >> 172.21.15.63:0/641534463 conn(0x7fcd08101b10 msgr2=0x7fcd08103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.136+0000 7fcd0d926640 1 -- 172.21.15.63:0/641534463 shutdown_connections 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.136+0000 7fcd0d926640 1 -- 172.21.15.63:0/641534463 wait complete. 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.137+0000 7fcd0d926640 1 Processor -- start 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.137+0000 7fcd0d926640 1 -- start start 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.137+0000 7fcd0d926640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd0819b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.137+0000 7fcd0d926640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0810a930 con 0x7fcd08106380 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.137+0000 7fcd06ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd0819b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.137+0000 7fcd06ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd0819b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52342/0 (socket says 172.21.15.63:52342) 2024-09-16T01:14:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.137+0000 7fcd06ffd640 1 -- 172.21.15.63:0/1844102837 learned_addr learned my addr 172.21.15.63:0/1844102837 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.138+0000 7fcd06ffd640 1 -- 172.21.15.63:0/1844102837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0819bcf0 con 0x7fcd08106380 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.138+0000 7fcd06ffd640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd0819b7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fccf8030520 tx=0x7fccf8032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.138+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccf8042070 con 0x7fcd08106380 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.138+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fccf8030cc0 con 0x7fcd08106380 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.138+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccf8037040 con 0x7fcd08106380 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.138+0000 7fcd0d926640 1 -- 172.21.15.63:0/1844102837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0819bf80 con 0x7fcd08106380 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.138+0000 7fcd0d926640 1 -- 172.21.15.63:0/1844102837 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0819ec70 con 0x7fcd08106380 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.139+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fccf8045070 con 0x7fcd08106380 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.139+0000 7fcd0c924640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 0x7fccf403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.139+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 --> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fccf403bdd0 con 0x7fccf4039200 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.139+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fccf806c470 con 0x7fcd08106380 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.139+0000 7fcd067fc640 1 -- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 msgr2=0x7fccf403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/843312492 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.139+0000 7fcd067fc640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 0x7fccf403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:14:14.571 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.340+0000 7fcd067fc640 1 -- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 msgr2=0x7fccf403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/843312492 2024-09-16T01:14:14.572 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.340+0000 7fcd067fc640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 0x7fccf403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:14:14.572 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.741+0000 7fcd067fc640 1 -- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 msgr2=0x7fccf403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/843312492 2024-09-16T01:14:14.572 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:10.741+0000 7fcd067fc640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 0x7fccf403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T01:14:14.572 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:11.542+0000 7fcd067fc640 1 -- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 msgr2=0x7fccf403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/843312492 2024-09-16T01:14:14.572 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:11.542+0000 7fcd067fc640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 0x7fccf403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T01:14:14.572 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:12.996+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fccf806af30 con 0x7fcd08106380 2024-09-16T01:14:14.572 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:12.996+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 msgr2=0x7fccf403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:14:14.572 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:12.996+0000 7fcd0c924640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 0x7fccf403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.572 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:13.997+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fccf803c5a0 con 0x7fcd08106380 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:13.997+0000 7fcd0c924640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fccf403cb30 0x7fccf403ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:13.997+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 --> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fccf802fec0 con 0x7fccf403cb30 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:13.998+0000 7fcd067fc640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fccf403cb30 0x7fccf403ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:13.999+0000 7fcd067fc640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fccf403cb30 0x7fccf403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fccf0003980 tx=0x7fccf00092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:13.999+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 <== mgr.14118 v2:172.21.15.63:6800/1469009490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fccf802fec0 con 0x7fccf403cb30 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.006+0000 7fcd0d926640 1 -- 172.21.15.63:0/1844102837 --> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fcd0810aab0 con 0x7fccf403cb30 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0c924640 1 -- 172.21.15.63:0/1844102837 <== mgr.14118 v2:172.21.15.63:6800/1469009490 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fcd0810aab0 con 0x7fccf403cb30 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 -- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fccf403cb30 msgr2=0x7fccf403ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fccf403cb30 0x7fccf403ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fccf0003980 tx=0x7fccf00092b0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 -- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 msgr2=0x7fcd0819b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:14.573 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd0819b7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fccf8030520 tx=0x7fccf8032dd0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.574 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 -- 172.21.15.63:0/1844102837 shutdown_connections 2024-09-16T01:14:14.574 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fccf403cb30 0x7fccf403ef20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.574 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:6800/843312492,v1:172.21.15.63:6801/843312492] conn(0x7fccf4039200 0x7fccf403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.574 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 --2- 172.21.15.63:0/1844102837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd08106380 0x7fcd0819b7b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:14.574 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 -- 172.21.15.63:0/1844102837 >> 172.21.15.63:0/1844102837 conn(0x7fcd08101b10 msgr2=0x7fcd08102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:14.574 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 -- 172.21.15.63:0/1844102837 shutdown_connections 2024-09-16T01:14:14.574 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.007+0000 7fcd0d926640 1 -- 172.21.15.63:0/1844102837 wait complete. 2024-09-16T01:14:14.574 INFO:teuthology.orchestra.run.smithi063.stdout:mgr epoch 5 is available 2024-09-16T01:14:14.574 INFO:teuthology.orchestra.run.smithi063.stdout:Setting orchestrator backend to cephadm... 2024-09-16T01:14:15.439 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:15 smithi063 ceph-mon[31070]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T01:14:15.439 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:15 smithi063 ceph-mon[31070]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T01:14:15.439 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:15 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:15.439 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:15 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:15.439 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:15 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:15.439 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:15 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:14:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.939+0000 7fb9ff13a640 1 Processor -- start 2024-09-16T01:14:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.939+0000 7fb9ff13a640 1 -- start start 2024-09-16T01:14:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.939+0000 7fb9ff13a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f810a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.939+0000 7fb9ff13a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f807be10 con 0x7fb9f8107f70 2024-09-16T01:14:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.940+0000 7fb9fced6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f810a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.940+0000 7fb9fced6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f810a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52396/0 (socket says 172.21.15.63:52396) 2024-09-16T01:14:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.940+0000 7fb9fced6640 1 -- 172.21.15.63:0/1086216291 learned_addr learned my addr 172.21.15.63:0/1086216291 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.940+0000 7fb9fced6640 1 -- 172.21.15.63:0/1086216291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f810a8a0 con 0x7fb9f8107f70 2024-09-16T01:14:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9fced6640 1 --2- 172.21.15.63:0/1086216291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f810a360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009820 tx=0x7fb9ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0511a20780c209 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9f77fe640 1 -- 172.21.15.63:0/1086216291 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ec037070 con 0x7fb9f8107f70 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9f77fe640 1 -- 172.21.15.63:0/1086216291 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb9ec0328d0 con 0x7fb9f8107f70 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9f77fe640 1 -- 172.21.15.63:0/1086216291 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ec0307d0 con 0x7fb9f8107f70 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9ff13a640 1 -- 172.21.15.63:0/1086216291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 msgr2=0x7fb9f810a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9ff13a640 1 --2- 172.21.15.63:0/1086216291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f810a360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009820 tx=0x7fb9ec02a270 comp rx=0 tx=0).stop 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9ff13a640 1 -- 172.21.15.63:0/1086216291 shutdown_connections 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9ff13a640 1 --2- 172.21.15.63:0/1086216291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f810a360 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9ff13a640 1 -- 172.21.15.63:0/1086216291 >> 172.21.15.63:0/1086216291 conn(0x7fb9f8101b10 msgr2=0x7fb9f8103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9ff13a640 1 -- 172.21.15.63:0/1086216291 shutdown_connections 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.941+0000 7fb9ff13a640 1 -- 172.21.15.63:0/1086216291 wait complete. 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.942+0000 7fb9ff13a640 1 Processor -- start 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.942+0000 7fb9ff13a640 1 -- start start 2024-09-16T01:14:15.706 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.942+0000 7fb9ff13a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.942+0000 7fb9ff13a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f810b820 con 0x7fb9f8107f70 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.942+0000 7fb9fced6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.942+0000 7fb9fced6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f819b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52408/0 (socket says 172.21.15.63:52408) 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.942+0000 7fb9fced6640 1 -- 172.21.15.63:0/2053154278 learned_addr learned my addr 172.21.15.63:0/2053154278 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.943+0000 7fb9fced6640 1 -- 172.21.15.63:0/2053154278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f819bcb0 con 0x7fb9f8107f70 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.943+0000 7fb9fced6640 1 --2- 172.21.15.63:0/2053154278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f819b770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec030520 tx=0x7fb9ec032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.943+0000 7fb9f5ffb640 1 -- 172.21.15.63:0/2053154278 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ec042070 con 0x7fb9f8107f70 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.943+0000 7fb9f5ffb640 1 -- 172.21.15.63:0/2053154278 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fb9ec030cc0 con 0x7fb9f8107f70 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.943+0000 7fb9f5ffb640 1 -- 172.21.15.63:0/2053154278 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ec037040 con 0x7fb9f8107f70 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.943+0000 7fb9ff13a640 1 -- 172.21.15.63:0/2053154278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f819bf40 con 0x7fb9f8107f70 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.943+0000 7fb9ff13a640 1 -- 172.21.15.63:0/2053154278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f819ec30 con 0x7fb9f8107f70 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.944+0000 7fb9f5ffb640 1 -- 172.21.15.63:0/2053154278 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fb9ec045070 con 0x7fb9f8107f70 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.944+0000 7fb9f5ffb640 1 --2- 172.21.15.63:0/2053154278 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fb9e80390f0 0x7fb9e803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:15.707 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.944+0000 7fb9f5ffb640 1 -- 172.21.15.63:0/2053154278 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb9ec06c0a0 con 0x7fb9f8107f70 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.944+0000 7fb9ff13a640 1 -- 172.21.15.63:0/2053154278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f81083d0 con 0x7fb9f8107f70 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.944+0000 7fb9f7fff640 1 --2- 172.21.15.63:0/2053154278 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fb9e80390f0 0x7fb9e803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.945+0000 7fb9f7fff640 1 --2- 172.21.15.63:0/2053154278 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fb9e80390f0 0x7fb9e803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40098c0 tx=0x7fb9e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:14.949+0000 7fb9f5ffb640 1 -- 172.21.15.63:0/2053154278 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9ec045360 con 0x7fb9f8107f70 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.141+0000 7fb9ff13a640 1 -- 172.21.15.63:0/2053154278 --> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fb9f8062630 con 0x7fb9e80390f0 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.147+0000 7fb9f5ffb640 1 -- 172.21.15.63:0/2053154278 <== mgr.14118 v2:172.21.15.63:6800/1469009490 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb9f8062630 con 0x7fb9e80390f0 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.149+0000 7fb9ff13a640 1 -- 172.21.15.63:0/2053154278 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fb9e80390f0 msgr2=0x7fb9e803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.149+0000 7fb9ff13a640 1 --2- 172.21.15.63:0/2053154278 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fb9e80390f0 0x7fb9e803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40098c0 tx=0x7fb9e4006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.149+0000 7fb9ff13a640 1 -- 172.21.15.63:0/2053154278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 msgr2=0x7fb9f819b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.149+0000 7fb9ff13a640 1 --2- 172.21.15.63:0/2053154278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f819b770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec030520 tx=0x7fb9ec032dd0 comp rx=0 tx=0).stop 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.149+0000 7fb9ff13a640 1 -- 172.21.15.63:0/2053154278 shutdown_connections 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.149+0000 7fb9ff13a640 1 --2- 172.21.15.63:0/2053154278 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fb9e80390f0 0x7fb9e803b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.149+0000 7fb9ff13a640 1 --2- 172.21.15.63:0/2053154278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f8107f70 0x7fb9f819b770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:15.708 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.149+0000 7fb9ff13a640 1 -- 172.21.15.63:0/2053154278 >> 172.21.15.63:0/2053154278 conn(0x7fb9f8101b10 msgr2=0x7fb9f8102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:15.709 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.149+0000 7fb9ff13a640 1 -- 172.21.15.63:0/2053154278 shutdown_connections 2024-09-16T01:14:15.709 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:15.149+0000 7fb9ff13a640 1 -- 172.21.15.63:0/2053154278 wait complete. 2024-09-16T01:14:16.578 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-mon[31070]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:16.578 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-mon[31070]: mgrmap e8: x(active, since 2s) 2024-09-16T01:14:16.578 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:16.455+0000 7fc160369640 -1 log_channel(cephadm) log [ERR] : [16/Sep/2024:01:14:16] ENGINE Error in HTTPServer.serve 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: Traceback (most recent call last): 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: self._connections.run(self.expiration_interval) 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: self._run(expiration_interval) 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: s = self.context.wrap_socket( 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:14:16.579 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: return self.sslsocket_class._create( 2024-09-16T01:14:16.580 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:14:16.580 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: self.do_handshake() 2024-09-16T01:14:16.580 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:14:16.580 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: self._sslobj.do_handshake() 2024-09-16T01:14:16.580 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:14:16.580 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:16 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:16.820 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-16T01:14:16.820 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.094+0000 7f203fec1640 1 Processor -- start 2024-09-16T01:14:16.820 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.094+0000 7f203fec1640 1 -- start start 2024-09-16T01:14:16.820 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.094+0000 7f203fec1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2038106380 0x7f2038106780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:16.820 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.094+0000 7f203fec1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2038106d50 con 0x7f2038106380 2024-09-16T01:14:16.820 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.094+0000 7f203dc5d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2038106380 0x7f2038106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:16.820 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.094+0000 7f203dc5d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2038106380 0x7f2038106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52414/0 (socket says 172.21.15.63:52414) 2024-09-16T01:14:16.820 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.094+0000 7f203dc5d640 1 -- 172.21.15.63:0/886188445 learned_addr learned my addr 172.21.15.63:0/886188445 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:16.820 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.095+0000 7f203dc5d640 1 -- 172.21.15.63:0/886188445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2038107580 con 0x7f2038106380 2024-09-16T01:14:16.820 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.095+0000 7f203dc5d640 1 --2- 172.21.15.63:0/886188445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2038106380 0x7f2038106780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2034009820 tx=0x7f203402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f8e269dfd0cb94 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.095+0000 7f203cc5b640 1 -- 172.21.15.63:0/886188445 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2034037070 con 0x7f2038106380 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.096+0000 7f203cc5b640 1 -- 172.21.15.63:0/886188445 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f20340328d0 con 0x7f2038106380 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.096+0000 7f203cc5b640 1 -- 172.21.15.63:0/886188445 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20340307d0 con 0x7f2038106380 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.096+0000 7f203fec1640 1 -- 172.21.15.63:0/886188445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2038106380 msgr2=0x7f2038106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.096+0000 7f203fec1640 1 --2- 172.21.15.63:0/886188445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2038106380 0x7f2038106780 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2034009820 tx=0x7f203402a270 comp rx=0 tx=0).stop 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.096+0000 7f203fec1640 1 -- 172.21.15.63:0/886188445 shutdown_connections 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.096+0000 7f203fec1640 1 --2- 172.21.15.63:0/886188445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2038106380 0x7f2038106780 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.096+0000 7f203fec1640 1 -- 172.21.15.63:0/886188445 >> 172.21.15.63:0/886188445 conn(0x7f2038101b10 msgr2=0x7f2038103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.096+0000 7f203fec1640 1 -- 172.21.15.63:0/886188445 shutdown_connections 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.096+0000 7f203fec1640 1 -- 172.21.15.63:0/886188445 wait complete. 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.097+0000 7f203fec1640 1 Processor -- start 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.097+0000 7f203fec1640 1 -- start start 2024-09-16T01:14:16.821 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.097+0000 7f203fec1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203819a8e0 0x7f203819ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.097+0000 7f203fec1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f203810a930 con 0x7f203819a8e0 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.098+0000 7f203dc5d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203819a8e0 0x7f203819ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.098+0000 7f203dc5d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203819a8e0 0x7f203819ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52428/0 (socket says 172.21.15.63:52428) 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.098+0000 7f203dc5d640 1 -- 172.21.15.63:0/2018345587 learned_addr learned my addr 172.21.15.63:0/2018345587 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.098+0000 7f203dc5d640 1 -- 172.21.15.63:0/2018345587 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203819b240 con 0x7f203819a8e0 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.098+0000 7f203dc5d640 1 --2- 172.21.15.63:0/2018345587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203819a8e0 0x7f203819ad00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2034009940 tx=0x7f2034032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.098+0000 7f202effd640 1 -- 172.21.15.63:0/2018345587 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2034037050 con 0x7f203819a8e0 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.098+0000 7f202effd640 1 -- 172.21.15.63:0/2018345587 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f2034043070 con 0x7f203819a8e0 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.098+0000 7f203fec1640 1 -- 172.21.15.63:0/2018345587 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203819b4d0 con 0x7f203819a8e0 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.098+0000 7f203fec1640 1 -- 172.21.15.63:0/2018345587 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203819dfb0 con 0x7f203819a8e0 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.098+0000 7f202effd640 1 -- 172.21.15.63:0/2018345587 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f203403c590 con 0x7f203819a8e0 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.099+0000 7f202effd640 1 -- 172.21.15.63:0/2018345587 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f203403c840 con 0x7f203819a8e0 2024-09-16T01:14:16.822 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.099+0000 7f203fec1640 1 -- 172.21.15.63:0/2018345587 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f203810aab0 con 0x7f203819a8e0 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.100+0000 7f202effd640 1 --2- 172.21.15.63:0/2018345587 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f20240391b0 0x7f202403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.100+0000 7f202effd640 1 -- 172.21.15.63:0/2018345587 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f203406d0b0 con 0x7f203819a8e0 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.100+0000 7f203d45c640 1 --2- 172.21.15.63:0/2018345587 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f20240391b0 0x7f202403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.100+0000 7f203d45c640 1 --2- 172.21.15.63:0/2018345587 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f20240391b0 0x7f202403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20280098c0 tx=0x7f2028006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.104+0000 7f202effd640 1 -- 172.21.15.63:0/2018345587 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2034047c70 con 0x7f203819a8e0 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.282+0000 7f203fec1640 1 -- 172.21.15.63:0/2018345587 --> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f203802d830 con 0x7f20240391b0 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.283+0000 7f202effd640 1 -- 172.21.15.63:0/2018345587 <== mgr.14118 v2:172.21.15.63:6800/1469009490 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f203802d830 con 0x7f20240391b0 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.286+0000 7f203fec1640 1 -- 172.21.15.63:0/2018345587 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f20240391b0 msgr2=0x7f202403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.286+0000 7f203fec1640 1 --2- 172.21.15.63:0/2018345587 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f20240391b0 0x7f202403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20280098c0 tx=0x7f2028006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.286+0000 7f203fec1640 1 -- 172.21.15.63:0/2018345587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203819a8e0 msgr2=0x7f203819ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.286+0000 7f203fec1640 1 --2- 172.21.15.63:0/2018345587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203819a8e0 0x7f203819ad00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2034009940 tx=0x7f2034032df0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.286+0000 7f203fec1640 1 -- 172.21.15.63:0/2018345587 shutdown_connections 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.286+0000 7f203fec1640 1 --2- 172.21.15.63:0/2018345587 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f20240391b0 0x7f202403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.823 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.286+0000 7f203fec1640 1 --2- 172.21.15.63:0/2018345587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f203819a8e0 0x7f203819ad00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:16.824 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.286+0000 7f203fec1640 1 -- 172.21.15.63:0/2018345587 >> 172.21.15.63:0/2018345587 conn(0x7f2038101b10 msgr2=0x7f20381028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:16.824 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.287+0000 7f203fec1640 1 -- 172.21.15.63:0/2018345587 shutdown_connections 2024-09-16T01:14:16.824 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:16.287+0000 7f203fec1640 1 -- 172.21.15.63:0/2018345587 wait complete. 2024-09-16T01:14:16.824 INFO:teuthology.orchestra.run.smithi063.stdout:Generating ssh key... 2024-09-16T01:14:17.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-mon[31070]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:17.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-mon[31070]: [16/Sep/2024:01:14:16] ENGINE Bus STARTING 2024-09-16T01:14:17.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-mon[31070]: [16/Sep/2024:01:14:16] ENGINE Serving on https://172.21.15.63:7150 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-mon[31070]: [16/Sep/2024:01:14:16] ENGINE Error in HTTPServer.serve 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: Traceback (most recent call last): 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._connections.run(self.expiration_interval) 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._run(expiration_interval) 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: s = self.context.wrap_socket( 2024-09-16T01:14:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:14:17.611 INFO:journalctl@ceph.mon.a.smithi063.stdout: return self.sslsocket_class._create( 2024-09-16T01:14:17.611 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:14:17.611 INFO:journalctl@ceph.mon.a.smithi063.stdout: self.do_handshake() 2024-09-16T01:14:17.611 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:14:17.611 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._sslobj.do_handshake() 2024-09-16T01:14:17.611 INFO:journalctl@ceph.mon.a.smithi063.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:14:17.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-mon[31070]: [16/Sep/2024:01:14:16] ENGINE Serving on http://172.21.15.63:8765 2024-09-16T01:14:17.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-mon[31070]: [16/Sep/2024:01:14:16] ENGINE Bus STARTED 2024-09-16T01:14:17.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: Generating public/private rsa key pair. 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: Your identification has been saved in /tmp/tmpgewn0646/key 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: Your public key has been saved in /tmp/tmpgewn0646/key.pub 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: The key fingerprint is: 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: SHA256:hbB9ubhs4DkCwQsaGx6yJAFD/HhjKn4fWD9D82wjdU4 ceph-c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: The key's randomart image is: 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: +---[RSA 3072]----+ 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: |B. . | 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: | = + . . | 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: |*o= . o + | 2024-09-16T01:14:18.293 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: |*B.B + . | 2024-09-16T01:14:18.294 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: |+.* ...oS..E | 2024-09-16T01:14:18.294 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: |.. .o.o+=.+ | 2024-09-16T01:14:18.294 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: |o ...+=+= . | 2024-09-16T01:14:18.294 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: | . . ..o= . | 2024-09-16T01:14:18.294 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: | . .. | 2024-09-16T01:14:18.294 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:17 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: +----[SHA256]-----+ 2024-09-16T01:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.246+0000 7fef4cfab640 1 Processor -- start 2024-09-16T01:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.246+0000 7fef4cfab640 1 -- start start 2024-09-16T01:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.246+0000 7fef4cfab640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4810b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.246+0000 7fef4cfab640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fef4810b630 con 0x7fef4810acf0 2024-09-16T01:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.246+0000 7fef4659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4810b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.246+0000 7fef4659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4810b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52430/0 (socket says 172.21.15.63:52430) 2024-09-16T01:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.247+0000 7fef4659c640 1 -- 172.21.15.63:0/4228195290 learned_addr learned my addr 172.21.15.63:0/4228195290 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.247+0000 7fef4659c640 1 -- 172.21.15.63:0/4228195290 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef481094c0 con 0x7fef4810acf0 2024-09-16T01:14:18.518 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.247+0000 7fef4659c640 1 --2- 172.21.15.63:0/4228195290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4810b0f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef38009820 tx=0x7fef3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a16861df12677dc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.248+0000 7fef4559a640 1 -- 172.21.15.63:0/4228195290 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef38037070 con 0x7fef4810acf0 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.248+0000 7fef4559a640 1 -- 172.21.15.63:0/4228195290 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fef380328d0 con 0x7fef4810acf0 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.248+0000 7fef4559a640 1 -- 172.21.15.63:0/4228195290 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef380307d0 con 0x7fef4810acf0 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.248+0000 7fef4cfab640 1 -- 172.21.15.63:0/4228195290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 msgr2=0x7fef4810b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.248+0000 7fef4cfab640 1 --2- 172.21.15.63:0/4228195290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4810b0f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef38009820 tx=0x7fef3802a270 comp rx=0 tx=0).stop 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.248+0000 7fef4cfab640 1 -- 172.21.15.63:0/4228195290 shutdown_connections 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.248+0000 7fef4cfab640 1 --2- 172.21.15.63:0/4228195290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4810b0f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.248+0000 7fef4cfab640 1 -- 172.21.15.63:0/4228195290 >> 172.21.15.63:0/4228195290 conn(0x7fef4807cc80 msgr2=0x7fef4807d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.249+0000 7fef4cfab640 1 -- 172.21.15.63:0/4228195290 shutdown_connections 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.249+0000 7fef4cfab640 1 -- 172.21.15.63:0/4228195290 wait complete. 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.249+0000 7fef4cfab640 1 Processor -- start 2024-09-16T01:14:18.519 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.249+0000 7fef4cfab640 1 -- start start 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef4cfab640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4819da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef4cfab640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fef4810dca0 con 0x7fef4810acf0 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef4659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4819da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef4659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4819da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52442/0 (socket says 172.21.15.63:52442) 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef4659c640 1 -- 172.21.15.63:0/1072107250 learned_addr learned my addr 172.21.15.63:0/1072107250 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef4659c640 1 -- 172.21.15.63:0/1072107250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4819df60 con 0x7fef4810acf0 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef4659c640 1 --2- 172.21.15.63:0/1072107250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4819da20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fef38032e10 tx=0x7fef38032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef377fe640 1 -- 172.21.15.63:0/1072107250 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef38042070 con 0x7fef4810acf0 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef377fe640 1 -- 172.21.15.63:0/1072107250 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fef38030c80 con 0x7fef4810acf0 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef4cfab640 1 -- 172.21.15.63:0/1072107250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4819e1f0 con 0x7fef4810acf0 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef377fe640 1 -- 172.21.15.63:0/1072107250 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef38037040 con 0x7fef4810acf0 2024-09-16T01:14:18.520 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.250+0000 7fef4cfab640 1 -- 172.21.15.63:0/1072107250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef481a0ee0 con 0x7fef4810acf0 2024-09-16T01:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.251+0000 7fef377fe640 1 -- 172.21.15.63:0/1072107250 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fef38045070 con 0x7fef4810acf0 2024-09-16T01:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.252+0000 7fef377fe640 1 --2- 172.21.15.63:0/1072107250 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fef300391b0 0x7fef3003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.252+0000 7fef4cfab640 1 -- 172.21.15.63:0/1072107250 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4810b170 con 0x7fef4810acf0 2024-09-16T01:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.252+0000 7fef377fe640 1 -- 172.21.15.63:0/1072107250 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fef3806c230 con 0x7fef4810acf0 2024-09-16T01:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.252+0000 7fef45d9b640 1 --2- 172.21.15.63:0/1072107250 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fef300391b0 0x7fef3003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.252+0000 7fef45d9b640 1 --2- 172.21.15.63:0/1072107250 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fef300391b0 0x7fef3003b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0098c0 tx=0x7fef3c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.257+0000 7fef377fe640 1 -- 172.21.15.63:0/1072107250 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef38045360 con 0x7fef4810acf0 2024-09-16T01:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.436+0000 7fef4cfab640 1 -- 172.21.15.63:0/1072107250 --> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fef48062630 con 0x7fef300391b0 2024-09-16T01:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.995+0000 7fef377fe640 1 -- 172.21.15.63:0/1072107250 <== mgr.14118 v2:172.21.15.63:6800/1469009490 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fef48062630 con 0x7fef300391b0 2024-09-16T01:14:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.997+0000 7fef4cfab640 1 -- 172.21.15.63:0/1072107250 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fef300391b0 msgr2=0x7fef3003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:18.522 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.997+0000 7fef4cfab640 1 --2- 172.21.15.63:0/1072107250 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fef300391b0 0x7fef3003b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0098c0 tx=0x7fef3c006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:18.522 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.997+0000 7fef4cfab640 1 -- 172.21.15.63:0/1072107250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 msgr2=0x7fef4819da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:18.522 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.997+0000 7fef4cfab640 1 --2- 172.21.15.63:0/1072107250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4819da20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fef38032e10 tx=0x7fef38032e40 comp rx=0 tx=0).stop 2024-09-16T01:14:18.522 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.998+0000 7fef4cfab640 1 -- 172.21.15.63:0/1072107250 shutdown_connections 2024-09-16T01:14:18.522 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.998+0000 7fef4cfab640 1 --2- 172.21.15.63:0/1072107250 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fef300391b0 0x7fef3003b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:18.522 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.998+0000 7fef4cfab640 1 --2- 172.21.15.63:0/1072107250 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef4810acf0 0x7fef4819da20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:18.522 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.998+0000 7fef4cfab640 1 -- 172.21.15.63:0/1072107250 >> 172.21.15.63:0/1072107250 conn(0x7fef4807cc80 msgr2=0x7fef481075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:18.522 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.998+0000 7fef4cfab640 1 -- 172.21.15.63:0/1072107250 shutdown_connections 2024-09-16T01:14:18.522 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:17.998+0000 7fef4cfab640 1 -- 172.21.15.63:0/1072107250 wait complete. 2024-09-16T01:14:18.602 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:18 smithi063 ceph-mon[31070]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:18.602 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:18 smithi063 ceph-mon[31070]: Generating ssh key... 2024-09-16T01:14:18.602 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:18 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:18.602 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:18 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:19.591 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCCBYtFxSriRrBcnk4IFxuXvPrt/0NUhBHo8SQvxKWqAGOY43OmE9Deg3TXrTVG9ms1fHTetgt7B2n0YUuRO8bG1rq1RBylpB3WDUZ/QQ2AixIIl4xOqtYCim8E/uTXqddCwAgW7NdMxk6THgutj+hQwSyQKs1L57KAgFMLpGGWDgXeJM5/z9dLwvwi1v18I9v1RQJZI6J8+xmD4p1gG1c4uYxEE7Q3OGJDRUHplbfam5OaaJ3vLRat59F0jhAfEtqWBxeruIJfygqsr0Ue+lwEOlUY3c3UwQYx9Lvmw3+dBAs0d6dqAKMHYddupO6I5ZtBgME6l5PraUtrrDzbsyGlRkADsaJiAn6Cs1d6VsmVE3g8+h1byJsEf5sJ1XeM8O/jhjuUdasRDFbRMirLOu75YFLV3MD4vpNTDrjxUFmBeBRSrEvXrCO2OkD/BvrCPqTuTKGDJtOw0RN6UDfhUznYccMU1yE94s7J91PXeqA3k+e6UTOJEB8V0mBAaB6AuP0= ceph-c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:14:19.591 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.856+0000 7f7feb74b640 1 Processor -- start 2024-09-16T01:14:19.591 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.856+0000 7f7feb74b640 1 -- start start 2024-09-16T01:14:19.591 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.856+0000 7f7feb74b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe410a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:19.591 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.856+0000 7f7feb74b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe407be90 con 0x7f7fe4107ef0 2024-09-16T01:14:19.591 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.857+0000 7f7fe94e7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe410a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:19.591 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.857+0000 7f7fe94e7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe410a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52140/0 (socket says 172.21.15.63:52140) 2024-09-16T01:14:19.591 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.857+0000 7f7fe94e7640 1 -- 172.21.15.63:0/1883642982 learned_addr learned my addr 172.21.15.63:0/1883642982 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.857+0000 7f7fe94e7640 1 -- 172.21.15.63:0/1883642982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe410a820 con 0x7f7fe4107ef0 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.858+0000 7f7fe94e7640 1 --2- 172.21.15.63:0/1883642982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe410a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009820 tx=0x7f7fe002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c2c08e94d5f02e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.858+0000 7f7fdbfff640 1 -- 172.21.15.63:0/1883642982 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fe0037070 con 0x7f7fe4107ef0 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.858+0000 7f7fdbfff640 1 -- 172.21.15.63:0/1883642982 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7fe00328d0 con 0x7f7fe4107ef0 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.858+0000 7f7fdbfff640 1 -- 172.21.15.63:0/1883642982 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fe00307d0 con 0x7f7fe4107ef0 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.858+0000 7f7feb74b640 1 -- 172.21.15.63:0/1883642982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 msgr2=0x7f7fe410a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.858+0000 7f7feb74b640 1 --2- 172.21.15.63:0/1883642982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe410a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0009820 tx=0x7f7fe002a270 comp rx=0 tx=0).stop 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.858+0000 7f7feb74b640 1 -- 172.21.15.63:0/1883642982 shutdown_connections 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.859+0000 7f7feb74b640 1 --2- 172.21.15.63:0/1883642982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe410a2e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.859+0000 7f7feb74b640 1 -- 172.21.15.63:0/1883642982 >> 172.21.15.63:0/1883642982 conn(0x7f7fe4101b10 msgr2=0x7f7fe4103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.859+0000 7f7feb74b640 1 -- 172.21.15.63:0/1883642982 shutdown_connections 2024-09-16T01:14:19.592 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.859+0000 7f7feb74b640 1 -- 172.21.15.63:0/1883642982 wait complete. 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.859+0000 7f7feb74b640 1 Processor -- start 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.859+0000 7f7feb74b640 1 -- start start 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.859+0000 7f7feb74b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe4107770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.859+0000 7f7feb74b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe410b860 con 0x7f7fe4107ef0 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.860+0000 7f7fe94e7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe4107770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.860+0000 7f7fe94e7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe4107770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52148/0 (socket says 172.21.15.63:52148) 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.860+0000 7f7fe94e7640 1 -- 172.21.15.63:0/3824434827 learned_addr learned my addr 172.21.15.63:0/3824434827 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.860+0000 7f7fe94e7640 1 -- 172.21.15.63:0/3824434827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe4107cb0 con 0x7f7fe4107ef0 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.860+0000 7f7fe94e7640 1 --2- 172.21.15.63:0/3824434827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe4107770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00097f0 tx=0x7f7fe0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.860+0000 7f7fda7fc640 1 -- 172.21.15.63:0/3824434827 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fe0037040 con 0x7f7fe4107ef0 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.860+0000 7f7fda7fc640 1 -- 172.21.15.63:0/3824434827 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f7fe003b3f0 con 0x7f7fe4107ef0 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.860+0000 7f7feb74b640 1 -- 172.21.15.63:0/3824434827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe4105ea0 con 0x7f7fe4107ef0 2024-09-16T01:14:19.593 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.860+0000 7f7fda7fc640 1 -- 172.21.15.63:0/3824434827 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fe003a520 con 0x7f7fe4107ef0 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.860+0000 7f7feb74b640 1 -- 172.21.15.63:0/3824434827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe41063e0 con 0x7f7fe4107ef0 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.861+0000 7f7fda7fc640 1 -- 172.21.15.63:0/3824434827 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7fe003a6c0 con 0x7f7fe4107ef0 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.861+0000 7f7feb74b640 1 -- 172.21.15.63:0/3824434827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe4108350 con 0x7f7fe4107ef0 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.861+0000 7f7fda7fc640 1 --2- 172.21.15.63:0/3824434827 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f7fd0039200 0x7f7fd003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.861+0000 7f7fda7fc640 1 -- 172.21.15.63:0/3824434827 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7fe006c660 con 0x7f7fe4107ef0 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.861+0000 7f7fe8ce6640 1 --2- 172.21.15.63:0/3824434827 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f7fd0039200 0x7f7fd003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.862+0000 7f7fe8ce6640 1 --2- 172.21.15.63:0/3824434827 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f7fd0039200 0x7f7fd003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40098c0 tx=0x7f7fd4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:18.866+0000 7f7fda7fc640 1 -- 172.21.15.63:0/3824434827 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7fe0032820 con 0x7f7fe4107ef0 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.045+0000 7f7feb74b640 1 -- 172.21.15.63:0/3824434827 --> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f7fe4194f60 con 0x7f7fd0039200 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.045+0000 7f7fda7fc640 1 -- 172.21.15.63:0/3824434827 <== mgr.14118 v2:172.21.15.63:6800/1469009490 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f7fe4194f60 con 0x7f7fd0039200 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.048+0000 7f7feb74b640 1 -- 172.21.15.63:0/3824434827 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f7fd0039200 msgr2=0x7f7fd003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.048+0000 7f7feb74b640 1 --2- 172.21.15.63:0/3824434827 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f7fd0039200 0x7f7fd003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40098c0 tx=0x7f7fd4006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:19.594 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.048+0000 7f7feb74b640 1 -- 172.21.15.63:0/3824434827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 msgr2=0x7f7fe4107770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:19.595 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.048+0000 7f7feb74b640 1 --2- 172.21.15.63:0/3824434827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe4107770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00097f0 tx=0x7f7fe0030d00 comp rx=0 tx=0).stop 2024-09-16T01:14:19.595 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.048+0000 7f7feb74b640 1 -- 172.21.15.63:0/3824434827 shutdown_connections 2024-09-16T01:14:19.595 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.048+0000 7f7feb74b640 1 --2- 172.21.15.63:0/3824434827 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f7fd0039200 0x7f7fd003b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:19.595 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.048+0000 7f7feb74b640 1 --2- 172.21.15.63:0/3824434827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fe4107ef0 0x7f7fe4107770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:19.595 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.048+0000 7f7feb74b640 1 -- 172.21.15.63:0/3824434827 >> 172.21.15.63:0/3824434827 conn(0x7f7fe4101b10 msgr2=0x7f7fe4102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:19.595 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.048+0000 7f7feb74b640 1 -- 172.21.15.63:0/3824434827 shutdown_connections 2024-09-16T01:14:19.595 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.048+0000 7f7feb74b640 1 -- 172.21.15.63:0/3824434827 wait complete. 2024-09-16T01:14:19.595 INFO:teuthology.orchestra.run.smithi063.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:14:19.595 INFO:teuthology.orchestra.run.smithi063.stdout:Adding key to root@localhost authorized_keys... 2024-09-16T01:14:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:Adding host smithi063... 2024-09-16T01:14:20.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:20 smithi063 ceph-mon[31070]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:21.230 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:21 smithi063 ceph-mon[31070]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi063", "addr": "172.21.15.63", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:22.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:22 smithi063 ceph-mon[31070]: Deploying cephadm binary to smithi063 2024-09-16T01:14:24.657 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Added host 'smithi063' with addr '172.21.15.63' 2024-09-16T01:14:24.657 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.999+0000 7fdf9d852640 1 Processor -- start 2024-09-16T01:14:24.657 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:19.999+0000 7fdf9d852640 1 -- start start 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.000+0000 7fdf9d852640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9810a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.000+0000 7fdf9d852640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9807be90 con 0x7fdf98107ef0 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.000+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9810a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.000+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9810a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52156/0 (socket says 172.21.15.63:52156) 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.000+0000 7fdf96ffd640 1 -- 172.21.15.63:0/449946280 learned_addr learned my addr 172.21.15.63:0/449946280 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.000+0000 7fdf96ffd640 1 -- 172.21.15.63:0/449946280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9810a820 con 0x7fdf98107ef0 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.001+0000 7fdf96ffd640 1 --2- 172.21.15.63:0/449946280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9810a2e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009e80 tx=0x7fdf8802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1b4fb423af29a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.001+0000 7fdf95ffb640 1 -- 172.21.15.63:0/449946280 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf88036070 con 0x7fdf98107ef0 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.001+0000 7fdf95ffb640 1 -- 172.21.15.63:0/449946280 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fdf88031890 con 0x7fdf98107ef0 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.001+0000 7fdf95ffb640 1 -- 172.21.15.63:0/449946280 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf88007980 con 0x7fdf98107ef0 2024-09-16T01:14:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.002+0000 7fdf9d852640 1 -- 172.21.15.63:0/449946280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 msgr2=0x7fdf9810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.002+0000 7fdf9d852640 1 --2- 172.21.15.63:0/449946280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9810a2e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009e80 tx=0x7fdf8802a7a0 comp rx=0 tx=0).stop 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.002+0000 7fdf9d852640 1 -- 172.21.15.63:0/449946280 shutdown_connections 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.002+0000 7fdf9d852640 1 --2- 172.21.15.63:0/449946280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9810a2e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.002+0000 7fdf9d852640 1 -- 172.21.15.63:0/449946280 >> 172.21.15.63:0/449946280 conn(0x7fdf98101b10 msgr2=0x7fdf98103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.002+0000 7fdf9d852640 1 -- 172.21.15.63:0/449946280 shutdown_connections 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.002+0000 7fdf9d852640 1 -- 172.21.15.63:0/449946280 wait complete. 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.002+0000 7fdf9d852640 1 Processor -- start 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.003+0000 7fdf9d852640 1 -- start start 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.003+0000 7fdf9d852640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9819b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.003+0000 7fdf9d852640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9810b860 con 0x7fdf98107ef0 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.003+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9819b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:24.659 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.003+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9819b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52160/0 (socket says 172.21.15.63:52160) 2024-09-16T01:14:24.660 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.003+0000 7fdf96ffd640 1 -- 172.21.15.63:0/625738352 learned_addr learned my addr 172.21.15.63:0/625738352 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:24.660 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.003+0000 7fdf96ffd640 1 -- 172.21.15.63:0/625738352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9819bca0 con 0x7fdf98107ef0 2024-09-16T01:14:24.660 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.003+0000 7fdf96ffd640 1 --2- 172.21.15.63:0/625738352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9819b760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009680 tx=0x7fdf88031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:24.660 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.004+0000 7fdf9c850640 1 -- 172.21.15.63:0/625738352 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf88041020 con 0x7fdf98107ef0 2024-09-16T01:14:24.660 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.004+0000 7fdf9c850640 1 -- 172.21.15.63:0/625738352 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fdf8803c900 con 0x7fdf98107ef0 2024-09-16T01:14:24.660 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.004+0000 7fdf9c850640 1 -- 172.21.15.63:0/625738352 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf88036040 con 0x7fdf98107ef0 2024-09-16T01:14:24.660 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.004+0000 7fdf9d852640 1 -- 172.21.15.63:0/625738352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9819bf30 con 0x7fdf98107ef0 2024-09-16T01:14:24.660 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.004+0000 7fdf9d852640 1 -- 172.21.15.63:0/625738352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf9819ec20 con 0x7fdf98107ef0 2024-09-16T01:14:24.660 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.005+0000 7fdf9c850640 1 -- 172.21.15.63:0/625738352 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fdf88044020 con 0x7fdf98107ef0 2024-09-16T01:14:24.660 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.005+0000 7fdf9c850640 1 --2- 172.21.15.63:0/625738352 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fdf84039200 0x7fdf8403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.005+0000 7fdf9d852640 1 -- 172.21.15.63:0/625738352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf98108350 con 0x7fdf98107ef0 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.005+0000 7fdf9c850640 1 -- 172.21.15.63:0/625738352 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdf8806d6d0 con 0x7fdf98107ef0 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.005+0000 7fdf967fc640 1 --2- 172.21.15.63:0/625738352 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fdf84039200 0x7fdf8403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.005+0000 7fdf967fc640 1 --2- 172.21.15.63:0/625738352 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fdf84039200 0x7fdf8403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdf800098c0 tx=0x7fdf80006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.010+0000 7fdf9c850640 1 -- 172.21.15.63:0/625738352 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdf8804b020 con 0x7fdf98107ef0 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:20.191+0000 7fdf9d852640 1 -- 172.21.15.63:0/625738352 --> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi063", "addr": "172.21.15.63", "target": ["mon-mgr", ""]}) -- 0x7fdf98062630 con 0x7fdf84039200 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.089+0000 7fdf9c850640 1 -- 172.21.15.63:0/625738352 <== mgr.14118 v2:172.21.15.63:6800/1469009490 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fdf98062630 con 0x7fdf84039200 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.092+0000 7fdf9d852640 1 -- 172.21.15.63:0/625738352 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fdf84039200 msgr2=0x7fdf8403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.092+0000 7fdf9d852640 1 --2- 172.21.15.63:0/625738352 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fdf84039200 0x7fdf8403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdf800098c0 tx=0x7fdf80006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.092+0000 7fdf9d852640 1 -- 172.21.15.63:0/625738352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 msgr2=0x7fdf9819b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.092+0000 7fdf9d852640 1 --2- 172.21.15.63:0/625738352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9819b760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009680 tx=0x7fdf88031c70 comp rx=0 tx=0).stop 2024-09-16T01:14:24.661 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.092+0000 7fdf9d852640 1 -- 172.21.15.63:0/625738352 shutdown_connections 2024-09-16T01:14:24.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.092+0000 7fdf9d852640 1 --2- 172.21.15.63:0/625738352 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fdf84039200 0x7fdf8403b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:24.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.092+0000 7fdf9d852640 1 --2- 172.21.15.63:0/625738352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdf98107ef0 0x7fdf9819b760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:24.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.092+0000 7fdf9d852640 1 -- 172.21.15.63:0/625738352 >> 172.21.15.63:0/625738352 conn(0x7fdf98101b10 msgr2=0x7fdf98102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:24.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.093+0000 7fdf9d852640 1 -- 172.21.15.63:0/625738352 shutdown_connections 2024-09-16T01:14:24.662 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:24.093+0000 7fdf9d852640 1 -- 172.21.15.63:0/625738352 wait complete. 2024-09-16T01:14:24.662 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying unmanaged mon service... 2024-09-16T01:14:25.203 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:25 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:25.203 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:25 smithi063 ceph-mon[31070]: Added host smithi063 2024-09-16T01:14:25.203 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:25 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.118+0000 7f9e89cbf640 1 Processor -- start 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.118+0000 7f9e89cbf640 1 -- start start 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.118+0000 7f9e89cbf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e84106780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.118+0000 7f9e89cbf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84106d50 con 0x7f9e84106380 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.118+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e84106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.118+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e84106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52164/0 (socket says 172.21.15.63:52164) 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.118+0000 7f9e837fe640 1 -- 172.21.15.63:0/3676787722 learned_addr learned my addr 172.21.15.63:0/3676787722 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.119+0000 7f9e837fe640 1 -- 172.21.15.63:0/3676787722 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e84107580 con 0x7f9e84106380 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.119+0000 7f9e837fe640 1 --2- 172.21.15.63:0/3676787722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e84106780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009820 tx=0x7f9e7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca5783b945ef893 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:25.931 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.120+0000 7f9e827fc640 1 -- 172.21.15.63:0/3676787722 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e74037070 con 0x7f9e84106380 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.120+0000 7f9e827fc640 1 -- 172.21.15.63:0/3676787722 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9e740328d0 con 0x7f9e84106380 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.120+0000 7f9e827fc640 1 -- 172.21.15.63:0/3676787722 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e740307d0 con 0x7f9e84106380 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.120+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3676787722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 msgr2=0x7f9e84106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.120+0000 7f9e89cbf640 1 --2- 172.21.15.63:0/3676787722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e84106780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009820 tx=0x7f9e7402a270 comp rx=0 tx=0).stop 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.120+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3676787722 shutdown_connections 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.120+0000 7f9e89cbf640 1 --2- 172.21.15.63:0/3676787722 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e84106780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.120+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3676787722 >> 172.21.15.63:0/3676787722 conn(0x7f9e84101b10 msgr2=0x7f9e84103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.120+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3676787722 shutdown_connections 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.120+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3676787722 wait complete. 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.121+0000 7f9e89cbf640 1 Processor -- start 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.121+0000 7f9e89cbf640 1 -- start start 2024-09-16T01:14:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.121+0000 7f9e89cbf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e841915b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.121+0000 7f9e89cbf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8410a930 con 0x7f9e84106380 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.121+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e841915b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.121+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e841915b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52172/0 (socket says 172.21.15.63:52172) 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.121+0000 7f9e837fe640 1 -- 172.21.15.63:0/3441602683 learned_addr learned my addr 172.21.15.63:0/3441602683 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.122+0000 7f9e837fe640 1 -- 172.21.15.63:0/3441602683 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e84191af0 con 0x7f9e84106380 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.122+0000 7f9e837fe640 1 --2- 172.21.15.63:0/3441602683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e841915b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e740097f0 tx=0x7f9e74030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.122+0000 7f9e80ff9640 1 -- 172.21.15.63:0/3441602683 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e74037040 con 0x7f9e84106380 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.122+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3441602683 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8418fce0 con 0x7f9e84106380 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.122+0000 7f9e80ff9640 1 -- 172.21.15.63:0/3441602683 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9e74032bb0 con 0x7f9e84106380 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.122+0000 7f9e80ff9640 1 -- 172.21.15.63:0/3441602683 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e7403a390 con 0x7f9e84106380 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.122+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3441602683 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e84190220 con 0x7f9e84106380 2024-09-16T01:14:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.123+0000 7f9e80ff9640 1 -- 172.21.15.63:0/3441602683 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9e7403a5d0 con 0x7f9e84106380 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.123+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3441602683 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8410aab0 con 0x7f9e84106380 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.123+0000 7f9e80ff9640 1 --2- 172.21.15.63:0/3441602683 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f9e6c0391b0 0x7f9e6c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.123+0000 7f9e80ff9640 1 -- 172.21.15.63:0/3441602683 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9e7406c530 con 0x7f9e84106380 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.123+0000 7f9e82ffd640 1 --2- 172.21.15.63:0/3441602683 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f9e6c0391b0 0x7f9e6c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.124+0000 7f9e82ffd640 1 --2- 172.21.15.63:0/3441602683 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f9e6c0391b0 0x7f9e6c03b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9e780098c0 tx=0x7f9e78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.128+0000 7f9e80ff9640 1 -- 172.21.15.63:0/3441602683 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e74040210 con 0x7f9e84106380 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.321+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3441602683 --> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f9e841950b0 con 0x7f9e6c0391b0 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.326+0000 7f9e80ff9640 1 -- 172.21.15.63:0/3441602683 <== mgr.14118 v2:172.21.15.63:6800/1469009490 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9e841950b0 con 0x7f9e6c0391b0 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.328+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3441602683 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f9e6c0391b0 msgr2=0x7f9e6c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.329+0000 7f9e89cbf640 1 --2- 172.21.15.63:0/3441602683 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f9e6c0391b0 0x7f9e6c03b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9e780098c0 tx=0x7f9e78006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.329+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3441602683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 msgr2=0x7f9e841915b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:25.934 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.329+0000 7f9e89cbf640 1 --2- 172.21.15.63:0/3441602683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e841915b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e740097f0 tx=0x7f9e74030d00 comp rx=0 tx=0).stop 2024-09-16T01:14:25.935 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.329+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3441602683 shutdown_connections 2024-09-16T01:14:25.935 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.329+0000 7f9e89cbf640 1 --2- 172.21.15.63:0/3441602683 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f9e6c0391b0 0x7f9e6c03b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:25.935 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.329+0000 7f9e89cbf640 1 --2- 172.21.15.63:0/3441602683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e84106380 0x7f9e841915b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:25.935 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.329+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3441602683 >> 172.21.15.63:0/3441602683 conn(0x7f9e84101b10 msgr2=0x7f9e84102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:25.935 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.329+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3441602683 shutdown_connections 2024-09-16T01:14:25.935 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:25.329+0000 7f9e89cbf640 1 -- 172.21.15.63:0/3441602683 wait complete. 2024-09-16T01:14:25.935 INFO:teuthology.orchestra.run.smithi063.stdout:Deploying unmanaged mgr service... 2024-09-16T01:14:26.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:26 smithi063 ceph-mon[31070]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:26.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:26 smithi063 ceph-mon[31070]: Saving service mon spec with placement count:5 2024-09-16T01:14:26.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:26 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:27.164 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-16T01:14:27.164 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.323+0000 7f6b29118640 1 Processor -- start 2024-09-16T01:14:27.164 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.323+0000 7f6b29118640 1 -- start start 2024-09-16T01:14:27.164 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.323+0000 7f6b29118640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24106d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:27.164 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.323+0000 7f6b29118640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6b24107310 con 0x7f6b24106940 2024-09-16T01:14:27.164 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.323+0000 7f6b22d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:27.164 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.323+0000 7f6b22d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52176/0 (socket says 172.21.15.63:52176) 2024-09-16T01:14:27.164 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.323+0000 7f6b22d9d640 1 -- 172.21.15.63:0/1502041980 learned_addr learned my addr 172.21.15.63:0/1502041980 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:27.164 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.323+0000 7f6b22d9d640 1 -- 172.21.15.63:0/1502041980 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b24107660 con 0x7f6b24106940 2024-09-16T01:14:27.164 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.324+0000 7f6b22d9d640 1 --2- 172.21.15.63:0/1502041980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24106d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400bac0 tx=0x7f6b1402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825082d25e3997ea server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.326+0000 7f6b21d9b640 1 -- 172.21.15.63:0/1502041980 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b140326d0 con 0x7f6b24106940 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.326+0000 7f6b21d9b640 1 -- 172.21.15.63:0/1502041980 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6b14038070 con 0x7f6b24106940 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.326+0000 7f6b21d9b640 1 -- 172.21.15.63:0/1502041980 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b14033c90 con 0x7f6b24106940 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.327+0000 7f6b29118640 1 -- 172.21.15.63:0/1502041980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 msgr2=0x7f6b24106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.327+0000 7f6b29118640 1 --2- 172.21.15.63:0/1502041980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24106d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400bac0 tx=0x7f6b1402c920 comp rx=0 tx=0).stop 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.327+0000 7f6b29118640 1 -- 172.21.15.63:0/1502041980 shutdown_connections 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.327+0000 7f6b29118640 1 --2- 172.21.15.63:0/1502041980 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24106d40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.327+0000 7f6b29118640 1 -- 172.21.15.63:0/1502041980 >> 172.21.15.63:0/1502041980 conn(0x7f6b241012f0 msgr2=0x7f6b24103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.327+0000 7f6b29118640 1 -- 172.21.15.63:0/1502041980 shutdown_connections 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.327+0000 7f6b29118640 1 -- 172.21.15.63:0/1502041980 wait complete. 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.328+0000 7f6b29118640 1 Processor -- start 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.328+0000 7f6b29118640 1 -- start start 2024-09-16T01:14:27.165 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.328+0000 7f6b29118640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.328+0000 7f6b29118640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6b241054a0 con 0x7f6b24106940 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.328+0000 7f6b22d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.328+0000 7f6b22d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52182/0 (socket says 172.21.15.63:52182) 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.328+0000 7f6b22d9d640 1 -- 172.21.15.63:0/1583028336 learned_addr learned my addr 172.21.15.63:0/1583028336 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.329+0000 7f6b22d9d640 1 -- 172.21.15.63:0/1583028336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b24199b70 con 0x7f6b24106940 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.329+0000 7f6b22d9d640 1 --2- 172.21.15.63:0/1583028336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24199630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b1402cee0 tx=0x7f6b140327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.329+0000 7f6b0bfff640 1 -- 172.21.15.63:0/1583028336 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b14042070 con 0x7f6b24106940 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.329+0000 7f6b0bfff640 1 -- 172.21.15.63:0/1583028336 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6b14032bf0 con 0x7f6b24106940 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.329+0000 7f6b29118640 1 -- 172.21.15.63:0/1583028336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b24199e00 con 0x7f6b24106940 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.329+0000 7f6b0bfff640 1 -- 172.21.15.63:0/1583028336 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b1403c580 con 0x7f6b24106940 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.329+0000 7f6b29118640 1 -- 172.21.15.63:0/1583028336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b2419caf0 con 0x7f6b24106940 2024-09-16T01:14:27.166 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.330+0000 7f6b0bfff640 1 -- 172.21.15.63:0/1583028336 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6b1403c7f0 con 0x7f6b24106940 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.330+0000 7f6b0bfff640 1 --2- 172.21.15.63:0/1583028336 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f6b0c0391b0 0x7f6b0c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.330+0000 7f6b0bfff640 1 -- 172.21.15.63:0/1583028336 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6b14030050 con 0x7f6b24106940 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.330+0000 7f6b2259c640 1 --2- 172.21.15.63:0/1583028336 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f6b0c0391b0 0x7f6b0c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.330+0000 7f6b29118640 1 -- 172.21.15.63:0/1583028336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b24106d40 con 0x7f6b24106940 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.331+0000 7f6b2259c640 1 --2- 172.21.15.63:0/1583028336 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f6b0c0391b0 0x7f6b0c03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6b180098c0 tx=0x7f6b18006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.335+0000 7f6b0bfff640 1 -- 172.21.15.63:0/1583028336 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b14009250 con 0x7f6b24106940 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.526+0000 7f6b29118640 1 -- 172.21.15.63:0/1583028336 --> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f6b24062630 con 0x7f6b0c0391b0 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.530+0000 7f6b0bfff640 1 -- 172.21.15.63:0/1583028336 <== mgr.14118 v2:172.21.15.63:6800/1469009490 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6b24062630 con 0x7f6b0c0391b0 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.532+0000 7f6b29118640 1 -- 172.21.15.63:0/1583028336 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f6b0c0391b0 msgr2=0x7f6b0c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.532+0000 7f6b29118640 1 --2- 172.21.15.63:0/1583028336 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f6b0c0391b0 0x7f6b0c03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6b180098c0 tx=0x7f6b18006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.532+0000 7f6b29118640 1 -- 172.21.15.63:0/1583028336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 msgr2=0x7f6b24199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.532+0000 7f6b29118640 1 --2- 172.21.15.63:0/1583028336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24199630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b1402cee0 tx=0x7f6b140327d0 comp rx=0 tx=0).stop 2024-09-16T01:14:27.167 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.532+0000 7f6b29118640 1 -- 172.21.15.63:0/1583028336 shutdown_connections 2024-09-16T01:14:27.168 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.532+0000 7f6b29118640 1 --2- 172.21.15.63:0/1583028336 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f6b0c0391b0 0x7f6b0c03b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:27.168 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.532+0000 7f6b29118640 1 --2- 172.21.15.63:0/1583028336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b24106940 0x7f6b24199630 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:27.168 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.532+0000 7f6b29118640 1 -- 172.21.15.63:0/1583028336 >> 172.21.15.63:0/1583028336 conn(0x7f6b241012f0 msgr2=0x7f6b2418fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:27.168 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.532+0000 7f6b29118640 1 -- 172.21.15.63:0/1583028336 shutdown_connections 2024-09-16T01:14:27.168 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:26.532+0000 7f6b29118640 1 -- 172.21.15.63:0/1583028336 wait complete. 2024-09-16T01:14:27.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:27 smithi063 ceph-mon[31070]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:27.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:27 smithi063 ceph-mon[31070]: Saving service mgr spec with placement count:2 2024-09-16T01:14:27.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:27 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:29.208 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:28 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:29.208 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:28 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:29.208 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:28 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/4088057163' entity='client.admin' 2024-09-16T01:14:29.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.413+0000 7f82f5cca640 1 Processor -- start 2024-09-16T01:14:29.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.413+0000 7f82f5cca640 1 -- start start 2024-09-16T01:14:29.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.413+0000 7f82f5cca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f0106180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:29.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.413+0000 7f82f5cca640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f82f007bdf0 con 0x7f82f0105d80 2024-09-16T01:14:29.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.413+0000 7f82ef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f0106180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:29.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.413+0000 7f82ef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f0106180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52190/0 (socket says 172.21.15.63:52190) 2024-09-16T01:14:29.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.413+0000 7f82ef7fe640 1 -- 172.21.15.63:0/2734075929 learned_addr learned my addr 172.21.15.63:0/2734075929 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:29.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.414+0000 7f82ef7fe640 1 -- 172.21.15.63:0/2734075929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f01066c0 con 0x7f82f0105d80 2024-09-16T01:14:29.215 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.414+0000 7f82ef7fe640 1 --2- 172.21.15.63:0/2734075929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f0106180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009820 tx=0x7f82e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6986b2476e2bd3a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.415+0000 7f82eeffd640 1 -- 172.21.15.63:0/2734075929 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82e0037070 con 0x7f82f0105d80 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.415+0000 7f82eeffd640 1 -- 172.21.15.63:0/2734075929 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82e00328f0 con 0x7f82f0105d80 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.415+0000 7f82eeffd640 1 -- 172.21.15.63:0/2734075929 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82e0030740 con 0x7f82f0105d80 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.415+0000 7f82f5cca640 1 -- 172.21.15.63:0/2734075929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 msgr2=0x7f82f0106180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.415+0000 7f82f5cca640 1 --2- 172.21.15.63:0/2734075929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f0106180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009820 tx=0x7f82e002a270 comp rx=0 tx=0).stop 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.415+0000 7f82f5cca640 1 -- 172.21.15.63:0/2734075929 shutdown_connections 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.415+0000 7f82f5cca640 1 --2- 172.21.15.63:0/2734075929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f0106180 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.415+0000 7f82f5cca640 1 -- 172.21.15.63:0/2734075929 >> 172.21.15.63:0/2734075929 conn(0x7f82f0101b10 msgr2=0x7f82f0103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.416+0000 7f82f5cca640 1 -- 172.21.15.63:0/2734075929 shutdown_connections 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.416+0000 7f82f5cca640 1 -- 172.21.15.63:0/2734075929 wait complete. 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.416+0000 7f82f5cca640 1 Processor -- start 2024-09-16T01:14:29.216 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.416+0000 7f82f5cca640 1 -- start start 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.416+0000 7f82f5cca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f019d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.416+0000 7f82f5cca640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f82f01077a0 con 0x7f82f0105d80 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.416+0000 7f82ef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f019d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.416+0000 7f82ef7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f019d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52198/0 (socket says 172.21.15.63:52198) 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.416+0000 7f82ef7fe640 1 -- 172.21.15.63:0/4088057163 learned_addr learned my addr 172.21.15.63:0/4088057163 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.417+0000 7f82ef7fe640 1 -- 172.21.15.63:0/4088057163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f019deb0 con 0x7f82f0105d80 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.417+0000 7f82ef7fe640 1 --2- 172.21.15.63:0/4088057163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f019d970 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f82e00327b0 tx=0x7f82e00327e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.417+0000 7f82ed7fa640 1 -- 172.21.15.63:0/4088057163 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82e0042070 con 0x7f82f0105d80 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.417+0000 7f82f5cca640 1 -- 172.21.15.63:0/4088057163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f019e140 con 0x7f82f0105d80 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.417+0000 7f82ed7fa640 1 -- 172.21.15.63:0/4088057163 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82e0030d50 con 0x7f82f0105d80 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.417+0000 7f82ed7fa640 1 -- 172.21.15.63:0/4088057163 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82e0037040 con 0x7f82f0105d80 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.417+0000 7f82f5cca640 1 -- 172.21.15.63:0/4088057163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f01a0e30 con 0x7f82f0105d80 2024-09-16T01:14:29.217 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.418+0000 7f82ed7fa640 1 -- 172.21.15.63:0/4088057163 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f82e0045070 con 0x7f82f0105d80 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.418+0000 7f82ed7fa640 1 --2- 172.21.15.63:0/4088057163 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f82dc039160 0x7f82dc03b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.418+0000 7f82ed7fa640 1 -- 172.21.15.63:0/4088057163 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f82e006c300 con 0x7f82f0105d80 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.418+0000 7f82e7fff640 1 --2- 172.21.15.63:0/4088057163 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f82dc039160 0x7f82dc03b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.419+0000 7f82f5cca640 1 -- 172.21.15.63:0/4088057163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f0106180 con 0x7f82f0105d80 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.419+0000 7f82e7fff640 1 --2- 172.21.15.63:0/4088057163 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f82dc039160 0x7f82dc03b620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f82d80098c0 tx=0x7f82d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.424+0000 7f82ed7fa640 1 -- 172.21.15.63:0/4088057163 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82e0045760 con 0x7f82f0105d80 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.613+0000 7f82f5cca640 1 -- 172.21.15.63:0/4088057163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f82f0075de0 con 0x7f82f0105d80 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.618+0000 7f82ed7fa640 1 -- 172.21.15.63:0/4088057163 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f82e0042d00 con 0x7f82f0105d80 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.622+0000 7f82f5cca640 1 -- 172.21.15.63:0/4088057163 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f82dc039160 msgr2=0x7f82dc03b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.622+0000 7f82f5cca640 1 --2- 172.21.15.63:0/4088057163 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f82dc039160 0x7f82dc03b620 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f82d80098c0 tx=0x7f82d8006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.622+0000 7f82f5cca640 1 -- 172.21.15.63:0/4088057163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 msgr2=0x7f82f019d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:29.218 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.622+0000 7f82f5cca640 1 --2- 172.21.15.63:0/4088057163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f019d970 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f82e00327b0 tx=0x7f82e00327e0 comp rx=0 tx=0).stop 2024-09-16T01:14:29.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.622+0000 7f82f5cca640 1 -- 172.21.15.63:0/4088057163 shutdown_connections 2024-09-16T01:14:29.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.622+0000 7f82f5cca640 1 --2- 172.21.15.63:0/4088057163 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f82dc039160 0x7f82dc03b620 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:29.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.622+0000 7f82f5cca640 1 --2- 172.21.15.63:0/4088057163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82f0105d80 0x7f82f019d970 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:29.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.622+0000 7f82f5cca640 1 -- 172.21.15.63:0/4088057163 >> 172.21.15.63:0/4088057163 conn(0x7f82f0101b10 msgr2=0x7f82f0194380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:29.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.623+0000 7f82f5cca640 1 -- 172.21.15.63:0/4088057163 shutdown_connections 2024-09-16T01:14:29.219 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:28.623+0000 7f82f5cca640 1 -- 172.21.15.63:0/4088057163 wait complete. 2024-09-16T01:14:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.777+0000 7f85a9670640 1 Processor -- start 2024-09-16T01:14:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.777+0000 7f85a9670640 1 -- start start 2024-09-16T01:14:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.777+0000 7f85a9670640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a41061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.777+0000 7f85a9670640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f85a407bdc0 con 0x7f85a4105de0 2024-09-16T01:14:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.777+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a41061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.777+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a41061e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58990/0 (socket says 172.21.15.63:58990) 2024-09-16T01:14:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.777+0000 7f85a2ffd640 1 -- 172.21.15.63:0/2188663555 learned_addr learned my addr 172.21.15.63:0/2188663555 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.778+0000 7f85a2ffd640 1 -- 172.21.15.63:0/2188663555 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a4106720 con 0x7f85a4105de0 2024-09-16T01:14:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.779+0000 7f85a2ffd640 1 --2- 172.21.15.63:0/2188663555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a41061e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8594009820 tx=0x7f859402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fe8a5e9c62b307 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.779+0000 7f85a1ffb640 1 -- 172.21.15.63:0/2188663555 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594037070 con 0x7f85a4105de0 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.779+0000 7f85a1ffb640 1 -- 172.21.15.63:0/2188663555 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f85940328f0 con 0x7f85a4105de0 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.779+0000 7f85a1ffb640 1 -- 172.21.15.63:0/2188663555 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594030740 con 0x7f85a4105de0 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.779+0000 7f85a9670640 1 -- 172.21.15.63:0/2188663555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 msgr2=0x7f85a41061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.779+0000 7f85a9670640 1 --2- 172.21.15.63:0/2188663555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a41061e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8594009820 tx=0x7f859402a270 comp rx=0 tx=0).stop 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.779+0000 7f85a9670640 1 -- 172.21.15.63:0/2188663555 shutdown_connections 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.779+0000 7f85a9670640 1 --2- 172.21.15.63:0/2188663555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a41061e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.779+0000 7f85a9670640 1 -- 172.21.15.63:0/2188663555 >> 172.21.15.63:0/2188663555 conn(0x7f85a4101bb0 msgr2=0x7f85a4103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.780+0000 7f85a9670640 1 -- 172.21.15.63:0/2188663555 shutdown_connections 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.780+0000 7f85a9670640 1 -- 172.21.15.63:0/2188663555 wait complete. 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.780+0000 7f85a9670640 1 Processor -- start 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.780+0000 7f85a9670640 1 -- start start 2024-09-16T01:14:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.781+0000 7f85a9670640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a419d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.781+0000 7f85a9670640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f85a4107680 con 0x7f85a4105de0 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.781+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a419d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.781+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a419d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59006/0 (socket says 172.21.15.63:59006) 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.781+0000 7f85a2ffd640 1 -- 172.21.15.63:0/2879009528 learned_addr learned my addr 172.21.15.63:0/2879009528 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.781+0000 7f85a2ffd640 1 -- 172.21.15.63:0/2879009528 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a419de30 con 0x7f85a4105de0 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.781+0000 7f85a2ffd640 1 --2- 172.21.15.63:0/2879009528 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a419d8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8594030cc0 tx=0x7f8594030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.781+0000 7f858bfff640 1 -- 172.21.15.63:0/2879009528 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594042070 con 0x7f85a4105de0 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.781+0000 7f858bfff640 1 -- 172.21.15.63:0/2879009528 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8594030e60 con 0x7f85a4105de0 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.781+0000 7f85a9670640 1 -- 172.21.15.63:0/2879009528 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a419e0c0 con 0x7f85a4105de0 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.782+0000 7f858bfff640 1 -- 172.21.15.63:0/2879009528 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8594037040 con 0x7f85a4105de0 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.782+0000 7f85a9670640 1 -- 172.21.15.63:0/2879009528 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a41a0db0 con 0x7f85a4105de0 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.783+0000 7f858bfff640 1 -- 172.21.15.63:0/2879009528 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f8594045070 con 0x7f85a4105de0 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.783+0000 7f858bfff640 1 --2- 172.21.15.63:0/2879009528 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f858c0391b0 0x7f858c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.783+0000 7f85a9670640 1 -- 172.21.15.63:0/2879009528 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a4107d30 con 0x7f85a4105de0 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.783+0000 7f858bfff640 1 -- 172.21.15.63:0/2879009528 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f859406c390 con 0x7f85a4105de0 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.783+0000 7f85a27fc640 1 --2- 172.21.15.63:0/2879009528 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f858c0391b0 0x7f858c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.783+0000 7f85a27fc640 1 --2- 172.21.15.63:0/2879009528 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f858c0391b0 0x7f858c03b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f85980098c0 tx=0x7f8598006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.788+0000 7f858bfff640 1 -- 172.21.15.63:0/2879009528 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8594045360 con 0x7f85a4105de0 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.962+0000 7f85a9670640 1 -- 172.21.15.63:0/2879009528 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f85a402d7c0 con 0x7f85a4105de0 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.965+0000 7f858bfff640 1 -- 172.21.15.63:0/2879009528 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f85940371e0 con 0x7f85a4105de0 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.967+0000 7f85a9670640 1 -- 172.21.15.63:0/2879009528 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f858c0391b0 msgr2=0x7f858c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.967+0000 7f85a9670640 1 --2- 172.21.15.63:0/2879009528 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f858c0391b0 0x7f858c03b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f85980098c0 tx=0x7f8598006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.967+0000 7f85a9670640 1 -- 172.21.15.63:0/2879009528 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 msgr2=0x7f85a419d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.967+0000 7f85a9670640 1 --2- 172.21.15.63:0/2879009528 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a419d8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8594030cc0 tx=0x7f8594030cf0 comp rx=0 tx=0).stop 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.967+0000 7f85a9670640 1 -- 172.21.15.63:0/2879009528 shutdown_connections 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.967+0000 7f85a9670640 1 --2- 172.21.15.63:0/2879009528 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f858c0391b0 0x7f858c03b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.967+0000 7f85a9670640 1 --2- 172.21.15.63:0/2879009528 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85a4105de0 0x7f85a419d8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:30.794 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.967+0000 7f85a9670640 1 -- 172.21.15.63:0/2879009528 >> 172.21.15.63:0/2879009528 conn(0x7f85a4101bb0 msgr2=0x7f85a41942a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:30.795 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.967+0000 7f85a9670640 1 -- 172.21.15.63:0/2879009528 shutdown_connections 2024-09-16T01:14:30.795 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:29.967+0000 7f85a9670640 1 -- 172.21.15.63:0/2879009528 wait complete. 2024-09-16T01:14:30.795 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling the dashboard module... 2024-09-16T01:14:31.194 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:30 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2879009528' entity='client.admin' 2024-09-16T01:14:31.194 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:30 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:32.315 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:31 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/4169202530' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-16T01:14:32.315 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:31 smithi063 ceph-mon[31070]: from='mgr.14118 172.21.15.63:0/1422991902' entity='mgr.x' 2024-09-16T01:14:32.316 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:32 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: ignoring --setuser ceph since I am not root 2024-09-16T01:14:32.316 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:32 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: ignoring --setgroup ceph since I am not root 2024-09-16T01:14:32.316 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:32 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:32.136+0000 7f563e3ba040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:14:32.316 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:32 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:32.198+0000 7f563e3ba040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:14:32.588 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:32 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:32.359+0000 7f563e3ba040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:14:32.589 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:32 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:32.429+0000 7f563e3ba040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:14:32.589 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:32 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:32.587+0000 7f563e3ba040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:14:32.625 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.200+0000 7f609963c640 1 Processor -- start 2024-09-16T01:14:32.625 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.200+0000 7f609963c640 1 -- start start 2024-09-16T01:14:32.625 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.200+0000 7f609963c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f6094106780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:32.625 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.200+0000 7f609963c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6094106d50 con 0x7f6094106380 2024-09-16T01:14:32.625 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.201+0000 7f6092ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f6094106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.201+0000 7f6092ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f6094106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59022/0 (socket says 172.21.15.63:59022) 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.201+0000 7f6092ffd640 1 -- 172.21.15.63:0/4235468445 learned_addr learned my addr 172.21.15.63:0/4235468445 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.201+0000 7f6092ffd640 1 -- 172.21.15.63:0/4235468445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6094107580 con 0x7f6094106380 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.202+0000 7f6092ffd640 1 --2- 172.21.15.63:0/4235468445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f6094106780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f608c009e80 tx=0x7f608c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3c41055cb30af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.202+0000 7f6091ffb640 1 -- 172.21.15.63:0/4235468445 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c036070 con 0x7f6094106380 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.202+0000 7f6091ffb640 1 -- 172.21.15.63:0/4235468445 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f608c0318b0 con 0x7f6094106380 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.202+0000 7f6091ffb640 1 -- 172.21.15.63:0/4235468445 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c007930 con 0x7f6094106380 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.202+0000 7f609963c640 1 -- 172.21.15.63:0/4235468445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 msgr2=0x7f6094106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.202+0000 7f609963c640 1 --2- 172.21.15.63:0/4235468445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f6094106780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f608c009e80 tx=0x7f608c02a7a0 comp rx=0 tx=0).stop 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.203+0000 7f609963c640 1 -- 172.21.15.63:0/4235468445 shutdown_connections 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.203+0000 7f609963c640 1 --2- 172.21.15.63:0/4235468445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f6094106780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:32.626 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.203+0000 7f609963c640 1 -- 172.21.15.63:0/4235468445 >> 172.21.15.63:0/4235468445 conn(0x7f6094101b10 msgr2=0x7f6094103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.203+0000 7f609963c640 1 -- 172.21.15.63:0/4235468445 shutdown_connections 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.203+0000 7f609963c640 1 -- 172.21.15.63:0/4235468445 wait complete. 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.203+0000 7f609963c640 1 Processor -- start 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.203+0000 7f609963c640 1 -- start start 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f609963c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f60941915b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f609963c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f609410a930 con 0x7f6094106380 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f6092ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f60941915b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f6092ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f60941915b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59034/0 (socket says 172.21.15.63:59034) 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f6092ffd640 1 -- 172.21.15.63:0/4169202530 learned_addr learned my addr 172.21.15.63:0/4169202530 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f6092ffd640 1 -- 172.21.15.63:0/4169202530 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6094191af0 con 0x7f6094106380 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f6092ffd640 1 --2- 172.21.15.63:0/4169202530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f60941915b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f608c02acc0 tx=0x7f608c031c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f608bfff640 1 -- 172.21.15.63:0/4169202530 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c036050 con 0x7f6094106380 2024-09-16T01:14:32.627 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f609963c640 1 -- 172.21.15.63:0/4169202530 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609418fce0 con 0x7f6094106380 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f608bfff640 1 -- 172.21.15.63:0/4169202530 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f608c037040 con 0x7f6094106380 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f608bfff640 1 -- 172.21.15.63:0/4169202530 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c03d950 con 0x7f6094106380 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.204+0000 7f609963c640 1 -- 172.21.15.63:0/4169202530 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6094190220 con 0x7f6094106380 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.205+0000 7f608bfff640 1 -- 172.21.15.63:0/4169202530 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f608c044020 con 0x7f6094106380 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.206+0000 7f609963c640 1 -- 172.21.15.63:0/4169202530 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609410aab0 con 0x7f6094106380 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.206+0000 7f608bfff640 1 --2- 172.21.15.63:0/4169202530 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f60800391b0 0x7f608003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.206+0000 7f608bfff640 1 -- 172.21.15.63:0/4169202530 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f608c042020 con 0x7f6094106380 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.206+0000 7f60927fc640 1 --2- 172.21.15.63:0/4169202530 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f60800391b0 0x7f608003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.206+0000 7f60927fc640 1 --2- 172.21.15.63:0/4169202530 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f60800391b0 0x7f608003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f607c0098c0 tx=0x7f607c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.211+0000 7f608bfff640 1 -- 172.21.15.63:0/4169202530 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f608c070030 con 0x7f6094106380 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.447+0000 7f609963c640 1 -- 172.21.15.63:0/4169202530 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f6094106800 con 0x7f6094106380 2024-09-16T01:14:32.628 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.970+0000 7f608bfff640 1 -- 172.21.15.63:0/4169202530 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f608c04b020 con 0x7f6094106380 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.973+0000 7f608bfff640 1 -- 172.21.15.63:0/4169202530 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f608c046410 con 0x7f6094106380 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.973+0000 7f609963c640 1 -- 172.21.15.63:0/4169202530 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f60800391b0 msgr2=0x7f608003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.973+0000 7f609963c640 1 --2- 172.21.15.63:0/4169202530 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f60800391b0 0x7f608003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f607c0098c0 tx=0x7f607c006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.973+0000 7f609963c640 1 -- 172.21.15.63:0/4169202530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 msgr2=0x7f60941915b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.973+0000 7f609963c640 1 --2- 172.21.15.63:0/4169202530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f60941915b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f608c02acc0 tx=0x7f608c031c90 comp rx=0 tx=0).stop 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.973+0000 7f609963c640 1 -- 172.21.15.63:0/4169202530 shutdown_connections 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.973+0000 7f609963c640 1 --2- 172.21.15.63:0/4169202530 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f60800391b0 0x7f608003b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.973+0000 7f609963c640 1 --2- 172.21.15.63:0/4169202530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6094106380 0x7f60941915b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.973+0000 7f609963c640 1 -- 172.21.15.63:0/4169202530 >> 172.21.15.63:0/4169202530 conn(0x7f6094101b10 msgr2=0x7f6094102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.973+0000 7f609963c640 1 -- 172.21.15.63:0/4169202530 shutdown_connections 2024-09-16T01:14:32.629 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:31.974+0000 7f609963c640 1 -- 172.21.15.63:0/4169202530 wait complete. 2024-09-16T01:14:32.859 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:32 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:32.742+0000 7f563e3ba040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:14:33.146 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:32 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/4169202530' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-16T01:14:33.146 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:32 smithi063 ceph-mon[31070]: mgrmap e9: x(active, since 18s) 2024-09-16T01:14:33.146 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:33 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:33.079+0000 7f563e3ba040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:14:33.146 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:33 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:33.144+0000 7f563e3ba040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:14:33.438 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:33 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:33.344+0000 7f563e3ba040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:14:34.250 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:33 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1753166478' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T01:14:34.259 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:14:34.259 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-16T01:14:34.259 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T01:14:34.259 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-16T01:14:34.259 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T01:14:34.259 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:14:34.259 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.250+0000 7f1cdbfb8640 1 Processor -- start 2024-09-16T01:14:34.259 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.250+0000 7f1cdbfb8640 1 -- start start 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.251+0000 7f1cdbfb8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd410a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.251+0000 7f1cdbfb8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd407be50 con 0x7f1cd4107f10 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.251+0000 7f1cd9d54640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd410a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.251+0000 7f1cd9d54640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd410a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59058/0 (socket says 172.21.15.63:59058) 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.251+0000 7f1cd9d54640 1 -- 172.21.15.63:0/2011705394 learned_addr learned my addr 172.21.15.63:0/2011705394 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.251+0000 7f1cd9d54640 1 -- 172.21.15.63:0/2011705394 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd410a840 con 0x7f1cd4107f10 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.252+0000 7f1cd9d54640 1 --2- 172.21.15.63:0/2011705394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd410a300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009820 tx=0x7f1cd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3405f144170d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.252+0000 7f1cd8d52640 1 -- 172.21.15.63:0/2011705394 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0037070 con 0x7f1cd4107f10 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.252+0000 7f1cd8d52640 1 -- 172.21.15.63:0/2011705394 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cd00328f0 con 0x7f1cd4107f10 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.252+0000 7f1cd8d52640 1 -- 172.21.15.63:0/2011705394 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0030740 con 0x7f1cd4107f10 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.253+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/2011705394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 msgr2=0x7f1cd410a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.253+0000 7f1cdbfb8640 1 --2- 172.21.15.63:0/2011705394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd410a300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009820 tx=0x7f1cd002a270 comp rx=0 tx=0).stop 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.253+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/2011705394 shutdown_connections 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.253+0000 7f1cdbfb8640 1 --2- 172.21.15.63:0/2011705394 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd410a300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.253+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/2011705394 >> 172.21.15.63:0/2011705394 conn(0x7f1cd4101b10 msgr2=0x7f1cd4103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.253+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/2011705394 shutdown_connections 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.253+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/2011705394 wait complete. 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.254+0000 7f1cdbfb8640 1 Processor -- start 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.254+0000 7f1cdbfb8640 1 -- start start 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.254+0000 7f1cdbfb8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd419d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.254+0000 7f1cdbfb8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd410b860 con 0x7f1cd4107f10 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.254+0000 7f1cd9d54640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd419d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:34.261 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.254+0000 7f1cd9d54640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd419d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59074/0 (socket says 172.21.15.63:59074) 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.254+0000 7f1cd9d54640 1 -- 172.21.15.63:0/1753166478 learned_addr learned my addr 172.21.15.63:0/1753166478 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.254+0000 7f1cd9d54640 1 -- 172.21.15.63:0/1753166478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd419de90 con 0x7f1cd4107f10 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.255+0000 7f1cd9d54640 1 --2- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd419d950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0030cc0 tx=0x7f1cd0030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.255+0000 7f1ccaffd640 1 -- 172.21.15.63:0/1753166478 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0042070 con 0x7f1cd4107f10 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.255+0000 7f1ccaffd640 1 -- 172.21.15.63:0/1753166478 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cd0030e60 con 0x7f1cd4107f10 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.255+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/1753166478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd419e120 con 0x7f1cd4107f10 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.255+0000 7f1ccaffd640 1 -- 172.21.15.63:0/1753166478 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0037040 con 0x7f1cd4107f10 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.255+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/1753166478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd41a0e10 con 0x7f1cd4107f10 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.256+0000 7f1ccaffd640 1 -- 172.21.15.63:0/1753166478 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f1cd0045070 con 0x7f1cd4107f10 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.256+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/1753166478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd4108370 con 0x7f1cd4107f10 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.256+0000 7f1ccaffd640 1 --2- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f1cc0039260 0x7f1cc003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.256+0000 7f1ccaffd640 1 -- 172.21.15.63:0/1753166478 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1cd006c310 con 0x7f1cd4107f10 2024-09-16T01:14:34.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.256+0000 7f1cd9553640 1 -- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f1cc0039260 msgr2=0x7f1cc003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1469009490 2024-09-16T01:14:34.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.256+0000 7f1cd9553640 1 --2- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f1cc0039260 0x7f1cc003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:14:34.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.261+0000 7f1ccaffd640 1 -- 172.21.15.63:0/1753166478 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1cd002fd90 con 0x7f1cd4107f10 2024-09-16T01:14:34.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.457+0000 7f1cd9553640 1 -- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f1cc0039260 msgr2=0x7f1cc003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1469009490 2024-09-16T01:14:34.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.457+0000 7f1cd9553640 1 --2- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f1cc0039260 0x7f1cc003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:14:34.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.487+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/1753166478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f1cd402d7c0 con 0x7f1cd4107f10 2024-09-16T01:14:34.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.487+0000 7f1ccaffd640 1 -- 172.21.15.63:0/1753166478 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f1cd003d950 con 0x7f1cd4107f10 2024-09-16T01:14:34.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.489+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f1cc0039260 msgr2=0x7f1cc003b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:14:34.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.489+0000 7f1cdbfb8640 1 --2- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f1cc0039260 0x7f1cc003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:34.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.489+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 msgr2=0x7f1cd419d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:34.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.489+0000 7f1cdbfb8640 1 --2- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd419d950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0030cc0 tx=0x7f1cd0030cf0 comp rx=0 tx=0).stop 2024-09-16T01:14:34.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.489+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/1753166478 shutdown_connections 2024-09-16T01:14:34.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.489+0000 7f1cdbfb8640 1 --2- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7f1cc0039260 0x7f1cc003b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:34.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.489+0000 7f1cdbfb8640 1 --2- 172.21.15.63:0/1753166478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cd4107f10 0x7f1cd419d950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:34.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.489+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/1753166478 >> 172.21.15.63:0/1753166478 conn(0x7f1cd4101b10 msgr2=0x7f1cd4102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:34.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.490+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/1753166478 shutdown_connections 2024-09-16T01:14:34.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:33.490+0000 7f1cdbfb8640 1 -- 172.21.15.63:0/1753166478 wait complete. 2024-09-16T01:14:34.264 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for the mgr to restart... 2024-09-16T01:14:34.264 INFO:teuthology.orchestra.run.smithi063.stdout:Waiting for mgr epoch 9... 2024-09-16T01:14:34.502 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:34 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:34.295+0000 7f563e3ba040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:14:34.502 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:34 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:34.366+0000 7f563e3ba040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:14:35.399 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:35.127+0000 7f563e3ba040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:14:35.399 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:35.248+0000 7f563e3ba040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:14:35.690 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:35.397+0000 7f563e3ba040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:14:35.691 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:35.461+0000 7f563e3ba040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:14:35.691 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:35.618+0000 7f563e3ba040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:14:35.691 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:35.689+0000 7f563e3ba040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:14:35.987 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:35.752+0000 7f563e3ba040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:14:35.987 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:35.918+0000 7f563e3ba040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:14:35.987 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:35.986+0000 7f563e3ba040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:14:36.267 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:36 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:36.055+0000 7f563e3ba040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:14:36.267 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:36 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:36.141+0000 7f563e3ba040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:14:36.267 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:36 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:36.204+0000 7f563e3ba040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:14:36.267 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:36 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:36.265+0000 7f563e3ba040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:14:37.359 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:37.094+0000 7f563e3ba040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:14:37.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: Active manager daemon x restarted 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: Activating manager daemon x 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: osdmap e3: 0 total, 0 up, 0 in 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: mgrmap e10: x(active, starting, since 0.00346152s) 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: Manager daemon x is now available 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:14:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-16T01:14:37.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:37 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-16T01:14:38.979 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout { 2024-09-16T01:14:38.979 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-16T01:14:38.979 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T01:14:38.979 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout } 2024-09-16T01:14:38.979 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.658+0000 7fadeff3b640 1 Processor -- start 2024-09-16T01:14:38.979 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.658+0000 7fadeff3b640 1 -- start start 2024-09-16T01:14:38.979 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.658+0000 7fadeff3b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade8106780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:38.979 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.658+0000 7fadeff3b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fade8106d50 con 0x7fade8106380 2024-09-16T01:14:38.979 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.658+0000 7fadedcd7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade8106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:38.979 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.658+0000 7fadedcd7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade8106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59090/0 (socket says 172.21.15.63:59090) 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.658+0000 7fadedcd7640 1 -- 172.21.15.63:0/933186471 learned_addr learned my addr 172.21.15.63:0/933186471 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.659+0000 7fadedcd7640 1 -- 172.21.15.63:0/933186471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade8107580 con 0x7fade8106380 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.659+0000 7fadedcd7640 1 --2- 172.21.15.63:0/933186471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade8106780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fade4009820 tx=0x7fade402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8013822b0169afe server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.659+0000 7fadeccd5640 1 -- 172.21.15.63:0/933186471 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade4037070 con 0x7fade8106380 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.659+0000 7fadeccd5640 1 -- 172.21.15.63:0/933186471 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fade40328f0 con 0x7fade8106380 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.659+0000 7fadeccd5640 1 -- 172.21.15.63:0/933186471 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade4030740 con 0x7fade8106380 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.660+0000 7fadeff3b640 1 -- 172.21.15.63:0/933186471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 msgr2=0x7fade8106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.660+0000 7fadeff3b640 1 --2- 172.21.15.63:0/933186471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade8106780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fade4009820 tx=0x7fade402a270 comp rx=0 tx=0).stop 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.660+0000 7fadeff3b640 1 -- 172.21.15.63:0/933186471 shutdown_connections 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.660+0000 7fadeff3b640 1 --2- 172.21.15.63:0/933186471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade8106780 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.660+0000 7fadeff3b640 1 -- 172.21.15.63:0/933186471 >> 172.21.15.63:0/933186471 conn(0x7fade8101b10 msgr2=0x7fade8103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.660+0000 7fadeff3b640 1 -- 172.21.15.63:0/933186471 shutdown_connections 2024-09-16T01:14:38.980 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.660+0000 7fadeff3b640 1 -- 172.21.15.63:0/933186471 wait complete. 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.661+0000 7fadeff3b640 1 Processor -- start 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.661+0000 7fadeff3b640 1 -- start start 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.661+0000 7fadeff3b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.661+0000 7fadeff3b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fade810a930 con 0x7fade8106380 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.661+0000 7fadedcd7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.661+0000 7fadedcd7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade819b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59100/0 (socket says 172.21.15.63:59100) 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.661+0000 7fadedcd7640 1 -- 172.21.15.63:0/3766517099 learned_addr learned my addr 172.21.15.63:0/3766517099 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.662+0000 7fadedcd7640 1 -- 172.21.15.63:0/3766517099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade819bd60 con 0x7fade8106380 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.662+0000 7fadedcd7640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade819b820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fade40097f0 tx=0x7fade4030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.662+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade4042070 con 0x7fade8106380 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.662+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fade4030e80 con 0x7fade8106380 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.662+0000 7fadeff3b640 1 -- 172.21.15.63:0/3766517099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade819bff0 con 0x7fade8106380 2024-09-16T01:14:38.981 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.662+0000 7fadeff3b640 1 -- 172.21.15.63:0/3766517099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade819ece0 con 0x7fade8106380 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.662+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade4037040 con 0x7fade8106380 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.663+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fade4045070 con 0x7fade8106380 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.663+0000 7faddeffd640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 0x7fadd403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.663+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 --> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fadd403bdd0 con 0x7fadd4039200 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.663+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fade406c380 con 0x7fade8106380 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.663+0000 7faded4d6640 1 -- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 msgr2=0x7fadd403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1469009490 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.663+0000 7faded4d6640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 0x7fadd403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.864+0000 7faded4d6640 1 -- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 msgr2=0x7fadd403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1469009490 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:34.864+0000 7faded4d6640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 0x7fadd403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:35.265+0000 7faded4d6640 1 -- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 msgr2=0x7fadd403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1469009490 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:35.265+0000 7faded4d6640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 0x7fadd403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-16T01:14:38.982 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:36.066+0000 7faded4d6640 1 -- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 msgr2=0x7fadd403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.63:6800/1469009490 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:36.066+0000 7faded4d6640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 0x7fadd403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:37.097+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7fade403db70 con 0x7fade8106380 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:37.097+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 msgr2=0x7fadd403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:37.097+0000 7faddeffd640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 0x7fadd403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.099+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fade403b330 con 0x7fade8106380 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.099+0000 7faddeffd640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fadd403ccc0 0x7fadd403f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.099+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fade402eb70 con 0x7fadd403ccc0 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.100+0000 7faded4d6640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fadd403ccc0 0x7fadd403f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.100+0000 7faded4d6640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fadd403ccc0 0x7fadd403f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fadd8003980 tx=0x7fadd8006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.101+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fade402eb70 con 0x7fadd403ccc0 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7fadeff3b640 1 -- 172.21.15.63:0/3766517099 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fadcc002570 con 0x7fadd403ccc0 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7faddeffd640 1 -- 172.21.15.63:0/3766517099 <== mgr.14150 v2:172.21.15.63:6800/3860332424 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fadcc002570 con 0x7fadd403ccc0 2024-09-16T01:14:38.983 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7fadeff3b640 1 -- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fadd403ccc0 msgr2=0x7fadd403f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7fadeff3b640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fadd403ccc0 0x7fadd403f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fadd8003980 tx=0x7fadd8006e10 comp rx=0 tx=0).stop 2024-09-16T01:14:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7fadeff3b640 1 -- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 msgr2=0x7fade819b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7fadeff3b640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade819b820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fade40097f0 tx=0x7fade4030c70 comp rx=0 tx=0).stop 2024-09-16T01:14:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7fadeff3b640 1 -- 172.21.15.63:0/3766517099 shutdown_connections 2024-09-16T01:14:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7fadeff3b640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fadd403ccc0 0x7fadd403f0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7fadeff3b640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:6800/1469009490,v1:172.21.15.63:6801/1469009490] conn(0x7fadd4039200 0x7fadd403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7fadeff3b640 1 --2- 172.21.15.63:0/3766517099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fade8106380 0x7fade819b820 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.108+0000 7fadeff3b640 1 -- 172.21.15.63:0/3766517099 >> 172.21.15.63:0/3766517099 conn(0x7fade8101b10 msgr2=0x7fade8102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.109+0000 7fadeff3b640 1 -- 172.21.15.63:0/3766517099 shutdown_connections 2024-09-16T01:14:38.984 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:38.109+0000 7fadeff3b640 1 -- 172.21.15.63:0/3766517099 wait complete. 2024-09-16T01:14:38.985 INFO:teuthology.orchestra.run.smithi063.stdout:mgr epoch 9 is available 2024-09-16T01:14:38.985 INFO:teuthology.orchestra.run.smithi063.stdout:Generating a dashboard self-signed certificate... 2024-09-16T01:14:39.223 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-mon[31070]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T01:14:39.223 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-mon[31070]: mgrmap e11: x(active, since 1.00594s) 2024-09-16T01:14:39.223 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-mon[31070]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T01:14:39.223 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:39.860 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:39.505+0000 7f55a3e83640 -1 log_channel(cephadm) log [ERR] : [16/Sep/2024:01:14:39] ENGINE Error in HTTPServer.serve 2024-09-16T01:14:39.860 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: Traceback (most recent call last): 2024-09-16T01:14:39.860 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:14:39.860 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: self._connections.run(self.expiration_interval) 2024-09-16T01:14:39.860 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:14:39.860 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: self._run(expiration_interval) 2024-09-16T01:14:39.860 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:14:39.860 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:14:39.860 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:14:39.860 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:14:39.861 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:14:39.861 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: s = self.context.wrap_socket( 2024-09-16T01:14:39.861 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:14:39.861 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: return self.sslsocket_class._create( 2024-09-16T01:14:39.861 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:14:39.861 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: self.do_handshake() 2024-09-16T01:14:39.861 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:14:39.861 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: self._sslobj.do_handshake() 2024-09-16T01:14:39.861 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:14:39.861 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:14:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:14:40.334 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-16T01:14:40.334 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.420+0000 7fcd25568640 1 Processor -- start 2024-09-16T01:14:40.334 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.421+0000 7fcd25568640 1 -- start start 2024-09-16T01:14:40.334 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.421+0000 7fcd25568640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd20106780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:40.334 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.421+0000 7fcd25568640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcd20106d50 con 0x7fcd20106380 2024-09-16T01:14:40.334 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.421+0000 7fcd1effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd20106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:40.334 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.421+0000 7fcd1effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd20106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43732/0 (socket says 172.21.15.63:43732) 2024-09-16T01:14:40.334 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.421+0000 7fcd1effd640 1 -- 172.21.15.63:0/2441877044 learned_addr learned my addr 172.21.15.63:0/2441877044 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:40.334 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.421+0000 7fcd1effd640 1 -- 172.21.15.63:0/2441877044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd20107580 con 0x7fcd20106380 2024-09-16T01:14:40.334 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.422+0000 7fcd1effd640 1 --2- 172.21.15.63:0/2441877044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd20106780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009820 tx=0x7fcd1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9355968fe2cb984c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.422+0000 7fcd1dffb640 1 -- 172.21.15.63:0/2441877044 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd10037070 con 0x7fcd20106380 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.422+0000 7fcd1dffb640 1 -- 172.21.15.63:0/2441877044 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd100328f0 con 0x7fcd20106380 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.422+0000 7fcd1dffb640 1 -- 172.21.15.63:0/2441877044 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd10030740 con 0x7fcd20106380 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.423+0000 7fcd25568640 1 -- 172.21.15.63:0/2441877044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 msgr2=0x7fcd20106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.423+0000 7fcd25568640 1 --2- 172.21.15.63:0/2441877044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd20106780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009820 tx=0x7fcd1002a270 comp rx=0 tx=0).stop 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.423+0000 7fcd25568640 1 -- 172.21.15.63:0/2441877044 shutdown_connections 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.423+0000 7fcd25568640 1 --2- 172.21.15.63:0/2441877044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd20106780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.423+0000 7fcd25568640 1 -- 172.21.15.63:0/2441877044 >> 172.21.15.63:0/2441877044 conn(0x7fcd20101b10 msgr2=0x7fcd20103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.423+0000 7fcd25568640 1 -- 172.21.15.63:0/2441877044 shutdown_connections 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.423+0000 7fcd25568640 1 -- 172.21.15.63:0/2441877044 wait complete. 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.424+0000 7fcd25568640 1 Processor -- start 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.424+0000 7fcd25568640 1 -- start start 2024-09-16T01:14:40.335 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.424+0000 7fcd25568640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd2019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.424+0000 7fcd25568640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2010a930 con 0x7fcd20106380 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.424+0000 7fcd1effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd2019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.424+0000 7fcd1effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd2019b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43746/0 (socket says 172.21.15.63:43746) 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.424+0000 7fcd1effd640 1 -- 172.21.15.63:0/698918663 learned_addr learned my addr 172.21.15.63:0/698918663 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.425+0000 7fcd1effd640 1 -- 172.21.15.63:0/698918663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2019bd50 con 0x7fcd20106380 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.425+0000 7fcd1effd640 1 --2- 172.21.15.63:0/698918663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd2019b810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009940 tx=0x7fcd100327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.425+0000 7fcd17fff640 1 -- 172.21.15.63:0/698918663 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd10042070 con 0x7fcd20106380 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.425+0000 7fcd17fff640 1 -- 172.21.15.63:0/698918663 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd10030d00 con 0x7fcd20106380 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.425+0000 7fcd25568640 1 -- 172.21.15.63:0/698918663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2019bfe0 con 0x7fcd20106380 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.425+0000 7fcd17fff640 1 -- 172.21.15.63:0/698918663 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd10037040 con 0x7fcd20106380 2024-09-16T01:14:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.425+0000 7fcd25568640 1 -- 172.21.15.63:0/698918663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2019ecd0 con 0x7fcd20106380 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.426+0000 7fcd17fff640 1 -- 172.21.15.63:0/698918663 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fcd10045070 con 0x7fcd20106380 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.426+0000 7fcd25568640 1 -- 172.21.15.63:0/698918663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd2010aab0 con 0x7fcd20106380 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.426+0000 7fcd17fff640 1 --2- 172.21.15.63:0/698918663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcd0c039140 0x7fcd0c03b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.426+0000 7fcd17fff640 1 -- 172.21.15.63:0/698918663 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcd1006c2d0 con 0x7fcd20106380 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.426+0000 7fcd1e7fc640 1 --2- 172.21.15.63:0/698918663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcd0c039140 0x7fcd0c03b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.427+0000 7fcd1e7fc640 1 --2- 172.21.15.63:0/698918663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcd0c039140 0x7fcd0c03b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd080098c0 tx=0x7fcd08006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.431+0000 7fcd17fff640 1 -- 172.21.15.63:0/698918663 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd10046e00 con 0x7fcd20106380 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.591+0000 7fcd17fff640 1 -- 172.21.15.63:0/698918663 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fcd1003caa0 con 0x7fcd20106380 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.614+0000 7fcd25568640 1 -- 172.21.15.63:0/698918663 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fcd20062630 con 0x7fcd0c039140 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.711+0000 7fcd17fff640 1 -- 172.21.15.63:0/698918663 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fcd20062630 con 0x7fcd0c039140 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.713+0000 7fcd25568640 1 -- 172.21.15.63:0/698918663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcd0c039140 msgr2=0x7fcd0c03b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.713+0000 7fcd25568640 1 --2- 172.21.15.63:0/698918663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcd0c039140 0x7fcd0c03b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd080098c0 tx=0x7fcd08006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:40.338 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.713+0000 7fcd25568640 1 -- 172.21.15.63:0/698918663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 msgr2=0x7fcd2019b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:40.338 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.713+0000 7fcd25568640 1 --2- 172.21.15.63:0/698918663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd2019b810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009940 tx=0x7fcd100327b0 comp rx=0 tx=0).stop 2024-09-16T01:14:40.338 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.713+0000 7fcd25568640 1 -- 172.21.15.63:0/698918663 shutdown_connections 2024-09-16T01:14:40.338 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.713+0000 7fcd25568640 1 --2- 172.21.15.63:0/698918663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcd0c039140 0x7fcd0c03b600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:40.338 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.713+0000 7fcd25568640 1 --2- 172.21.15.63:0/698918663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcd20106380 0x7fcd2019b810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:40.338 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.713+0000 7fcd25568640 1 -- 172.21.15.63:0/698918663 >> 172.21.15.63:0/698918663 conn(0x7fcd20101b10 msgr2=0x7fcd20102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:40.338 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.713+0000 7fcd25568640 1 -- 172.21.15.63:0/698918663 shutdown_connections 2024-09-16T01:14:40.338 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:39.713+0000 7fcd25568640 1 -- 172.21.15.63:0/698918663 wait complete. 2024-09-16T01:14:40.338 INFO:teuthology.orchestra.run.smithi063.stdout:Creating initial admin user... 2024-09-16T01:14:40.696 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:40 smithi063 ceph-mon[31070]: [16/Sep/2024:01:14:39] ENGINE Bus STARTING 2024-09-16T01:14:40.696 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:40 smithi063 ceph-mon[31070]: [16/Sep/2024:01:14:39] ENGINE Serving on http://172.21.15.63:8765 2024-09-16T01:14:40.696 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:40.696 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:40 smithi063 ceph-mon[31070]: [16/Sep/2024:01:14:39] ENGINE Serving on https://172.21.15.63:7150 2024-09-16T01:14:40.696 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:40 smithi063 ceph-mon[31070]: [16/Sep/2024:01:14:39] ENGINE Bus STARTED 2024-09-16T01:14:40.696 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:40 smithi063 ceph-mon[31070]: [16/Sep/2024:01:14:39] ENGINE Error in HTTPServer.serve 2024-09-16T01:14:40.696 INFO:journalctl@ceph.mon.a.smithi063.stdout: Traceback (most recent call last): 2024-09-16T01:14:40.696 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._connections.run(self.expiration_interval) 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._run(expiration_interval) 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: s = self.context.wrap_socket( 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: return self.sslsocket_class._create( 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T01:14:40.697 INFO:journalctl@ceph.mon.a.smithi063.stdout: self.do_handshake() 2024-09-16T01:14:40.698 INFO:journalctl@ceph.mon.a.smithi063.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T01:14:40.698 INFO:journalctl@ceph.mon.a.smithi063.stdout: self._sslobj.do_handshake() 2024-09-16T01:14:40.698 INFO:journalctl@ceph.mon.a.smithi063.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T01:14:40.698 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:40 smithi063 ceph-mon[31070]: mgrmap e12: x(active, since 2s) 2024-09-16T01:14:40.698 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:40 smithi063 ceph-mon[31070]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:40.698 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:40.698 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:41.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:41 smithi063 ceph-mon[31070]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:41.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:42.262 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$wpQZd5DFws1Rw1NrAyUDCuYHjjFi9J3uneNj87mUlNWEIG1fPIMG2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726449281, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.705+0000 7f2de0f18640 1 Processor -- start 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.705+0000 7f2de0f18640 1 -- start start 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.706+0000 7f2de0f18640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc106780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.706+0000 7f2de0f18640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc106d50 con 0x7f2ddc106380 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.706+0000 7f2dda59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc106780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.706+0000 7f2dda59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc106780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43760/0 (socket says 172.21.15.63:43760) 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.706+0000 7f2dda59c640 1 -- 172.21.15.63:0/2841455831 learned_addr learned my addr 172.21.15.63:0/2841455831 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.706+0000 7f2dda59c640 1 -- 172.21.15.63:0/2841455831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc107580 con 0x7f2ddc106380 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.707+0000 7f2dda59c640 1 --2- 172.21.15.63:0/2841455831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc106780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009820 tx=0x7f2dcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3a4ecf0b2f6373 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.707+0000 7f2dd9d9b640 1 -- 172.21.15.63:0/2841455831 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dcc037070 con 0x7f2ddc106380 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.707+0000 7f2dd9d9b640 1 -- 172.21.15.63:0/2841455831 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2dcc0328f0 con 0x7f2ddc106380 2024-09-16T01:14:42.263 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.707+0000 7f2dd9d9b640 1 -- 172.21.15.63:0/2841455831 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dcc030740 con 0x7f2ddc106380 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.707+0000 7f2de0f18640 1 -- 172.21.15.63:0/2841455831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 msgr2=0x7f2ddc106780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.707+0000 7f2de0f18640 1 --2- 172.21.15.63:0/2841455831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc106780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc009820 tx=0x7f2dcc02a270 comp rx=0 tx=0).stop 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.708+0000 7f2de0f18640 1 -- 172.21.15.63:0/2841455831 shutdown_connections 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.708+0000 7f2de0f18640 1 --2- 172.21.15.63:0/2841455831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc106780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.708+0000 7f2de0f18640 1 -- 172.21.15.63:0/2841455831 >> 172.21.15.63:0/2841455831 conn(0x7f2ddc101b10 msgr2=0x7f2ddc103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.708+0000 7f2de0f18640 1 -- 172.21.15.63:0/2841455831 shutdown_connections 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.708+0000 7f2de0f18640 1 -- 172.21.15.63:0/2841455831 wait complete. 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.708+0000 7f2de0f18640 1 Processor -- start 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.708+0000 7f2de0f18640 1 -- start start 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2de0f18640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2de0f18640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc10a930 con 0x7f2ddc106380 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2dda59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:42.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2dda59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc07ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43774/0 (socket says 172.21.15.63:43774) 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2dda59c640 1 -- 172.21.15.63:0/899569996 learned_addr learned my addr 172.21.15.63:0/899569996 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2dda59c640 1 -- 172.21.15.63:0/899569996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc19e550 con 0x7f2ddc106380 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2dda59c640 1 --2- 172.21.15.63:0/899569996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc07ba70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0097f0 tx=0x7f2dcc030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2dd37fe640 1 -- 172.21.15.63:0/899569996 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dcc042070 con 0x7f2ddc106380 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2dd37fe640 1 -- 172.21.15.63:0/899569996 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2dcc030e80 con 0x7f2ddc106380 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2de0f18640 1 -- 172.21.15.63:0/899569996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ddc19e720 con 0x7f2ddc106380 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2dd37fe640 1 -- 172.21.15.63:0/899569996 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dcc037040 con 0x7f2ddc106380 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.709+0000 7f2de0f18640 1 -- 172.21.15.63:0/899569996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ddc19eb40 con 0x7f2ddc106380 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.710+0000 7f2dd37fe640 1 -- 172.21.15.63:0/899569996 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f2dcc045070 con 0x7f2ddc106380 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.710+0000 7f2de0f18640 1 -- 172.21.15.63:0/899569996 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ddc10aab0 con 0x7f2ddc106380 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.710+0000 7f2dd37fe640 1 --2- 172.21.15.63:0/899569996 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2dc8039200 0x7f2dc803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.711+0000 7f2dd37fe640 1 -- 172.21.15.63:0/899569996 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2dcc06c490 con 0x7f2ddc106380 2024-09-16T01:14:42.265 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.711+0000 7f2dd3fff640 1 --2- 172.21.15.63:0/899569996 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2dc8039200 0x7f2dc803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.711+0000 7f2dd3fff640 1 --2- 172.21.15.63:0/899569996 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2dc8039200 0x7f2dc803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40098c0 tx=0x7f2dc4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.717+0000 7f2dd37fe640 1 -- 172.21.15.63:0/899569996 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2dcc045360 con 0x7f2ddc106380 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:40.916+0000 7f2de0f18640 1 -- 172.21.15.63:0/899569996 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f2ddc106800 con 0x7f2dc8039200 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.165+0000 7f2dd37fe640 1 -- 172.21.15.63:0/899569996 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f2ddc106800 con 0x7f2dc8039200 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.168+0000 7f2de0f18640 1 -- 172.21.15.63:0/899569996 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2dc8039200 msgr2=0x7f2dc803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.168+0000 7f2de0f18640 1 --2- 172.21.15.63:0/899569996 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2dc8039200 0x7f2dc803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40098c0 tx=0x7f2dc4006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.168+0000 7f2de0f18640 1 -- 172.21.15.63:0/899569996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 msgr2=0x7f2ddc07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.168+0000 7f2de0f18640 1 --2- 172.21.15.63:0/899569996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc07ba70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0097f0 tx=0x7f2dcc030c70 comp rx=0 tx=0).stop 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.168+0000 7f2de0f18640 1 -- 172.21.15.63:0/899569996 shutdown_connections 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.168+0000 7f2de0f18640 1 --2- 172.21.15.63:0/899569996 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2dc8039200 0x7f2dc803b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.168+0000 7f2de0f18640 1 --2- 172.21.15.63:0/899569996 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc106380 0x7f2ddc07ba70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:42.266 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.168+0000 7f2de0f18640 1 -- 172.21.15.63:0/899569996 >> 172.21.15.63:0/899569996 conn(0x7f2ddc101b10 msgr2=0x7f2ddc1028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:42.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.168+0000 7f2de0f18640 1 -- 172.21.15.63:0/899569996 shutdown_connections 2024-09-16T01:14:42.267 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:41.168+0000 7f2de0f18640 1 -- 172.21.15.63:0/899569996 wait complete. 2024-09-16T01:14:42.267 INFO:teuthology.orchestra.run.smithi063.stdout:Fetching dashboard port number... 2024-09-16T01:14:43.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:42 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3149248938' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-16T01:14:43.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stdout 8443 2024-09-16T01:14:43.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.738+0000 7f1f2fa82640 1 Processor -- start 2024-09-16T01:14:43.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.738+0000 7f1f2fa82640 1 -- start start 2024-09-16T01:14:43.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.738+0000 7f1f2fa82640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2807c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:43.464 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.738+0000 7f1f2fa82640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2807c820 con 0x7f1f2807de30 2024-09-16T01:14:43.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.738+0000 7f1f2d81e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2807c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:43.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.738+0000 7f1f2d81e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2807c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43786/0 (socket says 172.21.15.63:43786) 2024-09-16T01:14:43.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.738+0000 7f1f2d81e640 1 -- 172.21.15.63:0/2256717028 learned_addr learned my addr 172.21.15.63:0/2256717028 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:43.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.739+0000 7f1f2d81e640 1 -- 172.21.15.63:0/2256717028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2807c9a0 con 0x7f1f2807de30 2024-09-16T01:14:43.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.739+0000 7f1f2d81e640 1 --2- 172.21.15.63:0/2256717028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2807c2e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009820 tx=0x7f1f2402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b1e5272db0805c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:43.465 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.739+0000 7f1f2c81c640 1 -- 172.21.15.63:0/2256717028 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f24037070 con 0x7f1f2807de30 2024-09-16T01:14:43.466 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.739+0000 7f1f2c81c640 1 -- 172.21.15.63:0/2256717028 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1f240328f0 con 0x7f1f2807de30 2024-09-16T01:14:43.466 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.739+0000 7f1f2c81c640 1 -- 172.21.15.63:0/2256717028 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f240307c0 con 0x7f1f2807de30 2024-09-16T01:14:43.466 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.740+0000 7f1f2fa82640 1 -- 172.21.15.63:0/2256717028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 msgr2=0x7f1f2807c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:43.466 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.740+0000 7f1f2fa82640 1 --2- 172.21.15.63:0/2256717028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2807c2e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f24009820 tx=0x7f1f2402a300 comp rx=0 tx=0).stop 2024-09-16T01:14:43.466 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.740+0000 7f1f2fa82640 1 -- 172.21.15.63:0/2256717028 shutdown_connections 2024-09-16T01:14:43.466 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.740+0000 7f1f2fa82640 1 --2- 172.21.15.63:0/2256717028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2807c2e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:43.466 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.740+0000 7f1f2fa82640 1 -- 172.21.15.63:0/2256717028 >> 172.21.15.63:0/2256717028 conn(0x7f1f28102ca0 msgr2=0x7f1f281050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:43.467 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.740+0000 7f1f2fa82640 1 -- 172.21.15.63:0/2256717028 shutdown_connections 2024-09-16T01:14:43.467 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.740+0000 7f1f2fa82640 1 -- 172.21.15.63:0/2256717028 wait complete. 2024-09-16T01:14:43.467 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.741+0000 7f1f2fa82640 1 Processor -- start 2024-09-16T01:14:43.467 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.741+0000 7f1f2fa82640 1 -- start start 2024-09-16T01:14:43.467 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.741+0000 7f1f2fa82640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2819d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:43.467 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.741+0000 7f1f2fa82640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2810dac0 con 0x7f1f2807de30 2024-09-16T01:14:43.467 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.741+0000 7f1f2d81e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2819d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:43.468 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.741+0000 7f1f2d81e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2819d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43796/0 (socket says 172.21.15.63:43796) 2024-09-16T01:14:43.468 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.741+0000 7f1f2d81e640 1 -- 172.21.15.63:0/3149248938 learned_addr learned my addr 172.21.15.63:0/3149248938 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:43.468 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.741+0000 7f1f2d81e640 1 -- 172.21.15.63:0/3149248938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2819de70 con 0x7f1f2807de30 2024-09-16T01:14:43.468 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.741+0000 7f1f2d81e640 1 --2- 172.21.15.63:0/3149248938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2819d930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1f240304d0 tx=0x7f1f24032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:43.468 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.742+0000 7f1f1effd640 1 -- 172.21.15.63:0/3149248938 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f24037040 con 0x7f1f2807de30 2024-09-16T01:14:43.469 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.742+0000 7f1f1effd640 1 -- 172.21.15.63:0/3149248938 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1f24040070 con 0x7f1f2807de30 2024-09-16T01:14:43.469 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.742+0000 7f1f2fa82640 1 -- 172.21.15.63:0/3149248938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2819e100 con 0x7f1f2807de30 2024-09-16T01:14:43.469 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.742+0000 7f1f1effd640 1 -- 172.21.15.63:0/3149248938 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f2403be40 con 0x7f1f2807de30 2024-09-16T01:14:43.469 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.742+0000 7f1f2fa82640 1 -- 172.21.15.63:0/3149248938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f281a0df0 con 0x7f1f2807de30 2024-09-16T01:14:43.469 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.742+0000 7f1f1effd640 1 -- 172.21.15.63:0/3149248938 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f1f24045460 con 0x7f1f2807de30 2024-09-16T01:14:43.469 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.743+0000 7f1f2fa82640 1 -- 172.21.15.63:0/3149248938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2807c360 con 0x7f1f2807de30 2024-09-16T01:14:43.470 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.743+0000 7f1f1effd640 1 --2- 172.21.15.63:0/3149248938 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f14039260 0x7f1f1403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:43.470 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.743+0000 7f1f1effd640 1 -- 172.21.15.63:0/3149248938 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1f2406c5b0 con 0x7f1f2807de30 2024-09-16T01:14:43.470 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.743+0000 7f1f2d01d640 1 --2- 172.21.15.63:0/3149248938 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f14039260 0x7f1f1403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:43.470 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.743+0000 7f1f2d01d640 1 --2- 172.21.15.63:0/3149248938 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f14039260 0x7f1f1403b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1f180098c0 tx=0x7f1f18006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:43.470 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.748+0000 7f1f1effd640 1 -- 172.21.15.63:0/3149248938 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f240458a0 con 0x7f1f2807de30 2024-09-16T01:14:43.470 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.923+0000 7f1f2fa82640 1 -- 172.21.15.63:0/3149248938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f1f2802d7c0 con 0x7f1f2807de30 2024-09-16T01:14:43.471 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.924+0000 7f1f1effd640 1 -- 172.21.15.63:0/3149248938 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f1f24030ba0 con 0x7f1f2807de30 2024-09-16T01:14:43.471 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.925+0000 7f1f2fa82640 1 -- 172.21.15.63:0/3149248938 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f14039260 msgr2=0x7f1f1403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:43.471 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.926+0000 7f1f2fa82640 1 --2- 172.21.15.63:0/3149248938 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f14039260 0x7f1f1403b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1f180098c0 tx=0x7f1f18006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:43.471 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.926+0000 7f1f2fa82640 1 -- 172.21.15.63:0/3149248938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 msgr2=0x7f1f2819d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:43.471 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.926+0000 7f1f2fa82640 1 --2- 172.21.15.63:0/3149248938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2819d930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1f240304d0 tx=0x7f1f24032cd0 comp rx=0 tx=0).stop 2024-09-16T01:14:43.472 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.926+0000 7f1f2fa82640 1 -- 172.21.15.63:0/3149248938 shutdown_connections 2024-09-16T01:14:43.472 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.926+0000 7f1f2fa82640 1 --2- 172.21.15.63:0/3149248938 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f14039260 0x7f1f1403b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:43.472 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.926+0000 7f1f2fa82640 1 --2- 172.21.15.63:0/3149248938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f2807de30 0x7f1f2819d930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:43.472 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.926+0000 7f1f2fa82640 1 -- 172.21.15.63:0/3149248938 >> 172.21.15.63:0/3149248938 conn(0x7f1f28102ca0 msgr2=0x7f1f28103940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:43.472 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.926+0000 7f1f2fa82640 1 -- 172.21.15.63:0/3149248938 shutdown_connections 2024-09-16T01:14:43.472 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:42.926+0000 7f1f2fa82640 1 -- 172.21.15.63:0/3149248938 wait complete. 2024-09-16T01:14:43.473 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T01:14:43.473 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout disabled 2024-09-16T01:14:43.475 INFO:teuthology.orchestra.run.smithi063.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T01:14:43.475 INFO:teuthology.orchestra.run.smithi063.stdout:systemctl: stdout inactive 2024-09-16T01:14:43.475 INFO:teuthology.orchestra.run.smithi063.stdout:firewalld.service is not enabled 2024-09-16T01:14:43.475 INFO:teuthology.orchestra.run.smithi063.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-16T01:14:43.477 INFO:teuthology.orchestra.run.smithi063.stdout:Ceph Dashboard is now available at: 2024-09-16T01:14:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: URL: https://smithi063.front.sepia.ceph.com:8443/ 2024-09-16T01:14:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: User: admin 2024-09-16T01:14:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: Password: eykba35cw0 2024-09-16T01:14:43.477 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:43.477 INFO:teuthology.orchestra.run.smithi063.stdout:Saving cluster configuration to /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config directory 2024-09-16T01:14:44.710 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.845+0000 7fcce035b640 1 Processor -- start 2024-09-16T01:14:44.710 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.845+0000 7fcce035b640 1 -- start start 2024-09-16T01:14:44.710 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.845+0000 7fcce035b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd810a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:44.710 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.845+0000 7fcce035b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fccd807be50 con 0x7fccd8107f30 2024-09-16T01:14:44.710 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.846+0000 7fccde0f7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd810a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:44.710 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.846+0000 7fccde0f7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd810a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43810/0 (socket says 172.21.15.63:43810) 2024-09-16T01:14:44.710 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.846+0000 7fccde0f7640 1 -- 172.21.15.63:0/2583679984 learned_addr learned my addr 172.21.15.63:0/2583679984 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:44.710 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.846+0000 7fccde0f7640 1 -- 172.21.15.63:0/2583679984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd810a860 con 0x7fccd8107f30 2024-09-16T01:14:44.710 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.847+0000 7fccde0f7640 1 --2- 172.21.15.63:0/2583679984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd810a320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009820 tx=0x7fccd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2408e0e2f5a5d2e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:44.711 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.847+0000 7fccdd0f5640 1 -- 172.21.15.63:0/2583679984 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccd0037070 con 0x7fccd8107f30 2024-09-16T01:14:44.711 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.847+0000 7fccdd0f5640 1 -- 172.21.15.63:0/2583679984 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccd00328f0 con 0x7fccd8107f30 2024-09-16T01:14:44.711 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.847+0000 7fccdd0f5640 1 -- 172.21.15.63:0/2583679984 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccd0030740 con 0x7fccd8107f30 2024-09-16T01:14:44.711 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.847+0000 7fcce035b640 1 -- 172.21.15.63:0/2583679984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 msgr2=0x7fccd810a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:44.711 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.847+0000 7fcce035b640 1 --2- 172.21.15.63:0/2583679984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd810a320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009820 tx=0x7fccd002a270 comp rx=0 tx=0).stop 2024-09-16T01:14:44.711 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.848+0000 7fcce035b640 1 -- 172.21.15.63:0/2583679984 shutdown_connections 2024-09-16T01:14:44.711 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.848+0000 7fcce035b640 1 --2- 172.21.15.63:0/2583679984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd810a320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:44.711 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.848+0000 7fcce035b640 1 -- 172.21.15.63:0/2583679984 >> 172.21.15.63:0/2583679984 conn(0x7fccd8101b10 msgr2=0x7fccd8103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:44.711 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.848+0000 7fcce035b640 1 -- 172.21.15.63:0/2583679984 shutdown_connections 2024-09-16T01:14:44.712 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.848+0000 7fcce035b640 1 -- 172.21.15.63:0/2583679984 wait complete. 2024-09-16T01:14:44.712 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.848+0000 7fcce035b640 1 Processor -- start 2024-09-16T01:14:44.712 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.848+0000 7fcce035b640 1 -- start start 2024-09-16T01:14:44.712 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.848+0000 7fcce035b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:44.712 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.848+0000 7fcce035b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fccd810b880 con 0x7fccd8107f30 2024-09-16T01:14:44.712 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.849+0000 7fccde0f7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:44.712 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.849+0000 7fccde0f7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd819b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43814/0 (socket says 172.21.15.63:43814) 2024-09-16T01:14:44.712 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.849+0000 7fccde0f7640 1 -- 172.21.15.63:0/3156674352 learned_addr learned my addr 172.21.15.63:0/3156674352 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:44.712 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.849+0000 7fccde0f7640 1 -- 172.21.15.63:0/3156674352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd819bd10 con 0x7fccd8107f30 2024-09-16T01:14:44.712 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.849+0000 7fccde0f7640 1 --2- 172.21.15.63:0/3156674352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd819b7d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fccd00097f0 tx=0x7fccd0030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.849+0000 7fccd77fe640 1 -- 172.21.15.63:0/3156674352 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccd0042070 con 0x7fccd8107f30 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.849+0000 7fccd77fe640 1 -- 172.21.15.63:0/3156674352 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fccd0030e80 con 0x7fccd8107f30 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.849+0000 7fcce035b640 1 -- 172.21.15.63:0/3156674352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd819bfa0 con 0x7fccd8107f30 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.849+0000 7fccd77fe640 1 -- 172.21.15.63:0/3156674352 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccd0037040 con 0x7fccd8107f30 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.849+0000 7fcce035b640 1 -- 172.21.15.63:0/3156674352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd819ec90 con 0x7fccd8107f30 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.850+0000 7fccd77fe640 1 -- 172.21.15.63:0/3156674352 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fccd0045070 con 0x7fccd8107f30 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.850+0000 7fcce035b640 1 -- 172.21.15.63:0/3156674352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd8108390 con 0x7fccd8107f30 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.850+0000 7fccd77fe640 1 --2- 172.21.15.63:0/3156674352 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fccc0039200 0x7fccc003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.850+0000 7fccd77fe640 1 -- 172.21.15.63:0/3156674352 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fccd006c5b0 con 0x7fccd8107f30 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.851+0000 7fccdd8f6640 1 --2- 172.21.15.63:0/3156674352 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fccc0039200 0x7fccc003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:44.713 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.851+0000 7fccdd8f6640 1 --2- 172.21.15.63:0/3156674352 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fccc0039200 0x7fccc003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0098c0 tx=0x7fcccc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.855+0000 7fccd77fe640 1 -- 172.21.15.63:0/3156674352 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fccd003add0 con 0x7fccd8107f30 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:43.977+0000 7fccd77fe640 1 -- 172.21.15.63:0/3156674352 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fccd003db70 con 0x7fccd8107f30 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.126+0000 7fcce035b640 1 -- 172.21.15.63:0/3156674352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fccd802d7c0 con 0x7fccd8107f30 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.128+0000 7fccd77fe640 1 -- 172.21.15.63:0/3156674352 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fccd00371e0 con 0x7fccd8107f30 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.131+0000 7fcce035b640 1 -- 172.21.15.63:0/3156674352 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fccc0039200 msgr2=0x7fccc003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.131+0000 7fcce035b640 1 --2- 172.21.15.63:0/3156674352 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fccc0039200 0x7fccc003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0098c0 tx=0x7fcccc006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.131+0000 7fcce035b640 1 -- 172.21.15.63:0/3156674352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 msgr2=0x7fccd819b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.131+0000 7fcce035b640 1 --2- 172.21.15.63:0/3156674352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd819b7d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fccd00097f0 tx=0x7fccd0030c70 comp rx=0 tx=0).stop 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.131+0000 7fcce035b640 1 -- 172.21.15.63:0/3156674352 shutdown_connections 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.131+0000 7fcce035b640 1 --2- 172.21.15.63:0/3156674352 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fccc0039200 0x7fccc003b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.131+0000 7fcce035b640 1 --2- 172.21.15.63:0/3156674352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccd8107f30 0x7fccd819b7d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.131+0000 7fcce035b640 1 -- 172.21.15.63:0/3156674352 >> 172.21.15.63:0/3156674352 conn(0x7fccd8101b10 msgr2=0x7fccd81029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.131+0000 7fcce035b640 1 -- 172.21.15.63:0/3156674352 shutdown_connections 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/ceph: stderr 2024-09-16T01:14:44.131+0000 7fcce035b640 1 -- 172.21.15.63:0/3156674352 wait complete. 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout:Or, if you are only running a single cluster on this host: 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:44.715 INFO:teuthology.orchestra.run.smithi063.stdout: ceph telemetry on 2024-09-16T01:14:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:44.716 INFO:teuthology.orchestra.run.smithi063.stdout:For more information see: 2024-09-16T01:14:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-16T01:14:44.716 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:44.716 INFO:teuthology.orchestra.run.smithi063.stdout:Bootstrap complete. 2024-09-16T01:14:44.748 INFO:tasks.cephadm:Fetching config... 2024-09-16T01:14:44.748 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:14:44.748 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-16T01:14:44.765 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-16T01:14:44.765 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:14:44.765 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-16T01:14:44.821 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-16T01:14:44.821 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:14:44.821 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-16T01:14:44.888 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-16T01:14:44.888 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:14:44.888 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-16T01:14:44.944 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-16T01:14:44.945 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCCBYtFxSriRrBcnk4IFxuXvPrt/0NUhBHo8SQvxKWqAGOY43OmE9Deg3TXrTVG9ms1fHTetgt7B2n0YUuRO8bG1rq1RBylpB3WDUZ/QQ2AixIIl4xOqtYCim8E/uTXqddCwAgW7NdMxk6THgutj+hQwSyQKs1L57KAgFMLpGGWDgXeJM5/z9dLwvwi1v18I9v1RQJZI6J8+xmD4p1gG1c4uYxEE7Q3OGJDRUHplbfam5OaaJ3vLRat59F0jhAfEtqWBxeruIJfygqsr0Ue+lwEOlUY3c3UwQYx9Lvmw3+dBAs0d6dqAKMHYddupO6I5ZtBgME6l5PraUtrrDzbsyGlRkADsaJiAn6Cs1d6VsmVE3g8+h1byJsEf5sJ1XeM8O/jhjuUdasRDFbRMirLOu75YFLV3MD4vpNTDrjxUFmBeBRSrEvXrCO2OkD/BvrCPqTuTKGDJtOw0RN6UDfhUznYccMU1yE94s7J91PXeqA3k+e6UTOJEB8V0mBAaB6AuP0= ceph-c42394ec-73c8-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T01:14:45.004 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:44 smithi063 ceph-mon[31070]: mgrmap e13: x(active, since 6s) 2024-09-16T01:14:45.004 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:44 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3156674352' entity='client.admin' 2024-09-16T01:14:45.023 INFO:teuthology.orchestra.run.smithi063.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCCBYtFxSriRrBcnk4IFxuXvPrt/0NUhBHo8SQvxKWqAGOY43OmE9Deg3TXrTVG9ms1fHTetgt7B2n0YUuRO8bG1rq1RBylpB3WDUZ/QQ2AixIIl4xOqtYCim8E/uTXqddCwAgW7NdMxk6THgutj+hQwSyQKs1L57KAgFMLpGGWDgXeJM5/z9dLwvwi1v18I9v1RQJZI6J8+xmD4p1gG1c4uYxEE7Q3OGJDRUHplbfam5OaaJ3vLRat59F0jhAfEtqWBxeruIJfygqsr0Ue+lwEOlUY3c3UwQYx9Lvmw3+dBAs0d6dqAKMHYddupO6I5ZtBgME6l5PraUtrrDzbsyGlRkADsaJiAn6Cs1d6VsmVE3g8+h1byJsEf5sJ1XeM8O/jhjuUdasRDFbRMirLOu75YFLV3MD4vpNTDrjxUFmBeBRSrEvXrCO2OkD/BvrCPqTuTKGDJtOw0RN6UDfhUznYccMU1yE94s7J91PXeqA3k+e6UTOJEB8V0mBAaB6AuP0= ceph-c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:14:45.035 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCCBYtFxSriRrBcnk4IFxuXvPrt/0NUhBHo8SQvxKWqAGOY43OmE9Deg3TXrTVG9ms1fHTetgt7B2n0YUuRO8bG1rq1RBylpB3WDUZ/QQ2AixIIl4xOqtYCim8E/uTXqddCwAgW7NdMxk6THgutj+hQwSyQKs1L57KAgFMLpGGWDgXeJM5/z9dLwvwi1v18I9v1RQJZI6J8+xmD4p1gG1c4uYxEE7Q3OGJDRUHplbfam5OaaJ3vLRat59F0jhAfEtqWBxeruIJfygqsr0Ue+lwEOlUY3c3UwQYx9Lvmw3+dBAs0d6dqAKMHYddupO6I5ZtBgME6l5PraUtrrDzbsyGlRkADsaJiAn6Cs1d6VsmVE3g8+h1byJsEf5sJ1XeM8O/jhjuUdasRDFbRMirLOu75YFLV3MD4vpNTDrjxUFmBeBRSrEvXrCO2OkD/BvrCPqTuTKGDJtOw0RN6UDfhUznYccMU1yE94s7J91PXeqA3k+e6UTOJEB8V0mBAaB6AuP0= ceph-c42394ec-73c8-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T01:14:45.088 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCCBYtFxSriRrBcnk4IFxuXvPrt/0NUhBHo8SQvxKWqAGOY43OmE9Deg3TXrTVG9ms1fHTetgt7B2n0YUuRO8bG1rq1RBylpB3WDUZ/QQ2AixIIl4xOqtYCim8E/uTXqddCwAgW7NdMxk6THgutj+hQwSyQKs1L57KAgFMLpGGWDgXeJM5/z9dLwvwi1v18I9v1RQJZI6J8+xmD4p1gG1c4uYxEE7Q3OGJDRUHplbfam5OaaJ3vLRat59F0jhAfEtqWBxeruIJfygqsr0Ue+lwEOlUY3c3UwQYx9Lvmw3+dBAs0d6dqAKMHYddupO6I5ZtBgME6l5PraUtrrDzbsyGlRkADsaJiAn6Cs1d6VsmVE3g8+h1byJsEf5sJ1XeM8O/jhjuUdasRDFbRMirLOu75YFLV3MD4vpNTDrjxUFmBeBRSrEvXrCO2OkD/BvrCPqTuTKGDJtOw0RN6UDfhUznYccMU1yE94s7J91PXeqA3k+e6UTOJEB8V0mBAaB6AuP0= ceph-c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:14:45.101 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCCBYtFxSriRrBcnk4IFxuXvPrt/0NUhBHo8SQvxKWqAGOY43OmE9Deg3TXrTVG9ms1fHTetgt7B2n0YUuRO8bG1rq1RBylpB3WDUZ/QQ2AixIIl4xOqtYCim8E/uTXqddCwAgW7NdMxk6THgutj+hQwSyQKs1L57KAgFMLpGGWDgXeJM5/z9dLwvwi1v18I9v1RQJZI6J8+xmD4p1gG1c4uYxEE7Q3OGJDRUHplbfam5OaaJ3vLRat59F0jhAfEtqWBxeruIJfygqsr0Ue+lwEOlUY3c3UwQYx9Lvmw3+dBAs0d6dqAKMHYddupO6I5ZtBgME6l5PraUtrrDzbsyGlRkADsaJiAn6Cs1d6VsmVE3g8+h1byJsEf5sJ1XeM8O/jhjuUdasRDFbRMirLOu75YFLV3MD4vpNTDrjxUFmBeBRSrEvXrCO2OkD/BvrCPqTuTKGDJtOw0RN6UDfhUznYccMU1yE94s7J91PXeqA3k+e6UTOJEB8V0mBAaB6AuP0= ceph-c42394ec-73c8-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T01:14:45.251 INFO:teuthology.orchestra.run.smithi192.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCCBYtFxSriRrBcnk4IFxuXvPrt/0NUhBHo8SQvxKWqAGOY43OmE9Deg3TXrTVG9ms1fHTetgt7B2n0YUuRO8bG1rq1RBylpB3WDUZ/QQ2AixIIl4xOqtYCim8E/uTXqddCwAgW7NdMxk6THgutj+hQwSyQKs1L57KAgFMLpGGWDgXeJM5/z9dLwvwi1v18I9v1RQJZI6J8+xmD4p1gG1c4uYxEE7Q3OGJDRUHplbfam5OaaJ3vLRat59F0jhAfEtqWBxeruIJfygqsr0Ue+lwEOlUY3c3UwQYx9Lvmw3+dBAs0d6dqAKMHYddupO6I5ZtBgME6l5PraUtrrDzbsyGlRkADsaJiAn6Cs1d6VsmVE3g8+h1byJsEf5sJ1XeM8O/jhjuUdasRDFbRMirLOu75YFLV3MD4vpNTDrjxUFmBeBRSrEvXrCO2OkD/BvrCPqTuTKGDJtOw0RN6UDfhUznYccMU1yE94s7J91PXeqA3k+e6UTOJEB8V0mBAaB6AuP0= ceph-c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:14:45.265 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-16T01:14:45.534 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:46.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.544+0000 7fc6b2640640 1 -- 172.21.15.63:0/2836116042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ac1020a0 msgr2=0x7fc6ac104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:46.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.544+0000 7fc6b2640640 1 --2- 172.21.15.63:0/2836116042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ac1020a0 0x7fc6ac104490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009880 tx=0x7fc69c02a5d0 comp rx=0 tx=0).stop 2024-09-16T01:14:46.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.544+0000 7fc6b2640640 1 -- 172.21.15.63:0/2836116042 shutdown_connections 2024-09-16T01:14:46.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.544+0000 7fc6b2640640 1 --2- 172.21.15.63:0/2836116042 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ac1020a0 0x7fc6ac104490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:46.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.544+0000 7fc6b2640640 1 -- 172.21.15.63:0/2836116042 >> 172.21.15.63:0/2836116042 conn(0x7fc6ac0fbc80 msgr2=0x7fc6ac0fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:46.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.544+0000 7fc6b2640640 1 -- 172.21.15.63:0/2836116042 shutdown_connections 2024-09-16T01:14:46.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.544+0000 7fc6b2640640 1 -- 172.21.15.63:0/2836116042 wait complete. 2024-09-16T01:14:46.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.544+0000 7fc6b2640640 1 Processor -- start 2024-09-16T01:14:46.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.544+0000 7fc6b2640640 1 -- start start 2024-09-16T01:14:46.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.545+0000 7fc6b2640640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ac1020a0 0x7fc6ac196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:46.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.545+0000 7fc6b2640640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac107560 con 0x7fc6ac1020a0 2024-09-16T01:14:46.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.545+0000 7fc6abfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ac1020a0 0x7fc6ac196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:46.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.545+0000 7fc6abfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ac1020a0 0x7fc6ac196cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43842/0 (socket says 172.21.15.63:43842) 2024-09-16T01:14:46.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.545+0000 7fc6abfff640 1 -- 172.21.15.63:0/256490903 learned_addr learned my addr 172.21.15.63:0/256490903 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:46.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.545+0000 7fc6abfff640 1 -- 172.21.15.63:0/256490903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac197200 con 0x7fc6ac1020a0 2024-09-16T01:14:46.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.545+0000 7fc6abfff640 1 --2- 172.21.15.63:0/256490903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ac1020a0 0x7fc6ac196cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc69c005ab0 tx=0x7fc69c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:46.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.546+0000 7fc6a97fa640 1 -- 172.21.15.63:0/256490903 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc69c03f070 con 0x7fc6ac1020a0 2024-09-16T01:14:46.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.546+0000 7fc6a97fa640 1 -- 172.21.15.63:0/256490903 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc69c003aa0 con 0x7fc6ac1020a0 2024-09-16T01:14:46.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.546+0000 7fc6b2640640 1 -- 172.21.15.63:0/256490903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac1974f0 con 0x7fc6ac1020a0 2024-09-16T01:14:46.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.546+0000 7fc6b2640640 1 -- 172.21.15.63:0/256490903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac19a180 con 0x7fc6ac1020a0 2024-09-16T01:14:46.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.546+0000 7fc6a97fa640 1 -- 172.21.15.63:0/256490903 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc69c035030 con 0x7fc6ac1020a0 2024-09-16T01:14:46.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.547+0000 7fc6a97fa640 1 -- 172.21.15.63:0/256490903 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc69c042070 con 0x7fc6ac1020a0 2024-09-16T01:14:46.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.547+0000 7fc6a97fa640 1 --2- 172.21.15.63:0/256490903 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc694039350 0x7fc69403b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:46.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.547+0000 7fc6a97fa640 1 -- 172.21.15.63:0/256490903 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc69c06d040 con 0x7fc6ac1020a0 2024-09-16T01:14:46.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.547+0000 7fc6b2640640 1 -- 172.21.15.63:0/256490903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac107ce0 con 0x7fc6ac1020a0 2024-09-16T01:14:46.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.547+0000 7fc6ab7fe640 1 --2- 172.21.15.63:0/256490903 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc694039350 0x7fc69403b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:46.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.548+0000 7fc6ab7fe640 1 --2- 172.21.15.63:0/256490903 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc694039350 0x7fc69403b810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00098c0 tx=0x7fc6a0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:46.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.552+0000 7fc6a97fa640 1 -- 172.21.15.63:0/256490903 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc69c042360 con 0x7fc6ac1020a0 2024-09-16T01:14:46.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.734+0000 7fc6b2640640 1 -- 172.21.15.63:0/256490903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fc6ac02d9a0 con 0x7fc6ac1020a0 2024-09-16T01:14:46.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.736+0000 7fc6a97fa640 1 -- 172.21.15.63:0/256490903 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fc69c02f300 con 0x7fc6ac1020a0 2024-09-16T01:14:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.738+0000 7fc6b2640640 1 -- 172.21.15.63:0/256490903 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc694039350 msgr2=0x7fc69403b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.738+0000 7fc6b2640640 1 --2- 172.21.15.63:0/256490903 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc694039350 0x7fc69403b810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00098c0 tx=0x7fc6a0006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.739+0000 7fc6b2640640 1 -- 172.21.15.63:0/256490903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ac1020a0 msgr2=0x7fc6ac196cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.739+0000 7fc6b2640640 1 --2- 172.21.15.63:0/256490903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ac1020a0 0x7fc6ac196cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc69c005ab0 tx=0x7fc69c0048f0 comp rx=0 tx=0).stop 2024-09-16T01:14:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.739+0000 7fc6b2640640 1 -- 172.21.15.63:0/256490903 shutdown_connections 2024-09-16T01:14:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.739+0000 7fc6b2640640 1 --2- 172.21.15.63:0/256490903 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc694039350 0x7fc69403b810 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.739+0000 7fc6b2640640 1 --2- 172.21.15.63:0/256490903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ac1020a0 0x7fc6ac196cc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.739+0000 7fc6b2640640 1 -- 172.21.15.63:0/256490903 >> 172.21.15.63:0/256490903 conn(0x7fc6ac0fbc80 msgr2=0x7fc6ac0fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:46.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.739+0000 7fc6b2640640 1 -- 172.21.15.63:0/256490903 shutdown_connections 2024-09-16T01:14:46.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:46.739+0000 7fc6b2640640 1 -- 172.21.15.63:0/256490903 wait complete. 2024-09-16T01:14:47.631 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-16T01:14:47.632 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-16T01:14:48.036 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:47 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/256490903' entity='client.admin' 2024-09-16T01:14:48.329 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:48.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.944+0000 7fb215ed2640 1 -- 172.21.15.63:0/3748708288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb210100510 msgr2=0x7fb210100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:48.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.944+0000 7fb215ed2640 1 --2- 172.21.15.63:0/3748708288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb210100510 0x7fb210100910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb200009880 tx=0x7fb20002a5d0 comp rx=0 tx=0).stop 2024-09-16T01:14:48.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.944+0000 7fb215ed2640 1 -- 172.21.15.63:0/3748708288 shutdown_connections 2024-09-16T01:14:48.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.944+0000 7fb215ed2640 1 --2- 172.21.15.63:0/3748708288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb210100510 0x7fb210100910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:48.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.944+0000 7fb215ed2640 1 -- 172.21.15.63:0/3748708288 >> 172.21.15.63:0/3748708288 conn(0x7fb2100fbc80 msgr2=0x7fb2100fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:48.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.944+0000 7fb215ed2640 1 -- 172.21.15.63:0/3748708288 shutdown_connections 2024-09-16T01:14:48.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.944+0000 7fb215ed2640 1 -- 172.21.15.63:0/3748708288 wait complete. 2024-09-16T01:14:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.945+0000 7fb215ed2640 1 Processor -- start 2024-09-16T01:14:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.945+0000 7fb215ed2640 1 -- start start 2024-09-16T01:14:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.945+0000 7fb215ed2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb210100510 0x7fb210196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.945+0000 7fb215ed2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb2101064d0 con 0x7fb210100510 2024-09-16T01:14:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.945+0000 7fb20f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb210100510 0x7fb210196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:48.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.945+0000 7fb20f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb210100510 0x7fb210196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44662/0 (socket says 172.21.15.63:44662) 2024-09-16T01:14:48.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.945+0000 7fb20f7fe640 1 -- 172.21.15.63:0/3130543395 learned_addr learned my addr 172.21.15.63:0/3130543395 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:48.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.945+0000 7fb20f7fe640 1 -- 172.21.15.63:0/3130543395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2101971f0 con 0x7fb210100510 2024-09-16T01:14:48.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.946+0000 7fb20f7fe640 1 --2- 172.21.15.63:0/3130543395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb210100510 0x7fb210196cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb200009230 tx=0x7fb2000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.946+0000 7fb20cff9640 1 -- 172.21.15.63:0/3130543395 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb20003f070 con 0x7fb210100510 2024-09-16T01:14:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.946+0000 7fb20cff9640 1 -- 172.21.15.63:0/3130543395 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb200003aa0 con 0x7fb210100510 2024-09-16T01:14:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.946+0000 7fb20cff9640 1 -- 172.21.15.63:0/3130543395 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb200035030 con 0x7fb210100510 2024-09-16T01:14:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.946+0000 7fb215ed2640 1 -- 172.21.15.63:0/3130543395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb210197480 con 0x7fb210100510 2024-09-16T01:14:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.946+0000 7fb215ed2640 1 -- 172.21.15.63:0/3130543395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21019a170 con 0x7fb210100510 2024-09-16T01:14:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.947+0000 7fb20cff9640 1 -- 172.21.15.63:0/3130543395 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb200042070 con 0x7fb210100510 2024-09-16T01:14:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.947+0000 7fb20cff9640 1 --2- 172.21.15.63:0/3130543395 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb1f8039300 0x7fb1f803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.947+0000 7fb20cff9640 1 -- 172.21.15.63:0/3130543395 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb20006d0c0 con 0x7fb210100510 2024-09-16T01:14:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.947+0000 7fb215ed2640 1 -- 172.21.15.63:0/3130543395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb210106c50 con 0x7fb210100510 2024-09-16T01:14:48.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.947+0000 7fb20effd640 1 --2- 172.21.15.63:0/3130543395 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb1f8039300 0x7fb1f803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.947+0000 7fb20effd640 1 --2- 172.21.15.63:0/3130543395 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb1f8039300 0x7fb1f803b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb2040098c0 tx=0x7fb204006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:48.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:48.952+0000 7fb20cff9640 1 -- 172.21.15.63:0/3130543395 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb20003ae50 con 0x7fb210100510 2024-09-16T01:14:49.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.131+0000 7fb215ed2640 1 -- 172.21.15.63:0/3130543395 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fb21002d830 con 0x7fb1f8039300 2024-09-16T01:14:49.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.134+0000 7fb20cff9640 1 -- 172.21.15.63:0/3130543395 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb21002d830 con 0x7fb1f8039300 2024-09-16T01:14:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.136+0000 7fb215ed2640 1 -- 172.21.15.63:0/3130543395 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb1f8039300 msgr2=0x7fb1f803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.136+0000 7fb215ed2640 1 --2- 172.21.15.63:0/3130543395 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb1f8039300 0x7fb1f803b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb2040098c0 tx=0x7fb204006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.136+0000 7fb215ed2640 1 -- 172.21.15.63:0/3130543395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb210100510 msgr2=0x7fb210196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.136+0000 7fb215ed2640 1 --2- 172.21.15.63:0/3130543395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb210100510 0x7fb210196cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb200009230 tx=0x7fb2000048f0 comp rx=0 tx=0).stop 2024-09-16T01:14:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.136+0000 7fb215ed2640 1 -- 172.21.15.63:0/3130543395 shutdown_connections 2024-09-16T01:14:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.136+0000 7fb215ed2640 1 --2- 172.21.15.63:0/3130543395 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb1f8039300 0x7fb1f803b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.136+0000 7fb215ed2640 1 --2- 172.21.15.63:0/3130543395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb210100510 0x7fb210196cb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.136+0000 7fb215ed2640 1 -- 172.21.15.63:0/3130543395 >> 172.21.15.63:0/3130543395 conn(0x7fb2100fbc80 msgr2=0x7fb21006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.136+0000 7fb215ed2640 1 -- 172.21.15.63:0/3130543395 shutdown_connections 2024-09-16T01:14:49.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:49.137+0000 7fb215ed2640 1 -- 172.21.15.63:0/3130543395 wait complete. 2024-09-16T01:14:49.511 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:49.511 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:49.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi063", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:14:49.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:49.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:14:49.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:49.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:49.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:14:49.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:14:49.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:14:49.876 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-09-16T01:14:49.877 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:14:49.877 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-09-16T01:14:49.896 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:14:49.896 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:14:49.954 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-09-16T01:14:49.954 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch host add smithi162 2024-09-16T01:14:50.206 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.614+0000 7f561bc30640 1 -- 172.21.15.63:0/3563345429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5614106560 msgr2=0x7f5614106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.614+0000 7f561bc30640 1 --2- 172.21.15.63:0/3563345429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5614106560 0x7f5614106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5610009880 tx=0x7f561002a5d0 comp rx=0 tx=0).stop 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.614+0000 7f561bc30640 1 -- 172.21.15.63:0/3563345429 shutdown_connections 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.614+0000 7f561bc30640 1 --2- 172.21.15.63:0/3563345429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5614106560 0x7f5614106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.614+0000 7f561bc30640 1 -- 172.21.15.63:0/3563345429 >> 172.21.15.63:0/3563345429 conn(0x7f56140fc1b0 msgr2=0x7f56140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.614+0000 7f561bc30640 1 -- 172.21.15.63:0/3563345429 shutdown_connections 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.614+0000 7f561bc30640 1 -- 172.21.15.63:0/3563345429 wait complete. 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.615+0000 7f561bc30640 1 Processor -- start 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.615+0000 7f561bc30640 1 -- start start 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.615+0000 7f561bc30640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5614106560 0x7f5614197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:50.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.615+0000 7f561bc30640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f561410aa40 con 0x7f5614106560 2024-09-16T01:14:50.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.615+0000 7f56199cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5614106560 0x7f5614197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:50.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.615+0000 7f56199cc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5614106560 0x7f5614197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44680/0 (socket says 172.21.15.63:44680) 2024-09-16T01:14:50.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.615+0000 7f56199cc640 1 -- 172.21.15.63:0/3661304865 learned_addr learned my addr 172.21.15.63:0/3661304865 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:50.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.616+0000 7f56199cc640 1 -- 172.21.15.63:0/3661304865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5614197560 con 0x7f5614106560 2024-09-16T01:14:50.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.616+0000 7f56199cc640 1 --2- 172.21.15.63:0/3661304865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5614106560 0x7f5614197020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5610009230 tx=0x7f56100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:50.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.616+0000 7f560affd640 1 -- 172.21.15.63:0/3661304865 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561003f070 con 0x7f5614106560 2024-09-16T01:14:50.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.616+0000 7f560affd640 1 -- 172.21.15.63:0/3661304865 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5610004d10 con 0x7f5614106560 2024-09-16T01:14:50.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.616+0000 7f560affd640 1 -- 172.21.15.63:0/3661304865 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5610035030 con 0x7f5614106560 2024-09-16T01:14:50.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.616+0000 7f561bc30640 1 -- 172.21.15.63:0/3661304865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56141977f0 con 0x7f5614106560 2024-09-16T01:14:50.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.616+0000 7f561bc30640 1 -- 172.21.15.63:0/3661304865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f561419b8f0 con 0x7f5614106560 2024-09-16T01:14:50.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.617+0000 7f560affd640 1 -- 172.21.15.63:0/3661304865 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5610042070 con 0x7f5614106560 2024-09-16T01:14:50.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.617+0000 7f561bc30640 1 -- 172.21.15.63:0/3661304865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5614101bd0 con 0x7f5614106560 2024-09-16T01:14:50.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.617+0000 7f560affd640 1 --2- 172.21.15.63:0/3661304865 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5600039300 0x7f560003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:50.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.617+0000 7f560affd640 1 -- 172.21.15.63:0/3661304865 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f561006cf30 con 0x7f5614106560 2024-09-16T01:14:50.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.617+0000 7f56191cb640 1 --2- 172.21.15.63:0/3661304865 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5600039300 0x7f560003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:50.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.618+0000 7f56191cb640 1 --2- 172.21.15.63:0/3661304865 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5600039300 0x7f560003b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56040098c0 tx=0x7f5604006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:50.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.622+0000 7f560affd640 1 -- 172.21.15.63:0/3661304865 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5610042360 con 0x7f5614106560 2024-09-16T01:14:50.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:50.799+0000 7f561bc30640 1 -- 172.21.15.63:0/3661304865 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}) -- 0x7f5614198380 con 0x7f5600039300 2024-09-16T01:14:51.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:51 smithi063 ceph-mon[31070]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:51.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:51 smithi063 ceph-mon[31070]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-16T01:14:51.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:51 smithi063 ceph-mon[31070]: Updating smithi063:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:14:51.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:51 smithi063 ceph-mon[31070]: Updating smithi063:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:14:51.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:51 smithi063 ceph-mon[31070]: Updating smithi063:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:14:51.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:51 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:51.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:51 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:51.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:51 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:52.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:52 smithi063 ceph-mon[31070]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:14:53.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:53 smithi063 ceph-mon[31070]: Deploying cephadm binary to smithi162 2024-09-16T01:14:54.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.613+0000 7f560affd640 1 -- 172.21.15.63:0/3661304865 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f5614198380 con 0x7f5600039300 2024-09-16T01:14:54.615 INFO:teuthology.orchestra.run.smithi063.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-09-16T01:14:54.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.616+0000 7f561bc30640 1 -- 172.21.15.63:0/3661304865 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5600039300 msgr2=0x7f560003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:54.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.616+0000 7f561bc30640 1 --2- 172.21.15.63:0/3661304865 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5600039300 0x7f560003b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56040098c0 tx=0x7f5604006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:54.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.616+0000 7f561bc30640 1 -- 172.21.15.63:0/3661304865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5614106560 msgr2=0x7f5614197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:54.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.616+0000 7f561bc30640 1 --2- 172.21.15.63:0/3661304865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5614106560 0x7f5614197020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5610009230 tx=0x7f56100048f0 comp rx=0 tx=0).stop 2024-09-16T01:14:54.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.616+0000 7f561bc30640 1 -- 172.21.15.63:0/3661304865 shutdown_connections 2024-09-16T01:14:54.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.616+0000 7f561bc30640 1 --2- 172.21.15.63:0/3661304865 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5600039300 0x7f560003b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:54.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.616+0000 7f561bc30640 1 --2- 172.21.15.63:0/3661304865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5614106560 0x7f5614197020 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:54.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.616+0000 7f561bc30640 1 -- 172.21.15.63:0/3661304865 >> 172.21.15.63:0/3661304865 conn(0x7f56140fc1b0 msgr2=0x7f5614069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:54.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.616+0000 7f561bc30640 1 -- 172.21.15.63:0/3661304865 shutdown_connections 2024-09-16T01:14:54.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:54.616+0000 7f561bc30640 1 -- 172.21.15.63:0/3661304865 wait complete. 2024-09-16T01:14:55.162 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T01:14:55.411 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:55.846 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:55 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:55.846 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:55 smithi063 ceph-mon[31070]: Added host smithi162 2024-09-16T01:14:55.846 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:55 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:14:55.846 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:55 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:55.846 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:55 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:55.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.853+0000 7f43ddb18640 1 -- 172.21.15.63:0/1124499842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d8102750 msgr2=0x7f43d8102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:55.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.853+0000 7f43ddb18640 1 --2- 172.21.15.63:0/1124499842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d8102750 0x7f43d8102b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009880 tx=0x7f43c802a670 comp rx=0 tx=0).stop 2024-09-16T01:14:55.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.853+0000 7f43ddb18640 1 -- 172.21.15.63:0/1124499842 shutdown_connections 2024-09-16T01:14:55.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.853+0000 7f43ddb18640 1 --2- 172.21.15.63:0/1124499842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d8102750 0x7f43d8102b30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:55.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.853+0000 7f43ddb18640 1 -- 172.21.15.63:0/1124499842 >> 172.21.15.63:0/1124499842 conn(0x7f43d80fc1b0 msgr2=0x7f43d80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:55.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.853+0000 7f43ddb18640 1 -- 172.21.15.63:0/1124499842 shutdown_connections 2024-09-16T01:14:55.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.853+0000 7f43ddb18640 1 -- 172.21.15.63:0/1124499842 wait complete. 2024-09-16T01:14:55.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.854+0000 7f43ddb18640 1 Processor -- start 2024-09-16T01:14:55.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.854+0000 7f43ddb18640 1 -- start start 2024-09-16T01:14:55.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.854+0000 7f43ddb18640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d8102750 0x7f43d81970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:55.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43ddb18640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f43d810bb70 con 0x7f43d8102750 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43d77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d8102750 0x7f43d81970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43d77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d8102750 0x7f43d81970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44702/0 (socket says 172.21.15.63:44702) 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43d77fe640 1 -- 172.21.15.63:0/1909203218 learned_addr learned my addr 172.21.15.63:0/1909203218 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43d77fe640 1 -- 172.21.15.63:0/1909203218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d8197630 con 0x7f43d8102750 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43d77fe640 1 --2- 172.21.15.63:0/1909203218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d8102750 0x7f43d81970f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009230 tx=0x7f43c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43d4ff9640 1 -- 172.21.15.63:0/1909203218 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c803f070 con 0x7f43d8102750 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43ddb18640 1 -- 172.21.15.63:0/1909203218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d81978c0 con 0x7f43d8102750 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43d4ff9640 1 -- 172.21.15.63:0/1909203218 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f43c8004d10 con 0x7f43d8102750 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43d4ff9640 1 -- 172.21.15.63:0/1909203218 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43c8035030 con 0x7f43d8102750 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.855+0000 7f43ddb18640 1 -- 172.21.15.63:0/1909203218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d8197d20 con 0x7f43d8102750 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.856+0000 7f43d4ff9640 1 -- 172.21.15.63:0/1909203218 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f43c8042070 con 0x7f43d8102750 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.856+0000 7f43ddb18640 1 -- 172.21.15.63:0/1909203218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d806a7b0 con 0x7f43d8102750 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.856+0000 7f43d4ff9640 1 --2- 172.21.15.63:0/1909203218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43c00392a0 0x7f43c003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:55.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.856+0000 7f43d4ff9640 1 -- 172.21.15.63:0/1909203218 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f43c806d000 con 0x7f43d8102750 2024-09-16T01:14:55.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.857+0000 7f43d6ffd640 1 --2- 172.21.15.63:0/1909203218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43c00392a0 0x7f43c003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:55.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.857+0000 7f43d6ffd640 1 --2- 172.21.15.63:0/1909203218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43c00392a0 0x7f43c003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0098c0 tx=0x7f43cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:55.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:55.861+0000 7f43d4ff9640 1 -- 172.21.15.63:0/1909203218 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43c8039350 con 0x7f43d8102750 2024-09-16T01:14:56.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.041+0000 7f43ddb18640 1 -- 172.21.15.63:0/1909203218 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43d8198450 con 0x7f43c00392a0 2024-09-16T01:14:56.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.042+0000 7f43d4ff9640 1 -- 172.21.15.63:0/1909203218 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f43d8198450 con 0x7f43c00392a0 2024-09-16T01:14:56.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:14:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:[{"addr": "172.21.15.63", "hostname": "smithi063", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-09-16T01:14:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.044+0000 7f43ddb18640 1 -- 172.21.15.63:0/1909203218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43c00392a0 msgr2=0x7f43c003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.044+0000 7f43ddb18640 1 --2- 172.21.15.63:0/1909203218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43c00392a0 0x7f43c003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0098c0 tx=0x7f43cc006db0 comp rx=0 tx=0).stop 2024-09-16T01:14:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.044+0000 7f43ddb18640 1 -- 172.21.15.63:0/1909203218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d8102750 msgr2=0x7f43d81970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.044+0000 7f43ddb18640 1 --2- 172.21.15.63:0/1909203218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d8102750 0x7f43d81970f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009230 tx=0x7f43c80048f0 comp rx=0 tx=0).stop 2024-09-16T01:14:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.044+0000 7f43ddb18640 1 -- 172.21.15.63:0/1909203218 shutdown_connections 2024-09-16T01:14:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.044+0000 7f43ddb18640 1 --2- 172.21.15.63:0/1909203218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43c00392a0 0x7f43c003b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.044+0000 7f43ddb18640 1 --2- 172.21.15.63:0/1909203218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43d8102750 0x7f43d81970f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.044+0000 7f43ddb18640 1 -- 172.21.15.63:0/1909203218 >> 172.21.15.63:0/1909203218 conn(0x7f43d80fc1b0 msgr2=0x7f43d8105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.045+0000 7f43ddb18640 1 -- 172.21.15.63:0/1909203218 shutdown_connections 2024-09-16T01:14:56.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:56.045+0000 7f43ddb18640 1 -- 172.21.15.63:0/1909203218 wait complete. 2024-09-16T01:14:56.627 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi192 2024-09-16T01:14:56.628 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:14:56.628 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.conf 2024-09-16T01:14:56.646 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:14:56.646 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:14:56.705 INFO:tasks.cephadm:Adding host smithi192 to orchestrator... 2024-09-16T01:14:56.705 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch host add smithi192 2024-09-16T01:14:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:14:57.228 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:14:57.228 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:56 smithi063 ceph-mon[31070]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:14:57.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.384+0000 7fa90c47c640 1 -- 172.21.15.63:0/579885872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa904102810 msgr2=0x7fa904102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:14:57.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.384+0000 7fa90c47c640 1 --2- 172.21.15.63:0/579885872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa904102810 0x7fa904102bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa900009880 tx=0x7fa90002a670 comp rx=0 tx=0).stop 2024-09-16T01:14:57.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.384+0000 7fa90c47c640 1 -- 172.21.15.63:0/579885872 shutdown_connections 2024-09-16T01:14:57.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.384+0000 7fa90c47c640 1 --2- 172.21.15.63:0/579885872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa904102810 0x7fa904102bf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:14:57.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.384+0000 7fa90c47c640 1 -- 172.21.15.63:0/579885872 >> 172.21.15.63:0/579885872 conn(0x7fa9040fc1b0 msgr2=0x7fa9040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:14:57.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.384+0000 7fa90c47c640 1 -- 172.21.15.63:0/579885872 shutdown_connections 2024-09-16T01:14:57.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.384+0000 7fa90c47c640 1 -- 172.21.15.63:0/579885872 wait complete. 2024-09-16T01:14:57.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.385+0000 7fa90c47c640 1 Processor -- start 2024-09-16T01:14:57.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.385+0000 7fa90c47c640 1 -- start start 2024-09-16T01:14:57.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.385+0000 7fa90c47c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa904102810 0x7fa9041970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:57.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.385+0000 7fa90c47c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa90410bb60 con 0x7fa904102810 2024-09-16T01:14:57.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.386+0000 7fa90a218640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa904102810 0x7fa9041970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:57.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.386+0000 7fa90a218640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa904102810 0x7fa9041970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44712/0 (socket says 172.21.15.63:44712) 2024-09-16T01:14:57.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.386+0000 7fa90a218640 1 -- 172.21.15.63:0/4041761444 learned_addr learned my addr 172.21.15.63:0/4041761444 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:14:57.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.386+0000 7fa90a218640 1 -- 172.21.15.63:0/4041761444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa904197620 con 0x7fa904102810 2024-09-16T01:14:57.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.386+0000 7fa90a218640 1 --2- 172.21.15.63:0/4041761444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa904102810 0x7fa9041970e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa900009230 tx=0x7fa9000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:57.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.386+0000 7fa8fb7fe640 1 -- 172.21.15.63:0/4041761444 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa90003f070 con 0x7fa904102810 2024-09-16T01:14:57.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.386+0000 7fa90c47c640 1 -- 172.21.15.63:0/4041761444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9041978b0 con 0x7fa904102810 2024-09-16T01:14:57.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.386+0000 7fa8fb7fe640 1 -- 172.21.15.63:0/4041761444 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa900003aa0 con 0x7fa904102810 2024-09-16T01:14:57.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.386+0000 7fa8fb7fe640 1 -- 172.21.15.63:0/4041761444 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa900049060 con 0x7fa904102810 2024-09-16T01:14:57.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.386+0000 7fa90c47c640 1 -- 172.21.15.63:0/4041761444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa904197d10 con 0x7fa904102810 2024-09-16T01:14:57.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.387+0000 7fa8fb7fe640 1 -- 172.21.15.63:0/4041761444 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa900042070 con 0x7fa904102810 2024-09-16T01:14:57.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.387+0000 7fa8fb7fe640 1 --2- 172.21.15.63:0/4041761444 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8f00392a0 0x7fa8f003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:14:57.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.387+0000 7fa90c47c640 1 -- 172.21.15.63:0/4041761444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa90406a6f0 con 0x7fa904102810 2024-09-16T01:14:57.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.388+0000 7fa8fb7fe640 1 -- 172.21.15.63:0/4041761444 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa90006d3a0 con 0x7fa904102810 2024-09-16T01:14:57.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.388+0000 7fa909a17640 1 --2- 172.21.15.63:0/4041761444 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8f00392a0 0x7fa8f003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:14:57.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.388+0000 7fa909a17640 1 --2- 172.21.15.63:0/4041761444 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8f00392a0 0x7fa8f003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40098c0 tx=0x7fa8f4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:14:57.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.392+0000 7fa8fb7fe640 1 -- 172.21.15.63:0/4041761444 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa900038e30 con 0x7fa904102810 2024-09-16T01:14:57.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:14:57.573+0000 7fa90c47c640 1 -- 172.21.15.63:0/4041761444 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi192", "target": ["mon-mgr", ""]}) -- 0x7fa9041984a0 con 0x7fa8f00392a0 2024-09-16T01:14:58.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:58 smithi063 ceph-mon[31070]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:14:58.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:58 smithi063 ceph-mon[31070]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi192", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:15:00.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: Deploying cephadm binary to smithi192 2024-09-16T01:15:00.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:00.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:00.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:00.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:15:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-16T01:15:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:14:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:01.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:00 smithi063 ceph-mon[31070]: Updating smithi162:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:01.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:00 smithi063 ceph-mon[31070]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:01.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:00 smithi063 ceph-mon[31070]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:15:01.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:00 smithi063 ceph-mon[31070]: Updating smithi162:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:15:01.421 INFO:teuthology.orchestra.run.smithi063.stdout:Added host 'smithi192' with addr '172.21.15.192' 2024-09-16T01:15:01.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.420+0000 7fa8fb7fe640 1 -- 172.21.15.63:0/4041761444 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fa9041984a0 con 0x7fa8f00392a0 2024-09-16T01:15:01.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.422+0000 7fa90c47c640 1 -- 172.21.15.63:0/4041761444 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8f00392a0 msgr2=0x7fa8f003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:01.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.422+0000 7fa90c47c640 1 --2- 172.21.15.63:0/4041761444 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8f00392a0 0x7fa8f003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40098c0 tx=0x7fa8f4006db0 comp rx=0 tx=0).stop 2024-09-16T01:15:01.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.422+0000 7fa90c47c640 1 -- 172.21.15.63:0/4041761444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa904102810 msgr2=0x7fa9041970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:01.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.422+0000 7fa90c47c640 1 --2- 172.21.15.63:0/4041761444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa904102810 0x7fa9041970e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa900009230 tx=0x7fa9000048f0 comp rx=0 tx=0).stop 2024-09-16T01:15:01.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.422+0000 7fa90c47c640 1 -- 172.21.15.63:0/4041761444 shutdown_connections 2024-09-16T01:15:01.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.422+0000 7fa90c47c640 1 --2- 172.21.15.63:0/4041761444 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8f00392a0 0x7fa8f003b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:01.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.422+0000 7fa90c47c640 1 --2- 172.21.15.63:0/4041761444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa904102810 0x7fa9041970e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:01.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.422+0000 7fa90c47c640 1 -- 172.21.15.63:0/4041761444 >> 172.21.15.63:0/4041761444 conn(0x7fa9040fc1b0 msgr2=0x7fa9041055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:01.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.422+0000 7fa90c47c640 1 -- 172.21.15.63:0/4041761444 shutdown_connections 2024-09-16T01:15:01.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:01.422+0000 7fa90c47c640 1 -- 172.21.15.63:0/4041761444 wait complete. 2024-09-16T01:15:02.011 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T01:15:02.267 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:15:02.700 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:02 smithi063 ceph-mon[31070]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:02.700 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:02 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:02.700 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:02 smithi063 ceph-mon[31070]: Added host smithi192 2024-09-16T01:15:02.700 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:02 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:02.700 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:02 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:02.700 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:02 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:02.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.701+0000 7f5faec68640 1 -- 172.21.15.63:0/3172439532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5fa81076c0 msgr2=0x7f5fa8107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:02.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.701+0000 7f5faec68640 1 --2- 172.21.15.63:0/3172439532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5fa81076c0 0x7f5fa8107aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009880 tx=0x7f5f9c02a5d0 comp rx=0 tx=0).stop 2024-09-16T01:15:02.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.701+0000 7f5faec68640 1 -- 172.21.15.63:0/3172439532 shutdown_connections 2024-09-16T01:15:02.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.701+0000 7f5faec68640 1 --2- 172.21.15.63:0/3172439532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5fa81076c0 0x7f5fa8107aa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:02.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.701+0000 7f5faec68640 1 -- 172.21.15.63:0/3172439532 >> 172.21.15.63:0/3172439532 conn(0x7f5fa80fb8c0 msgr2=0x7f5fa80fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:02.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.701+0000 7f5faec68640 1 -- 172.21.15.63:0/3172439532 shutdown_connections 2024-09-16T01:15:02.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.701+0000 7f5faec68640 1 -- 172.21.15.63:0/3172439532 wait complete. 2024-09-16T01:15:02.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.702+0000 7f5faec68640 1 Processor -- start 2024-09-16T01:15:02.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.702+0000 7f5faec68640 1 -- start start 2024-09-16T01:15:02.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.702+0000 7f5faec68640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5fa81076c0 0x7f5fa8100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:02.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.702+0000 7f5faec68640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa810bb00 con 0x7f5fa81076c0 2024-09-16T01:15:02.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.702+0000 7f5faca04640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5fa81076c0 0x7f5fa8100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:02.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.702+0000 7f5faca04640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5fa81076c0 0x7f5fa8100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35258/0 (socket says 172.21.15.63:35258) 2024-09-16T01:15:02.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.702+0000 7f5faca04640 1 -- 172.21.15.63:0/2501962780 learned_addr learned my addr 172.21.15.63:0/2501962780 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:15:02.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.702+0000 7f5faca04640 1 -- 172.21.15.63:0/2501962780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa8102a80 con 0x7f5fa81076c0 2024-09-16T01:15:02.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.703+0000 7f5faca04640 1 --2- 172.21.15.63:0/2501962780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5fa81076c0 0x7f5fa8100b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009230 tx=0x7f5f9c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:02.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.703+0000 7f5fa5ffb640 1 -- 172.21.15.63:0/2501962780 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f9c03f070 con 0x7f5fa81076c0 2024-09-16T01:15:02.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.703+0000 7f5fa5ffb640 1 -- 172.21.15.63:0/2501962780 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f9c004d10 con 0x7f5fa81076c0 2024-09-16T01:15:02.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.703+0000 7f5faec68640 1 -- 172.21.15.63:0/2501962780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa81010d0 con 0x7f5fa81076c0 2024-09-16T01:15:02.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.703+0000 7f5fa5ffb640 1 -- 172.21.15.63:0/2501962780 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f9c035030 con 0x7f5fa81076c0 2024-09-16T01:15:02.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.703+0000 7f5faec68640 1 -- 172.21.15.63:0/2501962780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa8101590 con 0x7f5fa81076c0 2024-09-16T01:15:02.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.704+0000 7f5faec68640 1 -- 172.21.15.63:0/2501962780 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa8107b20 con 0x7f5fa81076c0 2024-09-16T01:15:02.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.704+0000 7f5fa5ffb640 1 -- 172.21.15.63:0/2501962780 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5f9c042070 con 0x7f5fa81076c0 2024-09-16T01:15:02.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.704+0000 7f5fa5ffb640 1 --2- 172.21.15.63:0/2501962780 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5f980392a0 0x7f5f9803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:02.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.704+0000 7f5fa5ffb640 1 -- 172.21.15.63:0/2501962780 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5f9c06d120 con 0x7f5fa81076c0 2024-09-16T01:15:02.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.705+0000 7f5fa7fff640 1 --2- 172.21.15.63:0/2501962780 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5f980392a0 0x7f5f9803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:02.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.705+0000 7f5fa7fff640 1 --2- 172.21.15.63:0/2501962780 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5f980392a0 0x7f5f9803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5f940098c0 tx=0x7f5f94006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:02.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.709+0000 7f5fa5ffb640 1 -- 172.21.15.63:0/2501962780 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f9c0303a0 con 0x7f5fa81076c0 2024-09-16T01:15:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.895+0000 7f5faec68640 1 -- 172.21.15.63:0/2501962780 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5fa80008d0 con 0x7f5f980392a0 2024-09-16T01:15:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.896+0000 7f5fa5ffb640 1 -- 172.21.15.63:0/2501962780 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f5fa80008d0 con 0x7f5f980392a0 2024-09-16T01:15:02.897 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:15:02.897 INFO:teuthology.orchestra.run.smithi063.stdout:[{"addr": "172.21.15.63", "hostname": "smithi063", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}, {"addr": "172.21.15.192", "hostname": "smithi192", "labels": [], "status": ""}] 2024-09-16T01:15:02.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.898+0000 7f5faec68640 1 -- 172.21.15.63:0/2501962780 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5f980392a0 msgr2=0x7f5f9803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:02.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.898+0000 7f5faec68640 1 --2- 172.21.15.63:0/2501962780 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5f980392a0 0x7f5f9803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5f940098c0 tx=0x7f5f94006db0 comp rx=0 tx=0).stop 2024-09-16T01:15:02.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.898+0000 7f5faec68640 1 -- 172.21.15.63:0/2501962780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5fa81076c0 msgr2=0x7f5fa8100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:02.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.898+0000 7f5faec68640 1 --2- 172.21.15.63:0/2501962780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5fa81076c0 0x7f5fa8100b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009230 tx=0x7f5f9c0048f0 comp rx=0 tx=0).stop 2024-09-16T01:15:02.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.898+0000 7f5faec68640 1 -- 172.21.15.63:0/2501962780 shutdown_connections 2024-09-16T01:15:02.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.898+0000 7f5faec68640 1 --2- 172.21.15.63:0/2501962780 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5f980392a0 0x7f5f9803b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:02.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.898+0000 7f5faec68640 1 --2- 172.21.15.63:0/2501962780 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5fa81076c0 0x7f5fa8100b90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:02.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.898+0000 7f5faec68640 1 -- 172.21.15.63:0/2501962780 >> 172.21.15.63:0/2501962780 conn(0x7f5fa80fb8c0 msgr2=0x7f5fa80fbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:02.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.898+0000 7f5faec68640 1 -- 172.21.15.63:0/2501962780 shutdown_connections 2024-09-16T01:15:02.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:02.898+0000 7f5faec68640 1 -- 172.21.15.63:0/2501962780 wait complete. 2024-09-16T01:15:03.514 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-16T01:15:03.514 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-16T01:15:03.763 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:15:04.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:04.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:03 smithi063 ceph-mon[31070]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:15:04.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.213+0000 7f607db58640 1 -- 172.21.15.63:0/3135647466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60781002e0 msgr2=0x7f60781006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:04.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.213+0000 7f607db58640 1 --2- 172.21.15.63:0/3135647466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60781002e0 0x7f60781006c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6068009880 tx=0x7f606802a5d0 comp rx=0 tx=0).stop 2024-09-16T01:15:04.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.213+0000 7f607db58640 1 -- 172.21.15.63:0/3135647466 shutdown_connections 2024-09-16T01:15:04.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.213+0000 7f607db58640 1 --2- 172.21.15.63:0/3135647466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60781002e0 0x7f60781006c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.213+0000 7f607db58640 1 -- 172.21.15.63:0/3135647466 >> 172.21.15.63:0/3135647466 conn(0x7f60780fc1b0 msgr2=0x7f60780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.213+0000 7f607db58640 1 -- 172.21.15.63:0/3135647466 shutdown_connections 2024-09-16T01:15:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.213+0000 7f607db58640 1 -- 172.21.15.63:0/3135647466 wait complete. 2024-09-16T01:15:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.214+0000 7f607db58640 1 Processor -- start 2024-09-16T01:15:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.214+0000 7f607db58640 1 -- start start 2024-09-16T01:15:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.214+0000 7f607db58640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60781002e0 0x7f60781992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.214+0000 7f607db58640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f607810dd50 con 0x7f60781002e0 2024-09-16T01:15:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.214+0000 7f60777fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60781002e0 0x7f60781992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.214+0000 7f60777fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60781002e0 0x7f60781992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35272/0 (socket says 172.21.15.63:35272) 2024-09-16T01:15:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.214+0000 7f60777fe640 1 -- 172.21.15.63:0/1176246040 learned_addr learned my addr 172.21.15.63:0/1176246040 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:15:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.215+0000 7f60777fe640 1 -- 172.21.15.63:0/1176246040 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60781997e0 con 0x7f60781002e0 2024-09-16T01:15:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.215+0000 7f60777fe640 1 --2- 172.21.15.63:0/1176246040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60781002e0 0x7f60781992a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6068009230 tx=0x7f60680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.215+0000 7f6074ff9640 1 -- 172.21.15.63:0/1176246040 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f606803f070 con 0x7f60781002e0 2024-09-16T01:15:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.215+0000 7f607db58640 1 -- 172.21.15.63:0/1176246040 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6078199a70 con 0x7f60781002e0 2024-09-16T01:15:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.215+0000 7f6074ff9640 1 -- 172.21.15.63:0/1176246040 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6068004d10 con 0x7f60781002e0 2024-09-16T01:15:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.215+0000 7f6074ff9640 1 -- 172.21.15.63:0/1176246040 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6068035030 con 0x7f60781002e0 2024-09-16T01:15:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.215+0000 7f607db58640 1 -- 172.21.15.63:0/1176246040 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6078199ed0 con 0x7f60781002e0 2024-09-16T01:15:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.216+0000 7f6074ff9640 1 -- 172.21.15.63:0/1176246040 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f6068042070 con 0x7f60781002e0 2024-09-16T01:15:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.216+0000 7f607db58640 1 -- 172.21.15.63:0/1176246040 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f607806a7b0 con 0x7f60781002e0 2024-09-16T01:15:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.216+0000 7f6074ff9640 1 --2- 172.21.15.63:0/1176246040 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60600392a0 0x7f606003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.216+0000 7f6074ff9640 1 -- 172.21.15.63:0/1176246040 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f606806cff0 con 0x7f60781002e0 2024-09-16T01:15:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.216+0000 7f6076ffd640 1 --2- 172.21.15.63:0/1176246040 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60600392a0 0x7f606003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.217+0000 7f6076ffd640 1 --2- 172.21.15.63:0/1176246040 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60600392a0 0x7f606003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f606c0098c0 tx=0x7f606c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:04.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.221+0000 7f6074ff9640 1 -- 172.21.15.63:0/1176246040 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6068039350 con 0x7f60781002e0 2024-09-16T01:15:04.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.399+0000 7f607db58640 1 -- 172.21.15.63:0/1176246040 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f607819a660 con 0x7f60781002e0 2024-09-16T01:15:04.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.771+0000 7f6074ff9640 1 -- 172.21.15.63:0/1176246040 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f606802f300 con 0x7f60781002e0 2024-09-16T01:15:04.773 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-09-16T01:15:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.774+0000 7f607db58640 1 -- 172.21.15.63:0/1176246040 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60600392a0 msgr2=0x7f606003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.774+0000 7f607db58640 1 --2- 172.21.15.63:0/1176246040 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60600392a0 0x7f606003b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f606c0098c0 tx=0x7f606c006db0 comp rx=0 tx=0).stop 2024-09-16T01:15:04.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.774+0000 7f607db58640 1 -- 172.21.15.63:0/1176246040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60781002e0 msgr2=0x7f60781992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.774+0000 7f607db58640 1 --2- 172.21.15.63:0/1176246040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60781002e0 0x7f60781992a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6068009230 tx=0x7f60680048f0 comp rx=0 tx=0).stop 2024-09-16T01:15:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.774+0000 7f607db58640 1 -- 172.21.15.63:0/1176246040 shutdown_connections 2024-09-16T01:15:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.774+0000 7f607db58640 1 --2- 172.21.15.63:0/1176246040 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60600392a0 0x7f606003b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.774+0000 7f607db58640 1 --2- 172.21.15.63:0/1176246040 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60781002e0 0x7f60781992a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.774+0000 7f607db58640 1 -- 172.21.15.63:0/1176246040 >> 172.21.15.63:0/1176246040 conn(0x7f60780fc1b0 msgr2=0x7f60780fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.774+0000 7f607db58640 1 -- 172.21.15.63:0/1176246040 shutdown_connections 2024-09-16T01:15:04.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:04.774+0000 7f607db58640 1 -- 172.21.15.63:0/1176246040 wait complete. 2024-09-16T01:15:05.067 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:04 smithi063 ceph-mon[31070]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:05.067 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:04 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1176246040' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T01:15:05.340 INFO:tasks.cephadm:Adding mon.a on smithi063 2024-09-16T01:15:05.341 INFO:tasks.cephadm:Adding mon.b on smithi162 2024-09-16T01:15:05.341 INFO:tasks.cephadm:Adding mon.c on smithi192 2024-09-16T01:15:05.341 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi063:172.21.15.63=a;smithi162:172.21.15.162=b;smithi192:172.21.15.192=c' 2024-09-16T01:15:05.612 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:15:05.658 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T01:15:06.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:05 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1176246040' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T01:15:06.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:05 smithi063 ceph-mon[31070]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:15:06.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:06.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:06.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:06.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:06.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:15:06.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:06.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:06.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.136+0000 7ff8fa120640 1 -- 172.21.15.192:0/2317708678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f4101bc0 msgr2=0x7ff8f4101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.136+0000 7ff8fa120640 1 --2- 172.21.15.192:0/2317708678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f4101bc0 0x7ff8f4101fc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009880 tx=0x7ff8e402a5d0 comp rx=0 tx=0).stop 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.136+0000 7ff8fa120640 1 -- 172.21.15.192:0/2317708678 shutdown_connections 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.136+0000 7ff8fa120640 1 --2- 172.21.15.192:0/2317708678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f4101bc0 0x7ff8f4101fc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.136+0000 7ff8fa120640 1 -- 172.21.15.192:0/2317708678 >> 172.21.15.192:0/2317708678 conn(0x7ff8f40fb450 msgr2=0x7ff8f40fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.136+0000 7ff8fa120640 1 -- 172.21.15.192:0/2317708678 shutdown_connections 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.136+0000 7ff8fa120640 1 -- 172.21.15.192:0/2317708678 wait complete. 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.137+0000 7ff8fa120640 1 Processor -- start 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.137+0000 7ff8fa120640 1 -- start start 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.137+0000 7ff8fa120640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f4101bc0 0x7ff8f4100100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.137+0000 7ff8fa120640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f4106530 con 0x7ff8f4101bc0 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.137+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f4101bc0 0x7ff8f4100100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:06.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.137+0000 7ff8f37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f4101bc0 0x7ff8f4100100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.192:37764/0 (socket says 172.21.15.192:37764) 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.137+0000 7ff8f37fe640 1 -- 172.21.15.192:0/2277051401 learned_addr learned my addr 172.21.15.192:0/2277051401 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.138+0000 7ff8f37fe640 1 -- 172.21.15.192:0/2277051401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f41999e0 con 0x7ff8f4101bc0 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.138+0000 7ff8f37fe640 1 --2- 172.21.15.192:0/2277051401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f4101bc0 0x7ff8f4100100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009230 tx=0x7ff8e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.138+0000 7ff8f0ff9640 1 -- 172.21.15.192:0/2277051401 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8e403f070 con 0x7ff8f4101bc0 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.138+0000 7ff8fa120640 1 -- 172.21.15.192:0/2277051401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f4199bb0 con 0x7ff8f4101bc0 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.138+0000 7ff8f0ff9640 1 -- 172.21.15.192:0/2277051401 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8e4003aa0 con 0x7ff8f4101bc0 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.138+0000 7ff8f0ff9640 1 -- 172.21.15.192:0/2277051401 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8e4035030 con 0x7ff8f4101bc0 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.138+0000 7ff8fa120640 1 -- 172.21.15.192:0/2277051401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f4199f50 con 0x7ff8f4101bc0 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.139+0000 7ff8fa120640 1 -- 172.21.15.192:0/2277051401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f4106cb0 con 0x7ff8f4101bc0 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.139+0000 7ff8f0ff9640 1 -- 172.21.15.192:0/2277051401 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ff8e4042070 con 0x7ff8f4101bc0 2024-09-16T01:15:06.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.140+0000 7ff8f0ff9640 1 --2- 172.21.15.192:0/2277051401 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8dc0392a0 0x7ff8dc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:06.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.140+0000 7ff8f0ff9640 1 -- 172.21.15.192:0/2277051401 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff8e406d460 con 0x7ff8f4101bc0 2024-09-16T01:15:06.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.140+0000 7ff8f2ffd640 1 --2- 172.21.15.192:0/2277051401 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8dc0392a0 0x7ff8dc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:06.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.140+0000 7ff8f2ffd640 1 --2- 172.21.15.192:0/2277051401 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8dc0392a0 0x7ff8dc03b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80098c0 tx=0x7ff8e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:06.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.144+0000 7ff8f0ff9640 1 -- 172.21.15.192:0/2277051401 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8e4039350 con 0x7ff8f4101bc0 2024-09-16T01:15:06.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.335+0000 7ff8fa120640 1 -- 172.21.15.192:0/2277051401 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi063:172.21.15.63=a;smithi162:172.21.15.162=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}) -- 0x7ff8f402db40 con 0x7ff8dc0392a0 2024-09-16T01:15:06.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.341+0000 7ff8f0ff9640 1 -- 172.21.15.192:0/2277051401 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff8f402db40 con 0x7ff8dc0392a0 2024-09-16T01:15:06.343 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mon update... 2024-09-16T01:15:06.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.343+0000 7ff8fa120640 1 -- 172.21.15.192:0/2277051401 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8dc0392a0 msgr2=0x7ff8dc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:06.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.343+0000 7ff8fa120640 1 --2- 172.21.15.192:0/2277051401 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8dc0392a0 0x7ff8dc03b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80098c0 tx=0x7ff8e8006db0 comp rx=0 tx=0).stop 2024-09-16T01:15:06.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.343+0000 7ff8fa120640 1 -- 172.21.15.192:0/2277051401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f4101bc0 msgr2=0x7ff8f4100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:06.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.343+0000 7ff8fa120640 1 --2- 172.21.15.192:0/2277051401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f4101bc0 0x7ff8f4100100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009230 tx=0x7ff8e40048f0 comp rx=0 tx=0).stop 2024-09-16T01:15:06.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.343+0000 7ff8fa120640 1 -- 172.21.15.192:0/2277051401 shutdown_connections 2024-09-16T01:15:06.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.343+0000 7ff8fa120640 1 --2- 172.21.15.192:0/2277051401 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8dc0392a0 0x7ff8dc03b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:06.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.343+0000 7ff8fa120640 1 --2- 172.21.15.192:0/2277051401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f4101bc0 0x7ff8f4100100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:06.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.343+0000 7ff8fa120640 1 -- 172.21.15.192:0/2277051401 >> 172.21.15.192:0/2277051401 conn(0x7ff8f40fb450 msgr2=0x7ff8f40fbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:06.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.343+0000 7ff8fa120640 1 -- 172.21.15.192:0/2277051401 shutdown_connections 2024-09-16T01:15:06.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:06.343+0000 7ff8fa120640 1 -- 172.21.15.192:0/2277051401 wait complete. 2024-09-16T01:15:06.968 DEBUG:teuthology.orchestra.run.smithi162:mon.b> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.b.service 2024-09-16T01:15:06.971 DEBUG:teuthology.orchestra.run.smithi192:mon.c> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.c.service 2024-09-16T01:15:06.973 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T01:15:06.973 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:15:07.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:06 smithi063 ceph-mon[31070]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:06 smithi063 ceph-mon[31070]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-16T01:15:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:06 smithi063 ceph-mon[31070]: Updating smithi192:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:06 smithi063 ceph-mon[31070]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:15:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:08.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:07 smithi063 ceph-mon[31070]: Updating smithi192:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:15:08.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:07 smithi063 ceph-mon[31070]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi063:172.21.15.63=a;smithi162:172.21.15.162=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:15:08.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:07 smithi063 ceph-mon[31070]: Saving service mon spec with placement smithi063:172.21.15.63=a;smithi162:172.21.15.162=b;smithi192:172.21.15.192=c;count:3 2024-09-16T01:15:08.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:07 smithi063 ceph-mon[31070]: Deploying daemon mon.c on smithi192 2024-09-16T01:15:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:09.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:08 smithi063 ceph-mon[31070]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.382+0000 7fc9c9e71640 1 -- 172.21.15.192:0/2695604072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c41076c0 msgr2=0x7fc9c4107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.382+0000 7fc9c9e71640 1 --2- 172.21.15.192:0/2695604072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c41076c0 0x7fc9c4107aa0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009880 tx=0x7fc9b402a5d0 comp rx=0 tx=0).stop 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.382+0000 7fc9c9e71640 1 -- 172.21.15.192:0/2695604072 shutdown_connections 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.382+0000 7fc9c9e71640 1 --2- 172.21.15.192:0/2695604072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c41076c0 0x7fc9c4107aa0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.382+0000 7fc9c9e71640 1 -- 172.21.15.192:0/2695604072 >> 172.21.15.192:0/2695604072 conn(0x7fc9c40fb8c0 msgr2=0x7fc9c40fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.382+0000 7fc9c9e71640 1 -- 172.21.15.192:0/2695604072 shutdown_connections 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.382+0000 7fc9c9e71640 1 -- 172.21.15.192:0/2695604072 wait complete. 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.383+0000 7fc9c9e71640 1 Processor -- start 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.383+0000 7fc9c9e71640 1 -- start start 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.383+0000 7fc9c9e71640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c41076c0 0x7fc9c4196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:09.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.383+0000 7fc9c9e71640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c410bb00 con 0x7fc9c41076c0 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.383+0000 7fc9c37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c41076c0 0x7fc9c4196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.383+0000 7fc9c37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c41076c0 0x7fc9c4196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.192:37776/0 (socket says 172.21.15.192:37776) 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.383+0000 7fc9c37fe640 1 -- 172.21.15.192:0/143854736 learned_addr learned my addr 172.21.15.192:0/143854736 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.384+0000 7fc9c37fe640 1 -- 172.21.15.192:0/143854736 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c4197530 con 0x7fc9c41076c0 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.384+0000 7fc9c37fe640 1 --2- 172.21.15.192:0/143854736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c41076c0 0x7fc9c4196ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009230 tx=0x7fc9b40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.384+0000 7fc9c0ff9640 1 -- 172.21.15.192:0/143854736 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b403f070 con 0x7fc9c41076c0 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.384+0000 7fc9c9e71640 1 -- 172.21.15.192:0/143854736 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c41977c0 con 0x7fc9c41076c0 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.384+0000 7fc9c9e71640 1 -- 172.21.15.192:0/143854736 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c419b8c0 con 0x7fc9c41076c0 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.385+0000 7fc9c0ff9640 1 -- 172.21.15.192:0/143854736 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9b4004d10 con 0x7fc9c41076c0 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.385+0000 7fc9c0ff9640 1 -- 172.21.15.192:0/143854736 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b4049060 con 0x7fc9c41076c0 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.385+0000 7fc9c9e71640 1 -- 172.21.15.192:0/143854736 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b0005290 con 0x7fc9c41076c0 2024-09-16T01:15:09.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.385+0000 7fc9c0ff9640 1 -- 172.21.15.192:0/143854736 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc9b4042070 con 0x7fc9c41076c0 2024-09-16T01:15:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.386+0000 7fc9c0ff9640 1 --2- 172.21.15.192:0/143854736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc9ac039300 0x7fc9ac03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.386+0000 7fc9c0ff9640 1 -- 172.21.15.192:0/143854736 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc9b406cf40 con 0x7fc9c41076c0 2024-09-16T01:15:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.386+0000 7fc9c2ffd640 1 --2- 172.21.15.192:0/143854736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc9ac039300 0x7fc9ac03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.387+0000 7fc9c2ffd640 1 --2- 172.21.15.192:0/143854736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc9ac039300 0x7fc9ac03b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80098c0 tx=0x7fc9b8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:09.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.391+0000 7fc9c0ff9640 1 -- 172.21.15.192:0/143854736 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9b4039350 con 0x7fc9c41076c0 2024-09-16T01:15:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.643+0000 7fc9c9e71640 1 -- 172.21.15.192:0/143854736 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc9b0005580 con 0x7fc9c41076c0 2024-09-16T01:15:09.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.644+0000 7fc9c0ff9640 1 -- 172.21.15.192:0/143854736 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fc9b403f210 con 0x7fc9c41076c0 2024-09-16T01:15:09.647 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:15:09.647 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","modified":"2024-09-16T01:13:47.917127Z","created":"2024-09-16T01:13:47.917127Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T01:15:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-16T01:15:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.646+0000 7fc9c9e71640 1 -- 172.21.15.192:0/143854736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc9ac039300 msgr2=0x7fc9ac03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.646+0000 7fc9c9e71640 1 --2- 172.21.15.192:0/143854736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc9ac039300 0x7fc9ac03b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80098c0 tx=0x7fc9b8006db0 comp rx=0 tx=0).stop 2024-09-16T01:15:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.646+0000 7fc9c9e71640 1 -- 172.21.15.192:0/143854736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c41076c0 msgr2=0x7fc9c4196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.646+0000 7fc9c9e71640 1 --2- 172.21.15.192:0/143854736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c41076c0 0x7fc9c4196ff0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009230 tx=0x7fc9b40048f0 comp rx=0 tx=0).stop 2024-09-16T01:15:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.646+0000 7fc9c9e71640 1 -- 172.21.15.192:0/143854736 shutdown_connections 2024-09-16T01:15:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.646+0000 7fc9c9e71640 1 --2- 172.21.15.192:0/143854736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc9ac039300 0x7fc9ac03b7c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.646+0000 7fc9c9e71640 1 --2- 172.21.15.192:0/143854736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9c41076c0 0x7fc9c4196ff0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.646+0000 7fc9c9e71640 1 -- 172.21.15.192:0/143854736 >> 172.21.15.192:0/143854736 conn(0x7fc9c40fb8c0 msgr2=0x7fc9c40fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.647+0000 7fc9c9e71640 1 -- 172.21.15.192:0/143854736 shutdown_connections 2024-09-16T01:15:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:09.647+0000 7fc9c9e71640 1 -- 172.21.15.192:0/143854736 wait complete. 2024-09-16T01:15:10.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:09 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/143854736' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:15:10.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 systemd[1]: Starting Ceph mon.c for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:15:10.563 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 podman[34755]: 2024-09-16 01:15:10.472455908 +0000 UTC m=+0.113018401 container create 75f8e12764a29af622c9f9510443cf7de7578b68f26692cf12def997e0f16f3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:15:10.563 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 podman[34755]: 2024-09-16 01:15:10.378634313 +0000 UTC m=+0.019196818 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 podman[34755]: 2024-09-16 01:15:10.650011383 +0000 UTC m=+0.290573877 container init 75f8e12764a29af622c9f9510443cf7de7578b68f26692cf12def997e0f16f3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-16T01:15:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 podman[34755]: 2024-09-16 01:15:10.6543158 +0000 UTC m=+0.294878298 container start 75f8e12764a29af622c9f9510443cf7de7578b68f26692cf12def997e0f16f3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-16T01:15:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T01:15:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-16T01:15:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: pidfile_write: ignore empty --pid-file 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: load: jerasure load: lrc 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: RocksDB version: 7.9.2 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Git sha 0 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: DB SUMMARY 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: DB Session ID: WP8WMIIVC07NFWCY9PWT 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: CURRENT file: CURRENT 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.error_if_exists: 0 2024-09-16T01:15:10.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.create_if_missing: 0 2024-09-16T01:15:10.926 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.paranoid_checks: 1 2024-09-16T01:15:10.926 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T01:15:10.926 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T01:15:10.926 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T01:15:10.926 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.env: 0x55d89fb75940 2024-09-16T01:15:10.926 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T01:15:10.926 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.info_log: 0x55d8a03e16e0 2024-09-16T01:15:10.926 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.statistics: (nil) 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.use_fsync: 0 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_log_file_size: 0 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.allow_fallocate: 1 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T01:15:10.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.use_direct_reads: 0 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.db_log_dir: 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.wal_dir: 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T01:15:10.929 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.write_buffer_manager: 0x55d8a03f0dc0 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.unordered_write: 0 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T01:15:10.930 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.row_cache: None 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.wal_filter: None 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.two_write_queues: 0 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.wal_compression: 0 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.atomic_flush: 0 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T01:15:10.931 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.log_readahead_size: 0 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_background_jobs: 2 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_background_compactions: -1 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_subcompactions: 1 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T01:15:10.932 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_open_files: -1 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_background_flushes: -1 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Compression algorithms supported: 2024-09-16T01:15:10.933 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: kZSTD supported: 0 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: kXpressCompression supported: 0 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: kBZip2Compression supported: 0 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: kLZ4Compression supported: 1 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: kZlibCompression supported: 1 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: kSnappyCompression supported: 1 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T01:15:10.934 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.merge_operator: 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_filter: None 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d8a03e1320) 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout: cache_index_and_filter_blocks: 1 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout: pin_top_level_index_and_filter: 1 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout: index_type: 0 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout: data_block_index_type: 0 2024-09-16T01:15:10.935 INFO:journalctl@ceph.mon.c.smithi192.stdout: index_shortening: 1 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: checksum: 4 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: no_block_cache: 0 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_cache: 0x55d8a03d5350 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_cache_name: BinnedLRUCache 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_cache_options: 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: capacity : 536870912 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: num_shard_bits : 4 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: strict_capacity_limit : 0 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: high_pri_pool_ratio: 0.000 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_cache_compressed: (nil) 2024-09-16T01:15:10.936 INFO:journalctl@ceph.mon.c.smithi192.stdout: persistent_cache: (nil) 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_size: 4096 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_size_deviation: 10 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_restart_interval: 16 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: index_block_restart_interval: 1 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: metadata_block_size: 4096 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: partition_filters: 0 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: use_delta_encoding: 1 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: filter_policy: bloomfilter 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: whole_key_filtering: 1 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: verify_compression: 0 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: read_amp_bytes_per_bit: 0 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: format_version: 5 2024-09-16T01:15:10.937 INFO:journalctl@ceph.mon.c.smithi192.stdout: enable_index_compression: 1 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout: block_align: 0 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout: max_auto_readahead_size: 262144 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout: prepopulate_block_cache: 0 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout: initial_auto_readahead_size: 8192 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compression: NoCompression 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.num_levels: 7 2024-09-16T01:15:10.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T01:15:10.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T01:15:10.940 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T01:15:10.941 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T01:15:10.942 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.inplace_update_support: 0 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.bloom_locality: 0 2024-09-16T01:15:10.943 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.max_successive_merges: 0 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.ttl: 2592000 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.enable_blob_files: false 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.min_blob_size: 0 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T01:15:10.944 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 75efd5c6-84ff-4a12-8d8e-7ef8c87f08dd 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726449310681534, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726449310681950, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726449310, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "75efd5c6-84ff-4a12-8d8e-7ef8c87f08dd", "db_session_id": "WP8WMIIVC07NFWCY9PWT", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726449310682045, "job": 1, "event": "recovery_finished"} 2024-09-16T01:15:10.945 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d8a0402e00 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: DB pointer 0x55d8a04fe000 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** DB Stats ** 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T01:15:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** Compaction Stats [default] ** 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** Compaction Stats [default] ** 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-16T01:15:10.947 INFO:journalctl@ceph.mon.c.smithi192.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T01:15:10.948 INFO:journalctl@ceph.mon.c.smithi192.stdout: Block cache BinnedLRUCache@0x55d8a03d5350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-16T01:15:10.949 INFO:journalctl@ceph.mon.c.smithi192.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-16T01:15:10.949 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-16T01:15:10.949 INFO:journalctl@ceph.mon.c.smithi192.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T01:15:10.949 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-16T01:15:10.949 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: using public_addr v2:172.21.15.192:0/0 -> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] 2024-09-16T01:15:10.949 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: starting mon.c rank -1 at public addrs [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] at bind addrs [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:10.949 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(???) e0 preinit fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:10.949 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).mds e1 new map 2024-09-16T01:15:10.949 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-16T01:15:10.949 INFO:journalctl@ceph.mon.c.smithi192.stdout: e1 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout: btime 2024-09-16T01:13:51:098754+0000 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout: legacy client fscid: -1 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout: 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout: No filesystems configured 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-16T01:15:10.950 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1176246040' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:10.951 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: Updating smithi192:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: Updating smithi192:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi063:172.21.15.63=a;smithi162:172.21.15.162=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: Saving service mon spec with placement smithi063:172.21.15.63=a;smithi162:172.21.15.162=b;smithi192:172.21.15.192=c;count:3 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: Deploying daemon mon.c on smithi192 2024-09-16T01:15:10.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:10.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/143854736' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:15:10.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 ceph-mon[34775]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-16T01:15:10.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 bash[34755]: 75f8e12764a29af622c9f9510443cf7de7578b68f26692cf12def997e0f16f3e 2024-09-16T01:15:10.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:10 smithi192 systemd[1]: Started Ceph mon.c for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:15:11.285 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T01:15:11.286 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:15:11.548 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:15:16.029 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:15:16.029 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.029 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: mon.a calling monitor election 2024-09-16T01:15:16.029 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:16.029 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.029 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.029 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: mon.c calling monitor election 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: monmap epoch 2 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: last_changed 2024-09-16T01:15:10.706528+0000 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: created 2024-09-16T01:13:47.917127+0000 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: min_mon_release 19 (squid) 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: election_strategy: 1 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-16T01:15:16.030 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-16T01:15:16.031 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: fsmap 2024-09-16T01:15:16.031 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:15:16.031 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: mgrmap e13: x(active, since 38s) 2024-09-16T01:15:16.031 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: overall HEALTH_OK 2024-09-16T01:15:16.031 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:16.031 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:16.031 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:16.031 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:16.031 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:15:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: mon.a calling monitor election 2024-09-16T01:15:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: mon.c calling monitor election 2024-09-16T01:15:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: monmap epoch 2 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: last_changed 2024-09-16T01:15:10.706528+0000 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: created 2024-09-16T01:13:47.917127+0000 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: min_mon_release 19 (squid) 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: election_strategy: 1 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: fsmap 2024-09-16T01:15:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:15:16.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: mgrmap e13: x(active, since 38s) 2024-09-16T01:15:16.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: overall HEALTH_OK 2024-09-16T01:15:16.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:16.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:16.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:16.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:16.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:16.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.346+0000 7f5e3da3c640 1 -- 172.21.15.192:0/2359719438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e20003530 msgr2=0x7f5e200059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.346+0000 7f5e3da3c640 1 --2- 172.21.15.192:0/2359719438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e20003530 0x7f5e200059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e3806aa60 tx=0x7f5e2802c490 comp rx=0 tx=0).stop 2024-09-16T01:15:16.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.346+0000 7f5e3da3c640 1 -- 172.21.15.192:0/2359719438 shutdown_connections 2024-09-16T01:15:16.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.346+0000 7f5e3da3c640 1 --2- 172.21.15.192:0/2359719438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e20003530 0x7f5e200059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.346+0000 7f5e3da3c640 1 -- 172.21.15.192:0/2359719438 >> 172.21.15.192:0/2359719438 conn(0x7f5e380fc220 msgr2=0x7f5e380fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:16.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.346+0000 7f5e3da3c640 1 -- 172.21.15.192:0/2359719438 shutdown_connections 2024-09-16T01:15:16.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.346+0000 7f5e3da3c640 1 -- 172.21.15.192:0/2359719438 wait complete. 2024-09-16T01:15:16.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.347+0000 7f5e3da3c640 1 Processor -- start 2024-09-16T01:15:16.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e3da3c640 1 -- start start 2024-09-16T01:15:16.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e3da3c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e20003530 0x7f5e381a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e3da3c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e381a3b10 0x7f5e3819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e3da3c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3810fc40 con 0x7f5e20003530 2024-09-16T01:15:16.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e3da3c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3810fac0 con 0x7f5e381a3b10 2024-09-16T01:15:16.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e367fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e381a3b10 0x7f5e3819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e36ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e20003530 0x7f5e381a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e367fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e381a3b10 0x7f5e3819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53274/0 (socket says 172.21.15.192:53274) 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e36ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e20003530 0x7f5e381a35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.192:44728/0 (socket says 172.21.15.192:44728) 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e367fc640 1 -- 172.21.15.192:0/1945175456 learned_addr learned my addr 172.21.15.192:0/1945175456 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e367fc640 1 -- 172.21.15.192:0/1945175456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e381a3b10 msgr2=0x7f5e3819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e367fc640 1 -- 172.21.15.192:0/1945175456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e381a3b10 msgr2=0x7f5e3819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e367fc640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e381a3b10 0x7f5e3819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e367fc640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e381a3b10 0x7f5e3819d6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e36ffd640 1 -- 172.21.15.192:0/1945175456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e381a3b10 msgr2=0x7f5e3819d6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e36ffd640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e381a3b10 0x7f5e3819d6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.348+0000 7f5e36ffd640 1 -- 172.21.15.192:0/1945175456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e381a40b0 con 0x7f5e20003530 2024-09-16T01:15:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.349+0000 7f5e36ffd640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e20003530 0x7f5e381a35d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e28005f30 tx=0x7f5e280339a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.349+0000 7f5e3ca3a640 1 -- 172.21.15.192:0/1945175456 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5e28038040 con 0x7f5e20003530 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.349+0000 7f5e3da3c640 1 -- 172.21.15.192:0/1945175456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3819dc40 con 0x7f5e20003530 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.349+0000 7f5e3ca3a640 1 -- 172.21.15.192:0/1945175456 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e280055c0 con 0x7f5e20003530 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.349+0000 7f5e3ca3a640 1 -- 172.21.15.192:0/1945175456 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5e28004980 con 0x7f5e20003530 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.349+0000 7f5e3da3c640 1 -- 172.21.15.192:0/1945175456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3819e1d0 con 0x7f5e20003530 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.350+0000 7f5e3ca3a640 1 -- 172.21.15.192:0/1945175456 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5e28043020 con 0x7f5e20003530 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.350+0000 7f5e3da3c640 1 -- 172.21.15.192:0/1945175456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3806ad10 con 0x7f5e20003530 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.351+0000 7f5e3ca3a640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e24039040 0x7f5e2403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.351+0000 7f5e3ca3a640 1 -- 172.21.15.192:0/1945175456 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5e2806ea30 con 0x7f5e20003530 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.351+0000 7f5e367fc640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e24039040 0x7f5e2403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.351+0000 7f5e367fc640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e24039040 0x7f5e2403b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009100 tx=0x7f5e2c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:16.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.356+0000 7f5e3ca3a640 1 -- 172.21.15.192:0/1945175456 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e2804a020 con 0x7f5e20003530 2024-09-16T01:15:16.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.593+0000 7f5e3da3c640 1 -- 172.21.15.192:0/1945175456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5e3819e540 con 0x7f5e20003530 2024-09-16T01:15:16.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.593+0000 7f5e3ca3a640 1 -- 172.21.15.192:0/1945175456 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f5e2804cbc0 con 0x7f5e20003530 2024-09-16T01:15:16.595 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:15:16.595 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":2,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","modified":"2024-09-16T01:15:10.706528Z","created":"2024-09-16T01:13:47.917127Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T01:15:16.595 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 2 2024-09-16T01:15:16.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.595+0000 7f5e3da3c640 1 -- 172.21.15.192:0/1945175456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e24039040 msgr2=0x7f5e2403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.595+0000 7f5e3da3c640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e24039040 0x7f5e2403b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009100 tx=0x7f5e2c008040 comp rx=0 tx=0).stop 2024-09-16T01:15:16.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.595+0000 7f5e3da3c640 1 -- 172.21.15.192:0/1945175456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e20003530 msgr2=0x7f5e381a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.595+0000 7f5e3da3c640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e20003530 0x7f5e381a35d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e28005f30 tx=0x7f5e280339a0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.595+0000 7f5e3da3c640 1 -- 172.21.15.192:0/1945175456 shutdown_connections 2024-09-16T01:15:16.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.595+0000 7f5e3da3c640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e24039040 0x7f5e2403b500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.595+0000 7f5e3da3c640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e381a3b10 0x7f5e3819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.595+0000 7f5e3da3c640 1 --2- 172.21.15.192:0/1945175456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e20003530 0x7f5e381a35d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.595+0000 7f5e3da3c640 1 -- 172.21.15.192:0/1945175456 >> 172.21.15.192:0/1945175456 conn(0x7f5e380fc220 msgr2=0x7f5e381961b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:16.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.596+0000 7f5e3da3c640 1 -- 172.21.15.192:0/1945175456 shutdown_connections 2024-09-16T01:15:16.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:16.596+0000 7f5e3da3c640 1 -- 172.21.15.192:0/1945175456 wait complete. 2024-09-16T01:15:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:16 smithi192 ceph-mon[34775]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:16 smithi192 ceph-mon[34775]: Deploying daemon mon.b on smithi162 2024-09-16T01:15:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:16 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/1945175456' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:15:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:16 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:17.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:16 smithi063 ceph-mon[31070]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:17.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:16 smithi063 ceph-mon[31070]: Deploying daemon mon.b on smithi162 2024-09-16T01:15:17.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:16 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/1945175456' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:15:17.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:16 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:18.211 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T01:15:18.211 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:15:18.463 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:15:18.862 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:18 smithi192 ceph-mon[34775]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:18.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.941+0000 7fbefe597640 1 -- 172.21.15.192:0/1024644663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef8102820 msgr2=0x7fbef8102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.941+0000 7fbefe597640 1 --2- 172.21.15.192:0/1024644663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef8102820 0x7fbef8102c00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009880 tx=0x7fbee802a670 comp rx=0 tx=0).stop 2024-09-16T01:15:18.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.941+0000 7fbefe597640 1 -- 172.21.15.192:0/1024644663 shutdown_connections 2024-09-16T01:15:18.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.941+0000 7fbefe597640 1 --2- 172.21.15.192:0/1024644663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef8102820 0x7fbef8102c00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.941+0000 7fbefe597640 1 -- 172.21.15.192:0/1024644663 >> 172.21.15.192:0/1024644663 conn(0x7fbef80fc220 msgr2=0x7fbef80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:18.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.941+0000 7fbefe597640 1 -- 172.21.15.192:0/1024644663 shutdown_connections 2024-09-16T01:15:18.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.941+0000 7fbefe597640 1 -- 172.21.15.192:0/1024644663 wait complete. 2024-09-16T01:15:18.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbefe597640 1 Processor -- start 2024-09-16T01:15:18.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbefe597640 1 -- start start 2024-09-16T01:15:18.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbefe597640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef8102820 0x7fbef8100480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbefe597640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81009c0 0x7fbef8100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbefe597640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbef810bc20 con 0x7fbef8102820 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbefe597640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbef810baa0 con 0x7fbef81009c0 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbef77fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81009c0 0x7fbef8100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbef77fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81009c0 0x7fbef8100e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53278/0 (socket says 172.21.15.192:53278) 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbef77fe640 1 -- 172.21.15.192:0/3123988012 learned_addr learned my addr 172.21.15.192:0/3123988012 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbef77fe640 1 -- 172.21.15.192:0/3123988012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81009c0 msgr2=0x7fbef8100e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbef77fe640 1 -- 172.21.15.192:0/3123988012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81009c0 msgr2=0x7fbef8100e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbef77fe640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81009c0 0x7fbef8100e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.942+0000 7fbef77fe640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81009c0 0x7fbef8100e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.943+0000 7fbef7fff640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef8102820 0x7fbef8100480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.943+0000 7fbef7fff640 1 -- 172.21.15.192:0/3123988012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81009c0 msgr2=0x7fbef8100e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.943+0000 7fbef7fff640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81009c0 0x7fbef8100e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.943+0000 7fbef7fff640 1 -- 172.21.15.192:0/3123988012 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef8102370 con 0x7fbef8102820 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.943+0000 7fbef7fff640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef8102820 0x7fbef8100480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbee8006010 tx=0x7fbee8004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.943+0000 7fbef57fa640 1 -- 172.21.15.192:0/3123988012 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbee8035030 con 0x7fbef8102820 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.943+0000 7fbefe597640 1 -- 172.21.15.192:0/3123988012 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef81a3530 con 0x7fbef8102820 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.943+0000 7fbef57fa640 1 -- 172.21.15.192:0/3123988012 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbee80053a0 con 0x7fbef8102820 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.943+0000 7fbef57fa640 1 -- 172.21.15.192:0/3123988012 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbee8031830 con 0x7fbef8102820 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.943+0000 7fbefe597640 1 -- 172.21.15.192:0/3123988012 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef81a3a60 con 0x7fbef8102820 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.945+0000 7fbefe597640 1 -- 172.21.15.192:0/3123988012 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef806ad10 con 0x7fbef8102820 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.945+0000 7fbef57fa640 1 -- 172.21.15.192:0/3123988012 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fbee8042070 con 0x7fbef8102820 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.945+0000 7fbef57fa640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbee0039040 0x7fbee003b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.945+0000 7fbef57fa640 1 -- 172.21.15.192:0/3123988012 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbee806d080 con 0x7fbef8102820 2024-09-16T01:15:18.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.946+0000 7fbef77fe640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbee0039040 0x7fbee003b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.946+0000 7fbef77fe640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbee0039040 0x7fbee003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009100 tx=0x7fbeec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:18.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:18.951+0000 7fbef57fa640 1 -- 172.21.15.192:0/3123988012 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbee8039350 con 0x7fbef8102820 2024-09-16T01:15:19.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:18 smithi063 ceph-mon[31070]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:19.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.181+0000 7fbefe597640 1 -- 172.21.15.192:0/3123988012 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbef81a3d10 con 0x7fbef8102820 2024-09-16T01:15:19.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.181+0000 7fbef57fa640 1 -- 172.21.15.192:0/3123988012 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fbee80372d0 con 0x7fbef8102820 2024-09-16T01:15:19.183 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:15:19.183 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":2,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","modified":"2024-09-16T01:15:10.706528Z","created":"2024-09-16T01:13:47.917127Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T01:15:19.183 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 2 2024-09-16T01:15:19.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 -- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbee0039040 msgr2=0x7fbee003b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:19.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbee0039040 0x7fbee003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009100 tx=0x7fbeec008040 comp rx=0 tx=0).stop 2024-09-16T01:15:19.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 -- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef8102820 msgr2=0x7fbef8100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:19.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef8102820 0x7fbef8100480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbee8006010 tx=0x7fbee8004e40 comp rx=0 tx=0).stop 2024-09-16T01:15:19.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 -- 172.21.15.192:0/3123988012 shutdown_connections 2024-09-16T01:15:19.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbee0039040 0x7fbee003b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbef81009c0 0x7fbef8100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 --2- 172.21.15.192:0/3123988012 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbef8102820 0x7fbef8100480 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 -- 172.21.15.192:0/3123988012 >> 172.21.15.192:0/3123988012 conn(0x7fbef80fc220 msgr2=0x7fbef81055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:19.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 -- 172.21.15.192:0/3123988012 shutdown_connections 2024-09-16T01:15:19.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:19.184+0000 7fbefe597640 1 -- 172.21.15.192:0/3123988012 wait complete. 2024-09-16T01:15:19.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:19 smithi162 systemd[1]: Started Ceph mon.b for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:15:20.788 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-16T01:15:20.788 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T01:15:21.038 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:15:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.631+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/41605095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a6c003530 msgr2=0x7f9a6c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.631+0000 7f9a8b9d9640 1 --2- 172.21.15.192:0/41605095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a6c003530 0x7f9a6c0059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9a84102af0 tx=0x7f9a7c02c150 comp rx=0 tx=0).stop 2024-09-16T01:15:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.631+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/41605095 shutdown_connections 2024-09-16T01:15:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.631+0000 7f9a8b9d9640 1 --2- 172.21.15.192:0/41605095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a6c003530 0x7f9a6c0059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.631+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/41605095 >> 172.21.15.192:0/41605095 conn(0x7f9a840fd320 msgr2=0x7f9a840ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.631+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/41605095 shutdown_connections 2024-09-16T01:15:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.631+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/41605095 wait complete. 2024-09-16T01:15:24.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a8b9d9640 1 Processor -- start 2024-09-16T01:15:24.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a8b9d9640 1 -- start start 2024-09-16T01:15:24.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a8b9d9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a6c003530 0x7f9a840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:24.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a8b9d9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84074a30 0x7f9a84074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a8b9d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a841a34d0 0x7f9a841a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a8b9d9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84109630 con 0x7f9a6c003530 2024-09-16T01:15:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a8b9d9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a841094b0 con 0x7f9a841a34d0 2024-09-16T01:15:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a8b9d9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9a841097b0 con 0x7f9a84074a30 2024-09-16T01:15:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a88f74640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84074a30 0x7f9a84074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a89775640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a6c003530 0x7f9a840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a88f74640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84074a30 0x7f9a84074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34786/0 (socket says 172.21.15.192:34786) 2024-09-16T01:15:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a88f74640 1 -- 172.21.15.192:0/1409558327 learned_addr learned my addr 172.21.15.192:0/1409558327 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:15:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a89775640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a6c003530 0x7f9a840744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.192:50594/0 (socket says 172.21.15.192:50594) 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a88f74640 1 -- 172.21.15.192:0/1409558327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84074a30 msgr2=0x7f9a84074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a88f74640 1 -- 172.21.15.192:0/1409558327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84074a30 msgr2=0x7f9a84074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a88f74640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84074a30 0x7f9a84074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a89f76640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a841a34d0 0x7f9a841a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.632+0000 7f9a88f74640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84074a30 0x7f9a84074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a89f76640 1 -- 172.21.15.192:0/1409558327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a841a34d0 msgr2=0x7f9a841a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a89f76640 1 -- 172.21.15.192:0/1409558327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a841a34d0 msgr2=0x7f9a841a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a89f76640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a841a34d0 0x7f9a841a58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a89775640 1 -- 172.21.15.192:0/1409558327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84074a30 msgr2=0x7f9a84074e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a89775640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84074a30 0x7f9a84074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:24.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a89f76640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a841a34d0 0x7f9a841a58c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a89775640 1 -- 172.21.15.192:0/1409558327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a841a34d0 msgr2=0x7f9a841a58c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a89775640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a841a34d0 0x7f9a841a58c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a89775640 1 -- 172.21.15.192:0/1409558327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a841a5f00 con 0x7f9a6c003530 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a89775640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a6c003530 0x7f9a840744f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9a84102af0 tx=0x7f9a7c004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a827fc640 1 -- 172.21.15.192:0/1409558327 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c032040 con 0x7f9a6c003530 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a827fc640 1 -- 172.21.15.192:0/1409558327 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9a7c043070 con 0x7f9a6c003530 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a827fc640 1 -- 172.21.15.192:0/1409558327 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c036410 con 0x7f9a6c003530 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/1409558327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a841a6190 con 0x7f9a6c003530 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.633+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/1409558327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a841a6720 con 0x7f9a6c003530 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.634+0000 7f9a827fc640 1 -- 172.21.15.192:0/1409558327 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9a7c0365b0 con 0x7f9a6c003530 2024-09-16T01:15:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.634+0000 7f9a827fc640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9a70039730 0x7f9a7003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.635+0000 7f9a827fc640 1 -- 172.21.15.192:0/1409558327 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9a7c06e110 con 0x7f9a6c003530 2024-09-16T01:15:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.635+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/1409558327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a8410a6e0 con 0x7f9a6c003530 2024-09-16T01:15:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.635+0000 7f9a88f74640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9a70039730 0x7f9a7003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.635+0000 7f9a88f74640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9a70039730 0x7f9a7003bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009400 tx=0x7f9a78007040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:24.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.642+0000 7f9a827fc640 1 -- 172.21.15.192:0/1409558327 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a7c045570 con 0x7f9a6c003530 2024-09-16T01:15:24.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.885+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/1409558327 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9a84190d10 con 0x7f9a6c003530 2024-09-16T01:15:24.886 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: mon.c calling monitor election 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: mon.a calling monitor election 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:24.887 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: monmap epoch 3 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: last_changed 2024-09-16T01:15:19.564182+0000 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: created 2024-09-16T01:13:47.917127+0000 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: min_mon_release 19 (squid) 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: election_strategy: 1 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: fsmap 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:15:24.888 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: mgrmap e13: x(active, since 47s) 2024-09-16T01:15:24.889 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: overall HEALTH_OK 2024-09-16T01:15:24.889 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:24.889 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:24.889 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:24.889 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:24.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.886+0000 7f9a827fc640 1 -- 172.21.15.192:0/1409558327 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f9a7c045310 con 0x7f9a6c003530 2024-09-16T01:15:24.889 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:15:24.890 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":3,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","modified":"2024-09-16T01:15:19.564182Z","created":"2024-09-16T01:13:47.917127Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T01:15:24.890 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 3 2024-09-16T01:15:24.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9a70039730 msgr2=0x7f9a7003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9a70039730 0x7f9a7003bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009400 tx=0x7f9a78007040 comp rx=0 tx=0).stop 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a6c003530 msgr2=0x7f9a840744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a6c003530 0x7f9a840744f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9a84102af0 tx=0x7f9a7c004f80 comp rx=0 tx=0).stop 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/1409558327 shutdown_connections 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9a70039730 0x7f9a7003bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a841a34d0 0x7f9a841a58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a84074a30 0x7f9a84074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 --2- 172.21.15.192:0/1409558327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a6c003530 0x7f9a840744f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/1409558327 >> 172.21.15.192:0/1409558327 conn(0x7f9a840fd320 msgr2=0x7f9a84106930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/1409558327 shutdown_connections 2024-09-16T01:15:24.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:24.888+0000 7f9a8b9d9640 1 -- 172.21.15.192:0/1409558327 wait complete. 2024-09-16T01:15:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:15:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: mon.c calling monitor election 2024-09-16T01:15:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: mon.a calling monitor election 2024-09-16T01:15:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T01:15:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: monmap epoch 3 2024-09-16T01:15:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: last_changed 2024-09-16T01:15:19.564182+0000 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: created 2024-09-16T01:13:47.917127+0000 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: min_mon_release 19 (squid) 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: election_strategy: 1 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: fsmap 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: mgrmap e13: x(active, since 47s) 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: overall HEALTH_OK 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:25.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:25.113 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:25.113 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:25.517 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-16T01:15:25.517 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-16T01:15:25.783 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:15:25.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:25.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:25 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/1409558327' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:15:25.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:25.899 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:25.899 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:25 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/1409558327' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:15:25.899 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:26.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.237+0000 7f7cb6202640 1 -- 172.21.15.63:0/2531595212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cb0106540 msgr2=0x7f7cb0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.237+0000 7f7cb6202640 1 --2- 172.21.15.63:0/2531595212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cb0106540 0x7f7cb0106920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009810 tx=0x7f7ca002a540 comp rx=0 tx=0).stop 2024-09-16T01:15:26.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.237+0000 7f7cb6202640 1 -- 172.21.15.63:0/2531595212 shutdown_connections 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.237+0000 7f7cb6202640 1 --2- 172.21.15.63:0/2531595212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cb0106540 0x7f7cb0106920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.237+0000 7f7cb6202640 1 -- 172.21.15.63:0/2531595212 >> 172.21.15.63:0/2531595212 conn(0x7f7cb0077310 msgr2=0x7f7cb00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.237+0000 7f7cb6202640 1 -- 172.21.15.63:0/2531595212 shutdown_connections 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.237+0000 7f7cb6202640 1 -- 172.21.15.63:0/2531595212 wait complete. 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7cb6202640 1 Processor -- start 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7cb6202640 1 -- start start 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7cb6202640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb0106540 0x7f7cb0198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7cb6202640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cb0198680 0x7f7cb0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7cb6202640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb01a11b0 0x7f7cb01a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7cb6202640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb010a9d0 con 0x7f7cb0198680 2024-09-16T01:15:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7cb6202640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb010a850 con 0x7f7cb01a11b0 2024-09-16T01:15:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7cb6202640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb010ab50 con 0x7f7cb0106540 2024-09-16T01:15:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cb0198680 0x7f7cb0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7caeffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cb0198680 0x7f7cb0198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53924/0 (socket says 172.21.15.63:53924) 2024-09-16T01:15:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7caeffd640 1 -- 172.21.15.63:0/3465489303 learned_addr learned my addr 172.21.15.63:0/3465489303 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:15:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.238+0000 7f7caf7fe640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb0106540 0x7f7cb0198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7caeffd640 1 -- 172.21.15.63:0/3465489303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb0106540 msgr2=0x7f7cb0198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7caeffd640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb0106540 0x7f7cb0198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7caeffd640 1 -- 172.21.15.63:0/3465489303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb01a11b0 msgr2=0x7f7cb01a35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7caffff640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb01a11b0 0x7f7cb01a35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7caeffd640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb01a11b0 0x7f7cb01a35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7caeffd640 1 -- 172.21.15.63:0/3465489303 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb01a3d40 con 0x7f7cb0198680 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7caffff640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb01a11b0 0x7f7cb01a35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7caeffd640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cb0198680 0x7f7cb0198ae0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400f9e0 tx=0x7f7ca400fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7cacff9640 1 -- 172.21.15.63:0/3465489303 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4004230 con 0x7f7cb0198680 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7cacff9640 1 -- 172.21.15.63:0/3465489303 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ca40043d0 con 0x7f7cb0198680 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7cacff9640 1 -- 172.21.15.63:0/3465489303 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4003a10 con 0x7f7cb0198680 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7cb6202640 1 -- 172.21.15.63:0/3465489303 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb0195f90 con 0x7f7cb0198680 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.239+0000 7f7cb6202640 1 -- 172.21.15.63:0/3465489303 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb0196480 con 0x7f7cb0198680 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.240+0000 7f7cacff9640 1 -- 172.21.15.63:0/3465489303 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7ca4003bf0 con 0x7f7cb0198680 2024-09-16T01:15:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.240+0000 7f7cb6202640 1 -- 172.21.15.63:0/3465489303 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb01069a0 con 0x7f7cb0198680 2024-09-16T01:15:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.240+0000 7f7cacff9640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c98039730 0x7f7c9803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.240+0000 7f7cacff9640 1 -- 172.21.15.63:0/3465489303 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7ca404fa30 con 0x7f7cb0198680 2024-09-16T01:15:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.241+0000 7f7caf7fe640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c98039730 0x7f7c9803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.241+0000 7f7caf7fe640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c98039730 0x7f7c9803bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0005e60 tx=0x7f7ca0009620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.245+0000 7f7cacff9640 1 -- 172.21.15.63:0/3465489303 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ca4017550 con 0x7f7cb0198680 2024-09-16T01:15:26.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.456+0000 7f7cb6202640 1 -- 172.21.15.63:0/3465489303 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f7cb0196930 con 0x7f7cb0198680 2024-09-16T01:15:26.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.457+0000 7f7cacff9640 1 -- 172.21.15.63:0/3465489303 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f7ca40177b0 con 0x7f7cb0198680 2024-09-16T01:15:26.458 INFO:teuthology.orchestra.run.smithi063.stdout:# minimal ceph.conf for c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:26.458 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-09-16T01:15:26.458 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:26.459 INFO:teuthology.orchestra.run.smithi063.stdout: mon_host = [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] 2024-09-16T01:15:26.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 -- 172.21.15.63:0/3465489303 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c98039730 msgr2=0x7f7c9803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c98039730 0x7f7c9803bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0005e60 tx=0x7f7ca0009620 comp rx=0 tx=0).stop 2024-09-16T01:15:26.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 -- 172.21.15.63:0/3465489303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cb0198680 msgr2=0x7f7cb0198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cb0198680 0x7f7cb0198ae0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400f9e0 tx=0x7f7ca400fea0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 -- 172.21.15.63:0/3465489303 shutdown_connections 2024-09-16T01:15:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c98039730 0x7f7c9803bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cb01a11b0 0x7f7cb01a35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7cb0198680 0x7f7cb0198ae0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 --2- 172.21.15.63:0/3465489303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb0106540 0x7f7cb0198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 -- 172.21.15.63:0/3465489303 >> 172.21.15.63:0/3465489303 conn(0x7f7cb0077310 msgr2=0x7f7cb00fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 -- 172.21.15.63:0/3465489303 shutdown_connections 2024-09-16T01:15:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:26.461+0000 7f7cb6202640 1 -- 172.21.15.63:0/3465489303 wait complete. 2024-09-16T01:15:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:15:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: mon.c calling monitor election 2024-09-16T01:15:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: mon.a calling monitor election 2024-09-16T01:15:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:15:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: monmap epoch 3 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: last_changed 2024-09-16T01:15:19.564182+0000 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: created 2024-09-16T01:13:47.917127+0000 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: min_mon_release 19 (squid) 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: election_strategy: 1 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-16T01:15:26.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: fsmap 2024-09-16T01:15:26.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:15:26.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: mgrmap e13: x(active, since 47s) 2024-09-16T01:15:26.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: overall HEALTH_OK 2024-09-16T01:15:26.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:26.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:26.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:26.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:26.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:26.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='client.? 172.21.15.192:0/1409558327' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T01:15:26.936 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:27.110 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-16T01:15:27.111 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:15:27.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T01:15:27.140 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:15:27.140 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:15:27.206 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:15:27.206 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T01:15:27.234 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:15:27.234 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:15:27.301 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:15:27.301 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T01:15:27.327 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:15:27.327 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T01:15:27.393 INFO:tasks.cephadm:Adding mgr.x on smithi063 2024-09-16T01:15:27.393 INFO:tasks.cephadm:Adding mgr.y on smithi162 2024-09-16T01:15:27.393 INFO:tasks.cephadm:Adding mgr.z on smithi192 2024-09-16T01:15:27.393 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi063=x;smithi162=y;smithi192=z' 2024-09-16T01:15:27.485 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: mon.b calling monitor election 2024-09-16T01:15:27.485 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-16T01:15:27.485 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-16T01:15:27.485 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-16T01:15:27.485 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: mon.b calling monitor election 2024-09-16T01:15:27.485 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: mon.c calling monitor election 2024-09-16T01:15:27.485 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: mon.a calling monitor election 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: monmap epoch 3 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: last_changed 2024-09-16T01:15:19.564182+0000 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: created 2024-09-16T01:13:47.917127+0000 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: min_mon_release 19 (squid) 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: election_strategy: 1 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: fsmap 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: mgrmap e13: x(active, since 49s) 2024-09-16T01:15:27.486 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: overall HEALTH_OK 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: Updating smithi192:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: Updating smithi162:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: Updating smithi063:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.487 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.488 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:27.488 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:15:27.488 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:27.488 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.629 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: mon.b calling monitor election 2024-09-16T01:15:27.629 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-16T01:15:27.629 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-16T01:15:27.629 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: mon.b calling monitor election 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: mon.c calling monitor election 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: mon.a calling monitor election 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: monmap epoch 3 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: last_changed 2024-09-16T01:15:19.564182+0000 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: created 2024-09-16T01:13:47.917127+0000 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: min_mon_release 19 (squid) 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: election_strategy: 1 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-16T01:15:27.630 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: fsmap 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: mgrmap e13: x(active, since 49s) 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: overall HEALTH_OK 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: Updating smithi192:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: Updating smithi162:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: Updating smithi063:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.631 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.632 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.632 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.632 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.632 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.632 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.632 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.632 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:27.632 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:15:27.632 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:27.632 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.667 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:15:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: mon.b calling monitor election 2024-09-16T01:15:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: Updating smithi063:/etc/ceph/ceph.conf 2024-09-16T01:15:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-16T01:15:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-16T01:15:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: mon.b calling monitor election 2024-09-16T01:15:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: mon.c calling monitor election 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: mon.a calling monitor election 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: monmap epoch 3 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: last_changed 2024-09-16T01:15:19.564182+0000 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: created 2024-09-16T01:13:47.917127+0000 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: min_mon_release 19 (squid) 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: election_strategy: 1 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: 0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: 2: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-16T01:15:27.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: fsmap 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: mgrmap e13: x(active, since 49s) 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: overall HEALTH_OK 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: Updating smithi192:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: Updating smithi162:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: Updating smithi063:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:27.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:27.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:15:27.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:27.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:28.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.110+0000 7f0d178df640 1 -- 172.21.15.192:0/2416885031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d10102180 msgr2=0x7f0d10104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:28.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.110+0000 7f0d178df640 1 --2- 172.21.15.192:0/2416885031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d10102180 0x7f0d10104570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009880 tx=0x7f0d0c02a5d0 comp rx=0 tx=0).stop 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.110+0000 7f0d178df640 1 -- 172.21.15.192:0/2416885031 shutdown_connections 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.110+0000 7f0d178df640 1 --2- 172.21.15.192:0/2416885031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d10102180 0x7f0d10104570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.110+0000 7f0d178df640 1 -- 172.21.15.192:0/2416885031 >> 172.21.15.192:0/2416885031 conn(0x7f0d100fbda0 msgr2=0x7f0d100fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.111+0000 7f0d178df640 1 -- 172.21.15.192:0/2416885031 shutdown_connections 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.111+0000 7f0d178df640 1 -- 172.21.15.192:0/2416885031 wait complete. 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.111+0000 7f0d178df640 1 Processor -- start 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.111+0000 7f0d178df640 1 -- start start 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.111+0000 7f0d178df640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d10102180 0x7f0d10196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.111+0000 7f0d178df640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d101973b0 0x7f0d1019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.111+0000 7f0d178df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10197830 0x7f0d1019e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:28.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.111+0000 7f0d178df640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0d101075f0 con 0x7f0d101973b0 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.111+0000 7f0d178df640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d10107470 con 0x7f0d10197830 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.111+0000 7f0d178df640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0d10107770 con 0x7f0d10102180 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d1567b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d10102180 0x7f0d10196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d1567b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d10102180 0x7f0d10196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34796/0 (socket says 172.21.15.192:34796) 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d1567b640 1 -- 172.21.15.192:0/2674582075 learned_addr learned my addr 172.21.15.192:0/2674582075 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d14e7a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d101973b0 0x7f0d1019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d15e7c640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10197830 0x7f0d1019e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d14e7a640 1 -- 172.21.15.192:0/2674582075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d10102180 msgr2=0x7f0d10196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d14e7a640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d10102180 0x7f0d10196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d14e7a640 1 -- 172.21.15.192:0/2674582075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10197830 msgr2=0x7f0d1019e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d14e7a640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10197830 0x7f0d1019e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:28.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d14e7a640 1 -- 172.21.15.192:0/2674582075 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1019f270 con 0x7f0d101973b0 2024-09-16T01:15:28.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d1567b640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d10102180 0x7f0d10196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:28.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d15e7c640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10197830 0x7f0d1019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:28.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d14e7a640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d101973b0 0x7f0d1019c420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000b450 tx=0x7f0d0000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:28.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d067fc640 1 -- 172.21.15.192:0/2674582075 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00004230 con 0x7f0d101973b0 2024-09-16T01:15:28.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d067fc640 1 -- 172.21.15.192:0/2674582075 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d000043d0 con 0x7f0d101973b0 2024-09-16T01:15:28.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d178df640 1 -- 172.21.15.192:0/2674582075 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d1019f560 con 0x7f0d101973b0 2024-09-16T01:15:28.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d067fc640 1 -- 172.21.15.192:0/2674582075 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00003be0 con 0x7f0d101973b0 2024-09-16T01:15:28.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.112+0000 7f0d178df640 1 -- 172.21.15.192:0/2674582075 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d1019fb20 con 0x7f0d101973b0 2024-09-16T01:15:28.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.113+0000 7f0d067fc640 1 -- 172.21.15.192:0/2674582075 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0d0000f050 con 0x7f0d101973b0 2024-09-16T01:15:28.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.113+0000 7f0d178df640 1 -- 172.21.15.192:0/2674582075 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d101903b0 con 0x7f0d101973b0 2024-09-16T01:15:28.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.113+0000 7f0d067fc640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0cfc039730 0x7f0cfc03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:28.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.113+0000 7f0d067fc640 1 -- 172.21.15.192:0/2674582075 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0d0004c230 con 0x7f0d101973b0 2024-09-16T01:15:28.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.114+0000 7f0d1567b640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0cfc039730 0x7f0cfc03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:28.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.114+0000 7f0d1567b640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0cfc039730 0x7f0cfc03bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c032fd0 tx=0x7f0d0c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:28.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.118+0000 7f0d067fc640 1 -- 172.21.15.192:0/2674582075 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d0000d040 con 0x7f0d101973b0 2024-09-16T01:15:28.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.295+0000 7f0d178df640 1 -- 172.21.15.192:0/2674582075 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi063=x;smithi162=y;smithi192=z", "target": ["mon-mgr", ""]}) -- 0x7f0d100626c0 con 0x7f0cfc039730 2024-09-16T01:15:28.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.301+0000 7f0d067fc640 1 -- 172.21.15.192:0/2674582075 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0d100626c0 con 0x7f0cfc039730 2024-09-16T01:15:28.302 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mgr update... 2024-09-16T01:15:28.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 -- 172.21.15.192:0/2674582075 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0cfc039730 msgr2=0x7f0cfc03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:28.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0cfc039730 0x7f0cfc03bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c032fd0 tx=0x7f0d0c005a20 comp rx=0 tx=0).stop 2024-09-16T01:15:28.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 -- 172.21.15.192:0/2674582075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d101973b0 msgr2=0x7f0d1019c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:28.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d101973b0 0x7f0d1019c420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000b450 tx=0x7f0d0000b910 comp rx=0 tx=0).stop 2024-09-16T01:15:28.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 -- 172.21.15.192:0/2674582075 shutdown_connections 2024-09-16T01:15:28.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0cfc039730 0x7f0cfc03bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:28.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10197830 0x7f0d1019e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:28.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d101973b0 0x7f0d1019c420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:28.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 --2- 172.21.15.192:0/2674582075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d10102180 0x7f0d10196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:28.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 -- 172.21.15.192:0/2674582075 >> 172.21.15.192:0/2674582075 conn(0x7f0d100fbda0 msgr2=0x7f0d100fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:28.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 -- 172.21.15.192:0/2674582075 shutdown_connections 2024-09-16T01:15:28.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:15:28.303+0000 7f0d178df640 1 -- 172.21.15.192:0/2674582075 wait complete. 2024-09-16T01:15:28.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:28 smithi063 ceph-mon[31070]: Reconfiguring mon.a (unknown last config time)... 2024-09-16T01:15:28.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:28 smithi063 ceph-mon[31070]: Reconfiguring daemon mon.a on smithi063 2024-09-16T01:15:28.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:28 smithi063 ceph-mon[31070]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:28.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:28.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:28.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:28.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:28.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:15:28.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:15:28.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:28.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:28 smithi192 ceph-mon[34775]: Reconfiguring mon.a (unknown last config time)... 2024-09-16T01:15:28.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:28 smithi192 ceph-mon[34775]: Reconfiguring daemon mon.a on smithi063 2024-09-16T01:15:28.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:28 smithi192 ceph-mon[34775]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:28.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:28.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:28.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:28.641 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:28.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:15:28.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:15:28.642 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:28.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:28 smithi162 ceph-mon[34539]: Reconfiguring mon.a (unknown last config time)... 2024-09-16T01:15:28.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:28 smithi162 ceph-mon[34539]: Reconfiguring daemon mon.a on smithi063 2024-09-16T01:15:28.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:28 smithi162 ceph-mon[34539]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:28.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:15:28.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:28.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:28.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:28.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:15:28.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:15:28.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:28.888 DEBUG:teuthology.orchestra.run.smithi162:mgr.y> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.y.service 2024-09-16T01:15:28.891 DEBUG:teuthology.orchestra.run.smithi192:mgr.z> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.z.service 2024-09-16T01:15:28.893 INFO:tasks.cephadm:Deploying OSDs... 2024-09-16T01:15:28.893 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:15:28.893 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T01:15:28.913 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T01:15:28.913 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-09-16T01:15:28.970 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T01:15:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:28.971 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-16T01:15:28.971 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:28.971 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:28.971 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-16 01:14:47.480554608 +0000 2024-09-16T01:15:28.971 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-16 01:10:41.828201172 +0000 2024-09-16T01:15:28.971 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-16 01:10:41.828201172 +0000 2024-09-16T01:15:28.971 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-16 01:10:41.828201172 +0000 2024-09-16T01:15:28.972 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T01:15:29.036 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-16T01:15:29.036 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-16T01:15:29.036 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000264759 s, 1.9 MB/s 2024-09-16T01:15:29.038 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T01:15:29.095 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-09-16T01:15:29.151 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T01:15:29.151 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:29.151 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T01:15:29.151 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:29.152 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:29.152 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-16 01:14:47.522554190 +0000 2024-09-16T01:15:29.152 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-16 01:10:42.171197768 +0000 2024-09-16T01:15:29.152 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-16 01:10:42.171197768 +0000 2024-09-16T01:15:29.152 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-16 01:10:42.171197768 +0000 2024-09-16T01:15:29.152 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T01:15:29.216 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-16T01:15:29.217 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-16T01:15:29.217 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000197034 s, 2.6 MB/s 2024-09-16T01:15:29.218 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T01:15:29.275 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-09-16T01:15:29.331 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T01:15:29.331 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:29.331 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-16T01:15:29.331 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:29.331 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:29.331 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-16 01:14:47.562553793 +0000 2024-09-16T01:15:29.331 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-16 01:10:42.498194523 +0000 2024-09-16T01:15:29.331 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-16 01:10:42.498194523 +0000 2024-09-16T01:15:29.331 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-16 01:10:42.498194523 +0000 2024-09-16T01:15:29.332 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T01:15:29.395 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-16T01:15:29.395 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-16T01:15:29.396 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000208238 s, 2.5 MB/s 2024-09-16T01:15:29.397 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T01:15:29.453 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-09-16T01:15:29.509 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T01:15:29.509 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:29.510 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-16T01:15:29.510 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:29.510 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:29.510 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-16 01:14:47.595553464 +0000 2024-09-16T01:15:29.510 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-16 01:10:42.819191337 +0000 2024-09-16T01:15:29.510 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-16 01:10:42.819191337 +0000 2024-09-16T01:15:29.510 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-16 01:10:42.819191337 +0000 2024-09-16T01:15:29.510 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T01:15:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-16T01:15:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-16T01:15:29.574 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000227662 s, 2.2 MB/s 2024-09-16T01:15:29.576 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T01:15:29.633 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-16T01:15:29.633 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T01:15:29.646 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:29 smithi063 ceph-mon[31070]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi063=x;smithi162=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:15:29.646 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:29 smithi063 ceph-mon[31070]: Saving service mgr spec with placement smithi063=x;smithi162=y;smithi192=z;count:3 2024-09-16T01:15:29.646 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:29 smithi063 ceph-mon[31070]: Reconfiguring mgr.x (unknown last config time)... 2024-09-16T01:15:29.646 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:29 smithi063 ceph-mon[31070]: Reconfiguring daemon mgr.x on smithi063 2024-09-16T01:15:29.653 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T01:15:29.653 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-16T01:15:29.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:29 smithi192 ceph-mon[34775]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi063=x;smithi162=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:15:29.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:29 smithi192 ceph-mon[34775]: Saving service mgr spec with placement smithi063=x;smithi162=y;smithi192=z;count:3 2024-09-16T01:15:29.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:29 smithi192 ceph-mon[34775]: Reconfiguring mgr.x (unknown last config time)... 2024-09-16T01:15:29.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:29 smithi192 ceph-mon[34775]: Reconfiguring daemon mgr.x on smithi063 2024-09-16T01:15:29.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:29 smithi162 ceph-mon[34539]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi063=x;smithi162=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:15:29.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:29 smithi162 ceph-mon[34539]: Saving service mgr spec with placement smithi063=x;smithi162=y;smithi192=z;count:3 2024-09-16T01:15:29.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:29 smithi162 ceph-mon[34539]: Reconfiguring mgr.x (unknown last config time)... 2024-09-16T01:15:29.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:29 smithi162 ceph-mon[34539]: Reconfiguring daemon mgr.x on smithi063 2024-09-16T01:15:29.700 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T01:15:29.701 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:29.701 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-16T01:15:29.701 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:29.701 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:29.701 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-16 01:15:19.001397462 +0000 2024-09-16T01:15:29.701 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-16 01:10:38.929669118 +0000 2024-09-16T01:15:29.701 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-16 01:10:38.929669118 +0000 2024-09-16T01:15:29.701 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-16 01:10:38.929669118 +0000 2024-09-16T01:15:29.701 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T01:15:29.767 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-16T01:15:29.767 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-16T01:15:29.767 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000276224 s, 1.9 MB/s 2024-09-16T01:15:29.768 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T01:15:29.825 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-16T01:15:29.881 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T01:15:29.881 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:29.881 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T01:15:29.882 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:29.882 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:29.882 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-16 01:15:19.001397462 +0000 2024-09-16T01:15:29.882 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-16 01:10:39.254662618 +0000 2024-09-16T01:15:29.882 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-16 01:10:39.254662618 +0000 2024-09-16T01:15:29.882 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-16 01:10:39.254662618 +0000 2024-09-16T01:15:29.882 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T01:15:29.946 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-16T01:15:29.946 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-16T01:15:29.946 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000186978 s, 2.7 MB/s 2024-09-16T01:15:29.947 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T01:15:30.003 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-16T01:15:30.059 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T01:15:30.059 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:30.059 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-16T01:15:30.059 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:30.059 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:30.059 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-16 01:15:19.002397442 +0000 2024-09-16T01:15:30.059 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-16 01:10:39.573656238 +0000 2024-09-16T01:15:30.059 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-16 01:10:39.573656238 +0000 2024-09-16T01:15:30.059 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-16 01:10:39.573656238 +0000 2024-09-16T01:15:30.060 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T01:15:30.122 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-16T01:15:30.123 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-16T01:15:30.123 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000171483 s, 3.0 MB/s 2024-09-16T01:15:30.124 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T01:15:30.180 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-16T01:15:30.236 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T01:15:30.236 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:30.236 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T01:15:30.236 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:30.236 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:30.236 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-16 01:15:19.002397442 +0000 2024-09-16T01:15:30.237 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-16 01:10:39.901649678 +0000 2024-09-16T01:15:30.237 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-16 01:10:39.901649678 +0000 2024-09-16T01:15:30.237 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-16 01:10:39.901649678 +0000 2024-09-16T01:15:30.237 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T01:15:30.300 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-16T01:15:30.301 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-16T01:15:30.301 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000196602 s, 2.6 MB/s 2024-09-16T01:15:30.302 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T01:15:30.359 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-16T01:15:30.359 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T01:15:30.380 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T01:15:30.380 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-09-16T01:15:30.438 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T01:15:30.438 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:30.438 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-16T01:15:30.438 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:30.438 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:30.439 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-16 01:15:10.008883926 +0000 2024-09-16T01:15:30.439 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-16 01:10:38.144269372 +0000 2024-09-16T01:15:30.439 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-16 01:10:38.144269372 +0000 2024-09-16T01:15:30.439 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-16 01:10:38.144269372 +0000 2024-09-16T01:15:30.439 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T01:15:30.505 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-16T01:15:30.505 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-16T01:15:30.505 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000247675 s, 2.1 MB/s 2024-09-16T01:15:30.506 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T01:15:30.565 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-09-16T01:15:30.623 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T01:15:30.623 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:30.623 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T01:15:30.623 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:30.624 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:30.624 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-16 01:15:10.008883926 +0000 2024-09-16T01:15:30.624 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-16 01:10:38.467263031 +0000 2024-09-16T01:15:30.624 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-16 01:10:38.467263031 +0000 2024-09-16T01:15:30.624 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-16 01:10:38.467263031 +0000 2024-09-16T01:15:30.624 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T01:15:30.689 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-16T01:15:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-16T01:15:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000223028 s, 2.3 MB/s 2024-09-16T01:15:30.691 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T01:15:30.748 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-09-16T01:15:30.804 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T01:15:30.804 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:30.804 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T01:15:30.804 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:30.804 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:30.804 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-16 01:15:10.009883907 +0000 2024-09-16T01:15:30.804 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-16 01:10:38.799256513 +0000 2024-09-16T01:15:30.804 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-16 01:10:38.799256513 +0000 2024-09-16T01:15:30.804 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-16 01:10:38.799256513 +0000 2024-09-16T01:15:30.805 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T01:15:30.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:30 smithi192 ceph-mon[34775]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:30.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:30 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:30.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:30 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:30.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:30 smithi192 ceph-mon[34775]: Reconfiguring mon.b (monmap changed)... 2024-09-16T01:15:30.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:30 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:30.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:30 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:15:30.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:30 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:30.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:30 smithi192 ceph-mon[34775]: Reconfiguring daemon mon.b on smithi162 2024-09-16T01:15:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-16T01:15:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-16T01:15:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000197871 s, 2.6 MB/s 2024-09-16T01:15:30.869 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T01:15:30.926 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-09-16T01:15:30.982 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T01:15:30.982 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:15:30.982 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-16T01:15:30.983 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:15:30.983 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:15:30.983 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-16 01:15:10.009883907 +0000 2024-09-16T01:15:30.983 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-16 01:10:39.120250211 +0000 2024-09-16T01:15:30.983 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-16 01:10:39.120250211 +0000 2024-09-16T01:15:30.983 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-16 01:10:39.120250211 +0000 2024-09-16T01:15:30.983 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T01:15:31.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:30 smithi063 ceph-mon[31070]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:31.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:30 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:31.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:30 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:31.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:30 smithi063 ceph-mon[31070]: Reconfiguring mon.b (monmap changed)... 2024-09-16T01:15:31.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:30 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:31.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:30 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:15:31.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:30 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:31.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:30 smithi063 ceph-mon[31070]: Reconfiguring daemon mon.b on smithi162 2024-09-16T01:15:31.046 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-16T01:15:31.046 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-16T01:15:31.046 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000206162 s, 2.5 MB/s 2024-09-16T01:15:31.047 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T01:15:31.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:30 smithi162 ceph-mon[34539]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:31.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:30 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:31.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:30 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:31.061 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:30 smithi162 ceph-mon[34539]: Reconfiguring mon.b (monmap changed)... 2024-09-16T01:15:31.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:30 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:31.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:30 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:15:31.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:30 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:31.062 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:30 smithi162 ceph-mon[34539]: Reconfiguring daemon mon.b on smithi162 2024-09-16T01:15:31.103 INFO:tasks.cephadm:Deploying osd.0 on smithi063 with /dev/vg_nvme/lv_4... 2024-09-16T01:15:31.104 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T01:15:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:15:32.389 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:32 smithi063 ceph-mon[31070]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:32.389 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:32.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:32.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:32 smithi063 ceph-mon[31070]: Reconfiguring mon.c (monmap changed)... 2024-09-16T01:15:32.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:32.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:15:32.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:32.390 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:32 smithi063 ceph-mon[31070]: Reconfiguring daemon mon.c on smithi192 2024-09-16T01:15:32.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:32 smithi192 ceph-mon[34775]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:32.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:32.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:32.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:32 smithi192 ceph-mon[34775]: Reconfiguring mon.c (monmap changed)... 2024-09-16T01:15:32.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:32.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:15:32.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:32.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:32 smithi192 ceph-mon[34775]: Reconfiguring daemon mon.c on smithi192 2024-09-16T01:15:32.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:32 smithi162 ceph-mon[34539]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:32.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:32.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:32.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:32 smithi162 ceph-mon[34539]: Reconfiguring mon.c (monmap changed)... 2024-09-16T01:15:32.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T01:15:32.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T01:15:32.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:32.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:32 smithi162 ceph-mon[34539]: Reconfiguring daemon mon.c on smithi192 2024-09-16T01:15:33.553 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:15:33.583 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi063:vg_nvme/lv_4 2024-09-16T01:15:33.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:33.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:33.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:33.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:33.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:33.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:33.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:15:33.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T01:15:33.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:15:33.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:33.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:33 smithi192 ceph-mon[34775]: Deploying daemon mgr.z on smithi192 2024-09-16T01:15:33.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:33.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:33.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:33.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:33.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:33.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:33.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:15:33.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T01:15:33.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:15:33.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:33.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:33 smithi162 ceph-mon[34539]: Deploying daemon mgr.z on smithi192 2024-09-16T01:15:33.838 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:15:33.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:33.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:33.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:33.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:33.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:33.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:33.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:15:33.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T01:15:33.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:15:33.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:33.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:33 smithi063 ceph-mon[31070]: Deploying daemon mgr.z on smithi192 2024-09-16T01:15:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.262+0000 7f77c7531640 1 -- 172.21.15.63:0/2580580594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c0102720 msgr2=0x7f77c0104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.262+0000 7f77c7531640 1 --2- 172.21.15.63:0/2580580594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c0102720 0x7f77c0104b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009900 tx=0x7f77bc02a410 comp rx=0 tx=0).stop 2024-09-16T01:15:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.262+0000 7f77c7531640 1 -- 172.21.15.63:0/2580580594 shutdown_connections 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.262+0000 7f77c7531640 1 --2- 172.21.15.63:0/2580580594 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0107980 0x7f77c0109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.262+0000 7f77c7531640 1 --2- 172.21.15.63:0/2580580594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77c0105050 0x7f77c0107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.262+0000 7f77c7531640 1 --2- 172.21.15.63:0/2580580594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c0102720 0x7f77c0104b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.262+0000 7f77c7531640 1 -- 172.21.15.63:0/2580580594 >> 172.21.15.63:0/2580580594 conn(0x7f77c00fc280 msgr2=0x7f77c00fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c7531640 1 -- 172.21.15.63:0/2580580594 shutdown_connections 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c7531640 1 -- 172.21.15.63:0/2580580594 wait complete. 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c7531640 1 Processor -- start 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c7531640 1 -- start start 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c7531640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c0102720 0x7f77c0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c7531640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0105050 0x7f77c0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c7531640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77c0107980 0x7f77c019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c7531640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f77c010d7a0 con 0x7f77c0102720 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c7531640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77c010d620 con 0x7f77c0105050 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c7531640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f77c010d920 con 0x7f77c0107980 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c52cd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c0102720 0x7f77c0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c52cd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c0102720 0x7f77c0197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:50502/0 (socket says 172.21.15.63:50502) 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.263+0000 7f77c52cd640 1 -- 172.21.15.63:0/1435398663 learned_addr learned my addr 172.21.15.63:0/1435398663 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77c5ace640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77c0107980 0x7f77c019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77c4acc640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0105050 0x7f77c0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77c52cd640 1 -- 172.21.15.63:0/1435398663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77c0107980 msgr2=0x7f77c019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77c52cd640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77c0107980 0x7f77c019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77c52cd640 1 -- 172.21.15.63:0/1435398663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0105050 msgr2=0x7f77c0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77c52cd640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0105050 0x7f77c0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77c52cd640 1 -- 172.21.15.63:0/1435398663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c019faf0 con 0x7f77c0102720 2024-09-16T01:15:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77c52cd640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c0102720 0x7f77c0197ec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f77bc005940 tx=0x7f77bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:34.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77b67fc640 1 -- 172.21.15.63:0/1435398663 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc03f030 con 0x7f77c0102720 2024-09-16T01:15:34.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77c7531640 1 -- 172.21.15.63:0/1435398663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c019fd80 con 0x7f77c0102720 2024-09-16T01:15:34.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77b67fc640 1 -- 172.21.15.63:0/1435398663 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f77bc003cb0 con 0x7f77c0102720 2024-09-16T01:15:34.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77b67fc640 1 -- 172.21.15.63:0/1435398663 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc035070 con 0x7f77c0102720 2024-09-16T01:15:34.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.264+0000 7f77c7531640 1 -- 172.21.15.63:0/1435398663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c01a0220 con 0x7f77c0102720 2024-09-16T01:15:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.265+0000 7f77b67fc640 1 -- 172.21.15.63:0/1435398663 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f77bc042030 con 0x7f77c0102720 2024-09-16T01:15:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.265+0000 7f77c7531640 1 -- 172.21.15.63:0/1435398663 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c00fdd70 con 0x7f77c0102720 2024-09-16T01:15:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.265+0000 7f77b67fc640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f77ac039500 0x7f77ac03b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.265+0000 7f77b67fc640 1 -- 172.21.15.63:0/1435398663 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f77bc06cb60 con 0x7f77c0102720 2024-09-16T01:15:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.265+0000 7f77c4acc640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f77ac039500 0x7f77ac03b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.266+0000 7f77c4acc640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f77ac039500 0x7f77ac03b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77c01993e0 tx=0x7f77b0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:34.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.270+0000 7f77b67fc640 1 -- 172.21.15.63:0/1435398663 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77bc03b460 con 0x7f77c0102720 2024-09-16T01:15:34.415 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 systemd[1]: Starting Ceph mgr.z for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:15:34.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:34.455+0000 7f77c7531640 1 -- 172.21.15.63:0/1435398663 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f77c0062630 con 0x7f77ac039500 2024-09-16T01:15:34.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:34 smithi063 ceph-mon[31070]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:34.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:34 smithi192 ceph-mon[34775]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:34.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 podman[36565]: 2024-09-16 01:15:34.416067932 +0000 UTC m=+0.080894832 container create 0846615ad3430d7871a8c5ff0c30f907823eb741e8eec1414503c6150f946eca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T01:15:34.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 podman[36565]: 2024-09-16 01:15:34.350769318 +0000 UTC m=+0.015596226 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:34.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 podman[36565]: 2024-09-16 01:15:34.628551016 +0000 UTC m=+0.293377925 container init 0846615ad3430d7871a8c5ff0c30f907823eb741e8eec1414503c6150f946eca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T01:15:34.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 podman[36565]: 2024-09-16 01:15:34.632174655 +0000 UTC m=+0.297001550 container start 0846615ad3430d7871a8c5ff0c30f907823eb741e8eec1414503c6150f946eca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2) 2024-09-16T01:15:34.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 ceph-mgr[36584]: -- 172.21.15.192:0/2275005993 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7b3ac10e0 con 0x55e7b3a9f000 2024-09-16T01:15:34.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:34 smithi162 ceph-mon[34539]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:35.029 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:34.750+0000 7f5aa27d2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:15:35.029 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 bash[36565]: 0846615ad3430d7871a8c5ff0c30f907823eb741e8eec1414503c6150f946eca 2024-09-16T01:15:35.029 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 systemd[1]: Started Ceph mgr.z for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:15:35.029 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:34.811+0000 7f5aa27d2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:15:35.029 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:34 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:34.962+0000 7f5aa27d2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:15:35.029 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:35.027+0000 7f5aa27d2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:15:35.314 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:35.175+0000 7f5aa27d2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:15:35.314 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:35.312+0000 7f5aa27d2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:15:35.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:15:35.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:15:35.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:15:35.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:35.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:35.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:35.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:35.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:15:35.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T01:15:35.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:15:35.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:35.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:35 smithi162 ceph-mon[34539]: Deploying daemon mgr.y on smithi162 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:15:35.627 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:35.628 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-mon[34775]: Deploying daemon mgr.y on smithi162 2024-09-16T01:15:35.668 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:35.669 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:35 smithi063 ceph-mon[31070]: Deploying daemon mgr.y on smithi162 2024-09-16T01:15:35.924 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:35.625+0000 7f5aa27d2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:15:35.924 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:35.687+0000 7f5aa27d2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:15:35.924 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:35.870+0000 7f5aa27d2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:15:36.848 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:36 smithi162 systemd[1]: Starting Ceph mgr.y for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:15:37.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:36 smithi063 ceph-mon[31070]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:37.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:36 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1625381315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39d7f320-babf-4ba5-86c8-9cd4c9ffa030"}]: dispatch 2024-09-16T01:15:37.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:36 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1625381315' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39d7f320-babf-4ba5-86c8-9cd4c9ffa030"}]': finished 2024-09-16T01:15:37.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:36 smithi063 ceph-mon[31070]: osdmap e5: 1 total, 0 up, 1 in 2024-09-16T01:15:37.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:15:37.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:36 smithi162 ceph-mon[34539]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:37.112 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:36 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1625381315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39d7f320-babf-4ba5-86c8-9cd4c9ffa030"}]: dispatch 2024-09-16T01:15:37.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:36 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1625381315' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39d7f320-babf-4ba5-86c8-9cd4c9ffa030"}]': finished 2024-09-16T01:15:37.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:36 smithi162 ceph-mon[34539]: osdmap e5: 1 total, 0 up, 1 in 2024-09-16T01:15:37.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:15:37.113 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:36 smithi162 podman[35895]: 2024-09-16 01:15:36.75766997 +0000 UTC m=+0.015947804 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:15:37.113 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:36 smithi162 podman[35895]: 2024-09-16 01:15:36.859859477 +0000 UTC m=+0.118137353 container create 2e427d1d05f2137dc3086771b709542f46428b43ce5e706e663e0b5f2779c7f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-16T01:15:37.113 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 podman[35895]: 2024-09-16 01:15:37.037067108 +0000 UTC m=+0.295344942 container init 2e427d1d05f2137dc3086771b709542f46428b43ce5e706e663e0b5f2779c7f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-16T01:15:37.113 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 podman[35895]: 2024-09-16 01:15:37.039738903 +0000 UTC m=+0.298016738 container start 2e427d1d05f2137dc3086771b709542f46428b43ce5e706e663e0b5f2779c7f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-16T01:15:37.113 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 ceph-mgr[35914]: -- 172.21.15.162:0/632166251 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56085737d0e0 con 0x56085735b400 2024-09-16T01:15:37.174 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:36 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:36.747+0000 7f5aa27d2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:15:37.174 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:36 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:36.813+0000 7f5aa27d2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:15:37.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:36 smithi192 ceph-mon[34775]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:37.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:36 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1625381315' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39d7f320-babf-4ba5-86c8-9cd4c9ffa030"}]: dispatch 2024-09-16T01:15:37.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:36 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1625381315' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39d7f320-babf-4ba5-86c8-9cd4c9ffa030"}]': finished 2024-09-16T01:15:37.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:36 smithi192 ceph-mon[34775]: osdmap e5: 1 total, 0 up, 1 in 2024-09-16T01:15:37.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:15:37.397 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 bash[35895]: 2e427d1d05f2137dc3086771b709542f46428b43ce5e706e663e0b5f2779c7f3 2024-09-16T01:15:37.397 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 systemd[1]: Started Ceph mgr.y for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:15:37.397 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:37.176+0000 7f7c5ce02040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:15:37.397 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:37.239+0000 7f7c5ce02040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:15:37.397 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:37.396+0000 7f7c5ce02040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:15:37.683 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:37.465+0000 7f7c5ce02040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:15:37.683 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:37.628+0000 7f7c5ce02040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:15:37.827 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:37 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:37.544+0000 7f5aa27d2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:15:37.827 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:37 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:37.679+0000 7f5aa27d2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:15:37.827 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:37 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:37.826+0000 7f5aa27d2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:15:38.087 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:37 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:37.888+0000 7f5aa27d2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:15:38.087 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:38.042+0000 7f5aa27d2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:15:38.107 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:37 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:37.780+0000 7f7c5ce02040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:15:38.374 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:38 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:38.115+0000 7f7c5ce02040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:15:38.374 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:38 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:38.177+0000 7f7c5ce02040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:15:38.374 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:38 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:38.373+0000 7f7c5ce02040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:15:38.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:38 smithi162 ceph-mon[34539]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:38.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:38 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/932375484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:15:38.375 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:38.409 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-mon[34775]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:38.409 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.409 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.409 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.409 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.409 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/932375484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:15:38.409 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:38.409 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:38.113+0000 7f5aa27d2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:15:38.410 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:38.174+0000 7f5aa27d2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:15:38.410 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:38.334+0000 7f5aa27d2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:15:38.410 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:38.407+0000 7f5aa27d2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:15:38.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:38 smithi063 ceph-mon[31070]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:38.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:38.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:38 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/932375484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:15:38.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:38.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:38.475+0000 7f5aa27d2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:15:38.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:38.560+0000 7f5aa27d2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:15:38.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:38.621+0000 7f5aa27d2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:15:39.174 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:38.681+0000 7f5aa27d2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:15:39.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z[36580]: 2024-09-16T01:15:39.469+0000 7f5aa27d2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:15:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:39.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:39.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:39.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:39.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:39.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.683 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:39.262+0000 7f7c5ce02040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:15:39.683 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:39.329+0000 7f7c5ce02040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:15:39.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:39.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:39.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:39.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:39.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:39.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:39.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:40.302 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:40.045+0000 7f7c5ce02040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:15:40.302 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:40.159+0000 7f7c5ce02040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:15:40.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:40.389+0000 7f77b67fc640 1 -- 172.21.15.63:0/1435398663 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f77bc003800 con 0x7f77c0102720 2024-09-16T01:15:40.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-mon[34539]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:40.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-mon[34539]: Standby manager daemon z started 2024-09-16T01:15:40.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-mon[34539]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T01:15:40.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-mon[34539]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:15:40.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-mon[34539]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T01:15:40.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-mon[34539]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:15:40.579 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:40.300+0000 7f7c5ce02040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:15:40.580 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:40.360+0000 7f7c5ce02040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:15:40.580 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:40.509+0000 7f7c5ce02040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:15:40.580 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:40.577+0000 7f7c5ce02040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:15:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:40 smithi192 ceph-mon[34775]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:40 smithi192 ceph-mon[34775]: Standby manager daemon z started 2024-09-16T01:15:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:40 smithi192 ceph-mon[34775]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T01:15:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:40 smithi192 ceph-mon[34775]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:15:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:40 smithi192 ceph-mon[34775]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T01:15:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:40 smithi192 ceph-mon[34775]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:15:40.859 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:40.636+0000 7f7c5ce02040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:15:40.859 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:40.792+0000 7f7c5ce02040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:15:40.859 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:40.857+0000 7f7c5ce02040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:15:40.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:40 smithi063 ceph-mon[31070]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:40.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:40 smithi063 ceph-mon[31070]: Standby manager daemon z started 2024-09-16T01:15:40.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:40 smithi063 ceph-mon[31070]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-16T01:15:40.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:40 smithi063 ceph-mon[31070]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:15:40.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:40 smithi063 ceph-mon[31070]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-16T01:15:40.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:40 smithi063 ceph-mon[31070]: from='mgr.? 172.21.15.192:0/1772073152' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:15:41.122 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:40.922+0000 7f7c5ce02040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:15:41.122 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:41 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:41.003+0000 7f7c5ce02040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:15:41.122 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:41 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:41.062+0000 7f7c5ce02040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:15:41.122 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:41 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:41.120+0000 7f7c5ce02040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:15:41.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:41 smithi192 ceph-mon[34775]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-16T01:15:41.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T01:15:41.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:41 smithi162 ceph-mon[34539]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-16T01:15:41.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T01:15:41.794 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:41 smithi063 ceph-mon[31070]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-16T01:15:41.794 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-16T01:15:42.183 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:15:41 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y[35910]: 2024-09-16T01:15:41.900+0000 7f7c5ce02040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:15:42.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:42.401+0000 7f77b67fc640 1 -- 172.21.15.63:0/1435398663 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f77bc039bd0 con 0x7f77c0102720 2024-09-16T01:15:42.474 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:42 smithi063 ceph-mon[31070]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:42.474 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:42 smithi063 ceph-mon[31070]: Standby manager daemon y started 2024-09-16T01:15:42.474 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:42 smithi063 ceph-mon[31070]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T01:15:42.474 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:42 smithi063 ceph-mon[31070]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:15:42.474 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:42 smithi063 ceph-mon[31070]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T01:15:42.474 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:42 smithi063 ceph-mon[31070]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:15:42.474 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:42 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:42.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:42 smithi192 ceph-mon[34775]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:42.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:42 smithi192 ceph-mon[34775]: Standby manager daemon y started 2024-09-16T01:15:42.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:42 smithi192 ceph-mon[34775]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T01:15:42.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:42 smithi192 ceph-mon[34775]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:15:42.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:42 smithi192 ceph-mon[34775]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T01:15:42.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:42 smithi192 ceph-mon[34775]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:15:42.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:42 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:42.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:42 smithi162 ceph-mon[34539]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:42.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:42 smithi162 ceph-mon[34539]: Standby manager daemon y started 2024-09-16T01:15:42.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:42 smithi162 ceph-mon[34539]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-16T01:15:42.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:42 smithi162 ceph-mon[34539]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T01:15:42.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:42 smithi162 ceph-mon[34539]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-16T01:15:42.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:42 smithi162 ceph-mon[34539]: from='mgr.? 172.21.15.162:0/2005480295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T01:15:42.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:42 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:43.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:43 smithi063 ceph-mon[31070]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-16T01:15:43.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:43 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T01:15:43.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:43 smithi192 ceph-mon[34775]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-16T01:15:43.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:43 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T01:15:43.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:43 smithi162 ceph-mon[34539]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-16T01:15:43.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:43 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-16T01:15:44.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:44 smithi192 ceph-mon[34775]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:44.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:44 smithi162 ceph-mon[34539]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:44.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:44 smithi063 ceph-mon[31070]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:45.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:45 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T01:15:45.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:45 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:45.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:45 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T01:15:45.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:45 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:45.705 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:45 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T01:15:45.705 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:45 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:46 smithi192 ceph-mon[34775]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:46 smithi192 ceph-mon[34775]: Deploying daemon osd.0 on smithi063 2024-09-16T01:15:46.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:46 smithi162 ceph-mon[34539]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:46.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:46 smithi162 ceph-mon[34539]: Deploying daemon osd.0 on smithi063 2024-09-16T01:15:46.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:46 smithi063 ceph-mon[31070]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:46.810 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:46 smithi063 ceph-mon[31070]: Deploying daemon osd.0 on smithi063 2024-09-16T01:15:48.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:48 smithi063 ceph-mon[31070]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:48.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:48 smithi192 ceph-mon[34775]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:48.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:48 smithi162 ceph-mon[34539]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:50.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:50 smithi192 ceph-mon[34775]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:50.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:50 smithi162 ceph-mon[34539]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:50.731 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:50 smithi063 ceph-mon[31070]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:52.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:52 smithi063 ceph-mon[31070]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:52.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:52 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:52.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:52 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:52.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:52 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:52.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:52 smithi192 ceph-mon[34775]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:52.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:52 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:52.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:52 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:52.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:52 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:52.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:52 smithi162 ceph-mon[34539]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:52.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:52 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:52.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:52 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:52.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:52 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:55.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:54 smithi063 ceph-mon[31070]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:55.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:54 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:55.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:54 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:55.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:54 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:55.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:54 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:55.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:54 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:55.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:54 smithi192 ceph-mon[34775]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:55.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:55.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:55.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:55.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:55.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:55.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:54 smithi162 ceph-mon[34539]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:55.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:54 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:55.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:54 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:55.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:54 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:55.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:54 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:55.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:54 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:55.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.786+0000 7f77b67fc640 1 -- 172.21.15.63:0/1435398663 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f77c0062630 con 0x7f77ac039500 2024-09-16T01:15:55.789 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 0 on host 'smithi063' 2024-09-16T01:15:55.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 -- 172.21.15.63:0/1435398663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f77ac039500 msgr2=0x7f77ac03b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:55.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f77ac039500 0x7f77ac03b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77c01993e0 tx=0x7f77b0009110 comp rx=0 tx=0).stop 2024-09-16T01:15:55.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 -- 172.21.15.63:0/1435398663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c0102720 msgr2=0x7f77c0197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:55.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c0102720 0x7f77c0197ec0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f77bc005940 tx=0x7f77bc0042f0 comp rx=0 tx=0).stop 2024-09-16T01:15:55.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 -- 172.21.15.63:0/1435398663 shutdown_connections 2024-09-16T01:15:55.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f77ac039500 0x7f77ac03b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:55.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77c0107980 0x7f77c019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:55.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c0105050 0x7f77c0198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:55.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 --2- 172.21.15.63:0/1435398663 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c0102720 0x7f77c0197ec0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:55.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 -- 172.21.15.63:0/1435398663 >> 172.21.15.63:0/1435398663 conn(0x7f77c00fc280 msgr2=0x7f77c01031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:55.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 -- 172.21.15.63:0/1435398663 shutdown_connections 2024-09-16T01:15:55.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:15:55.789+0000 7f77c7531640 1 -- 172.21.15.63:0/1435398663 wait complete. 2024-09-16T01:15:56.404 DEBUG:teuthology.orchestra.run.smithi063:osd.0> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.0.service 2024-09-16T01:15:56.406 INFO:tasks.cephadm:Deploying osd.1 on smithi162 with /dev/vg_nvme/lv_4... 2024-09-16T01:15:56.406 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T01:15:56.651 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:15:56.947 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:56 smithi063 ceph-mon[31070]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:56.947 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:56.947 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:56.947 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:57.000 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:56 smithi162 ceph-mon[34539]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:57.000 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:57.000 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:57.000 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:57.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:56 smithi192 ceph-mon[34775]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:57.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:15:57.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:57.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:57.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:57 smithi063 ceph-mon[31070]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T01:15:57.860 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:15:57 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0[44659]: 2024-09-16T01:15:57.606+0000 7f5beaab0640 -1 osd.0 0 log_to_monitors true 2024-09-16T01:15:57.882 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:57 smithi162 ceph-mon[34539]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T01:15:58.173 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:57 smithi192 ceph-mon[34775]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T01:15:58.922 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:15:58.948 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-09-16T01:15:59.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:58 smithi063 ceph-mon[31070]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:59.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:58 smithi063 ceph-mon[31070]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T01:15:59.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:58 smithi063 ceph-mon[31070]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T01:15:59.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:58 smithi063 ceph-mon[31070]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:15:59.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:58 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:15:59.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:58 smithi192 ceph-mon[34775]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:59.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:58 smithi192 ceph-mon[34775]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T01:15:59.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:58 smithi192 ceph-mon[34775]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T01:15:59.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:58 smithi192 ceph-mon[34775]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:15:59.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:58 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:15:59.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:58 smithi162 ceph-mon[34539]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:15:59.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:58 smithi162 ceph-mon[34539]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T01:15:59.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:58 smithi162 ceph-mon[34539]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T01:15:59.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:58 smithi162 ceph-mon[34539]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:15:59.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:58 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:15:59.193 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:15:59.565 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0[44659]: 2024-09-16T01:15:59.278+0000 7f5be6a33640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T01:15:59.565 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0[44659]: 2024-09-16T01:15:59.281+0000 7f5bde853640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:15:59.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.647+0000 7f591b9a0640 1 -- 172.21.15.162:0/2277838525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914105020 msgr2=0x7f5914107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.647+0000 7f591b9a0640 1 --2- 172.21.15.162:0/2277838525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914105020 0x7f5914107410 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5904009900 tx=0x7f590402a410 comp rx=0 tx=0).stop 2024-09-16T01:15:59.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.647+0000 7f591b9a0640 1 -- 172.21.15.162:0/2277838525 shutdown_connections 2024-09-16T01:15:59.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.647+0000 7f591b9a0640 1 --2- 172.21.15.162:0/2277838525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5914107950 0x7f5914109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 --2- 172.21.15.162:0/2277838525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914105020 0x7f5914107410 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 --2- 172.21.15.162:0/2277838525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59141026f0 0x7f5914104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 -- 172.21.15.162:0/2277838525 >> 172.21.15.162:0/2277838525 conn(0x7f59140fc290 msgr2=0x7f59140fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 -- 172.21.15.162:0/2277838525 shutdown_connections 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 -- 172.21.15.162:0/2277838525 wait complete. 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 Processor -- start 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 -- start start 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59141026f0 0x7f5914197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914105020 0x7f5914198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914107950 0x7f591419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f591410d730 con 0x7f59141026f0 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f591410d5b0 con 0x7f5914107950 2024-09-16T01:15:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.648+0000 7f591b9a0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f591410d8b0 con 0x7f5914105020 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5919f3d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914107950 0x7f591419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5919f3d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914107950 0x7f591419f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42440/0 (socket says 172.21.15.162:42440) 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5919f3d640 1 -- 172.21.15.162:0/695931337 learned_addr learned my addr 172.21.15.162:0/695931337 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f591973c640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59141026f0 0x7f5914197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5918f3b640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914105020 0x7f5914198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5919f3d640 1 -- 172.21.15.162:0/695931337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914105020 msgr2=0x7f5914198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5919f3d640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914105020 0x7f5914198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5919f3d640 1 -- 172.21.15.162:0/695931337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59141026f0 msgr2=0x7f5914197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5919f3d640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59141026f0 0x7f5914197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5919f3d640 1 -- 172.21.15.162:0/695931337 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591419fa80 con 0x7f5914107950 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5918f3b640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914105020 0x7f5914198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:59.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f5919f3d640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914107950 0x7f591419f410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f590c00eb10 tx=0x7f590c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f590a7fc640 1 -- 172.21.15.162:0/695931337 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c004b20 con 0x7f5914107950 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f590a7fc640 1 -- 172.21.15.162:0/695931337 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f590c004cc0 con 0x7f5914107950 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f591b9a0640 1 -- 172.21.15.162:0/695931337 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591419fd70 con 0x7f5914107950 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f590a7fc640 1 -- 172.21.15.162:0/695931337 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c010690 con 0x7f5914107950 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.649+0000 7f591b9a0640 1 -- 172.21.15.162:0/695931337 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59141a0250 con 0x7f5914107950 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.650+0000 7f591b9a0640 1 -- 172.21.15.162:0/695931337 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59140fdd80 con 0x7f5914107950 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.651+0000 7f590a7fc640 1 -- 172.21.15.162:0/695931337 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f590c005000 con 0x7f5914107950 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.652+0000 7f590a7fc640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f59000a3260 0x7f59000a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.652+0000 7f590a7fc640 1 -- 172.21.15.162:0/695931337 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f590c0ce4a0 con 0x7f5914107950 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.652+0000 7f591973c640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f59000a3260 0x7f59000a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.653+0000 7f591973c640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f59000a3260 0x7f59000a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5910005fd0 tx=0x7f591000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.655+0000 7f590a7fc640 1 -- 172.21.15.162:0/695931337 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f590c0541b0 con 0x7f5914107950 2024-09-16T01:15:59.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:15:59.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T01:15:59.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:15:59.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:15:59.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' 2024-09-16T01:15:59.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:59.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:59.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:15:59.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:59.819 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:59.820 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:59.820 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:15:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:59.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:15:59.840+0000 7f591b9a0640 1 -- 172.21.15.162:0/695931337 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5914062630 con 0x7f59000a3260 2024-09-16T01:15:59.842 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:15:59.843 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:15:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:16:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T01:16:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:16:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:16:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449]' entity='osd.0' 2024-09-16T01:16:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:16:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:00.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:00.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:00.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:15:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:00.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi063 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi063 to 17088M 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] boot 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: osdmap e8: 1 total, 1 up, 1 in 2024-09-16T01:16:00.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:00 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi063 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi063 to 17088M 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] boot 2024-09-16T01:16:01.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: osdmap e8: 1 total, 1 up, 1 in 2024-09-16T01:16:01.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:00 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:16:01.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:16:01.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:16:01.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T01:16:01.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi063 2024-09-16T01:16:01.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi063 to 17088M 2024-09-16T01:16:01.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:16:01.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:16:01.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:16:01.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:16:01.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:01.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: osd.0 [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] boot 2024-09-16T01:16:01.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: osdmap e8: 1 total, 1 up, 1 in 2024-09-16T01:16:01.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:00 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T01:16:02.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:02 smithi162 ceph-mon[34539]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:02.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:02 smithi162 ceph-mon[34539]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T01:16:02.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:02 smithi162 ceph-mon[34539]: from='client.? 172.21.15.162:0/1740962497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a7a8f9d-2b87-41ec-8781-b2ece64566ba"}]: dispatch 2024-09-16T01:16:02.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:02 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a7a8f9d-2b87-41ec-8781-b2ece64566ba"}]: dispatch 2024-09-16T01:16:02.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:02 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a7a8f9d-2b87-41ec-8781-b2ece64566ba"}]': finished 2024-09-16T01:16:02.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:02 smithi162 ceph-mon[34539]: osdmap e10: 2 total, 1 up, 2 in 2024-09-16T01:16:02.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:02 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:02.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:02 smithi063 ceph-mon[31070]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:02.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:02 smithi063 ceph-mon[31070]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T01:16:02.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:02 smithi063 ceph-mon[31070]: from='client.? 172.21.15.162:0/1740962497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a7a8f9d-2b87-41ec-8781-b2ece64566ba"}]: dispatch 2024-09-16T01:16:02.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:02 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a7a8f9d-2b87-41ec-8781-b2ece64566ba"}]: dispatch 2024-09-16T01:16:02.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:02 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a7a8f9d-2b87-41ec-8781-b2ece64566ba"}]': finished 2024-09-16T01:16:02.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:02 smithi063 ceph-mon[31070]: osdmap e10: 2 total, 1 up, 2 in 2024-09-16T01:16:02.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:02 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:02 smithi192 ceph-mon[34775]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:02 smithi192 ceph-mon[34775]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T01:16:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:02 smithi192 ceph-mon[34775]: from='client.? 172.21.15.162:0/1740962497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a7a8f9d-2b87-41ec-8781-b2ece64566ba"}]: dispatch 2024-09-16T01:16:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:02 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a7a8f9d-2b87-41ec-8781-b2ece64566ba"}]: dispatch 2024-09-16T01:16:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:02 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a7a8f9d-2b87-41ec-8781-b2ece64566ba"}]': finished 2024-09-16T01:16:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:02 smithi192 ceph-mon[34775]: osdmap e10: 2 total, 1 up, 2 in 2024-09-16T01:16:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:02 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:03.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:03 smithi063 ceph-mon[31070]: from='client.? 172.21.15.162:0/1540526469' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:16:03.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:03 smithi192 ceph-mon[34775]: from='client.? 172.21.15.162:0/1540526469' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:16:03.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:03 smithi162 ceph-mon[34539]: from='client.? 172.21.15.162:0/1540526469' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:16:04.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:04 smithi063 ceph-mon[31070]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:04.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:04 smithi192 ceph-mon[34775]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:04.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:04 smithi162 ceph-mon[34539]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:06.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:06 smithi063 ceph-mon[31070]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:06.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:06 smithi192 ceph-mon[34775]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:06.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:06 smithi162 ceph-mon[34539]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:08.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:08 smithi162 ceph-mon[34539]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:08.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:08 smithi063 ceph-mon[31070]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:08.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:08 smithi192 ceph-mon[34775]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:10.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:10 smithi063 ceph-mon[31070]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:10.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T01:16:10.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:10.672 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:10 smithi162 ceph-mon[34539]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:10.672 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T01:16:10.673 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:10.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:10 smithi192 ceph-mon[34775]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T01:16:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:11.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:11 smithi063 ceph-mon[31070]: Deploying daemon osd.1 on smithi162 2024-09-16T01:16:11.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:11 smithi192 ceph-mon[34775]: Deploying daemon osd.1 on smithi162 2024-09-16T01:16:11.677 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:11 smithi162 ceph-mon[34539]: Deploying daemon osd.1 on smithi162 2024-09-16T01:16:12.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:12 smithi063 ceph-mon[31070]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:12.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:12 smithi192 ceph-mon[34775]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:12.676 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:12 smithi162 ceph-mon[34539]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:14.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:14 smithi063 ceph-mon[31070]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:14.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:14 smithi192 ceph-mon[34775]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:14.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:14 smithi162 ceph-mon[34539]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:16.480 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:16 smithi162 ceph-mon[34539]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:16.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:16 smithi063 ceph-mon[31070]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:16.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:16 smithi192 ceph-mon[34775]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:17.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:17 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:17.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:17 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:17.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:17 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:17.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:17 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:17.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:17 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:17.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:17 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:17.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:17 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:17.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:17 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:17.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:17 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:18.738 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:18 smithi162 ceph-mon[34539]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:18.738 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:18.738 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:18.738 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:18.738 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:18.739 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:18.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:18 smithi063 ceph-mon[31070]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:18.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:18.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:18.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:18.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:18.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:18 smithi192 ceph-mon[34775]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:20.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.611+0000 7f590a7fc640 1 -- 172.21.15.162:0/695931337 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5914062630 con 0x7f59000a3260 2024-09-16T01:16:20.614 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 1 on host 'smithi162' 2024-09-16T01:16:20.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.613+0000 7f591b9a0640 1 -- 172.21.15.162:0/695931337 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f59000a3260 msgr2=0x7f59000a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.613+0000 7f591b9a0640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f59000a3260 0x7f59000a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5910005fd0 tx=0x7f591000b390 comp rx=0 tx=0).stop 2024-09-16T01:16:20.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.613+0000 7f591b9a0640 1 -- 172.21.15.162:0/695931337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914107950 msgr2=0x7f591419f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.613+0000 7f591b9a0640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914107950 0x7f591419f410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f590c00eb10 tx=0x7f590c00c2d0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.613+0000 7f591b9a0640 1 -- 172.21.15.162:0/695931337 shutdown_connections 2024-09-16T01:16:20.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.613+0000 7f591b9a0640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f59000a3260 0x7f59000a5720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.613+0000 7f591b9a0640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5914107950 0x7f591419f410 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.613+0000 7f591b9a0640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914105020 0x7f5914198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.613+0000 7f591b9a0640 1 --2- 172.21.15.162:0/695931337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59141026f0 0x7f5914197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.613+0000 7f591b9a0640 1 -- 172.21.15.162:0/695931337 >> 172.21.15.162:0/695931337 conn(0x7f59140fc290 msgr2=0x7f5914102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:20.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.614+0000 7f591b9a0640 1 -- 172.21.15.162:0/695931337 shutdown_connections 2024-09-16T01:16:20.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:16:20.614+0000 7f591b9a0640 1 -- 172.21.15.162:0/695931337 wait complete. 2024-09-16T01:16:20.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:20 smithi063 ceph-mon[31070]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:20.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:20 smithi192 ceph-mon[34775]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:20.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:20 smithi162 ceph-mon[34539]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:21.299 DEBUG:teuthology.orchestra.run.smithi162:osd.1> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.1.service 2024-09-16T01:16:21.302 INFO:tasks.cephadm:Deploying osd.2 on smithi192 with /dev/vg_nvme/lv_4... 2024-09-16T01:16:21.302 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T01:16:21.553 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:16:21.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:21 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:21.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:21 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:21.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:21 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:21.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:21 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:21.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:21 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:21.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:21 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:21.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:21 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:21.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:21 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:21.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:21 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:22.877 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:22 smithi192 ceph-mon[34775]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:22.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:22 smithi162 ceph-mon[34539]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:22.934 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:22 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1[39002]: 2024-09-16T01:16:22.618+0000 7fe5173ce640 -1 osd.1 0 log_to_monitors true 2024-09-16T01:16:23.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:22 smithi063 ceph-mon[31070]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:23.782 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:23 smithi192 ceph-mon[34775]: from='osd.1 [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T01:16:23.783 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:23 smithi192 ceph-mon[34775]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T01:16:23.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:23 smithi162 ceph-mon[34539]: from='osd.1 [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T01:16:23.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:23 smithi162 ceph-mon[34539]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T01:16:24.071 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:16:24.096 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_4 2024-09-16T01:16:24.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:23 smithi063 ceph-mon[31070]: from='osd.1 [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T01:16:24.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:23 smithi063 ceph-mon[31070]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T01:16:24.345 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:16:24.705 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:24.705 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T01:16:24.705 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='osd.1 [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:16:24.705 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T01:16:24.705 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:24.705 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:16:24.705 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi162 2024-09-16T01:16:24.705 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:24.705 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:24.706 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:16:24.706 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-16T01:16:24.706 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:24.706 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:24.706 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:24.706 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:24.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.787+0000 7f4134467640 1 -- 172.21.15.192:0/3165161446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c101d10 msgr2=0x7f412c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:24.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.787+0000 7f4134467640 1 --2- 172.21.15.192:0/3165161446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c101d10 0x7f412c102190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f411c009900 tx=0x7f411c02a410 comp rx=0 tx=0).stop 2024-09-16T01:16:24.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.787+0000 7f4134467640 1 -- 172.21.15.192:0/3165161446 shutdown_connections 2024-09-16T01:16:24.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.787+0000 7f4134467640 1 --2- 172.21.15.192:0/3165161446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412c1026d0 0x7f412c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.787+0000 7f4134467640 1 --2- 172.21.15.192:0/3165161446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c101d10 0x7f412c102190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.787+0000 7f4134467640 1 --2- 172.21.15.192:0/3165161446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f412c100b10 0x7f412c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.787+0000 7f4134467640 1 -- 172.21.15.192:0/3165161446 >> 172.21.15.192:0/3165161446 conn(0x7f412c0fc2a0 msgr2=0x7f412c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:24.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.787+0000 7f4134467640 1 -- 172.21.15.192:0/3165161446 shutdown_connections 2024-09-16T01:16:24.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.787+0000 7f4134467640 1 -- 172.21.15.192:0/3165161446 wait complete. 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4134467640 1 Processor -- start 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4134467640 1 -- start start 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4134467640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412c100b10 0x7f412c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4134467640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c101d10 0x7f412c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4134467640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f412c1026d0 0x7f412c19e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4134467640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f412c10c690 con 0x7f412c1026d0 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4134467640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f412c10c510 con 0x7f412c100b10 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4134467640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f412c10c810 con 0x7f412c101d10 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4131a02640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c101d10 0x7f412c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4131a02640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c101d10 0x7f412c197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50486/0 (socket says 172.21.15.192:50486) 2024-09-16T01:16:24.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4131a02640 1 -- 172.21.15.192:0/1916561990 learned_addr learned my addr 172.21.15.192:0/1916561990 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4132a04640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f412c1026d0 0x7f412c19e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4131a02640 1 -- 172.21.15.192:0/1916561990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412c100b10 msgr2=0x7f412c196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4131a02640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412c100b10 0x7f412c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4131a02640 1 -- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f412c1026d0 msgr2=0x7f412c19e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4131a02640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f412c1026d0 0x7f412c19e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4131a02640 1 -- 172.21.15.192:0/1916561990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412c19e950 con 0x7f412c101d10 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.788+0000 7f4132a04640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f412c1026d0 0x7f412c19e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.789+0000 7f4131a02640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c101d10 0x7f412c197270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f411c0314e0 tx=0x7f411c003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.789+0000 7f41237fe640 1 -- 172.21.15.192:0/1916561990 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c03f070 con 0x7f412c101d10 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.789+0000 7f41237fe640 1 -- 172.21.15.192:0/1916561990 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f411c031e40 con 0x7f412c101d10 2024-09-16T01:16:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.789+0000 7f4134467640 1 -- 172.21.15.192:0/1916561990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f412c19ebe0 con 0x7f412c101d10 2024-09-16T01:16:24.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.789+0000 7f41237fe640 1 -- 172.21.15.192:0/1916561990 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c035030 con 0x7f412c101d10 2024-09-16T01:16:24.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.789+0000 7f4134467640 1 -- 172.21.15.192:0/1916561990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f412c19f110 con 0x7f412c101d10 2024-09-16T01:16:24.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.790+0000 7f4134467640 1 -- 172.21.15.192:0/1916561990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f412c107ee0 con 0x7f412c101d10 2024-09-16T01:16:24.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.791+0000 7f41237fe640 1 -- 172.21.15.192:0/1916561990 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f411c042070 con 0x7f412c101d10 2024-09-16T01:16:24.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.791+0000 7f41237fe640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f41180a3230 0x7f41180a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.792+0000 7f41237fe640 1 -- 172.21.15.192:0/1916561990 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f411c0ee8e0 con 0x7f412c101d10 2024-09-16T01:16:24.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.792+0000 7f4132203640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f41180a3230 0x7f41180a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.792+0000 7f4132203640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f41180a3230 0x7f41180a56f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4128005fd0 tx=0x7f412800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:24.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.796+0000 7f41237fe640 1 -- 172.21.15.192:0/1916561990 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f411c0bcf70 con 0x7f412c101d10 2024-09-16T01:16:24.933 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1[39002]: 2024-09-16T01:16:24.628+0000 7fe513351640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T01:16:24.934 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1[39002]: 2024-09-16T01:16:24.632+0000 7fe50f179640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:16:24.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:24.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T01:16:24.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='osd.1 [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:16:24.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T01:16:24.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:24.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:16:24.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi162 2024-09-16T01:16:24.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:24.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:24.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:16:24.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-16T01:16:24.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:24.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:24.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:24.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:24.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:24.969+0000 7f4134467640 1 -- 172.21.15.192:0/1916561990 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f412c062630 con 0x7f41180a3230 2024-09-16T01:16:25.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:25.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='osd.1 [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi162 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:25.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:25.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:25 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:16:25.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:25 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:16:25.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:25 smithi192 ceph-mon[34775]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:16:25.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:25 smithi192 ceph-mon[34775]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T01:16:25.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:25.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:25.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:25 smithi192 ceph-mon[34775]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:16:25.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:16:25.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:16:25.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:25.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:25 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:16:25.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:25 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:16:25.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:25 smithi162 ceph-mon[34539]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:16:25.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:25 smithi162 ceph-mon[34539]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T01:16:25.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:25.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:25.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:25 smithi162 ceph-mon[34539]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:16:25.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:16:25.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:16:25.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:26.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:25 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:16:26.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:25 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:16:26.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:25 smithi063 ceph-mon[31070]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:16:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:25 smithi063 ceph-mon[31070]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T01:16:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:25 smithi063 ceph-mon[31070]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:16:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:16:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:16:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:26.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:26 smithi192 ceph-mon[34775]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:26.867 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:26 smithi192 ceph-mon[34775]: osd.1 [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] boot 2024-09-16T01:16:26.867 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:26 smithi192 ceph-mon[34775]: osdmap e13: 2 total, 2 up, 2 in 2024-09-16T01:16:26.867 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:26 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:26.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:26 smithi162 ceph-mon[34539]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:26.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:26 smithi162 ceph-mon[34539]: osd.1 [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] boot 2024-09-16T01:16:26.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:26 smithi162 ceph-mon[34539]: osdmap e13: 2 total, 2 up, 2 in 2024-09-16T01:16:26.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:26 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:27.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:26 smithi063 ceph-mon[31070]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-16T01:16:27.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:26 smithi063 ceph-mon[31070]: osd.1 [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] boot 2024-09-16T01:16:27.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:26 smithi063 ceph-mon[31070]: osdmap e13: 2 total, 2 up, 2 in 2024-09-16T01:16:27.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:26 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T01:16:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:27 smithi192 ceph-mon[34775]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T01:16:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:27 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/3603100497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "073915c9-5d6f-40db-9720-fd0bd7e8522b"}]: dispatch 2024-09-16T01:16:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:27 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "073915c9-5d6f-40db-9720-fd0bd7e8522b"}]: dispatch 2024-09-16T01:16:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:27 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "073915c9-5d6f-40db-9720-fd0bd7e8522b"}]': finished 2024-09-16T01:16:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:27 smithi192 ceph-mon[34775]: osdmap e15: 3 total, 2 up, 3 in 2024-09-16T01:16:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:27 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:27.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:27 smithi162 ceph-mon[34539]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T01:16:27.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:27 smithi162 ceph-mon[34539]: from='client.? 172.21.15.192:0/3603100497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "073915c9-5d6f-40db-9720-fd0bd7e8522b"}]: dispatch 2024-09-16T01:16:27.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:27 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "073915c9-5d6f-40db-9720-fd0bd7e8522b"}]: dispatch 2024-09-16T01:16:27.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:27 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "073915c9-5d6f-40db-9720-fd0bd7e8522b"}]': finished 2024-09-16T01:16:27.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:27 smithi162 ceph-mon[34539]: osdmap e15: 3 total, 2 up, 3 in 2024-09-16T01:16:27.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:27 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:28.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:27 smithi063 ceph-mon[31070]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T01:16:28.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:27 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/3603100497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "073915c9-5d6f-40db-9720-fd0bd7e8522b"}]: dispatch 2024-09-16T01:16:28.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:27 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "073915c9-5d6f-40db-9720-fd0bd7e8522b"}]: dispatch 2024-09-16T01:16:28.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:27 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "073915c9-5d6f-40db-9720-fd0bd7e8522b"}]': finished 2024-09-16T01:16:28.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:27 smithi063 ceph-mon[31070]: osdmap e15: 3 total, 2 up, 3 in 2024-09-16T01:16:28.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:27 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:28.923 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:28 smithi192 ceph-mon[34775]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:28.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:28 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/1310338177' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:16:28.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:28 smithi162 ceph-mon[34539]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:28.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:28 smithi162 ceph-mon[34539]: from='client.? 172.21.15.192:0/1310338177' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:16:29.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:28 smithi063 ceph-mon[31070]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:29.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:28 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/1310338177' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:16:30.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:30 smithi192 ceph-mon[34775]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:30.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:30 smithi162 ceph-mon[34539]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:31.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:30 smithi063 ceph-mon[31070]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:32.871 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:32 smithi192 ceph-mon[34775]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:32.911 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:32 smithi063 ceph-mon[31070]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:32.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:32 smithi162 ceph-mon[34539]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:34.916 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:34 smithi192 ceph-mon[34775]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:34.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:34 smithi162 ceph-mon[34539]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:35.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:34 smithi063 ceph-mon[31070]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:35.912 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T01:16:35.912 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:35.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T01:16:35.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:36.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T01:16:36.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:36.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:36 smithi192 ceph-mon[34775]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:36.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:36 smithi192 ceph-mon[34775]: Deploying daemon osd.2 on smithi192 2024-09-16T01:16:36.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:36 smithi162 ceph-mon[34539]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:36.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:36 smithi162 ceph-mon[34539]: Deploying daemon osd.2 on smithi192 2024-09-16T01:16:37.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:36 smithi063 ceph-mon[31070]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:37.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:36 smithi063 ceph-mon[31070]: Deploying daemon osd.2 on smithi192 2024-09-16T01:16:38.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:38 smithi192 ceph-mon[34775]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:38 smithi162 ceph-mon[34539]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:39.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:38 smithi063 ceph-mon[31070]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:40.855 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:40 smithi192 ceph-mon[34775]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:40.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:40 smithi162 ceph-mon[34539]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:41.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:40 smithi063 ceph-mon[31070]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:41.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:41.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:41.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:41.964 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:41.964 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:41.964 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:42.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:42.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:42.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:42.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:42 smithi162 ceph-mon[34539]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:42.997 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:42 smithi192 ceph-mon[34775]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:43.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:42 smithi063 ceph-mon[31070]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:45.173 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:44 smithi192 ceph-mon[34775]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:45.173 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:45.173 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:45.173 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:45.173 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:45.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:44 smithi162 ceph-mon[34539]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:45.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:44 smithi063 ceph-mon[31070]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:45.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:45.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:45.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:45.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:45.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:45.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.462+0000 7f41237fe640 1 -- 172.21.15.192:0/1916561990 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f412c062630 con 0x7f41180a3230 2024-09-16T01:16:45.464 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 2 on host 'smithi192' 2024-09-16T01:16:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 -- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f41180a3230 msgr2=0x7f41180a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f41180a3230 0x7f41180a56f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4128005fd0 tx=0x7f412800b410 comp rx=0 tx=0).stop 2024-09-16T01:16:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 -- 172.21.15.192:0/1916561990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c101d10 msgr2=0x7f412c197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c101d10 0x7f412c197270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f411c0314e0 tx=0x7f411c003c80 comp rx=0 tx=0).stop 2024-09-16T01:16:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 -- 172.21.15.192:0/1916561990 shutdown_connections 2024-09-16T01:16:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f41180a3230 0x7f41180a56f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f412c1026d0 0x7f412c19e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c101d10 0x7f412c197270 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 --2- 172.21.15.192:0/1916561990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f412c100b10 0x7f412c196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 -- 172.21.15.192:0/1916561990 >> 172.21.15.192:0/1916561990 conn(0x7f412c0fc2a0 msgr2=0x7f412c1050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 -- 172.21.15.192:0/1916561990 shutdown_connections 2024-09-16T01:16:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:16:45.465+0000 7f4134467640 1 -- 172.21.15.192:0/1916561990 wait complete. 2024-09-16T01:16:46.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:45 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:46.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:45 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:46.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:45 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:46.103 DEBUG:teuthology.orchestra.run.smithi192:osd.2> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.2.service 2024-09-16T01:16:46.105 INFO:tasks.cephadm:Deploying osd.3 on smithi063 with /dev/vg_nvme/lv_3... 2024-09-16T01:16:46.105 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T01:16:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:45 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:45 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:45 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:46.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:45 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:16:46.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:45 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:46.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:45 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:46.376 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:16:47.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:46 smithi063 ceph-mon[31070]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:47.166 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:46 smithi192 ceph-mon[34775]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:47.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:46 smithi162 ceph-mon[34539]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:47.893 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:47 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2[39749]: 2024-09-16T01:16:47.745+0000 7fb6f59cd640 -1 osd.2 0 log_to_monitors true 2024-09-16T01:16:48.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:47 smithi063 ceph-mon[31070]: from='osd.2 [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T01:16:48.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:47 smithi063 ceph-mon[31070]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T01:16:48.142 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:47 smithi192 ceph-mon[34775]: from='osd.2 [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T01:16:48.142 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:47 smithi192 ceph-mon[34775]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T01:16:48.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:47 smithi162 ceph-mon[34539]: from='osd.2 [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T01:16:48.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:47 smithi162 ceph-mon[34539]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T01:16:48.887 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:16:48.917 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi063:vg_nvme/lv_3 2024-09-16T01:16:49.174 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2[39749]: 2024-09-16T01:16:48.910+0000 7fb6f1950640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T01:16:49.174 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2[39749]: 2024-09-16T01:16:48.915+0000 7fb6ed778640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:16:49.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:49.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T01:16:49.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T01:16:49.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:49.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='osd.2 [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:16:49.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:16:49.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:16:49.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:49.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:49.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:48 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.179 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:16:49.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:49.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T01:16:49.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T01:16:49.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:49.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='osd.2 [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:16:49.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:16:49.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:16:49.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:49.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:49.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:48 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.300 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:49.300 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='osd.2 [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:16:49.301 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:48 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.616+0000 7f580c61e640 1 -- 172.21.15.63:0/3166592108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58041026c0 msgr2=0x7f5804108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.616+0000 7f580c61e640 1 --2- 172.21.15.63:0/3166592108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58041026c0 0x7f5804108f50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009ca0 tx=0x7f57fc02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:16:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.616+0000 7f580c61e640 1 -- 172.21.15.63:0/3166592108 shutdown_connections 2024-09-16T01:16:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.616+0000 7f580c61e640 1 --2- 172.21.15.63:0/3166592108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58041026c0 0x7f5804108f50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.616+0000 7f580c61e640 1 --2- 172.21.15.63:0/3166592108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5804101d00 0x7f5804102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.616+0000 7f580c61e640 1 --2- 172.21.15.63:0/3166592108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5804100b00 0x7f5804100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.616+0000 7f580c61e640 1 -- 172.21.15.63:0/3166592108 >> 172.21.15.63:0/3166592108 conn(0x7f58040fc290 msgr2=0x7f58040fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.616+0000 7f580c61e640 1 -- 172.21.15.63:0/3166592108 shutdown_connections 2024-09-16T01:16:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.616+0000 7f580c61e640 1 -- 172.21.15.63:0/3166592108 wait complete. 2024-09-16T01:16:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580c61e640 1 Processor -- start 2024-09-16T01:16:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580c61e640 1 -- start start 2024-09-16T01:16:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580c61e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5804100b00 0x7f5804104a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580c61e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5804101d00 0x7f58041030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580c61e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58041026c0 0x7f5804103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580c61e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f580410c610 con 0x7f58041026c0 2024-09-16T01:16:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580c61e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f580410c490 con 0x7f5804100b00 2024-09-16T01:16:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580c61e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f580410c790 con 0x7f5804101d00 2024-09-16T01:16:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580abbb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58041026c0 0x7f5804103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580abbb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58041026c0 0x7f5804103620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58028/0 (socket says 172.21.15.63:58028) 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580abbb640 1 -- 172.21.15.63:0/4288805200 learned_addr learned my addr 172.21.15.63:0/4288805200 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.617+0000 7f580a3ba640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5804100b00 0x7f5804104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f5809bb9640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5804101d00 0x7f58041030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f580abbb640 1 -- 172.21.15.63:0/4288805200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5804101d00 msgr2=0x7f58041030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f580abbb640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5804101d00 0x7f58041030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f580abbb640 1 -- 172.21.15.63:0/4288805200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5804100b00 msgr2=0x7f5804104a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f580abbb640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5804100b00 0x7f5804104a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f580abbb640 1 -- 172.21.15.63:0/4288805200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5804103ee0 con 0x7f58041026c0 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f580abbb640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58041026c0 0x7f5804103620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009dc0 tx=0x7f57fc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f57fb7fe640 1 -- 172.21.15.63:0/4288805200 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc032ec0 con 0x7f58041026c0 2024-09-16T01:16:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f57fb7fe640 1 -- 172.21.15.63:0/4288805200 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f57fc0044f0 con 0x7f58041026c0 2024-09-16T01:16:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f580c61e640 1 -- 172.21.15.63:0/4288805200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58041a1f10 con 0x7f58041026c0 2024-09-16T01:16:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f57fb7fe640 1 -- 172.21.15.63:0/4288805200 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57fc030d40 con 0x7f58041026c0 2024-09-16T01:16:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.618+0000 7f580c61e640 1 -- 172.21.15.63:0/4288805200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58041a23c0 con 0x7f58041026c0 2024-09-16T01:16:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.620+0000 7f580c61e640 1 -- 172.21.15.63:0/4288805200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58041a25f0 con 0x7f58041026c0 2024-09-16T01:16:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.620+0000 7f57fb7fe640 1 -- 172.21.15.63:0/4288805200 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f57fc004040 con 0x7f58041026c0 2024-09-16T01:16:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.621+0000 7f57fb7fe640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57f00a3350 0x7f57f00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.621+0000 7f580a3ba640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57f00a3350 0x7f57f00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.621+0000 7f57fb7fe640 1 -- 172.21.15.63:0/4288805200 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f57fc0ef6b0 con 0x7f58041026c0 2024-09-16T01:16:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.622+0000 7f580a3ba640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57f00a3350 0x7f57f00a5810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5804101b60 tx=0x7f580000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:49.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.625+0000 7f57fb7fe640 1 -- 172.21.15.63:0/4288805200 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57fc0bdb20 con 0x7f58041026c0 2024-09-16T01:16:49.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:49.811+0000 7f580c61e640 1 -- 172.21.15.63:0/4288805200 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f58041a27c0 con 0x7f57f00a3350 2024-09-16T01:16:50.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:49 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi192 2024-09-16T01:16:50.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:49 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi192 to 17088M 2024-09-16T01:16:50.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:49 smithi192 ceph-mon[34775]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:16:50.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:49 smithi192 ceph-mon[34775]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T01:16:50.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:50.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:50.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:16:50.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:16:50.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:50.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:49 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi192 2024-09-16T01:16:50.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:49 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi192 to 17088M 2024-09-16T01:16:50.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:49 smithi162 ceph-mon[34539]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:16:50.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:49 smithi162 ceph-mon[34539]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T01:16:50.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:50.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:50.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:16:50.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:16:50.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:50.230 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:49 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi192 2024-09-16T01:16:50.230 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:49 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi192 to 17088M 2024-09-16T01:16:50.230 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:49 smithi063 ceph-mon[31070]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:16:50.230 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:49 smithi063 ceph-mon[31070]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T01:16:50.230 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:50.230 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:50.230 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:16:50.230 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:16:50.230 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:16:51.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:50 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:16:51.212 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:50 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:16:51.212 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:50 smithi192 ceph-mon[34775]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:51.212 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:50 smithi192 ceph-mon[34775]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:16:51.212 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:51.212 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:50 smithi192 ceph-mon[34775]: osd.2 [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] boot 2024-09-16T01:16:51.212 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:50 smithi192 ceph-mon[34775]: osdmap e18: 3 total, 3 up, 3 in 2024-09-16T01:16:51.212 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:51.213 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:50 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:16:51.213 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:50 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:16:51.213 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:50 smithi162 ceph-mon[34539]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:51.213 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:50 smithi162 ceph-mon[34539]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:16:51.213 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:51.213 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:50 smithi162 ceph-mon[34539]: osd.2 [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] boot 2024-09-16T01:16:51.213 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:50 smithi162 ceph-mon[34539]: osdmap e18: 3 total, 3 up, 3 in 2024-09-16T01:16:51.213 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:51.268 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:50 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:16:51.268 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:50 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:16:51.268 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:50 smithi063 ceph-mon[31070]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T01:16:51.268 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:50 smithi063 ceph-mon[31070]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:16:51.268 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:51.268 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:50 smithi063 ceph-mon[31070]: osd.2 [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] boot 2024-09-16T01:16:51.269 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:50 smithi063 ceph-mon[31070]: osdmap e18: 3 total, 3 up, 3 in 2024-09-16T01:16:51.269 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T01:16:51.934 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:51 smithi063 ceph-mon[31070]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T01:16:51.934 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:51 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:16:52.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:51 smithi162 ceph-mon[34539]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T01:16:52.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:51 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:16:52.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:51 smithi192 ceph-mon[34775]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T01:16:52.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:51 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:16:53.109 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:16:52 smithi063 sudo[49246]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T01:16:53.109 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:16:52 smithi063 sudo[49246]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:53.109 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:16:52 smithi063 sudo[49246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:53.109 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:16:52 smithi063 sudo[49246]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:53.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:52 smithi063 ceph-mon[31070]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:53.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:52 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T01:16:53.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:52 smithi063 ceph-mon[31070]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T01:16:53.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:52 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:16:53.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:52 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2212252303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d565129a-d24c-4262-a024-993dad3c27e3"}]: dispatch 2024-09-16T01:16:53.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:52 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:16:53.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:52 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2212252303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d565129a-d24c-4262-a024-993dad3c27e3"}]': finished 2024-09-16T01:16:53.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:52 smithi063 ceph-mon[31070]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T01:16:53.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:52 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:16:53.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:52 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1443532964' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:16:53.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:52 smithi162 ceph-mon[34539]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:52 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T01:16:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:52 smithi162 ceph-mon[34539]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T01:16:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:52 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:16:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:52 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2212252303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d565129a-d24c-4262-a024-993dad3c27e3"}]: dispatch 2024-09-16T01:16:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:52 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:16:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:52 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2212252303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d565129a-d24c-4262-a024-993dad3c27e3"}]': finished 2024-09-16T01:16:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:52 smithi162 ceph-mon[34539]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T01:16:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:52 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:16:53.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:52 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1443532964' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:16:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:52 smithi192 ceph-mon[34775]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:52 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T01:16:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:52 smithi192 ceph-mon[34775]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T01:16:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:52 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:16:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:52 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2212252303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d565129a-d24c-4262-a024-993dad3c27e3"}]: dispatch 2024-09-16T01:16:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:52 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:16:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:52 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2212252303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d565129a-d24c-4262-a024-993dad3c27e3"}]': finished 2024-09-16T01:16:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:52 smithi192 ceph-mon[34775]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T01:16:53.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:52 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:16:53.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:52 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1443532964' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:16:53.609 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:16:53 smithi063 sudo[49295]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T01:16:53.609 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:16:53 smithi063 sudo[49295]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:53.609 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:16:53 smithi063 sudo[49295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:53.610 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:16:53 smithi063 sudo[49295]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:53.811 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:53 smithi162 sudo[42808]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T01:16:53.811 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:53 smithi162 sudo[42808]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:53.811 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:53 smithi162 sudo[42808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:53.812 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:53 smithi162 sudo[42808]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:16:53.939+0000 7f57fb7fe640 1 -- 172.21.15.63:0/4288805200 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f57fc0b9a90 con 0x7f58041026c0 2024-09-16T01:16:54.183 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:53 smithi162 sudo[42811]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T01:16:54.183 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:53 smithi162 sudo[42811]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:54.183 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:53 smithi162 sudo[42811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:54.183 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:16:53 smithi162 sudo[42811]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:54.337 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:54 smithi192 sudo[43358]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T01:16:54.337 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:54 smithi192 sudo[43358]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:54.337 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:54 smithi192 sudo[43358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:54.337 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:54 smithi192 sudo[43358]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:54.337 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:54 smithi192 ceph-mon[34775]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:54.338 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:54 smithi192 ceph-mon[34775]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T01:16:54.338 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:16:54.338 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:54.338 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:54.338 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:54 smithi192 ceph-mon[34775]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-16T01:16:54.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:54 smithi063 ceph-mon[31070]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:54.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:54 smithi063 ceph-mon[31070]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T01:16:54.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:54 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:16:54.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:54 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:54.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:54 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:54.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:54 smithi063 ceph-mon[31070]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-16T01:16:54.674 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:54 smithi192 sudo[43361]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T01:16:54.674 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:54 smithi192 sudo[43361]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:54.674 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:54 smithi192 sudo[43361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:54.674 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:16:54 smithi192 sudo[43361]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:54.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:54 smithi162 ceph-mon[34539]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:54.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:54 smithi162 ceph-mon[34539]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T01:16:54.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:54 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:16:54.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:54 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:54.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:54 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:54.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:54 smithi162 ceph-mon[34539]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-16T01:16:55.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:54 smithi063 sudo[49672]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T01:16:55.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:54 smithi063 sudo[49672]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:55.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:54 smithi063 sudo[49672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:55.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:54 smithi063 sudo[49672]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:55.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:55 smithi063 sudo[49677]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T01:16:55.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:55 smithi063 sudo[49677]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:55.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:55 smithi063 sudo[49677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:55.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:55 smithi063 sudo[49677]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:55.758 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:55 smithi192 sudo[43364]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T01:16:55.758 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:55 smithi192 sudo[43364]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:55.758 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:55 smithi192 sudo[43364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:55.758 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:55 smithi192 sudo[43364]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:56.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:55 smithi192 sudo[43367]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T01:16:56.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:55 smithi192 sudo[43367]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:56.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:55 smithi192 sudo[43367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:56.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:55 smithi192 sudo[43367]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:56.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 sudo[42814]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T01:16:56.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 sudo[42814]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:56.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 sudo[42814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:56.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 sudo[42814]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:56.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:56.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:56 smithi063 ceph-mon[31070]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T01:16:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:56 smithi063 ceph-mon[31070]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T01:16:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:16:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:16:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:16:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:16:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:16:56.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:16:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:56 smithi192 ceph-mon[34775]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T01:16:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:56 smithi192 ceph-mon[34775]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T01:16:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:16:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:16:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:16:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:16:56.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:16:56.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:16:56.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 sudo[42817]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T01:16:56.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 sudo[42817]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 sudo[42817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 sudo[42817]: pam_unix(sudo:session): session closed for user root 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 ceph-mon[34539]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 ceph-mon[34539]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:16:56.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:16:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:57 smithi063 ceph-mon[31070]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:57 smithi063 ceph-mon[31070]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T01:16:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:57 smithi063 ceph-mon[31070]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T01:16:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:57 smithi063 ceph-mon[31070]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T01:16:57.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:57 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:16:57.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:57 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:16:57.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:57 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:16:57.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:57 smithi063 ceph-mon[31070]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T01:16:57.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:57 smithi192 ceph-mon[34775]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:57.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:57 smithi192 ceph-mon[34775]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T01:16:57.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:57 smithi192 ceph-mon[34775]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T01:16:57.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:57 smithi192 ceph-mon[34775]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T01:16:57.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:57 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:16:57.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:57 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:16:57.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:57 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:16:57.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:57 smithi192 ceph-mon[34775]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T01:16:57.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:57 smithi162 ceph-mon[34539]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:57.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:57 smithi162 ceph-mon[34539]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T01:16:57.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:57 smithi162 ceph-mon[34539]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T01:16:57.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:57 smithi162 ceph-mon[34539]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T01:16:57.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:57 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-16T01:16:57.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:57 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-16T01:16:57.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:57 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-16T01:16:57.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:57 smithi162 ceph-mon[34539]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T01:16:58.576 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:16:58 smithi063 ceph-mon[31070]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:58.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:16:58 smithi192 ceph-mon[34775]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:16:58.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:16:58 smithi162 ceph-mon[34539]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:00.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:00 smithi063 ceph-mon[31070]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:00.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:00 smithi192 ceph-mon[34775]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:00.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:00 smithi162 ceph-mon[34539]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:01.559 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:01 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T01:17:01.559 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:01 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:01.559 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:01 smithi063 ceph-mon[31070]: Deploying daemon osd.3 on smithi063 2024-09-16T01:17:01.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:01 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T01:17:01.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:01 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:01.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:01 smithi192 ceph-mon[34775]: Deploying daemon osd.3 on smithi063 2024-09-16T01:17:01.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:01 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T01:17:01.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:01 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:01.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:01 smithi162 ceph-mon[34539]: Deploying daemon osd.3 on smithi063 2024-09-16T01:17:02.550 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:02 smithi063 ceph-mon[31070]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:02 smithi192 ceph-mon[34775]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:02.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:02 smithi162 ceph-mon[34539]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:04.516 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:04 smithi063 ceph-mon[31070]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:05.538 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:04 smithi162 ceph-mon[34539]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:05.539 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:04 smithi192 ceph-mon[34775]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:06.477 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:06 smithi063 ceph-mon[31070]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:06.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:06 smithi192 ceph-mon[34775]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:06.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:06 smithi162 ceph-mon[34539]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:07.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:07 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:07.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:07 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:07.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:07 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:07.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:07 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:07.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:07 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:07.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:07 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:07.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:07 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:07.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:07 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:07.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:07 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:08.512 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:08 smithi063 ceph-mon[31070]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:08.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:08 smithi192 ceph-mon[34775]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:08.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:08 smithi162 ceph-mon[34539]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:10 smithi192 ceph-mon[34775]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:10.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:10.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:10 smithi162 ceph-mon[34539]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:10.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:10.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:10.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:10.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:10.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:11.030 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:10 smithi063 ceph-mon[31070]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:11.030 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:11.030 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:11.030 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:11.030 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:11.030 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:11.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.069+0000 7f57fb7fe640 1 -- 172.21.15.63:0/4288805200 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f58041a27c0 con 0x7f57f00a3350 2024-09-16T01:17:11.070 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 3 on host 'smithi063' 2024-09-16T01:17:11.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 -- 172.21.15.63:0/4288805200 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57f00a3350 msgr2=0x7f57f00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:11.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57f00a3350 0x7f57f00a5810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5804101b60 tx=0x7f580000a2d0 comp rx=0 tx=0).stop 2024-09-16T01:17:11.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 -- 172.21.15.63:0/4288805200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58041026c0 msgr2=0x7f5804103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:11.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58041026c0 0x7f5804103620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009dc0 tx=0x7f57fc003ba0 comp rx=0 tx=0).stop 2024-09-16T01:17:11.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 -- 172.21.15.63:0/4288805200 shutdown_connections 2024-09-16T01:17:11.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57f00a3350 0x7f57f00a5810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:11.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58041026c0 0x7f5804103620 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:11.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5804101d00 0x7f58041030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:11.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 --2- 172.21.15.63:0/4288805200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5804100b00 0x7f5804104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:11.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 -- 172.21.15.63:0/4288805200 >> 172.21.15.63:0/4288805200 conn(0x7f58040fc290 msgr2=0x7f580406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:11.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 -- 172.21.15.63:0/4288805200 shutdown_connections 2024-09-16T01:17:11.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:17:11.071+0000 7f580c61e640 1 -- 172.21.15.63:0/4288805200 wait complete. 2024-09-16T01:17:11.686 DEBUG:teuthology.orchestra.run.smithi063:osd.3> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.3.service 2024-09-16T01:17:11.688 INFO:tasks.cephadm:Deploying osd.4 on smithi162 with /dev/vg_nvme/lv_3... 2024-09-16T01:17:11.688 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T01:17:11.918 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:11 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:11.918 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:11 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:11.918 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:11 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:11.923 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:11 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:11.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:11 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:11.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:11 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:11.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:11 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:11.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:11 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:11.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:11 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:11.942 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:17:12.926 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:12 smithi063 ceph-mon[31070]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:12.926 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:17:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3[51270]: 2024-09-16T01:17:12.899+0000 7f3d891d2640 -1 osd.3 0 log_to_monitors true 2024-09-16T01:17:12.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:12 smithi162 ceph-mon[34539]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:13.173 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:12 smithi192 ceph-mon[34775]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:13.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:13 smithi162 ceph-mon[34539]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T01:17:13.989 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:13 smithi063 ceph-mon[31070]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T01:17:14.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:13 smithi192 ceph-mon[34775]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T01:17:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:17:14.478 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-09-16T01:17:14.732 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:17:14.752 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:14 smithi162 ceph-mon[34539]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:14.752 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:14 smithi162 ceph-mon[34539]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T01:17:14.753 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:14 smithi162 ceph-mon[34539]: osdmap e23: 4 total, 3 up, 4 in 2024-09-16T01:17:14.753 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:14 smithi162 ceph-mon[34539]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:17:14.753 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:14 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:14.753 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:14 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:15.105 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:14 smithi063 ceph-mon[31070]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:15.105 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:14 smithi063 ceph-mon[31070]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T01:17:15.105 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:14 smithi063 ceph-mon[31070]: osdmap e23: 4 total, 3 up, 4 in 2024-09-16T01:17:15.105 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:14 smithi063 ceph-mon[31070]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:17:15.105 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:14 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:15.105 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:14 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:15.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:14 smithi192 ceph-mon[34775]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:15.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:14 smithi192 ceph-mon[34775]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T01:17:15.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:14 smithi192 ceph-mon[34775]: osdmap e23: 4 total, 3 up, 4 in 2024-09-16T01:17:15.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:14 smithi192 ceph-mon[34775]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:17:15.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:14 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:15.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:14 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:15.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 -- 172.21.15.162:0/3238729968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8100ad0 msgr2=0x7f2ca8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:15.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 --2- 172.21.15.162:0/3238729968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8100ad0 0x7f2ca8100ed0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009900 tx=0x7f2c9c02a410 comp rx=0 tx=0).stop 2024-09-16T01:17:15.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 -- 172.21.15.162:0/3238729968 shutdown_connections 2024-09-16T01:17:15.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 --2- 172.21.15.162:0/3238729968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca8102690 0x7f2ca8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:15.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 --2- 172.21.15.162:0/3238729968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ca8101cd0 0x7f2ca8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:15.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 --2- 172.21.15.162:0/3238729968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8100ad0 0x7f2ca8100ed0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:15.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 -- 172.21.15.162:0/3238729968 >> 172.21.15.162:0/3238729968 conn(0x7f2ca80fc280 msgr2=0x7f2ca80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 -- 172.21.15.162:0/3238729968 shutdown_connections 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 -- 172.21.15.162:0/3238729968 wait complete. 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 Processor -- start 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 -- start start 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8100ad0 0x7f2ca806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca8101cd0 0x7f2ca819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ca8102690 0x7f2ca819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca810c600 con 0x7f2ca8101cd0 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.177+0000 7f2caf221640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca810c480 con 0x7f2ca8100ad0 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2caf221640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca810c780 con 0x7f2ca8102690 2024-09-16T01:17:15.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2cacfbd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8100ad0 0x7f2ca806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2cacfbd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8100ad0 0x7f2ca806aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35394/0 (socket says 172.21.15.162:35394) 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2cacfbd640 1 -- 172.21.15.162:0/4045138715 learned_addr learned my addr 172.21.15.162:0/4045138715 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2ca7fff640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca8101cd0 0x7f2ca819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2cad7be640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ca8102690 0x7f2ca819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2cacfbd640 1 -- 172.21.15.162:0/4045138715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ca8102690 msgr2=0x7f2ca819f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2cacfbd640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ca8102690 0x7f2ca819f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2cacfbd640 1 -- 172.21.15.162:0/4045138715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca8101cd0 msgr2=0x7f2ca819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2cacfbd640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca8101cd0 0x7f2ca819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2cacfbd640 1 -- 172.21.15.162:0/4045138715 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca819fa70 con 0x7f2ca8100ad0 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2cacfbd640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8100ad0 0x7f2ca806aad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009230 tx=0x7f2c9c004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2ca5ffb640 1 -- 172.21.15.162:0/4045138715 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c03f030 con 0x7f2ca8100ad0 2024-09-16T01:17:15.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2ca5ffb640 1 -- 172.21.15.162:0/4045138715 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2c9c003cb0 con 0x7f2ca8100ad0 2024-09-16T01:17:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2ca5ffb640 1 -- 172.21.15.162:0/4045138715 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c035070 con 0x7f2ca8100ad0 2024-09-16T01:17:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.178+0000 7f2caf221640 1 -- 172.21.15.162:0/4045138715 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca819fca0 con 0x7f2ca8100ad0 2024-09-16T01:17:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.179+0000 7f2caf221640 1 -- 172.21.15.162:0/4045138715 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca81a0180 con 0x7f2ca8100ad0 2024-09-16T01:17:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.180+0000 7f2caf221640 1 -- 172.21.15.162:0/4045138715 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca8107f70 con 0x7f2ca8100ad0 2024-09-16T01:17:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.181+0000 7f2ca5ffb640 1 -- 172.21.15.162:0/4045138715 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2c9c042030 con 0x7f2ca8100ad0 2024-09-16T01:17:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.181+0000 7f2ca5ffb640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2c980a3240 0x7f2c980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.181+0000 7f2ca5ffb640 1 -- 172.21.15.162:0/4045138715 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3389+0+0 (secure 0 0 0) 0x7f2c9c0eec10 con 0x7f2ca8100ad0 2024-09-16T01:17:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.182+0000 7f2ca7fff640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2c980a3240 0x7f2c980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.182+0000 7f2ca7fff640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2c980a3240 0x7f2c980a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ca806b050 tx=0x7f2c9400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:15.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.186+0000 7f2ca5ffb640 1 -- 172.21.15.162:0/4045138715 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c9c0bcc70 con 0x7f2ca8100ad0 2024-09-16T01:17:15.359 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3[51270]: 2024-09-16T01:17:15.102+0000 7f3d85155640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T01:17:15.359 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3[51270]: 2024-09-16T01:17:15.108+0000 7f3d7cf75640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:17:15.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:15.368+0000 7f2caf221640 1 -- 172.21.15.162:0/4045138715 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2ca8062630 con 0x7f2c980a3240 2024-09-16T01:17:16.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi063 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi063 to 8544M 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: osdmap e24: 4 total, 3 up, 4 in 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:16.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' 2024-09-16T01:17:16.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:17:16.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:17:16.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:16.075 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi063 2024-09-16T01:17:16.075 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:16.075 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi063 to 8544M 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: osdmap e24: 4 total, 3 up, 4 in 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' 2024-09-16T01:17:16.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:17:16.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:17:16.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:16.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi063 2024-09-16T01:17:16.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi063 to 8544M 2024-09-16T01:17:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:17:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: osdmap e24: 4 total, 3 up, 4 in 2024-09-16T01:17:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:16.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325]' entity='osd.3' 2024-09-16T01:17:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:17:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:17:16.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:16.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:16 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:17:16.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:16 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:17:16.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:16 smithi162 ceph-mon[34539]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:16.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:16 smithi162 ceph-mon[34539]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:17:16.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:16 smithi162 ceph-mon[34539]: osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] boot 2024-09-16T01:17:16.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:16 smithi162 ceph-mon[34539]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T01:17:16.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:16 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:16.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:16 smithi162 ceph-mon[34539]: osdmap e26: 4 total, 4 up, 4 in 2024-09-16T01:17:17.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:16 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:17:17.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:16 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:17:17.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:16 smithi063 ceph-mon[31070]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:17.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:16 smithi063 ceph-mon[31070]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:17:17.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:16 smithi063 ceph-mon[31070]: osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] boot 2024-09-16T01:17:17.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:16 smithi063 ceph-mon[31070]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T01:17:17.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:16 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:17.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:16 smithi063 ceph-mon[31070]: osdmap e26: 4 total, 4 up, 4 in 2024-09-16T01:17:17.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:16 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:17:17.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:16 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:17:17.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:16 smithi192 ceph-mon[34775]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T01:17:17.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:16 smithi192 ceph-mon[34775]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:17:17.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:16 smithi192 ceph-mon[34775]: osd.3 [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] boot 2024-09-16T01:17:17.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:16 smithi192 ceph-mon[34775]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T01:17:17.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:16 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T01:17:17.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:16 smithi192 ceph-mon[34775]: osdmap e26: 4 total, 4 up, 4 in 2024-09-16T01:17:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:18 smithi192 ceph-mon[34775]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:18 smithi192 ceph-mon[34775]: osdmap e27: 4 total, 4 up, 4 in 2024-09-16T01:17:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:18 smithi192 ceph-mon[34775]: from='client.? 172.21.15.162:0/4243224650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b40f769-2023-43f4-a415-27ba2acf8624"}]: dispatch 2024-09-16T01:17:18.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:18 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b40f769-2023-43f4-a415-27ba2acf8624"}]: dispatch 2024-09-16T01:17:18.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:18 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b40f769-2023-43f4-a415-27ba2acf8624"}]': finished 2024-09-16T01:17:18.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:18 smithi192 ceph-mon[34775]: osdmap e28: 5 total, 4 up, 5 in 2024-09-16T01:17:18.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:18.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:18 smithi192 ceph-mon[34775]: from='client.? 172.21.15.162:0/979358557' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:17:18.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:18 smithi162 ceph-mon[34539]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:18.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:18 smithi162 ceph-mon[34539]: osdmap e27: 4 total, 4 up, 4 in 2024-09-16T01:17:18.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:18 smithi162 ceph-mon[34539]: from='client.? 172.21.15.162:0/4243224650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b40f769-2023-43f4-a415-27ba2acf8624"}]: dispatch 2024-09-16T01:17:18.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:18 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b40f769-2023-43f4-a415-27ba2acf8624"}]: dispatch 2024-09-16T01:17:18.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:18 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b40f769-2023-43f4-a415-27ba2acf8624"}]': finished 2024-09-16T01:17:18.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:18 smithi162 ceph-mon[34539]: osdmap e28: 5 total, 4 up, 5 in 2024-09-16T01:17:18.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:18.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:18 smithi162 ceph-mon[34539]: from='client.? 172.21.15.162:0/979358557' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:17:19.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:18 smithi063 ceph-mon[31070]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:19.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:18 smithi063 ceph-mon[31070]: osdmap e27: 4 total, 4 up, 4 in 2024-09-16T01:17:19.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:18 smithi063 ceph-mon[31070]: from='client.? 172.21.15.162:0/4243224650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b40f769-2023-43f4-a415-27ba2acf8624"}]: dispatch 2024-09-16T01:17:19.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:18 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b40f769-2023-43f4-a415-27ba2acf8624"}]: dispatch 2024-09-16T01:17:19.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:18 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b40f769-2023-43f4-a415-27ba2acf8624"}]': finished 2024-09-16T01:17:19.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:18 smithi063 ceph-mon[31070]: osdmap e28: 5 total, 4 up, 5 in 2024-09-16T01:17:19.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:19.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:18 smithi063 ceph-mon[31070]: from='client.? 172.21.15.162:0/979358557' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:17:20.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:19 smithi063 ceph-mon[31070]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T01:17:20.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:19 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:20.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:19 smithi192 ceph-mon[34775]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T01:17:20.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:19 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:20.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:19 smithi162 ceph-mon[34539]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T01:17:20.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:19 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:21.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:20 smithi063 ceph-mon[31070]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:21.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:20 smithi063 ceph-mon[31070]: osdmap e30: 5 total, 4 up, 5 in 2024-09-16T01:17:21.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:21.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:20 smithi192 ceph-mon[34775]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:21.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:20 smithi192 ceph-mon[34775]: osdmap e30: 5 total, 4 up, 5 in 2024-09-16T01:17:21.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:21.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:20 smithi162 ceph-mon[34539]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:21.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:20 smithi162 ceph-mon[34539]: osdmap e30: 5 total, 4 up, 5 in 2024-09-16T01:17:21.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:23.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:22 smithi063 ceph-mon[31070]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:23.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:22 smithi162 ceph-mon[34539]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:23.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:22 smithi192 ceph-mon[34775]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:25.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:24 smithi063 ceph-mon[31070]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-16T01:17:25.140 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:24 smithi162 ceph-mon[34539]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-16T01:17:25.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:24 smithi192 ceph-mon[34775]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-16T01:17:25.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T01:17:25.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T01:17:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:26.173 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T01:17:26.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:27.063 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:26 smithi162 ceph-mon[34539]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-16T01:17:27.063 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:26 smithi162 ceph-mon[34539]: Deploying daemon osd.4 on smithi162 2024-09-16T01:17:27.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:26 smithi063 ceph-mon[31070]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-16T01:17:27.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:26 smithi063 ceph-mon[31070]: Deploying daemon osd.4 on smithi162 2024-09-16T01:17:27.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:26 smithi192 ceph-mon[34775]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-16T01:17:27.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:26 smithi192 ceph-mon[34775]: Deploying daemon osd.4 on smithi162 2024-09-16T01:17:29.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:28 smithi063 ceph-mon[31070]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-16T01:17:29.150 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:28 smithi162 ceph-mon[34539]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-16T01:17:29.173 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:28 smithi192 ceph-mon[34775]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-16T01:17:30.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:30 smithi162 ceph-mon[34539]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T01:17:31.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:30 smithi063 ceph-mon[31070]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T01:17:31.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:30 smithi192 ceph-mon[34775]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T01:17:33.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:32 smithi063 ceph-mon[31070]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-16T01:17:33.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:33.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:33.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:33.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:32 smithi192 ceph-mon[34775]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-16T01:17:33.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:33.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:33.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:33.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:32 smithi162 ceph-mon[34539]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-16T01:17:33.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:33.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:33.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:35.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:34 smithi063 ceph-mon[31070]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T01:17:35.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:34 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:35.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:34 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:35.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:34 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:35.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:34 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:35.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:34 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:35.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:34 smithi192 ceph-mon[34775]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T01:17:35.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:34 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:35.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:34 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:35.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:34 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:35.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:34 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:35.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:34 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:35.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:34 smithi162 ceph-mon[34539]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T01:17:35.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:34 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:35.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:34 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:35.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:34 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:35.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:34 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:35.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:34 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:35.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.828+0000 7f2ca5ffb640 1 -- 172.21.15.162:0/4045138715 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2ca8062630 con 0x7f2c980a3240 2024-09-16T01:17:35.841 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 4 on host 'smithi162' 2024-09-16T01:17:35.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 -- 172.21.15.162:0/4045138715 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2c980a3240 msgr2=0x7f2c980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:35.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2c980a3240 0x7f2c980a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ca806b050 tx=0x7f2c9400a250 comp rx=0 tx=0).stop 2024-09-16T01:17:35.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 -- 172.21.15.162:0/4045138715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8100ad0 msgr2=0x7f2ca806aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:35.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8100ad0 0x7f2ca806aad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009230 tx=0x7f2c9c004340 comp rx=0 tx=0).stop 2024-09-16T01:17:35.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 -- 172.21.15.162:0/4045138715 shutdown_connections 2024-09-16T01:17:35.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2c980a3240 0x7f2c980a5700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ca8102690 0x7f2ca819f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca8101cd0 0x7f2ca819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 --2- 172.21.15.162:0/4045138715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ca8100ad0 0x7f2ca806aad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 -- 172.21.15.162:0/4045138715 >> 172.21.15.162:0/4045138715 conn(0x7f2ca80fc280 msgr2=0x7f2ca8105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:35.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 -- 172.21.15.162:0/4045138715 shutdown_connections 2024-09-16T01:17:35.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:17:35.831+0000 7f2caf221640 1 -- 172.21.15.162:0/4045138715 wait complete. 2024-09-16T01:17:36.387 DEBUG:teuthology.orchestra.run.smithi162:osd.4> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.4.service 2024-09-16T01:17:36.389 INFO:tasks.cephadm:Deploying osd.5 on smithi192 with /dev/vg_nvme/lv_3... 2024-09-16T01:17:36.389 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T01:17:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:17:37.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:36 smithi192 ceph-mon[34775]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:37.013 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:37.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:37.014 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:37.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:36 smithi063 ceph-mon[31070]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:37.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:37.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:37.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:37.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:36 smithi162 ceph-mon[34539]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:37.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:37.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:37.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:37.812 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:17:37 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4[45575]: 2024-09-16T01:17:37.517+0000 7f920a475640 -1 osd.4 0 log_to_monitors true 2024-09-16T01:17:37.813 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:37 smithi162 ceph-mon[34539]: from='osd.4 [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T01:17:37.813 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:37 smithi162 ceph-mon[34539]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T01:17:37.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:37 smithi192 ceph-mon[34775]: from='osd.4 [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T01:17:37.973 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:37 smithi192 ceph-mon[34775]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T01:17:38.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:37 smithi063 ceph-mon[31070]: from='osd.4 [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T01:17:38.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:37 smithi063 ceph-mon[31070]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T01:17:39.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:38 smithi192 ceph-mon[34775]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:39.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:38 smithi192 ceph-mon[34775]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T01:17:39.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:38 smithi192 ceph-mon[34775]: osdmap e31: 5 total, 4 up, 5 in 2024-09-16T01:17:39.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:39.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:38 smithi192 ceph-mon[34775]: from='osd.4 [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:17:39.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:38 smithi192 ceph-mon[34775]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:17:39.079 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:17:39.104 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_3 2024-09-16T01:17:39.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:38 smithi063 ceph-mon[31070]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:39.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:38 smithi063 ceph-mon[31070]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T01:17:39.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:38 smithi063 ceph-mon[31070]: osdmap e31: 5 total, 4 up, 5 in 2024-09-16T01:17:39.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:39.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:38 smithi063 ceph-mon[31070]: from='osd.4 [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:17:39.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:38 smithi063 ceph-mon[31070]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:17:39.149 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:17:38 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4[45575]: 2024-09-16T01:17:38.815+0000 7f92063f8640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T01:17:39.150 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:17:38 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4[45575]: 2024-09-16T01:17:38.824+0000 7f9202220640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:17:39.150 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:38 smithi162 ceph-mon[34539]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:39.150 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:38 smithi162 ceph-mon[34539]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T01:17:39.150 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:38 smithi162 ceph-mon[34539]: osdmap e31: 5 total, 4 up, 5 in 2024-09-16T01:17:39.150 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:39.150 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:38 smithi162 ceph-mon[34539]: from='osd.4 [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:17:39.150 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:38 smithi162 ceph-mon[34539]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:17:39.360 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:17:39.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 -- 172.21.15.192:0/2857442579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3124101cd0 msgr2=0x7f3124102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 --2- 172.21.15.192:0/2857442579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3124101cd0 0x7f3124102150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3120009900 tx=0x7f312002a410 comp rx=0 tx=0).stop 2024-09-16T01:17:39.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 -- 172.21.15.192:0/2857442579 shutdown_connections 2024-09-16T01:17:39.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 --2- 172.21.15.192:0/2857442579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3124102690 0x7f3124108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 --2- 172.21.15.192:0/2857442579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3124101cd0 0x7f3124102150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 --2- 172.21.15.192:0/2857442579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3124100ad0 0x7f3124100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 -- 172.21.15.192:0/2857442579 >> 172.21.15.192:0/2857442579 conn(0x7f31240fc280 msgr2=0x7f31240fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 -- 172.21.15.192:0/2857442579 shutdown_connections 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 -- 172.21.15.192:0/2857442579 wait complete. 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 Processor -- start 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.857+0000 7f312c2be640 1 -- start start 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312c2be640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3124100ad0 0x7f312419a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312c2be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3124101cd0 0x7f312419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312c2be640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3124102690 0x7f31241a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312c2be640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f312410c600 con 0x7f3124100ad0 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312c2be640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f312410c480 con 0x7f3124101cd0 2024-09-16T01:17:39.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312c2be640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f312410c780 con 0x7f3124102690 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312a85b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3124102690 0x7f31241a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312a85b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3124102690 0x7f31241a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48726/0 (socket says 172.21.15.192:48726) 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312a85b640 1 -- 172.21.15.192:0/2727013104 learned_addr learned my addr 172.21.15.192:0/2727013104 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f3129859640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3124101cd0 0x7f312419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312a05a640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3124100ad0 0x7f312419a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f3129859640 1 -- 172.21.15.192:0/2727013104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3124102690 msgr2=0x7f31241a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f3129859640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3124102690 0x7f31241a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f3129859640 1 -- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3124100ad0 msgr2=0x7f312419a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f3129859640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3124100ad0 0x7f312419a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f3129859640 1 -- 172.21.15.192:0/2727013104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31241a1ca0 con 0x7f3124101cd0 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312a85b640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3124102690 0x7f31241a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:17:39.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f312a05a640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3124100ad0 0x7f312419a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.858+0000 7f3129859640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3124101cd0 0x7f312419a5b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31200314e0 tx=0x7f3120004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.859+0000 7f311b7fe640 1 -- 172.21.15.192:0/2727013104 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312003f030 con 0x7f3124101cd0 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.859+0000 7f311b7fe640 1 -- 172.21.15.192:0/2727013104 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3120003aa0 con 0x7f3124101cd0 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.859+0000 7f312c2be640 1 -- 172.21.15.192:0/2727013104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31241a1f30 con 0x7f3124101cd0 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.859+0000 7f311b7fe640 1 -- 172.21.15.192:0/2727013104 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120035070 con 0x7f3124101cd0 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.859+0000 7f312c2be640 1 -- 172.21.15.192:0/2727013104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31241a2380 con 0x7f3124101cd0 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.860+0000 7f312c2be640 1 -- 172.21.15.192:0/2727013104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31241a25b0 con 0x7f3124101cd0 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.861+0000 7f311b7fe640 1 -- 172.21.15.192:0/2727013104 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3120042030 con 0x7f3124101cd0 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.861+0000 7f311b7fe640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f31100a3270 0x7f31100a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.861+0000 7f311b7fe640 1 -- 172.21.15.192:0/2727013104 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7f31200eefa0 con 0x7f3124101cd0 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.862+0000 7f312a05a640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f31100a3270 0x7f31100a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.862+0000 7f312a05a640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f31100a3270 0x7f31100a5730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3124101b30 tx=0x7f3114005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:39.865+0000 7f311b7fe640 1 -- 172.21.15.192:0/2727013104 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31200bcc90 con 0x7f3124101cd0 2024-09-16T01:17:39.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:17:39.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: osdmap e32: 5 total, 4 up, 5 in 2024-09-16T01:17:39.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:39.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:39.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:39.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:39.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:39.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:39.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:39.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:39.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:39.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:40.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:40.048+0000 7f312c2be640 1 -- 172.21.15.192:0/2727013104 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f312406a730 con 0x7f31100a3270 2024-09-16T01:17:40.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:17:40.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: osdmap e32: 5 total, 4 up, 5 in 2024-09-16T01:17:40.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:40.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:40.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:40.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:40.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:40.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:40.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:40.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:40.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:40.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:40.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: osdmap e32: 5 total, 4 up, 5 in 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:17:40.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:41.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:17:41.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:17:41.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:41.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi162 2024-09-16T01:17:41.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-16T01:17:41.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: osd.4 [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] boot 2024-09-16T01:17:41.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: osdmap e33: 5 total, 5 up, 5 in 2024-09-16T01:17:41.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:41.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:17:41.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:17:41.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:17:41.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:41.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:17:41.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:17:41.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:41.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi162 2024-09-16T01:17:41.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-16T01:17:41.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: osd.4 [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] boot 2024-09-16T01:17:41.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: osdmap e33: 5 total, 5 up, 5 in 2024-09-16T01:17:41.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:41.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:17:41.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:17:41.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:17:41.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:41.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:17:41.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:17:41.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-16T01:17:41.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi162 2024-09-16T01:17:41.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-16T01:17:41.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: osd.4 [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] boot 2024-09-16T01:17:41.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: osdmap e33: 5 total, 5 up, 5 in 2024-09-16T01:17:41.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T01:17:41.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:17:41.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:17:41.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:17:41.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:41 smithi192 ceph-mon[34775]: osdmap e34: 5 total, 5 up, 5 in 2024-09-16T01:17:42.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:41 smithi063 ceph-mon[31070]: osdmap e34: 5 total, 5 up, 5 in 2024-09-16T01:17:42.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:41 smithi162 ceph-mon[34539]: osdmap e34: 5 total, 5 up, 5 in 2024-09-16T01:17:43.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:42 smithi063 ceph-mon[31070]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:43.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:42 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/2490826508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae53db9-bbae-4a94-8e71-843209fc8204"}]: dispatch 2024-09-16T01:17:43.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:42 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae53db9-bbae-4a94-8e71-843209fc8204"}]: dispatch 2024-09-16T01:17:43.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:42 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cae53db9-bbae-4a94-8e71-843209fc8204"}]': finished 2024-09-16T01:17:43.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:42 smithi063 ceph-mon[31070]: osdmap e35: 6 total, 5 up, 6 in 2024-09-16T01:17:43.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:42 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:17:43.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:42 smithi192 ceph-mon[34775]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:43.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:42 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/2490826508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae53db9-bbae-4a94-8e71-843209fc8204"}]: dispatch 2024-09-16T01:17:43.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:42 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae53db9-bbae-4a94-8e71-843209fc8204"}]: dispatch 2024-09-16T01:17:43.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:42 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cae53db9-bbae-4a94-8e71-843209fc8204"}]': finished 2024-09-16T01:17:43.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:42 smithi192 ceph-mon[34775]: osdmap e35: 6 total, 5 up, 6 in 2024-09-16T01:17:43.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:42 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:17:43.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:42 smithi162 ceph-mon[34539]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:43.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:42 smithi162 ceph-mon[34539]: from='client.? 172.21.15.192:0/2490826508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae53db9-bbae-4a94-8e71-843209fc8204"}]: dispatch 2024-09-16T01:17:43.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:42 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cae53db9-bbae-4a94-8e71-843209fc8204"}]: dispatch 2024-09-16T01:17:43.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:42 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cae53db9-bbae-4a94-8e71-843209fc8204"}]': finished 2024-09-16T01:17:43.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:42 smithi162 ceph-mon[34539]: osdmap e35: 6 total, 5 up, 6 in 2024-09-16T01:17:43.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:42 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:17:44.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:43 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/665584876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:17:44.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:43 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/665584876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:17:44.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:43 smithi162 ceph-mon[34539]: from='client.? 172.21.15.192:0/665584876' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:17:45.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:44 smithi063 ceph-mon[31070]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:45.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:44 smithi192 ceph-mon[34775]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:44 smithi162 ceph-mon[34539]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:47.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:46 smithi063 ceph-mon[31070]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:47.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:46 smithi192 ceph-mon[34775]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:47.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:46 smithi162 ceph-mon[34539]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:49.094 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:48 smithi192 ceph-mon[34775]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:49.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:48 smithi063 ceph-mon[31070]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:49.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:48 smithi162 ceph-mon[34539]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:51.070 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:50 smithi192 ceph-mon[34775]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:51.070 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T01:17:51.070 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:51.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:50 smithi063 ceph-mon[31070]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:51.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T01:17:51.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:51.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:50 smithi162 ceph-mon[34539]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:51.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T01:17:51.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:17:52.008 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:51 smithi192 ceph-mon[34775]: Deploying daemon osd.5 on smithi192 2024-09-16T01:17:52.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:51 smithi063 ceph-mon[31070]: Deploying daemon osd.5 on smithi192 2024-09-16T01:17:52.198 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:51 smithi162 ceph-mon[34539]: Deploying daemon osd.5 on smithi192 2024-09-16T01:17:52.910 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:52 smithi192 ceph-mon[34775]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:53.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:52 smithi162 ceph-mon[34539]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:53.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:52 smithi063 ceph-mon[31070]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:55.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:54 smithi192 ceph-mon[34775]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:55.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:54 smithi162 ceph-mon[34539]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:55.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:54 smithi063 ceph-mon[31070]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:57.162 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:56 smithi192 ceph-mon[34775]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:57.163 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:57.163 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:57.163 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:57.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:56 smithi162 ceph-mon[34539]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:57.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:57.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:57.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:56 smithi063 ceph-mon[31070]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:17:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:57.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:17:59.124 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:17:58 smithi192 ceph-mon[34775]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:59.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:17:58 smithi162 ceph-mon[34539]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:59.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:17:58 smithi063 ceph-mon[31070]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:17:59.786 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 5 on host 'smithi192' 2024-09-16T01:17:59.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.785+0000 7f311b7fe640 1 -- 172.21.15.192:0/2727013104 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f312406a730 con 0x7f31100a3270 2024-09-16T01:17:59.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 -- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f31100a3270 msgr2=0x7f31100a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f31100a3270 0x7f31100a5730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3124101b30 tx=0x7f3114005f90 comp rx=0 tx=0).stop 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 -- 172.21.15.192:0/2727013104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3124101cd0 msgr2=0x7f312419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3124101cd0 0x7f312419a5b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31200314e0 tx=0x7f3120004270 comp rx=0 tx=0).stop 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 -- 172.21.15.192:0/2727013104 shutdown_connections 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f31100a3270 0x7f31100a5730 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3124102690 0x7f31241a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3124101cd0 0x7f312419a5b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 --2- 172.21.15.192:0/2727013104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3124100ad0 0x7f312419a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 -- 172.21.15.192:0/2727013104 >> 172.21.15.192:0/2727013104 conn(0x7f31240fc280 msgr2=0x7f312406a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 -- 172.21.15.192:0/2727013104 shutdown_connections 2024-09-16T01:17:59.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:17:59.787+0000 7f312c2be640 1 -- 172.21.15.192:0/2727013104 wait complete. 2024-09-16T01:18:00.399 DEBUG:teuthology.orchestra.run.smithi192:osd.5> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.5.service 2024-09-16T01:18:00.402 INFO:tasks.cephadm:Deploying osd.6 on smithi063 with /dev/vg_nvme/lv_2... 2024-09-16T01:18:00.402 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T01:18:00.672 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:18:00.917 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:00 smithi192 ceph-mon[34775]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:18:00.918 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:00 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:00.918 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:00 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:00.918 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:00 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:00.918 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:00 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:01.107 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:00 smithi063 ceph-mon[31070]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:18:01.107 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:00 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:01.107 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:00 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:01.107 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:00 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:01.107 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:00 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:01.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:00 smithi162 ceph-mon[34539]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:18:01.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:00 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:01.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:00 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:01.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:00 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:01.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:00 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:02.783 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:18:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:18:02.726+0000 7f542207e640 -1 osd.5 0 log_to_monitors true 2024-09-16T01:18:03.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:02 smithi063 ceph-mon[31070]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:18:03.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:02 smithi063 ceph-mon[31070]: from='osd.5 [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T01:18:03.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:02 smithi063 ceph-mon[31070]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T01:18:03.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:02 smithi192 ceph-mon[34775]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:18:03.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:02 smithi192 ceph-mon[34775]: from='osd.5 [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T01:18:03.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:02 smithi192 ceph-mon[34775]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T01:18:03.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:02 smithi162 ceph-mon[34539]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:18:03.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:02 smithi162 ceph-mon[34539]: from='osd.5 [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T01:18:03.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:02 smithi162 ceph-mon[34539]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T01:18:03.220 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:18:03.246 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi063:vg_nvme/lv_2 2024-09-16T01:18:03.509 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:18:03.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T01:18:03.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: osdmap e36: 6 total, 5 up, 6 in 2024-09-16T01:18:03.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:03.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='osd.5 [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:18:03.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:18:03.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:03.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:03.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:03.861 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:03.861 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:03.861 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:03.861 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:03.861 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:03.861 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:03.861 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:03.861 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:03.861 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.016+0000 7fb2595ea640 1 -- 172.21.15.63:0/3678574939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb254101c00 msgr2=0x7fb254102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.016+0000 7fb2595ea640 1 --2- 172.21.15.63:0/3678574939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb254101c00 0x7fb254102000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb244009900 tx=0x7fb24402a410 comp rx=0 tx=0).stop 2024-09-16T01:18:04.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.016+0000 7fb2595ea640 1 -- 172.21.15.63:0/3678574939 shutdown_connections 2024-09-16T01:18:04.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.016+0000 7fb2595ea640 1 --2- 172.21.15.63:0/3678574939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2541037c0 0x7fb25410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.016+0000 7fb2595ea640 1 --2- 172.21.15.63:0/3678574939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb254102e00 0x7fb254103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.016+0000 7fb2595ea640 1 --2- 172.21.15.63:0/3678574939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb254101c00 0x7fb254102000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.016+0000 7fb2595ea640 1 -- 172.21.15.63:0/3678574939 >> 172.21.15.63:0/3678574939 conn(0x7fb2540fd390 msgr2=0x7fb2540ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.016+0000 7fb2595ea640 1 -- 172.21.15.63:0/3678574939 shutdown_connections 2024-09-16T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.016+0000 7fb2595ea640 1 -- 172.21.15.63:0/3678574939 wait complete. 2024-09-16T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2595ea640 1 Processor -- start 2024-09-16T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2595ea640 1 -- start start 2024-09-16T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2595ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb254101c00 0x7fb254075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2595ea640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb254102e00 0x7fb2540745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2595ea640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2541037c0 0x7fb254074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2595ea640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb25410d790 con 0x7fb254102e00 2024-09-16T01:18:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2595ea640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb25410d610 con 0x7fb254101c00 2024-09-16T01:18:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2595ea640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb25410d910 con 0x7fb2541037c0 2024-09-16T01:18:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2527fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb254102e00 0x7fb2540745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2527fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb254102e00 0x7fb2540745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41990/0 (socket says 172.21.15.63:41990) 2024-09-16T01:18:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb2527fc640 1 -- 172.21.15.63:0/3104437760 learned_addr learned my addr 172.21.15.63:0/3104437760 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:18:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.017+0000 7fb252ffd640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb254101c00 0x7fb254075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb2537fe640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2541037c0 0x7fb254074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb2527fc640 1 -- 172.21.15.63:0/3104437760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2541037c0 msgr2=0x7fb254074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb2527fc640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2541037c0 0x7fb254074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb2527fc640 1 -- 172.21.15.63:0/3104437760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb254101c00 msgr2=0x7fb254075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb2527fc640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb254101c00 0x7fb254075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb2527fc640 1 -- 172.21.15.63:0/3104437760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2540753e0 con 0x7fb254102e00 2024-09-16T01:18:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb2527fc640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb254102e00 0x7fb2540745e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c890 tx=0x7fb24800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb23bfff640 1 -- 172.21.15.63:0/3104437760 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248004220 con 0x7fb254102e00 2024-09-16T01:18:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb2595ea640 1 -- 172.21.15.63:0/3104437760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2541a1fd0 con 0x7fb254102e00 2024-09-16T01:18:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb23bfff640 1 -- 172.21.15.63:0/3104437760 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb2480043c0 con 0x7fb254102e00 2024-09-16T01:18:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb23bfff640 1 -- 172.21.15.63:0/3104437760 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248004a00 con 0x7fb254102e00 2024-09-16T01:18:04.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.018+0000 7fb2595ea640 1 -- 172.21.15.63:0/3104437760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2541a2500 con 0x7fb254102e00 2024-09-16T01:18:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.019+0000 7fb2595ea640 1 -- 172.21.15.63:0/3104437760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2541090f0 con 0x7fb254102e00 2024-09-16T01:18:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.021+0000 7fb23bfff640 1 -- 172.21.15.63:0/3104437760 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb248004ba0 con 0x7fb254102e00 2024-09-16T01:18:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.022+0000 7fb23bfff640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb23c0a3240 0x7fb23c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.022+0000 7fb252ffd640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb23c0a3240 0x7fb23c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.022+0000 7fb23bfff640 1 -- 172.21.15.63:0/3104437760 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4253+0+0 (secure 0 0 0) 0x7fb2480cea70 con 0x7fb254102e00 2024-09-16T01:18:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.022+0000 7fb252ffd640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb23c0a3240 0x7fb23c0a5700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb244006010 tx=0x7fb244000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.025+0000 7fb23bfff640 1 -- 172.21.15.63:0/3104437760 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb248014030 con 0x7fb254102e00 2024-09-16T01:18:04.174 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:18:03.800+0000 7f541e001640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T01:18:04.174 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:18:03.805+0000 7f5419e29640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:18:04.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T01:18:04.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: osdmap e36: 6 total, 5 up, 6 in 2024-09-16T01:18:04.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:04.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='osd.5 [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:18:04.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:04.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: osdmap e36: 6 total, 5 up, 6 in 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='osd.5 [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:04.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:04.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:04.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:04.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:04.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:04.213+0000 7fb2595ea640 1 -- 172.21.15.63:0/3104437760 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb254062630 con 0x7fb23c0a3240 2024-09-16T01:18:04.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:04 smithi063 ceph-mon[31070]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:18:04.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:04 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi192 2024-09-16T01:18:04.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:04 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi192 to 8544M 2024-09-16T01:18:04.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:04 smithi063 ceph-mon[31070]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:18:04.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:04 smithi063 ceph-mon[31070]: osdmap e37: 6 total, 5 up, 6 in 2024-09-16T01:18:04.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:04 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:04.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:04 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:04.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:04 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:18:04.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:04 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:18:04.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:04 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:05.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:04 smithi192 ceph-mon[34775]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:18:05.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:04 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi192 2024-09-16T01:18:05.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:04 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi192 to 8544M 2024-09-16T01:18:05.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:04 smithi192 ceph-mon[34775]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:18:05.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:04 smithi192 ceph-mon[34775]: osdmap e37: 6 total, 5 up, 6 in 2024-09-16T01:18:05.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:04 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:05.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:04 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:05.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:04 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:18:05.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:04 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:18:05.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:04 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:05.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:04 smithi162 ceph-mon[34539]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-16T01:18:05.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:04 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi192 2024-09-16T01:18:05.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:04 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi192 to 8544M 2024-09-16T01:18:05.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:04 smithi162 ceph-mon[34539]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:18:05.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:04 smithi162 ceph-mon[34539]: osdmap e37: 6 total, 5 up, 6 in 2024-09-16T01:18:05.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:04 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:05.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:04 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:05.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:04 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:18:05.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:04 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:18:05.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:04 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:05.954 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:05 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:18:05.955 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:05 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:18:05.955 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:05 smithi063 ceph-mon[31070]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:18:05.955 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:05 smithi063 ceph-mon[31070]: osd.5 [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] boot 2024-09-16T01:18:05.955 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:05 smithi063 ceph-mon[31070]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T01:18:05.955 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:06.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:05 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:18:06.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:05 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:18:06.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:05 smithi192 ceph-mon[34775]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:18:06.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:05 smithi192 ceph-mon[34775]: osd.5 [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] boot 2024-09-16T01:18:06.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:05 smithi192 ceph-mon[34775]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T01:18:06.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:05 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:06.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:05 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:18:06.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:05 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:18:06.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:05 smithi162 ceph-mon[34539]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:18:06.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:05 smithi162 ceph-mon[34539]: osd.5 [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] boot 2024-09-16T01:18:06.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:05 smithi162 ceph-mon[34539]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T01:18:06.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:05 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T01:18:07.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:06 smithi063 ceph-mon[31070]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:07.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:06 smithi063 ceph-mon[31070]: osdmap e39: 6 total, 6 up, 6 in 2024-09-16T01:18:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:06 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1235650939' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46244e9b-0619-42f1-8f8a-815f21ab4e98"}]: dispatch 2024-09-16T01:18:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:06 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1235650939' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46244e9b-0619-42f1-8f8a-815f21ab4e98"}]': finished 2024-09-16T01:18:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:06 smithi063 ceph-mon[31070]: osdmap e40: 7 total, 6 up, 7 in 2024-09-16T01:18:07.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:07.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:06 smithi192 ceph-mon[34775]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:07.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:06 smithi192 ceph-mon[34775]: osdmap e39: 6 total, 6 up, 6 in 2024-09-16T01:18:07.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:06 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1235650939' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46244e9b-0619-42f1-8f8a-815f21ab4e98"}]: dispatch 2024-09-16T01:18:07.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:06 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1235650939' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46244e9b-0619-42f1-8f8a-815f21ab4e98"}]': finished 2024-09-16T01:18:07.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:06 smithi192 ceph-mon[34775]: osdmap e40: 7 total, 6 up, 7 in 2024-09-16T01:18:07.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:06 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:07.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:06 smithi162 ceph-mon[34539]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:07.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:06 smithi162 ceph-mon[34539]: osdmap e39: 6 total, 6 up, 6 in 2024-09-16T01:18:07.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:06 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1235650939' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46244e9b-0619-42f1-8f8a-815f21ab4e98"}]: dispatch 2024-09-16T01:18:07.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:06 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1235650939' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46244e9b-0619-42f1-8f8a-815f21ab4e98"}]': finished 2024-09-16T01:18:07.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:06 smithi162 ceph-mon[34539]: osdmap e40: 7 total, 6 up, 7 in 2024-09-16T01:18:07.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:06 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:08.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:07 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3325146685' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:18:08.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:07 smithi063 ceph-mon[31070]: osdmap e41: 7 total, 6 up, 7 in 2024-09-16T01:18:08.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:07 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:08.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:07 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3325146685' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:18:08.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:07 smithi192 ceph-mon[34775]: osdmap e41: 7 total, 6 up, 7 in 2024-09-16T01:18:08.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:07 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:08.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:07 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3325146685' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:18:08.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:07 smithi162 ceph-mon[34539]: osdmap e41: 7 total, 6 up, 7 in 2024-09-16T01:18:08.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:07 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:09.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:08 smithi063 ceph-mon[31070]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:09.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:08 smithi063 ceph-mon[31070]: osdmap e42: 7 total, 6 up, 7 in 2024-09-16T01:18:09.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:08 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:09.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:08 smithi192 ceph-mon[34775]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:09.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:08 smithi192 ceph-mon[34775]: osdmap e42: 7 total, 6 up, 7 in 2024-09-16T01:18:09.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:08 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:09.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:08 smithi162 ceph-mon[34539]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:09.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:08 smithi162 ceph-mon[34539]: osdmap e42: 7 total, 6 up, 7 in 2024-09-16T01:18:09.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:08 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:11.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:10 smithi063 ceph-mon[31070]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:11.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:10 smithi192 ceph-mon[34775]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:11.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:10 smithi162 ceph-mon[34539]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:13.112 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:12 smithi063 ceph-mon[31070]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:13.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:12 smithi192 ceph-mon[34775]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:13.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:12 smithi162 ceph-mon[34539]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:14.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:14 smithi063 ceph-mon[31070]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-16T01:18:15.173 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:14 smithi192 ceph-mon[34775]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-16T01:18:15.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:14 smithi162 ceph-mon[34539]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-16T01:18:16.084 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-16T01:18:16.085 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:16.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-16T01:18:16.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:16.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-16T01:18:16.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:17.096 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:16 smithi063 ceph-mon[31070]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T01:18:17.096 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:16 smithi063 ceph-mon[31070]: Deploying daemon osd.6 on smithi063 2024-09-16T01:18:17.097 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:16 smithi192 ceph-mon[34775]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T01:18:17.097 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:16 smithi192 ceph-mon[34775]: Deploying daemon osd.6 on smithi063 2024-09-16T01:18:17.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:16 smithi162 ceph-mon[34539]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-16T01:18:17.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:16 smithi162 ceph-mon[34539]: Deploying daemon osd.6 on smithi063 2024-09-16T01:18:19.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:18 smithi063 ceph-mon[31070]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-16T01:18:19.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:18 smithi192 ceph-mon[34775]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-16T01:18:19.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:18 smithi162 ceph-mon[34539]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-16T01:18:21.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:20 smithi063 ceph-mon[31070]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-16T01:18:21.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:20 smithi192 ceph-mon[34775]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-16T01:18:21.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:20 smithi162 ceph-mon[34539]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-16T01:18:22.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:21 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:22.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:21 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:22.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:21 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:22.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:21 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:22.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:21 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:22.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:21 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:22.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:21 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:22.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:21 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:22.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:21 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:23.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:22 smithi063 ceph-mon[31070]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T01:18:23.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:22 smithi192 ceph-mon[34775]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T01:18:23.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:22 smithi162 ceph-mon[34539]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T01:18:24.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.851+0000 7fb23bfff640 1 -- 172.21.15.63:0/3104437760 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb254062630 con 0x7fb23c0a3240 2024-09-16T01:18:24.853 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 6 on host 'smithi063' 2024-09-16T01:18:24.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 -- 172.21.15.63:0/3104437760 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb23c0a3240 msgr2=0x7fb23c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:24.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb23c0a3240 0x7fb23c0a5700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb244006010 tx=0x7fb244000bc0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 -- 172.21.15.63:0/3104437760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb254102e00 msgr2=0x7fb2540745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:24.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb254102e00 0x7fb2540745e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb24800c890 tx=0x7fb24800cd50 comp rx=0 tx=0).stop 2024-09-16T01:18:24.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 -- 172.21.15.63:0/3104437760 shutdown_connections 2024-09-16T01:18:24.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb23c0a3240 0x7fb23c0a5700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2541037c0 0x7fb254074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb254102e00 0x7fb2540745e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 --2- 172.21.15.63:0/3104437760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb254101c00 0x7fb254075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 -- 172.21.15.63:0/3104437760 >> 172.21.15.63:0/3104437760 conn(0x7fb2540fd390 msgr2=0x7fb2541062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:24.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 -- 172.21.15.63:0/3104437760 shutdown_connections 2024-09-16T01:18:24.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:18:24.853+0000 7fb2595ea640 1 -- 172.21.15.63:0/3104437760 wait complete. 2024-09-16T01:18:25.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:24 smithi063 ceph-mon[31070]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T01:18:25.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:24 smithi192 ceph-mon[34775]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T01:18:25.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:24 smithi162 ceph-mon[34539]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T01:18:25.546 DEBUG:teuthology.orchestra.run.smithi063:osd.6> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.6.service 2024-09-16T01:18:25.548 INFO:tasks.cephadm:Deploying osd.7 on smithi162 with /dev/vg_nvme/lv_2... 2024-09-16T01:18:25.549 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T01:18:25.808 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:18:26.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.147 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.147 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.147 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.147 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:26.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:27.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:26 smithi063 ceph-mon[31070]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:27.154 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:26 smithi162 ceph-mon[34539]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:27.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:26 smithi192 ceph-mon[34775]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:27.824 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:18:27 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:18:27.586+0000 7ff505fe4640 -1 osd.6 0 log_to_monitors true 2024-09-16T01:18:28.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:27 smithi063 ceph-mon[31070]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-16T01:18:28.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:27 smithi192 ceph-mon[34775]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-16T01:18:28.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:27 smithi162 ceph-mon[34539]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-16T01:18:28.243 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:18:28.268 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-09-16T01:18:28.524 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:18:29.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.019+0000 7fe69359e640 1 -- 172.21.15.162:0/343915018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe694102510 msgr2=0x7fe694108da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.019+0000 7fe69359e640 1 --2- 172.21.15.162:0/343915018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe694102510 0x7fe694108da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe68c009ca0 tx=0x7fe68c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.020+0000 7fe69359e640 1 -- 172.21.15.162:0/343915018 shutdown_connections 2024-09-16T01:18:29.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.020+0000 7fe69359e640 1 --2- 172.21.15.162:0/343915018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe694102510 0x7fe694108da0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.020+0000 7fe69359e640 1 --2- 172.21.15.162:0/343915018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe694101b50 0x7fe694101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.020+0000 7fe69359e640 1 --2- 172.21.15.162:0/343915018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe694100950 0x7fe694100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.020+0000 7fe69359e640 1 -- 172.21.15.162:0/343915018 >> 172.21.15.162:0/343915018 conn(0x7fe6940fc0e0 msgr2=0x7fe6940fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:29.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.020+0000 7fe69359e640 1 -- 172.21.15.162:0/343915018 shutdown_connections 2024-09-16T01:18:29.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.020+0000 7fe69359e640 1 -- 172.21.15.162:0/343915018 wait complete. 2024-09-16T01:18:29.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.020+0000 7fe69359e640 1 Processor -- start 2024-09-16T01:18:29.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.020+0000 7fe69359e640 1 -- start start 2024-09-16T01:18:29.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe69359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe694100950 0x7fe694196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe69359e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe694101b50 0x7fe694197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe69359e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe694102510 0x7fe69419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe69359e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe69410c480 con 0x7fe694100950 2024-09-16T01:18:29.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe69359e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe69410c300 con 0x7fe694101b50 2024-09-16T01:18:29.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe69359e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe69410c600 con 0x7fe694102510 2024-09-16T01:18:29.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe691d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe694101b50 0x7fe694197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe691d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe694101b50 0x7fe694197050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:59706/0 (socket says 172.21.15.162:59706) 2024-09-16T01:18:29.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe691d9b640 1 -- 172.21.15.162:0/2637099905 learned_addr learned my addr 172.21.15.162:0/2637099905 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-16T01:18:29.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe69259c640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe694100950 0x7fe694196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe692d9d640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe694102510 0x7fe69419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe691d9b640 1 -- 172.21.15.162:0/2637099905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe694102510 msgr2=0x7fe69419e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe691d9b640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe694102510 0x7fe69419e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe691d9b640 1 -- 172.21.15.162:0/2637099905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe694100950 msgr2=0x7fe694196b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe691d9b640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe694100950 0x7fe694196b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe691d9b640 1 -- 172.21.15.162:0/2637099905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69419e740 con 0x7fe694101b50 2024-09-16T01:18:29.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe692d9d640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe694102510 0x7fe69419e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:29.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe691d9b640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe694101b50 0x7fe694197050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe68800d950 tx=0x7fe68800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.021+0000 7fe6837fe640 1 -- 172.21.15.162:0/2637099905 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe688017030 con 0x7fe694101b50 2024-09-16T01:18:29.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.022+0000 7fe6837fe640 1 -- 172.21.15.162:0/2637099905 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe688004020 con 0x7fe694101b50 2024-09-16T01:18:29.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.022+0000 7fe69359e640 1 -- 172.21.15.162:0/2637099905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69419ea30 con 0x7fe694101b50 2024-09-16T01:18:29.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.022+0000 7fe6837fe640 1 -- 172.21.15.162:0/2637099905 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6880047a0 con 0x7fe694101b50 2024-09-16T01:18:29.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.022+0000 7fe69359e640 1 -- 172.21.15.162:0/2637099905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe69419efc0 con 0x7fe694101b50 2024-09-16T01:18:29.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.023+0000 7fe69359e640 1 -- 172.21.15.162:0/2637099905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe694107dc0 con 0x7fe694101b50 2024-09-16T01:18:29.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.025+0000 7fe6837fe640 1 -- 172.21.15.162:0/2637099905 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe6880041d0 con 0x7fe694101b50 2024-09-16T01:18:29.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.026+0000 7fe6837fe640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe67c0a32f0 0x7fe67c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.026+0000 7fe6837fe640 1 -- 172.21.15.162:0/2637099905 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4685+0+0 (secure 0 0 0) 0x7fe6880ceb40 con 0x7fe694101b50 2024-09-16T01:18:29.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.026+0000 7fe69259c640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe67c0a32f0 0x7fe67c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.026+0000 7fe69259c640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe67c0a32f0 0x7fe67c0a57b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe6840058c0 tx=0x7fe68400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.028+0000 7fe6837fe640 1 -- 172.21.15.162:0/2637099905 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe68809c710 con 0x7fe694101b50 2024-09-16T01:18:29.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:28 smithi192 ceph-mon[34775]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:29.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:28 smithi192 ceph-mon[34775]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-16T01:18:29.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:28 smithi192 ceph-mon[34775]: osdmap e43: 7 total, 6 up, 7 in 2024-09-16T01:18:29.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:28 smithi192 ceph-mon[34775]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:18:29.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:29.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:28 smithi162 ceph-mon[34539]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:29.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:28 smithi162 ceph-mon[34539]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-16T01:18:29.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:28 smithi162 ceph-mon[34539]: osdmap e43: 7 total, 6 up, 7 in 2024-09-16T01:18:29.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:28 smithi162 ceph-mon[34539]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:18:29.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:29.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:29.209+0000 7fe69359e640 1 -- 172.21.15.162:0/2637099905 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe694062630 con 0x7fe67c0a32f0 2024-09-16T01:18:29.289 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:28 smithi063 ceph-mon[31070]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:29.289 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:28 smithi063 ceph-mon[31070]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-16T01:18:29.289 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:28 smithi063 ceph-mon[31070]: osdmap e43: 7 total, 6 up, 7 in 2024-09-16T01:18:29.289 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:28 smithi063 ceph-mon[31070]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:18:29.289 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:29.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:18:29.316+0000 7ff501f67640 -1 osd.6 0 waiting for initial osdmap 2024-09-16T01:18:29.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:18:29.324+0000 7ff4f9d87640 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:18:30.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:18:30.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: osdmap e44: 7 total, 6 up, 7 in 2024-09-16T01:18:30.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:30.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:30.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:18:30.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:30.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:30.176 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:30.176 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:29 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:18:30.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: osdmap e44: 7 total, 6 up, 7 in 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:30.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:30.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:30.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:30.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:30.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:30.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:29 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: osdmap e44: 7 total, 6 up, 7 in 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237]' entity='osd.6' 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:30.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:30.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:30.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:30.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:30.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:30.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:30.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:30.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:29 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:30 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:18:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:30 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:18:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:30 smithi162 ceph-mon[34539]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:30 smithi162 ceph-mon[34539]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:18:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:30 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi063 2024-09-16T01:18:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:30 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi063 to 5696M 2024-09-16T01:18:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:30 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:30 smithi162 ceph-mon[34539]: osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] boot 2024-09-16T01:18:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:30 smithi162 ceph-mon[34539]: osdmap e45: 7 total, 7 up, 7 in 2024-09-16T01:18:31.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:30 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:31.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:30 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:18:31.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:30 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:18:31.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:30 smithi192 ceph-mon[34775]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:31.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:30 smithi192 ceph-mon[34775]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:18:31.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:30 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi063 2024-09-16T01:18:31.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:30 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi063 to 5696M 2024-09-16T01:18:31.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:30 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:31.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:30 smithi192 ceph-mon[34775]: osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] boot 2024-09-16T01:18:31.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:30 smithi192 ceph-mon[34775]: osdmap e45: 7 total, 7 up, 7 in 2024-09-16T01:18:31.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:30 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:31.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:30 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:18:31.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:30 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:18:31.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:30 smithi063 ceph-mon[31070]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-16T01:18:31.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:30 smithi063 ceph-mon[31070]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:18:31.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:30 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi063 2024-09-16T01:18:31.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:30 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi063 to 5696M 2024-09-16T01:18:31.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:30 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:31.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:30 smithi063 ceph-mon[31070]: osd.6 [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] boot 2024-09-16T01:18:31.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:30 smithi063 ceph-mon[31070]: osdmap e45: 7 total, 7 up, 7 in 2024-09-16T01:18:31.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:30 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-16T01:18:32.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:32 smithi063 ceph-mon[31070]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:32.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:32 smithi063 ceph-mon[31070]: osdmap e46: 7 total, 7 up, 7 in 2024-09-16T01:18:32.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:32 smithi063 ceph-mon[31070]: from='client.? 172.21.15.162:0/3683712163' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c588431-8c7a-4d8f-b02b-22e2adabc3d3"}]: dispatch 2024-09-16T01:18:32.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:32 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c588431-8c7a-4d8f-b02b-22e2adabc3d3"}]: dispatch 2024-09-16T01:18:32.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:32 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c588431-8c7a-4d8f-b02b-22e2adabc3d3"}]': finished 2024-09-16T01:18:32.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:32 smithi063 ceph-mon[31070]: osdmap e47: 8 total, 7 up, 8 in 2024-09-16T01:18:32.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:32.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:32 smithi192 ceph-mon[34775]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:32.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:32 smithi192 ceph-mon[34775]: osdmap e46: 7 total, 7 up, 7 in 2024-09-16T01:18:32.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:32 smithi192 ceph-mon[34775]: from='client.? 172.21.15.162:0/3683712163' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c588431-8c7a-4d8f-b02b-22e2adabc3d3"}]: dispatch 2024-09-16T01:18:32.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:32 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c588431-8c7a-4d8f-b02b-22e2adabc3d3"}]: dispatch 2024-09-16T01:18:32.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:32 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c588431-8c7a-4d8f-b02b-22e2adabc3d3"}]': finished 2024-09-16T01:18:32.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:32 smithi192 ceph-mon[34775]: osdmap e47: 8 total, 7 up, 8 in 2024-09-16T01:18:32.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:32 smithi162 ceph-mon[34539]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:32 smithi162 ceph-mon[34539]: osdmap e46: 7 total, 7 up, 7 in 2024-09-16T01:18:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:32 smithi162 ceph-mon[34539]: from='client.? 172.21.15.162:0/3683712163' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c588431-8c7a-4d8f-b02b-22e2adabc3d3"}]: dispatch 2024-09-16T01:18:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:32 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c588431-8c7a-4d8f-b02b-22e2adabc3d3"}]: dispatch 2024-09-16T01:18:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:32 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c588431-8c7a-4d8f-b02b-22e2adabc3d3"}]': finished 2024-09-16T01:18:32.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:32 smithi162 ceph-mon[34539]: osdmap e47: 8 total, 7 up, 8 in 2024-09-16T01:18:32.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:33.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:33 smithi063 ceph-mon[31070]: from='client.? 172.21.15.162:0/624307437' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:18:33.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:33 smithi192 ceph-mon[34775]: from='client.? 172.21.15.162:0/624307437' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:18:33.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:33 smithi162 ceph-mon[34539]: from='client.? 172.21.15.162:0/624307437' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:18:34.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:34 smithi063 ceph-mon[31070]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:34.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:34 smithi192 ceph-mon[34775]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:34.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:34 smithi162 ceph-mon[34539]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:36.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:36 smithi063 ceph-mon[31070]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:36.640 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:36 smithi162 ceph-mon[34539]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:36.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:36 smithi192 ceph-mon[34775]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:38.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:38 smithi063 ceph-mon[31070]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:38.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:38 smithi192 ceph-mon[34775]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:38.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:38 smithi162 ceph-mon[34539]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:40.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:40 smithi063 ceph-mon[31070]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:40.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-16T01:18:40.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:40.648 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:40 smithi162 ceph-mon[34539]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:40.648 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-16T01:18:40.648 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:40 smithi192 ceph-mon[34775]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-16T01:18:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:41.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:41 smithi063 ceph-mon[31070]: Deploying daemon osd.7 on smithi162 2024-09-16T01:18:41.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:41 smithi162 ceph-mon[34539]: Deploying daemon osd.7 on smithi162 2024-09-16T01:18:41.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:41 smithi192 ceph-mon[34775]: Deploying daemon osd.7 on smithi162 2024-09-16T01:18:42.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:42 smithi063 ceph-mon[31070]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:42.662 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:42 smithi162 ceph-mon[34539]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:42.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:42 smithi192 ceph-mon[34775]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:44.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:44 smithi192 ceph-mon[34775]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:44.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:44 smithi162 ceph-mon[34539]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:44.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:44 smithi063 ceph-mon[31070]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:46.652 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:46 smithi162 ceph-mon[34539]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:46.652 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:46.652 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:46.652 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:46 smithi192 ceph-mon[34775]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:46 smithi063 ceph-mon[31070]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:48.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:48 smithi162 ceph-mon[34539]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:48.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:48 smithi192 ceph-mon[34775]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:48.861 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:48 smithi063 ceph-mon[31070]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:50.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.033+0000 7fe6837fe640 1 -- 172.21.15.162:0/2637099905 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe694062630 con 0x7fe67c0a32f0 2024-09-16T01:18:50.035 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 7 on host 'smithi162' 2024-09-16T01:18:50.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.035+0000 7fe69359e640 1 -- 172.21.15.162:0/2637099905 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe67c0a32f0 msgr2=0x7fe67c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:50.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.035+0000 7fe69359e640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe67c0a32f0 0x7fe67c0a57b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe6840058c0 tx=0x7fe68400a2d0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.035+0000 7fe69359e640 1 -- 172.21.15.162:0/2637099905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe694101b50 msgr2=0x7fe694197050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:50.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.035+0000 7fe69359e640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe694101b50 0x7fe694197050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe68800d950 tx=0x7fe68800de10 comp rx=0 tx=0).stop 2024-09-16T01:18:50.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.036+0000 7fe69359e640 1 -- 172.21.15.162:0/2637099905 shutdown_connections 2024-09-16T01:18:50.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.036+0000 7fe69359e640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe67c0a32f0 0x7fe67c0a57b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.036+0000 7fe69359e640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe694102510 0x7fe69419e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.036+0000 7fe69359e640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe694101b50 0x7fe694197050 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.036+0000 7fe69359e640 1 --2- 172.21.15.162:0/2637099905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe694100950 0x7fe694196b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.036+0000 7fe69359e640 1 -- 172.21.15.162:0/2637099905 >> 172.21.15.162:0/2637099905 conn(0x7fe6940fc0e0 msgr2=0x7fe694104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:50.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.036+0000 7fe69359e640 1 -- 172.21.15.162:0/2637099905 shutdown_connections 2024-09-16T01:18:50.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:18:50.036+0000 7fe69359e640 1 -- 172.21.15.162:0/2637099905 wait complete. 2024-09-16T01:18:50.356 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:50.356 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:50.357 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:50.357 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:50.357 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:50.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:50.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:50.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:50.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:50.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:50.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:50.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:50.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:50.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:50.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:50.668 DEBUG:teuthology.orchestra.run.smithi162:osd.7> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.7.service 2024-09-16T01:18:50.670 INFO:tasks.cephadm:Deploying osd.8 on smithi192 with /dev/vg_nvme/lv_2... 2024-09-16T01:18:50.671 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T01:18:50.925 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:18:51.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:50 smithi162 ceph-mon[34539]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:51.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:51.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:51.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:51.244 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:50 smithi192 ceph-mon[34775]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:51.244 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:51.244 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:51.244 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:51.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:50 smithi063 ceph-mon[31070]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:51.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:18:51.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:51.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:52.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:18:52 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:18:52.025+0000 7fdddc652640 -1 osd.7 0 log_to_monitors true 2024-09-16T01:18:53.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:52 smithi162 ceph-mon[34539]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:53.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:52 smithi162 ceph-mon[34539]: from='osd.7 [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T01:18:53.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:52 smithi162 ceph-mon[34539]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T01:18:53.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:52 smithi063 ceph-mon[31070]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:53.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:52 smithi063 ceph-mon[31070]: from='osd.7 [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T01:18:53.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:52 smithi063 ceph-mon[31070]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T01:18:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:52 smithi192 ceph-mon[34775]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:52 smithi192 ceph-mon[34775]: from='osd.7 [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T01:18:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:52 smithi192 ceph-mon[34775]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-16T01:18:53.476 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:18:53.503 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_2 2024-09-16T01:18:53.770 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:18:54.119 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-16T01:18:54.119 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: osdmap e48: 8 total, 7 up, 8 in 2024-09-16T01:18:54.119 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:54.119 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='osd.7 [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:18:54.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:18:54.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:54.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:54.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:54.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:54.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:54.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:54 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.202+0000 7fd15dcdd640 1 -- 172.21.15.192:0/194109091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd158101cd0 msgr2=0x7fd158102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.202+0000 7fd15dcdd640 1 --2- 172.21.15.192:0/194109091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd158101cd0 0x7fd158102150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd14c009900 tx=0x7fd14c02a410 comp rx=0 tx=0).stop 2024-09-16T01:18:54.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.202+0000 7fd15dcdd640 1 -- 172.21.15.192:0/194109091 shutdown_connections 2024-09-16T01:18:54.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.202+0000 7fd15dcdd640 1 --2- 172.21.15.192:0/194109091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd158102690 0x7fd158108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.202+0000 7fd15dcdd640 1 --2- 172.21.15.192:0/194109091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd158101cd0 0x7fd158102150 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.202+0000 7fd15dcdd640 1 --2- 172.21.15.192:0/194109091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd158100ad0 0x7fd158100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.202+0000 7fd15dcdd640 1 -- 172.21.15.192:0/194109091 >> 172.21.15.192:0/194109091 conn(0x7fd1580fc280 msgr2=0x7fd1580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:54.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.203+0000 7fd15dcdd640 1 -- 172.21.15.192:0/194109091 shutdown_connections 2024-09-16T01:18:54.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.203+0000 7fd15dcdd640 1 -- 172.21.15.192:0/194109091 wait complete. 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.203+0000 7fd15dcdd640 1 Processor -- start 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.203+0000 7fd15dcdd640 1 -- start start 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.203+0000 7fd15dcdd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd158100ad0 0x7fd158104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.203+0000 7fd15dcdd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd158101cd0 0x7fd1581030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.203+0000 7fd15dcdd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd158102690 0x7fd1581035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.203+0000 7fd15dcdd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd15810c5e0 con 0x7fd158101cd0 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.203+0000 7fd15dcdd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd15810c460 con 0x7fd158100ad0 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.203+0000 7fd15dcdd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd15810c760 con 0x7fd158102690 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd157fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd158102690 0x7fd1581035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd157fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd158102690 0x7fd1581035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39548/0 (socket says 172.21.15.192:39548) 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd157fff640 1 -- 172.21.15.192:0/3725517734 learned_addr learned my addr 172.21.15.192:0/3725517734 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:18:54.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd1577fe640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd158100ad0 0x7fd158104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd156ffd640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd158101cd0 0x7fd1581030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd157fff640 1 -- 172.21.15.192:0/3725517734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd158100ad0 msgr2=0x7fd158104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd157fff640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd158100ad0 0x7fd158104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd157fff640 1 -- 172.21.15.192:0/3725517734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd158101cd0 msgr2=0x7fd1581030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd157fff640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd158101cd0 0x7fd1581030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd157fff640 1 -- 172.21.15.192:0/3725517734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd158103eb0 con 0x7fd158102690 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd1577fe640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd158100ad0 0x7fd158104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd157fff640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd158102690 0x7fd1581035f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd15000eaa0 tx=0x7fd15000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd154ff9640 1 -- 172.21.15.192:0/3725517734 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15000cdb0 con 0x7fd158102690 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd154ff9640 1 -- 172.21.15.192:0/3725517734 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd150005020 con 0x7fd158102690 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd15dcdd640 1 -- 172.21.15.192:0/3725517734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1581a1f40 con 0x7fd158102690 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd154ff9640 1 -- 172.21.15.192:0/3725517734 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1500116d0 con 0x7fd158102690 2024-09-16T01:18:54.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.204+0000 7fd15dcdd640 1 -- 172.21.15.192:0/3725517734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1581a23a0 con 0x7fd158102690 2024-09-16T01:18:54.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.205+0000 7fd15dcdd640 1 -- 172.21.15.192:0/3725517734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1581a2630 con 0x7fd158102690 2024-09-16T01:18:54.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.206+0000 7fd154ff9640 1 -- 172.21.15.192:0/3725517734 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd1500051d0 con 0x7fd158102690 2024-09-16T01:18:54.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.207+0000 7fd154ff9640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1400a3240 0x7fd1400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.207+0000 7fd154ff9640 1 -- 172.21.15.192:0/3725517734 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5117+0+0 (secure 0 0 0) 0x7fd1500cf2d0 con 0x7fd158102690 2024-09-16T01:18:54.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.207+0000 7fd1577fe640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1400a3240 0x7fd1400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.208+0000 7fd1577fe640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1400a3240 0x7fd1400a5700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd158101b30 tx=0x7fd14800a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.210+0000 7fd154ff9640 1 -- 172.21.15.192:0/3725517734 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd150016030 con 0x7fd158102690 2024-09-16T01:18:54.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-16T01:18:54.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: osdmap e48: 8 total, 7 up, 8 in 2024-09-16T01:18:54.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:54.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='osd.7 [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:18:54.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:18:54.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:54.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:54.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:54.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:54.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:54.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:18:54.388+0000 7fd15dcdd640 1 -- 172.21.15.192:0/3725517734 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd1581a2800 con 0x7fd1400a3240 2024-09-16T01:18:54.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:18:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:18:54.002+0000 7fddd85d5640 -1 osd.7 0 waiting for initial osdmap 2024-09-16T01:18:54.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:18:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:18:54.010+0000 7fddd43fd640 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: osdmap e48: 8 total, 7 up, 8 in 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='osd.7 [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:18:54.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:54.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:54.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:18:54.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:18:55.108 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:55 smithi192 ceph-mon[34775]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:55.108 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:55 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi162 2024-09-16T01:18:55.108 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:55 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-16T01:18:55.108 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:55 smithi192 ceph-mon[34775]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:18:55.108 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:55 smithi192 ceph-mon[34775]: osdmap e49: 8 total, 7 up, 8 in 2024-09-16T01:18:55.108 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:55 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:55.108 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:55 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:55.109 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:55 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:18:55.109 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:55 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:18:55.109 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:55 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:55.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:55 smithi063 ceph-mon[31070]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:55.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:55 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi162 2024-09-16T01:18:55.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:55 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-16T01:18:55.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:55 smithi063 ceph-mon[31070]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:18:55.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:55 smithi063 ceph-mon[31070]: osdmap e49: 8 total, 7 up, 8 in 2024-09-16T01:18:55.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:55 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:55.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:55 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:55.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:55 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:18:55.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:55 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:18:55.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:55 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:55.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:55 smithi162 ceph-mon[34539]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-16T01:18:55.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:55 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi162 2024-09-16T01:18:55.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:55 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-16T01:18:55.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:55 smithi162 ceph-mon[34539]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:18:55.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:55 smithi162 ceph-mon[34539]: osdmap e49: 8 total, 7 up, 8 in 2024-09-16T01:18:55.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:55 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:55.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:55 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:55.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:55 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:18:55.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:55 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:18:55.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:55 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:18:56.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:56 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:18:56.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:56 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:18:56.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:56 smithi192 ceph-mon[34775]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:18:56.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:56 smithi192 ceph-mon[34775]: osd.7 [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] boot 2024-09-16T01:18:56.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:56 smithi192 ceph-mon[34775]: osdmap e50: 8 total, 8 up, 8 in 2024-09-16T01:18:56.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:56.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:56 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:18:56.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:56 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:18:56.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:56 smithi063 ceph-mon[31070]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:18:56.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:56 smithi063 ceph-mon[31070]: osd.7 [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] boot 2024-09-16T01:18:56.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:56 smithi063 ceph-mon[31070]: osdmap e50: 8 total, 8 up, 8 in 2024-09-16T01:18:56.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:56.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:56 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:18:56.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:56 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:18:56.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:56 smithi162 ceph-mon[34539]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:18:56.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:56 smithi162 ceph-mon[34539]: osd.7 [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] boot 2024-09-16T01:18:56.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:56 smithi162 ceph-mon[34539]: osdmap e50: 8 total, 8 up, 8 in 2024-09-16T01:18:56.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-16T01:18:57.312 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:57 smithi192 ceph-mon[34775]: pgmap v169: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:18:57.312 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:57 smithi192 ceph-mon[34775]: osdmap e51: 8 total, 8 up, 8 in 2024-09-16T01:18:57.312 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:57 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/3811264872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51d7f064-3b9d-4556-bc0d-1275eaef7ea0"}]: dispatch 2024-09-16T01:18:57.313 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:57 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51d7f064-3b9d-4556-bc0d-1275eaef7ea0"}]: dispatch 2024-09-16T01:18:57.313 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:57 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51d7f064-3b9d-4556-bc0d-1275eaef7ea0"}]': finished 2024-09-16T01:18:57.313 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:57 smithi192 ceph-mon[34775]: osdmap e52: 9 total, 8 up, 9 in 2024-09-16T01:18:57.313 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:57 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:18:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:57 smithi063 ceph-mon[31070]: pgmap v169: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:18:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:57 smithi063 ceph-mon[31070]: osdmap e51: 8 total, 8 up, 8 in 2024-09-16T01:18:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:57 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/3811264872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51d7f064-3b9d-4556-bc0d-1275eaef7ea0"}]: dispatch 2024-09-16T01:18:57.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:57 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51d7f064-3b9d-4556-bc0d-1275eaef7ea0"}]: dispatch 2024-09-16T01:18:57.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:57 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51d7f064-3b9d-4556-bc0d-1275eaef7ea0"}]': finished 2024-09-16T01:18:57.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:57 smithi063 ceph-mon[31070]: osdmap e52: 9 total, 8 up, 9 in 2024-09-16T01:18:57.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:57 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:18:57.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:57 smithi162 ceph-mon[34539]: pgmap v169: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:18:57.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:57 smithi162 ceph-mon[34539]: osdmap e51: 8 total, 8 up, 8 in 2024-09-16T01:18:57.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:57 smithi162 ceph-mon[34539]: from='client.? 172.21.15.192:0/3811264872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51d7f064-3b9d-4556-bc0d-1275eaef7ea0"}]: dispatch 2024-09-16T01:18:57.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:57 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "51d7f064-3b9d-4556-bc0d-1275eaef7ea0"}]: dispatch 2024-09-16T01:18:57.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:57 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "51d7f064-3b9d-4556-bc0d-1275eaef7ea0"}]': finished 2024-09-16T01:18:57.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:57 smithi162 ceph-mon[34539]: osdmap e52: 9 total, 8 up, 9 in 2024-09-16T01:18:57.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:57 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:18:58.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:58 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/2583987887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:18:58.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:58 smithi063 ceph-mon[31070]: osdmap e53: 9 total, 8 up, 9 in 2024-09-16T01:18:58.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:58 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:18:58.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:58 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/2583987887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:18:58.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:58 smithi192 ceph-mon[34775]: osdmap e53: 9 total, 8 up, 9 in 2024-09-16T01:18:58.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:58 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:18:58.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:58 smithi162 ceph-mon[34539]: from='client.? 172.21.15.192:0/2583987887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:18:58.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:58 smithi162 ceph-mon[34539]: osdmap e53: 9 total, 8 up, 9 in 2024-09-16T01:18:58.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:58 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:18:59.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:59 smithi063 ceph-mon[31070]: pgmap v172: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:18:59.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:59 smithi063 ceph-mon[31070]: osdmap e54: 9 total, 8 up, 9 in 2024-09-16T01:18:59.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:18:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:18:59.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:59 smithi192 ceph-mon[34775]: pgmap v172: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:18:59.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:59 smithi192 ceph-mon[34775]: osdmap e54: 9 total, 8 up, 9 in 2024-09-16T01:18:59.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:18:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:18:59.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:59 smithi162 ceph-mon[34539]: pgmap v172: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:18:59.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:59 smithi162 ceph-mon[34539]: osdmap e54: 9 total, 8 up, 9 in 2024-09-16T01:18:59.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:18:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:01.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:01 smithi063 ceph-mon[31070]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:01.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:01 smithi192 ceph-mon[34775]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:01.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:01 smithi162 ceph-mon[34539]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:03.264 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:03 smithi192 ceph-mon[34775]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:03.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:03 smithi063 ceph-mon[31070]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:03.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:03 smithi162 ceph-mon[34539]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:05.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:05 smithi063 ceph-mon[31070]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:05 smithi192 ceph-mon[34775]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:05.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:05 smithi162 ceph-mon[34539]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:06.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-16T01:19:06.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:06.398 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:06 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-16T01:19:06.398 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:06 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:06.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:06 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-16T01:19:06.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:06 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:07.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:07 smithi192 ceph-mon[34775]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:07.252 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:07 smithi192 ceph-mon[34775]: Deploying daemon osd.8 on smithi192 2024-09-16T01:19:07.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:07 smithi063 ceph-mon[31070]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:07.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:07 smithi063 ceph-mon[31070]: Deploying daemon osd.8 on smithi192 2024-09-16T01:19:07.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:07 smithi162 ceph-mon[34539]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:07.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:07 smithi162 ceph-mon[34539]: Deploying daemon osd.8 on smithi192 2024-09-16T01:19:09.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:09 smithi192 ceph-mon[34775]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:09.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:09 smithi063 ceph-mon[31070]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:09.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:09 smithi162 ceph-mon[34539]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:11.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:11 smithi063 ceph-mon[31070]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:11.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:11 smithi192 ceph-mon[34775]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:11.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:11 smithi162 ceph-mon[34539]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:12.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:12 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:12.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:12 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:12.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:12 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:12.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:12 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:12.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:12 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:12.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:12 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:12.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:12 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:12.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:12 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:12.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:12 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:13.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:13 smithi063 ceph-mon[31070]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:13.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:13 smithi192 ceph-mon[34775]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:13.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:13 smithi162 ceph-mon[34539]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:14.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.949+0000 7fd154ff9640 1 -- 172.21.15.192:0/3725517734 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd1581a2800 con 0x7fd1400a3240 2024-09-16T01:19:14.951 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 8 on host 'smithi192' 2024-09-16T01:19:14.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 -- 172.21.15.192:0/3725517734 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1400a3240 msgr2=0x7fd1400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:14.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1400a3240 0x7fd1400a5700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd158101b30 tx=0x7fd14800a5e0 comp rx=0 tx=0).stop 2024-09-16T01:19:14.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 -- 172.21.15.192:0/3725517734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd158102690 msgr2=0x7fd1581035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:14.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd158102690 0x7fd1581035f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd15000eaa0 tx=0x7fd15000ef60 comp rx=0 tx=0).stop 2024-09-16T01:19:14.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 -- 172.21.15.192:0/3725517734 shutdown_connections 2024-09-16T01:19:14.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1400a3240 0x7fd1400a5700 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:14.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd158102690 0x7fd1581035f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:14.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd158101cd0 0x7fd1581030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:14.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 --2- 172.21.15.192:0/3725517734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd158100ad0 0x7fd158104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:14.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 -- 172.21.15.192:0/3725517734 >> 172.21.15.192:0/3725517734 conn(0x7fd1580fc280 msgr2=0x7fd15806a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:14.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 -- 172.21.15.192:0/3725517734 shutdown_connections 2024-09-16T01:19:14.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:19:14.952+0000 7fd15dcdd640 1 -- 172.21.15.192:0/3725517734 wait complete. 2024-09-16T01:19:15.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:14 smithi192 ceph-mon[34775]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:15.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:14 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:15.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:14 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:15.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:14 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:15.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:14 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:15.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:14 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:15.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:14 smithi162 ceph-mon[34539]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:15.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:14 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:15.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:14 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:15.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:14 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:15.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:14 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:15.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:14 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:15.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:14 smithi063 ceph-mon[31070]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:15.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:14 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:15.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:14 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:15.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:14 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:15.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:14 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:15.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:14 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:15.549 DEBUG:teuthology.orchestra.run.smithi192:osd.8> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.8.service 2024-09-16T01:19:15.551 INFO:tasks.cephadm:Deploying osd.9 on smithi063 with /dev/vg_nvme/lv_1... 2024-09-16T01:19:15.551 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-16T01:19:15.828 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:19:16.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:16.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:16.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:16.207 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:16.207 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:16.208 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:16.359 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:16.359 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:16.359 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:17.244 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:16 smithi063 ceph-mon[31070]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:17.318 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:16 smithi162 ceph-mon[34539]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:17.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:16 smithi192 ceph-mon[34775]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:17.424 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:19:17 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:19:17.080+0000 7f3574cb8640 -1 osd.8 0 log_to_monitors true 2024-09-16T01:19:18.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:17 smithi063 ceph-mon[31070]: from='osd.8 [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T01:19:18.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:17 smithi063 ceph-mon[31070]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T01:19:18.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:17 smithi192 ceph-mon[34775]: from='osd.8 [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T01:19:18.283 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:17 smithi192 ceph-mon[34775]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T01:19:18.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:17 smithi162 ceph-mon[34539]: from='osd.8 [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T01:19:18.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:17 smithi162 ceph-mon[34539]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-16T01:19:18.758 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:19:18.788 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi063:vg_nvme/lv_1 2024-09-16T01:19:19.049 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:19:19.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:19:18.965+0000 7f3570c3b640 -1 osd.8 0 waiting for initial osdmap 2024-09-16T01:19:19.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:19:18.973+0000 7f356ca63640 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:19:19.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:19.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-16T01:19:19.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: osdmap e55: 9 total, 8 up, 9 in 2024-09-16T01:19:19.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:19.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='osd.8 [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:19:19.176 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:19:19.176 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.176 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.176 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:19.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:19.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:19.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:19.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:19.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.311 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:19.311 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-16T01:19:19.312 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: osdmap e55: 9 total, 8 up, 9 in 2024-09-16T01:19:19.312 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:19.312 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='osd.8 [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:19:19.312 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:19:19.313 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.313 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.313 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:19.313 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:19.313 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:19.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:19.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:19.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:19.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-16T01:19:19.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: osdmap e55: 9 total, 8 up, 9 in 2024-09-16T01:19:19.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:19.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='osd.8 [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:19:19.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:19:19.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.436 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:19.436 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:19.436 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:19.436 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.436 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:19.437 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:19.437 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:19.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.525+0000 7fe84e6a1640 1 -- 172.21.15.63:0/1840900104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848107900 msgr2=0x7fe848109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:19.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.525+0000 7fe84e6a1640 1 --2- 172.21.15.63:0/1840900104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848107900 0x7fe848109d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe840009ca0 tx=0x7fe84002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:19:19.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.525+0000 7fe84e6a1640 1 -- 172.21.15.63:0/1840900104 shutdown_connections 2024-09-16T01:19:19.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.525+0000 7fe84e6a1640 1 --2- 172.21.15.63:0/1840900104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848107900 0x7fe848109d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.525+0000 7fe84e6a1640 1 --2- 172.21.15.63:0/1840900104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe848104fd0 0x7fe8481073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.525+0000 7fe84e6a1640 1 --2- 172.21.15.63:0/1840900104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8481026a0 0x7fe848104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.525+0000 7fe84e6a1640 1 -- 172.21.15.63:0/1840900104 >> 172.21.15.63:0/1840900104 conn(0x7fe8480fc280 msgr2=0x7fe8480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.525+0000 7fe84e6a1640 1 -- 172.21.15.63:0/1840900104 shutdown_connections 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.526+0000 7fe84e6a1640 1 -- 172.21.15.63:0/1840900104 wait complete. 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.526+0000 7fe84e6a1640 1 Processor -- start 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.526+0000 7fe84e6a1640 1 -- start start 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.526+0000 7fe84e6a1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8481026a0 0x7fe848197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.526+0000 7fe84e6a1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848104fd0 0x7fe848198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.526+0000 7fe84e6a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe848107900 0x7fe84819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.526+0000 7fe84e6a1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe84810d730 con 0x7fe848104fd0 2024-09-16T01:19:19.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.526+0000 7fe84e6a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe84810d5b0 con 0x7fe848107900 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.526+0000 7fe84e6a1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe84810d8b0 con 0x7fe8481026a0 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8477fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848104fd0 0x7fe848198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8477fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848104fd0 0x7fe848198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54962/0 (socket says 172.21.15.63:54962) 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8477fe640 1 -- 172.21.15.63:0/3357057218 learned_addr learned my addr 172.21.15.63:0/3357057218 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe847fff640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8481026a0 0x7fe848197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe84cc3e640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe848107900 0x7fe84819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8477fe640 1 -- 172.21.15.63:0/3357057218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8481026a0 msgr2=0x7fe848197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8477fe640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8481026a0 0x7fe848197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8477fe640 1 -- 172.21.15.63:0/3357057218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe848107900 msgr2=0x7fe84819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8477fe640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe848107900 0x7fe84819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:19.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8477fe640 1 -- 172.21.15.63:0/3357057218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84819fa70 con 0x7fe848104fd0 2024-09-16T01:19:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8477fe640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848104fd0 0x7fe848198380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00e9f0 tx=0x7fe83c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8457fa640 1 -- 172.21.15.63:0/3357057218 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00ccc0 con 0x7fe848104fd0 2024-09-16T01:19:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8457fa640 1 -- 172.21.15.63:0/3357057218 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe83c0054d0 con 0x7fe848104fd0 2024-09-16T01:19:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe84e6a1640 1 -- 172.21.15.63:0/3357057218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84819fd60 con 0x7fe848104fd0 2024-09-16T01:19:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe8457fa640 1 -- 172.21.15.63:0/3357057218 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c010430 con 0x7fe848104fd0 2024-09-16T01:19:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.527+0000 7fe84e6a1640 1 -- 172.21.15.63:0/3357057218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8481a01f0 con 0x7fe848104fd0 2024-09-16T01:19:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.529+0000 7fe84e6a1640 1 -- 172.21.15.63:0/3357057218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8480fdd70 con 0x7fe848104fd0 2024-09-16T01:19:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.530+0000 7fe8457fa640 1 -- 172.21.15.63:0/3357057218 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe83c005020 con 0x7fe848104fd0 2024-09-16T01:19:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.530+0000 7fe8457fa640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe8300a3270 0x7fe8300a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:19.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.530+0000 7fe847fff640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe8300a3270 0x7fe8300a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:19.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.530+0000 7fe8457fa640 1 -- 172.21.15.63:0/3357057218 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5549+0+0 (secure 0 0 0) 0x7fe83c0cf1f0 con 0x7fe848104fd0 2024-09-16T01:19:19.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.531+0000 7fe847fff640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe8300a3270 0x7fe8300a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe838005d00 tx=0x7fe83800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:19.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.534+0000 7fe8457fa640 1 -- 172.21.15.63:0/3357057218 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe83c09c9e0 con 0x7fe848104fd0 2024-09-16T01:19:19.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:19.720+0000 7fe84e6a1640 1 -- 172.21.15.63:0/3357057218 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe848062630 con 0x7fe8300a3270 2024-09-16T01:19:20.266 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:19 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi192 2024-09-16T01:19:20.266 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:19 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi192 to 5696M 2024-09-16T01:19:20.266 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:19 smithi063 ceph-mon[31070]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:19:20.266 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:19 smithi063 ceph-mon[31070]: osdmap e56: 9 total, 8 up, 9 in 2024-09-16T01:19:20.266 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:19 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:20.266 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:19 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:20.266 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:19 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:19:20.266 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:19 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:19:20.266 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:19 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:19 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi192 2024-09-16T01:19:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:19 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi192 to 5696M 2024-09-16T01:19:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:19 smithi192 ceph-mon[34775]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:19:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:19 smithi192 ceph-mon[34775]: osdmap e56: 9 total, 8 up, 9 in 2024-09-16T01:19:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:19 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:19 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:19 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:19:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:19 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:19:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:19 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:20.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:19 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi192 2024-09-16T01:19:20.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:19 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi192 to 5696M 2024-09-16T01:19:20.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:19 smithi162 ceph-mon[34539]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:19:20.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:19 smithi162 ceph-mon[34539]: osdmap e56: 9 total, 8 up, 9 in 2024-09-16T01:19:20.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:19 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:20.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:19 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:20.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:19 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:19:20.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:19 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:19:20.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:19 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:21.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:20 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:19:21.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:20 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:19:21.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:20 smithi063 ceph-mon[31070]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:21.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:20 smithi063 ceph-mon[31070]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:19:21.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:21.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:20 smithi063 ceph-mon[31070]: osd.8 [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] boot 2024-09-16T01:19:21.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:20 smithi063 ceph-mon[31070]: osdmap e57: 9 total, 9 up, 9 in 2024-09-16T01:19:21.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:21.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:20 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:19:21.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:20 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:19:21.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:20 smithi192 ceph-mon[34775]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:21.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:20 smithi192 ceph-mon[34775]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:19:21.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:21.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:20 smithi192 ceph-mon[34775]: osd.8 [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] boot 2024-09-16T01:19:21.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:20 smithi192 ceph-mon[34775]: osdmap e57: 9 total, 9 up, 9 in 2024-09-16T01:19:21.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:21.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:20 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:19:21.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:20 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:19:21.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:20 smithi162 ceph-mon[34539]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-16T01:19:21.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:20 smithi162 ceph-mon[34539]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:19:21.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:21.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:20 smithi162 ceph-mon[34539]: osd.8 [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] boot 2024-09-16T01:19:21.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:20 smithi162 ceph-mon[34539]: osdmap e57: 9 total, 9 up, 9 in 2024-09-16T01:19:21.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-16T01:19:22.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:21 smithi063 ceph-mon[31070]: osdmap e58: 9 total, 9 up, 9 in 2024-09-16T01:19:22.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:21 smithi192 ceph-mon[34775]: osdmap e58: 9 total, 9 up, 9 in 2024-09-16T01:19:22.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:21 smithi162 ceph-mon[34539]: osdmap e58: 9 total, 9 up, 9 in 2024-09-16T01:19:23.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:22 smithi063 ceph-mon[31070]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:23.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:22 smithi063 ceph-mon[31070]: osdmap e59: 9 total, 9 up, 9 in 2024-09-16T01:19:23.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:22 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2309001346' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85070701-b935-4fc2-9add-9c0bcd2896f9"}]: dispatch 2024-09-16T01:19:23.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:22 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2309001346' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85070701-b935-4fc2-9add-9c0bcd2896f9"}]': finished 2024-09-16T01:19:23.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:22 smithi063 ceph-mon[31070]: osdmap e60: 10 total, 9 up, 10 in 2024-09-16T01:19:23.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:22 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:23.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:22 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2724094853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:19:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:22 smithi192 ceph-mon[34775]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:22 smithi192 ceph-mon[34775]: osdmap e59: 9 total, 9 up, 9 in 2024-09-16T01:19:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:22 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2309001346' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85070701-b935-4fc2-9add-9c0bcd2896f9"}]: dispatch 2024-09-16T01:19:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:22 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2309001346' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85070701-b935-4fc2-9add-9c0bcd2896f9"}]': finished 2024-09-16T01:19:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:22 smithi192 ceph-mon[34775]: osdmap e60: 10 total, 9 up, 10 in 2024-09-16T01:19:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:22 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:22 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2724094853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:19:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:22 smithi162 ceph-mon[34539]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:22 smithi162 ceph-mon[34539]: osdmap e59: 9 total, 9 up, 9 in 2024-09-16T01:19:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:22 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2309001346' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85070701-b935-4fc2-9add-9c0bcd2896f9"}]: dispatch 2024-09-16T01:19:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:22 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2309001346' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85070701-b935-4fc2-9add-9c0bcd2896f9"}]': finished 2024-09-16T01:19:23.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:22 smithi162 ceph-mon[34539]: osdmap e60: 10 total, 9 up, 10 in 2024-09-16T01:19:23.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:22 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:23.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:22 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2724094853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:19:24.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:24 smithi063 ceph-mon[31070]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:24.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:24 smithi063 ceph-mon[31070]: osdmap e61: 10 total, 9 up, 10 in 2024-09-16T01:19:24.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:24.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:24 smithi192 ceph-mon[34775]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:24.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:24 smithi192 ceph-mon[34775]: osdmap e61: 10 total, 9 up, 10 in 2024-09-16T01:19:24.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:24.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:24 smithi162 ceph-mon[34539]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:24.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:24 smithi162 ceph-mon[34539]: osdmap e61: 10 total, 9 up, 10 in 2024-09-16T01:19:24.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:26.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:26 smithi063 ceph-mon[31070]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-16T01:19:26.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:26 smithi192 ceph-mon[34775]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-16T01:19:26.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:26 smithi162 ceph-mon[34539]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-16T01:19:28.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:28 smithi063 ceph-mon[31070]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T01:19:28.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:28 smithi192 ceph-mon[34775]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T01:19:28.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:28 smithi162 ceph-mon[34539]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-16T01:19:30.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:30 smithi063 ceph-mon[31070]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-16T01:19:30.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:30 smithi192 ceph-mon[34775]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-16T01:19:30.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:30 smithi162 ceph-mon[34539]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-16T01:19:32.548 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:32 smithi063 ceph-mon[31070]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-16T01:19:32.548 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-16T01:19:32.549 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:32.549 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:32 smithi063 ceph-mon[31070]: Deploying daemon osd.9 on smithi063 2024-09-16T01:19:32.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:32 smithi192 ceph-mon[34775]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-16T01:19:32.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-16T01:19:32.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:32.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:32 smithi192 ceph-mon[34775]: Deploying daemon osd.9 on smithi063 2024-09-16T01:19:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:32 smithi162 ceph-mon[34539]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-16T01:19:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-16T01:19:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:32 smithi162 ceph-mon[34539]: Deploying daemon osd.9 on smithi063 2024-09-16T01:19:34.570 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:34 smithi063 ceph-mon[31070]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T01:19:34.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:34 smithi192 ceph-mon[34775]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T01:19:34.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:34 smithi162 ceph-mon[34539]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T01:19:36.574 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:36 smithi063 ceph-mon[31070]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-16T01:19:36.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:36 smithi192 ceph-mon[34775]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-16T01:19:36.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:36 smithi162 ceph-mon[34539]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-16T01:19:38.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:38 smithi063 ceph-mon[31070]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:38.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:38.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:38.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:38.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:38 smithi192 ceph-mon[34775]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:38.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:38.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:38.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:38.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:38 smithi162 ceph-mon[34539]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:38.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:38.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:38.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:40.548 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:40 smithi063 ceph-mon[31070]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:40 smithi192 ceph-mon[34775]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:40.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:40 smithi162 ceph-mon[34539]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:41.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.368+0000 7fe8457fa640 1 -- 172.21.15.63:0/3357057218 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe848062630 con 0x7fe8300a3270 2024-09-16T01:19:41.369 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 9 on host 'smithi063' 2024-09-16T01:19:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 -- 172.21.15.63:0/3357057218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe8300a3270 msgr2=0x7fe8300a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe8300a3270 0x7fe8300a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe838005d00 tx=0x7fe83800b410 comp rx=0 tx=0).stop 2024-09-16T01:19:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 -- 172.21.15.63:0/3357057218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848104fd0 msgr2=0x7fe848198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:41.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848104fd0 0x7fe848198380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00e9f0 tx=0x7fe83c00eeb0 comp rx=0 tx=0).stop 2024-09-16T01:19:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 -- 172.21.15.63:0/3357057218 shutdown_connections 2024-09-16T01:19:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe8300a3270 0x7fe8300a5730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe848107900 0x7fe84819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe848104fd0 0x7fe848198380 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 --2- 172.21.15.63:0/3357057218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8481026a0 0x7fe848197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 -- 172.21.15.63:0/3357057218 >> 172.21.15.63:0/3357057218 conn(0x7fe8480fc280 msgr2=0x7fe848103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 -- 172.21.15.63:0/3357057218 shutdown_connections 2024-09-16T01:19:41.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:19:41.370+0000 7fe84e6a1640 1 -- 172.21.15.63:0/3357057218 wait complete. 2024-09-16T01:19:41.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:41.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:41.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:41.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:41.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:41.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:19:41.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:41.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:42.082 DEBUG:teuthology.orchestra.run.smithi063:osd.9> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.9.service 2024-09-16T01:19:42.084 INFO:tasks.cephadm:Deploying osd.10 on smithi162 with /dev/vg_nvme/lv_1... 2024-09-16T01:19:42.085 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-16T01:19:42.341 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:19:43.337 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:43 smithi063 ceph-mon[31070]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:43.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:43 smithi192 ceph-mon[34775]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:43.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:43 smithi162 ceph-mon[34539]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:43.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:19:43 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:19:43.335+0000 7fcaeb2c4640 -1 osd.9 0 log_to_monitors true 2024-09-16T01:19:44.352 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:44 smithi162 ceph-mon[34539]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-16T01:19:44.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:44 smithi063 ceph-mon[31070]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-16T01:19:44.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:44 smithi192 ceph-mon[34775]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-16T01:19:44.885 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-16T01:19:44.910 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-09-16T01:19:45.161 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:19:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:45 smithi162 ceph-mon[34539]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:45 smithi162 ceph-mon[34539]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-16T01:19:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:45 smithi162 ceph-mon[34539]: osdmap e62: 10 total, 9 up, 10 in 2024-09-16T01:19:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:45 smithi162 ceph-mon[34539]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:19:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:45 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:45.346 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:19:45 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:19:45.097+0000 7fcae7247640 -1 osd.9 0 waiting for initial osdmap 2024-09-16T01:19:45.346 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:19:45 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:19:45.114+0000 7fcae306f640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:19:45.347 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:45 smithi063 ceph-mon[31070]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:45.347 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:45 smithi063 ceph-mon[31070]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-16T01:19:45.347 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:45 smithi063 ceph-mon[31070]: osdmap e62: 10 total, 9 up, 10 in 2024-09-16T01:19:45.347 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:45 smithi063 ceph-mon[31070]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:19:45.347 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:45 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:45 smithi192 ceph-mon[34775]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:45 smithi192 ceph-mon[34775]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-16T01:19:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:45 smithi192 ceph-mon[34775]: osdmap e62: 10 total, 9 up, 10 in 2024-09-16T01:19:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:45 smithi192 ceph-mon[34775]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-09-16T01:19:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:45 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:45.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.677+0000 7f4a7d3db640 1 -- 172.21.15.162:0/3189852306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a78102e10 msgr2=0x7f4a78103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:45.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.677+0000 7f4a7d3db640 1 --2- 172.21.15.162:0/3189852306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a78102e10 0x7f4a78103290 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009900 tx=0x7f4a6c02a410 comp rx=0 tx=0).stop 2024-09-16T01:19:45.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.678+0000 7f4a7d3db640 1 -- 172.21.15.162:0/3189852306 shutdown_connections 2024-09-16T01:19:45.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.678+0000 7f4a7d3db640 1 --2- 172.21.15.162:0/3189852306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a781037d0 0x7f4a7810a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:45.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.678+0000 7f4a7d3db640 1 --2- 172.21.15.162:0/3189852306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a78102e10 0x7f4a78103290 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:45.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.678+0000 7f4a7d3db640 1 --2- 172.21.15.162:0/3189852306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78101c10 0x7f4a78102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:45.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.678+0000 7f4a7d3db640 1 -- 172.21.15.162:0/3189852306 >> 172.21.15.162:0/3189852306 conn(0x7f4a780fd3c0 msgr2=0x7f4a780ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:45.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.678+0000 7f4a7d3db640 1 -- 172.21.15.162:0/3189852306 shutdown_connections 2024-09-16T01:19:45.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.678+0000 7f4a7d3db640 1 -- 172.21.15.162:0/3189852306 wait complete. 2024-09-16T01:19:45.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.678+0000 7f4a7d3db640 1 Processor -- start 2024-09-16T01:19:45.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a7d3db640 1 -- start start 2024-09-16T01:19:45.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a7d3db640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78101c10 0x7f4a78197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:45.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a7d3db640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a78102e10 0x7f4a78198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:45.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a7d3db640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a781037d0 0x7f4a7819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:45.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a7d3db640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7810d720 con 0x7f4a781037d0 2024-09-16T01:19:45.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a7d3db640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7810d5a0 con 0x7f4a78102e10 2024-09-16T01:19:45.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a7d3db640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7810d8a0 con 0x7f4a78101c10 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a767fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a78102e10 0x7f4a78198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a767fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a78102e10 0x7f4a78198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45438/0 (socket says 172.21.15.162:45438) 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a767fc640 1 -- 172.21.15.162:0/402333740 learned_addr learned my addr 172.21.15.162:0/402333740 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a76ffd640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78101c10 0x7f4a78197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a767fc640 1 -- 172.21.15.162:0/402333740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78101c10 msgr2=0x7f4a78197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a767fc640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78101c10 0x7f4a78197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a777fe640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a781037d0 0x7f4a7819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a767fc640 1 -- 172.21.15.162:0/402333740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a781037d0 msgr2=0x7f4a7819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a767fc640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a781037d0 0x7f4a7819f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a767fc640 1 -- 172.21.15.162:0/402333740 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7819fa70 con 0x7f4a78102e10 2024-09-16T01:19:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a76ffd640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78101c10 0x7f4a78197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a767fc640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a78102e10 0x7f4a78198380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c004770 tx=0x7f4a6c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.679+0000 7f4a5ffff640 1 -- 172.21.15.162:0/402333740 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c03f030 con 0x7f4a78102e10 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.680+0000 7f4a7d3db640 1 -- 172.21.15.162:0/402333740 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7819fd00 con 0x7f4a78102e10 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.680+0000 7f4a5ffff640 1 -- 172.21.15.162:0/402333740 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a6c003cb0 con 0x7f4a78102e10 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.680+0000 7f4a5ffff640 1 -- 172.21.15.162:0/402333740 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c035070 con 0x7f4a78102e10 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.680+0000 7f4a7d3db640 1 -- 172.21.15.162:0/402333740 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a781a0190 con 0x7f4a78102e10 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.681+0000 7f4a7d3db640 1 -- 172.21.15.162:0/402333740 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a78109150 con 0x7f4a78102e10 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.682+0000 7f4a5ffff640 1 -- 172.21.15.162:0/402333740 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4a6c042030 con 0x7f4a78102e10 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.682+0000 7f4a5ffff640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4a600a3270 0x7f4a600a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.682+0000 7f4a5ffff640 1 -- 172.21.15.162:0/402333740 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5981+0+0 (secure 0 0 0) 0x7f4a6c0ef6d0 con 0x7f4a78102e10 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.683+0000 7f4a76ffd640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4a600a3270 0x7f4a600a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:45.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.683+0000 7f4a76ffd640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4a600a3270 0x7f4a600a5730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a78102c70 tx=0x7f4a68009400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:45.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.686+0000 7f4a5ffff640 1 -- 172.21.15.162:0/402333740 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a6c0bcd10 con 0x7f4a78102e10 2024-09-16T01:19:45.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:19:45.860+0000 7f4a7d3db640 1 -- 172.21.15.162:0/402333740 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f4a78062630 con 0x7f4a600a3270 2024-09-16T01:19:46.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:19:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: osdmap e63: 10 total, 9 up, 10 in 2024-09-16T01:19:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi063 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi063 to 4272M 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:46.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:19:46.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:19:46.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:19:46.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:46.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:19:46.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: osdmap e63: 10 total, 9 up, 10 in 2024-09-16T01:19:46.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:46.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:46.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:46.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi063 2024-09-16T01:19:46.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi063 to 4272M 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:19:46.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:46.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-09-16T01:19:46.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: osdmap e63: 10 total, 9 up, 10 in 2024-09-16T01:19:46.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:46.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:46.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-16T01:19:46.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi063 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi063 to 4272M 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:19:46.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:19:46.426 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:19:46.426 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:47.311 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:47 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:19:47.311 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:47 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:19:47.311 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:47 smithi162 ceph-mon[34539]: osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] boot 2024-09-16T01:19:47.311 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:47 smithi162 ceph-mon[34539]: osdmap e64: 10 total, 10 up, 10 in 2024-09-16T01:19:47.311 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:47 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:47.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:47 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:19:47.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:47 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:19:47.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:47 smithi063 ceph-mon[31070]: osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] boot 2024-09-16T01:19:47.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:47 smithi063 ceph-mon[31070]: osdmap e64: 10 total, 10 up, 10 in 2024-09-16T01:19:47.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:47 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:47.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:47 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:19:47.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:47 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:19:47.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:47 smithi192 ceph-mon[34775]: osd.9 [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] boot 2024-09-16T01:19:47.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:47 smithi192 ceph-mon[34775]: osdmap e64: 10 total, 10 up, 10 in 2024-09-16T01:19:47.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:47 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-16T01:19:48.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:48 smithi192 ceph-mon[34775]: osdmap e65: 10 total, 10 up, 10 in 2024-09-16T01:19:48.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:48 smithi192 ceph-mon[34775]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:48.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:48 smithi162 ceph-mon[34539]: osdmap e65: 10 total, 10 up, 10 in 2024-09-16T01:19:48.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:48 smithi162 ceph-mon[34539]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:48.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:48 smithi063 ceph-mon[31070]: osdmap e65: 10 total, 10 up, 10 in 2024-09-16T01:19:48.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:48 smithi063 ceph-mon[31070]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:49.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:49 smithi162 ceph-mon[34539]: from='client.? 172.21.15.162:0/1604489806' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7568686-adaf-46b9-8fc6-544ed2265715"}]: dispatch 2024-09-16T01:19:49.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:49 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7568686-adaf-46b9-8fc6-544ed2265715"}]: dispatch 2024-09-16T01:19:49.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:49 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7568686-adaf-46b9-8fc6-544ed2265715"}]': finished 2024-09-16T01:19:49.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:49 smithi162 ceph-mon[34539]: osdmap e66: 11 total, 10 up, 11 in 2024-09-16T01:19:49.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:49 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:19:49.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:49 smithi162 ceph-mon[34539]: from='client.? 172.21.15.162:0/3537475852' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:19:49.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:49 smithi192 ceph-mon[34775]: from='client.? 172.21.15.162:0/1604489806' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7568686-adaf-46b9-8fc6-544ed2265715"}]: dispatch 2024-09-16T01:19:49.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:49 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7568686-adaf-46b9-8fc6-544ed2265715"}]: dispatch 2024-09-16T01:19:49.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:49 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7568686-adaf-46b9-8fc6-544ed2265715"}]': finished 2024-09-16T01:19:49.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:49 smithi192 ceph-mon[34775]: osdmap e66: 11 total, 10 up, 11 in 2024-09-16T01:19:49.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:49 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:19:49.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:49 smithi192 ceph-mon[34775]: from='client.? 172.21.15.162:0/3537475852' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:19:49.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:49 smithi063 ceph-mon[31070]: from='client.? 172.21.15.162:0/1604489806' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7568686-adaf-46b9-8fc6-544ed2265715"}]: dispatch 2024-09-16T01:19:49.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:49 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7568686-adaf-46b9-8fc6-544ed2265715"}]: dispatch 2024-09-16T01:19:49.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:49 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7568686-adaf-46b9-8fc6-544ed2265715"}]': finished 2024-09-16T01:19:49.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:49 smithi063 ceph-mon[31070]: osdmap e66: 11 total, 10 up, 11 in 2024-09-16T01:19:49.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:49 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:19:49.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:49 smithi063 ceph-mon[31070]: from='client.? 172.21.15.162:0/3537475852' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:19:50.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:50 smithi192 ceph-mon[34775]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:50.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:50 smithi162 ceph-mon[34539]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:50.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:50 smithi063 ceph-mon[31070]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:52.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:52 smithi063 ceph-mon[31070]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:52.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:52 smithi192 ceph-mon[34775]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:52.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:52 smithi162 ceph-mon[34539]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:54.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:54 smithi063 ceph-mon[31070]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:54.651 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:54 smithi162 ceph-mon[34539]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:54.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:54 smithi192 ceph-mon[34775]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:56.498 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:56 smithi162 ceph-mon[34539]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:56.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:56 smithi063 ceph-mon[31070]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:56.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:56 smithi192 ceph-mon[34775]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:57.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:57 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-16T01:19:57.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:57 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:57.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:57 smithi192 ceph-mon[34775]: Deploying daemon osd.10 on smithi162 2024-09-16T01:19:57.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:57 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-16T01:19:57.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:57 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:57.476 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:57 smithi162 ceph-mon[34539]: Deploying daemon osd.10 on smithi162 2024-09-16T01:19:57.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:57 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-16T01:19:57.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:57 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:19:57.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:57 smithi063 ceph-mon[31070]: Deploying daemon osd.10 on smithi162 2024-09-16T01:19:58.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:19:58 smithi063 ceph-mon[31070]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:58.661 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:19:58 smithi162 ceph-mon[34539]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:19:58.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:19:58 smithi192 ceph-mon[34775]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:00.386 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:00 smithi162 ceph-mon[34539]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:00.386 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:00 smithi162 ceph-mon[34539]: overall HEALTH_OK 2024-09-16T01:20:00.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:00 smithi063 ceph-mon[31070]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:00.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:00 smithi063 ceph-mon[31070]: overall HEALTH_OK 2024-09-16T01:20:00.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:00 smithi192 ceph-mon[34775]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:00.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:00 smithi192 ceph-mon[34775]: overall HEALTH_OK 2024-09-16T01:20:02.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:02 smithi162 ceph-mon[34539]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:02.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:02 smithi063 ceph-mon[31070]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:02 smithi192 ceph-mon[34775]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:03.511 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:03.511 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:03.511 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:03 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:03.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:03.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:03.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:03 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:03.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:03.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:03.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:03 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:04.854 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:04 smithi162 ceph-mon[34539]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:05.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:04 smithi063 ceph-mon[31070]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:05.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:04 smithi192 ceph-mon[34775]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:05.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.914+0000 7f4a5ffff640 1 -- 172.21.15.162:0/402333740 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f4a78062630 con 0x7f4a600a3270 2024-09-16T01:20:05.917 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 10 on host 'smithi162' 2024-09-16T01:20:05.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 -- 172.21.15.162:0/402333740 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4a600a3270 msgr2=0x7f4a600a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:05.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4a600a3270 0x7f4a600a5730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a78102c70 tx=0x7f4a68009400 comp rx=0 tx=0).stop 2024-09-16T01:20:05.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 -- 172.21.15.162:0/402333740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a78102e10 msgr2=0x7f4a78198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:05.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a78102e10 0x7f4a78198380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c004770 tx=0x7f4a6c0042f0 comp rx=0 tx=0).stop 2024-09-16T01:20:05.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 -- 172.21.15.162:0/402333740 shutdown_connections 2024-09-16T01:20:05.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4a600a3270 0x7f4a600a5730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:05.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a781037d0 0x7f4a7819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:05.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a78102e10 0x7f4a78198380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:05.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 --2- 172.21.15.162:0/402333740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78101c10 0x7f4a78197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:05.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 -- 172.21.15.162:0/402333740 >> 172.21.15.162:0/402333740 conn(0x7f4a780fd3c0 msgr2=0x7f4a78106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:05.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 -- 172.21.15.162:0/402333740 shutdown_connections 2024-09-16T01:20:05.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-16T01:20:05.917+0000 7f4a7d3db640 1 -- 172.21.15.162:0/402333740 wait complete. 2024-09-16T01:20:06.580 DEBUG:teuthology.orchestra.run.smithi162:osd.10> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.10.service 2024-09-16T01:20:06.583 INFO:tasks.cephadm:Deploying osd.11 on smithi192 with /dev/vg_nvme/lv_1... 2024-09-16T01:20:06.583 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-16T01:20:06.841 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:20:07.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:06 smithi192 ceph-mon[34775]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:07.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:06 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:06 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:06 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:06 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:06 smithi162 ceph-mon[34539]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:07.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:06 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:06 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:06 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:06 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:06 smithi063 ceph-mon[31070]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:07.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:07.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:06 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:08.557 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:20:08 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:20:08.367+0000 7f06a558a640 -1 osd.10 0 log_to_monitors true 2024-09-16T01:20:09.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:08 smithi192 ceph-mon[34775]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:09.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:08 smithi192 ceph-mon[34775]: from='osd.10 [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T01:20:09.177 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:08 smithi192 ceph-mon[34775]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T01:20:09.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:08 smithi162 ceph-mon[34539]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:09.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:08 smithi162 ceph-mon[34539]: from='osd.10 [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T01:20:09.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:08 smithi162 ceph-mon[34539]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T01:20:09.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:08 smithi063 ceph-mon[31070]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:09.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:08 smithi063 ceph-mon[31070]: from='osd.10 [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T01:20:09.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:08 smithi063 ceph-mon[31070]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-16T01:20:09.625 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-16T01:20:09.653 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_1 2024-09-16T01:20:09.924 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:20:10.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:09 smithi192 ceph-mon[34775]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-16T01:20:10.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:09 smithi192 ceph-mon[34775]: osdmap e67: 11 total, 10 up, 11 in 2024-09-16T01:20:10.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:09 smithi192 ceph-mon[34775]: from='osd.10 [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:20:10.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:09 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:10.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:09 smithi192 ceph-mon[34775]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:20:10.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:09 smithi192 ceph-mon[34775]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:20:10.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:09 smithi162 ceph-mon[34539]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-16T01:20:10.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:09 smithi162 ceph-mon[34539]: osdmap e67: 11 total, 10 up, 11 in 2024-09-16T01:20:10.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:09 smithi162 ceph-mon[34539]: from='osd.10 [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:20:10.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:09 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:10.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:09 smithi162 ceph-mon[34539]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:20:10.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:09 smithi162 ceph-mon[34539]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:20:10.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:09 smithi063 ceph-mon[31070]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-16T01:20:10.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:09 smithi063 ceph-mon[31070]: osdmap e67: 11 total, 10 up, 11 in 2024-09-16T01:20:10.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:09 smithi063 ceph-mon[31070]: from='osd.10 [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:20:10.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:09 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:10.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:09 smithi063 ceph-mon[31070]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-16T01:20:10.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:09 smithi063 ceph-mon[31070]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-16T01:20:10.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.403+0000 7ff37e17d640 1 -- 172.21.15.192:0/301758624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3781078c0 msgr2=0x7ff378109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:10.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.403+0000 7ff37e17d640 1 --2- 172.21.15.192:0/301758624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3781078c0 0x7ff378109d10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff370009ca0 tx=0x7ff37002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:20:10.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.403+0000 7ff37e17d640 1 -- 172.21.15.192:0/301758624 shutdown_connections 2024-09-16T01:20:10.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.403+0000 7ff37e17d640 1 --2- 172.21.15.192:0/301758624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3781078c0 0x7ff378109d10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:10.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.403+0000 7ff37e17d640 1 --2- 172.21.15.192:0/301758624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff378104f90 0x7ff378107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:10.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.403+0000 7ff37e17d640 1 --2- 172.21.15.192:0/301758624 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff378102660 0x7ff378104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:10.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.403+0000 7ff37e17d640 1 -- 172.21.15.192:0/301758624 >> 172.21.15.192:0/301758624 conn(0x7ff3780fc280 msgr2=0x7ff3780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.403+0000 7ff37e17d640 1 -- 172.21.15.192:0/301758624 shutdown_connections 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.403+0000 7ff37e17d640 1 -- 172.21.15.192:0/301758624 wait complete. 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.403+0000 7ff37e17d640 1 Processor -- start 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff37e17d640 1 -- start start 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff37e17d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff378102660 0x7ff378101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff37e17d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff378104f90 0x7ff378100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff37e17d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3781078c0 0x7ff378100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff37e17d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff37810d710 con 0x7ff378102660 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff37e17d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff37810d590 con 0x7ff378104f90 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff37e17d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff37810d890 con 0x7ff3781078c0 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff377fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3781078c0 0x7ff378100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:10.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff377fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3781078c0 0x7ff378100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45420/0 (socket says 172.21.15.192:45420) 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff377fff640 1 -- 172.21.15.192:0/3772262615 learned_addr learned my addr 172.21.15.192:0/3772262615 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff3777fe640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff378102660 0x7ff378101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff376ffd640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff378104f90 0x7ff378100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff377fff640 1 -- 172.21.15.192:0/3772262615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff378104f90 msgr2=0x7ff378100610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff377fff640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff378104f90 0x7ff378100610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff377fff640 1 -- 172.21.15.192:0/3772262615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff378102660 msgr2=0x7ff378101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff377fff640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff378102660 0x7ff378101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff377fff640 1 -- 172.21.15.192:0/3772262615 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff378101410 con 0x7ff3781078c0 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff376ffd640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff378104f90 0x7ff378100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.404+0000 7ff377fff640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3781078c0 0x7ff378100b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff370009dc0 tx=0x7ff370003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.405+0000 7ff374ff9640 1 -- 172.21.15.192:0/3772262615 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370032ec0 con 0x7ff3781078c0 2024-09-16T01:20:10.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.405+0000 7ff374ff9640 1 -- 172.21.15.192:0/3772262615 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3700044f0 con 0x7ff3781078c0 2024-09-16T01:20:10.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.405+0000 7ff37e17d640 1 -- 172.21.15.192:0/3772262615 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3781a1e90 con 0x7ff3781078c0 2024-09-16T01:20:10.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.405+0000 7ff374ff9640 1 -- 172.21.15.192:0/3772262615 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370030d40 con 0x7ff3781078c0 2024-09-16T01:20:10.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.405+0000 7ff37e17d640 1 -- 172.21.15.192:0/3772262615 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3781a2390 con 0x7ff3781078c0 2024-09-16T01:20:10.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.406+0000 7ff37e17d640 1 -- 172.21.15.192:0/3772262615 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3780fdd70 con 0x7ff3781078c0 2024-09-16T01:20:10.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.407+0000 7ff374ff9640 1 -- 172.21.15.192:0/3772262615 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff370004040 con 0x7ff3781078c0 2024-09-16T01:20:10.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.407+0000 7ff374ff9640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3600a3460 0x7ff3600a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:10.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.408+0000 7ff374ff9640 1 -- 172.21.15.192:0/3772262615 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6414+0+0 (secure 0 0 0) 0x7ff3700f0820 con 0x7ff3781078c0 2024-09-16T01:20:10.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.408+0000 7ff3777fe640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3600a3460 0x7ff3600a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:10.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.408+0000 7ff3777fe640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3600a3460 0x7ff3600a5920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00bbe0 tx=0x7ff36c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:10.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.411+0000 7ff374ff9640 1 -- 172.21.15.192:0/3772262615 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3700bdcb0 con 0x7ff3781078c0 2024-09-16T01:20:10.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:10.593+0000 7ff37e17d640 1 -- 172.21.15.192:0/3772262615 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff378062630 con 0x7ff3600a3460 2024-09-16T01:20:10.683 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:20:10.341+0000 7f06a1d21640 -1 osd.10 0 waiting for initial osdmap 2024-09-16T01:20:10.684 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:20:10.352+0000 7f069932d640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:20:11.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:11.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: osdmap e68: 11 total, 10 up, 11 in 2024-09-16T01:20:11.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:11.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:11.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi162 2024-09-16T01:20:11.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='osd.10 ' entity='osd.10' 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:20:11.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:20:11.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:11.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: osd.10 [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] boot 2024-09-16T01:20:11.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: osdmap e69: 11 total, 11 up, 11 in 2024-09-16T01:20:11.186 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:11.229 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:11.229 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: osdmap e68: 11 total, 10 up, 11 in 2024-09-16T01:20:11.229 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi162 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:11.230 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='osd.10 ' entity='osd.10' 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: osd.10 [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] boot 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: osdmap e69: 11 total, 11 up, 11 in 2024-09-16T01:20:11.231 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:11.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: osdmap e68: 11 total, 10 up, 11 in 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi162 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='osd.10 ' entity='osd.10' 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:11.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: osd.10 [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] boot 2024-09-16T01:20:11.362 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: osdmap e69: 11 total, 11 up, 11 in 2024-09-16T01:20:11.362 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-16T01:20:12.083 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:11 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:20:12.083 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:11 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:20:12.083 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:11 smithi192 ceph-mon[34775]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:20:12.083 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:11 smithi192 ceph-mon[34775]: osdmap e70: 11 total, 11 up, 11 in 2024-09-16T01:20:12.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:11 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:20:12.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:11 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:20:12.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:11 smithi063 ceph-mon[31070]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:20:12.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:11 smithi063 ceph-mon[31070]: osdmap e70: 11 total, 11 up, 11 in 2024-09-16T01:20:12.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:11 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:20:12.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:11 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:20:12.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:11 smithi162 ceph-mon[34539]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:20:12.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:11 smithi162 ceph-mon[34539]: osdmap e70: 11 total, 11 up, 11 in 2024-09-16T01:20:13.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:12 smithi192 ceph-mon[34775]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:13.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:12 smithi192 ceph-mon[34775]: osdmap e71: 11 total, 11 up, 11 in 2024-09-16T01:20:13.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:12 smithi063 ceph-mon[31070]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:13.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:12 smithi063 ceph-mon[31070]: osdmap e71: 11 total, 11 up, 11 in 2024-09-16T01:20:13.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:12 smithi162 ceph-mon[34539]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:13.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:12 smithi162 ceph-mon[34539]: osdmap e71: 11 total, 11 up, 11 in 2024-09-16T01:20:14.293 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:13 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/3636641973' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c12f12-3089-459f-a85d-17699c95a7f5"}]: dispatch 2024-09-16T01:20:14.293 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:13 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c12f12-3089-459f-a85d-17699c95a7f5"}]: dispatch 2024-09-16T01:20:14.293 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:13 smithi063 ceph-mon[31070]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7c12f12-3089-459f-a85d-17699c95a7f5"}]': finished 2024-09-16T01:20:14.293 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:13 smithi063 ceph-mon[31070]: osdmap e72: 12 total, 11 up, 12 in 2024-09-16T01:20:14.293 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:13 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:14.293 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:13 smithi063 ceph-mon[31070]: from='client.? 172.21.15.192:0/1849561205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:20:14.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:13 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/3636641973' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c12f12-3089-459f-a85d-17699c95a7f5"}]: dispatch 2024-09-16T01:20:14.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:13 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c12f12-3089-459f-a85d-17699c95a7f5"}]: dispatch 2024-09-16T01:20:14.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:13 smithi192 ceph-mon[34775]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7c12f12-3089-459f-a85d-17699c95a7f5"}]': finished 2024-09-16T01:20:14.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:13 smithi192 ceph-mon[34775]: osdmap e72: 12 total, 11 up, 12 in 2024-09-16T01:20:14.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:13 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:14.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:13 smithi192 ceph-mon[34775]: from='client.? 172.21.15.192:0/1849561205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:20:14.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:13 smithi162 ceph-mon[34539]: from='client.? 172.21.15.192:0/3636641973' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c12f12-3089-459f-a85d-17699c95a7f5"}]: dispatch 2024-09-16T01:20:14.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:13 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7c12f12-3089-459f-a85d-17699c95a7f5"}]: dispatch 2024-09-16T01:20:14.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:13 smithi162 ceph-mon[34539]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7c12f12-3089-459f-a85d-17699c95a7f5"}]': finished 2024-09-16T01:20:14.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:13 smithi162 ceph-mon[34539]: osdmap e72: 12 total, 11 up, 12 in 2024-09-16T01:20:14.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:13 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:14.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:13 smithi162 ceph-mon[34539]: from='client.? 172.21.15.192:0/1849561205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T01:20:15.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:15 smithi063 ceph-mon[31070]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:15.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:15 smithi063 ceph-mon[31070]: osdmap e73: 12 total, 11 up, 12 in 2024-09-16T01:20:15.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:15 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:15.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:15 smithi192 ceph-mon[34775]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:15.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:15 smithi192 ceph-mon[34775]: osdmap e73: 12 total, 11 up, 12 in 2024-09-16T01:20:15.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:15 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:15.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:15 smithi162 ceph-mon[34539]: pgmap v230: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:15.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:15 smithi162 ceph-mon[34539]: osdmap e73: 12 total, 11 up, 12 in 2024-09-16T01:20:15.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:15 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:17.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:17 smithi063 ceph-mon[31070]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T01:20:17.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:17 smithi192 ceph-mon[34775]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T01:20:17.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:17 smithi162 ceph-mon[34539]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-16T01:20:19.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:19 smithi192 ceph-mon[34775]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-16T01:20:19.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:19 smithi063 ceph-mon[31070]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-16T01:20:19.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:19 smithi162 ceph-mon[34539]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-16T01:20:21.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:21 smithi063 ceph-mon[31070]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-16T01:20:21.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:21 smithi192 ceph-mon[34775]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-16T01:20:21.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:21 smithi162 ceph-mon[34539]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-16T01:20:22.349 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:22 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-16T01:20:22.349 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:22 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:22.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:22 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-16T01:20:22.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:22 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:22.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:22 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-16T01:20:22.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:22 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:23.225 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:23 smithi192 ceph-mon[34775]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-16T01:20:23.225 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:23 smithi192 ceph-mon[34775]: Deploying daemon osd.11 on smithi192 2024-09-16T01:20:23.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:23 smithi063 ceph-mon[31070]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-16T01:20:23.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:23 smithi063 ceph-mon[31070]: Deploying daemon osd.11 on smithi192 2024-09-16T01:20:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:23 smithi162 ceph-mon[34539]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-16T01:20:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:23 smithi162 ceph-mon[34539]: Deploying daemon osd.11 on smithi192 2024-09-16T01:20:24.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:24 smithi192 ceph-mon[34775]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T01:20:24.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:24 smithi162 ceph-mon[34539]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T01:20:24.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:24 smithi063 ceph-mon[31070]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T01:20:26.493 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:26 smithi192 ceph-mon[34775]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-16T01:20:26.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:26 smithi063 ceph-mon[31070]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-16T01:20:26.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:26 smithi162 ceph-mon[34539]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-16T01:20:28.480 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:28 smithi192 ceph-mon[34775]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:28.480 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:28.480 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:28.480 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:28 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:28.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:28 smithi063 ceph-mon[31070]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:28.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:28.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:28.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:28 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:28.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:28 smithi162 ceph-mon[34539]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:28.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:28.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:28.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:28 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:30.608 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:30 smithi192 ceph-mon[34775]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:30.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:30 smithi063 ceph-mon[31070]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:30.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:30 smithi162 ceph-mon[34539]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:31.054 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 11 on host 'smithi192' 2024-09-16T01:20:31.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.053+0000 7ff374ff9640 1 -- 172.21.15.192:0/3772262615 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff378062630 con 0x7ff3600a3460 2024-09-16T01:20:31.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.055+0000 7ff37e17d640 1 -- 172.21.15.192:0/3772262615 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3600a3460 msgr2=0x7ff3600a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:31.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.055+0000 7ff37e17d640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3600a3460 0x7ff3600a5920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00bbe0 tx=0x7ff36c00b390 comp rx=0 tx=0).stop 2024-09-16T01:20:31.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.055+0000 7ff37e17d640 1 -- 172.21.15.192:0/3772262615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3781078c0 msgr2=0x7ff378100b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:31.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.055+0000 7ff37e17d640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3781078c0 0x7ff378100b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff370009dc0 tx=0x7ff370003ba0 comp rx=0 tx=0).stop 2024-09-16T01:20:31.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.055+0000 7ff37e17d640 1 -- 172.21.15.192:0/3772262615 shutdown_connections 2024-09-16T01:20:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.055+0000 7ff37e17d640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3600a3460 0x7ff3600a5920 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.055+0000 7ff37e17d640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3781078c0 0x7ff378100b50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.055+0000 7ff37e17d640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff378104f90 0x7ff378100610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.055+0000 7ff37e17d640 1 --2- 172.21.15.192:0/3772262615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff378102660 0x7ff378101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.055+0000 7ff37e17d640 1 -- 172.21.15.192:0/3772262615 >> 172.21.15.192:0/3772262615 conn(0x7ff3780fc280 msgr2=0x7ff378102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.056+0000 7ff37e17d640 1 -- 172.21.15.192:0/3772262615 shutdown_connections 2024-09-16T01:20:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:31.056+0000 7ff37e17d640 1 -- 172.21.15.192:0/3772262615 wait complete. 2024-09-16T01:20:32.091 DEBUG:teuthology.orchestra.run.smithi192:osd.11> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.11.service 2024-09-16T01:20:32.095 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-16T01:20:32.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T01:20:32.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:32.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:32 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:32.367 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:20:32.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:32.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:32 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:32.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:32.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:32 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:32.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.855+0000 7f0725a50640 1 -- 172.21.15.63:0/1603694982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0720100b10 msgr2=0x7f0720100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:32.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.855+0000 7f0725a50640 1 --2- 172.21.15.63:0/1603694982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0720100b10 0x7f0720100f10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0710009900 tx=0x7f071002a410 comp rx=0 tx=0).stop 2024-09-16T01:20:32.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.855+0000 7f0725a50640 1 -- 172.21.15.63:0/1603694982 shutdown_connections 2024-09-16T01:20:32.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.855+0000 7f0725a50640 1 --2- 172.21.15.63:0/1603694982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07201026d0 0x7f0720108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:32.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.855+0000 7f0725a50640 1 --2- 172.21.15.63:0/1603694982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0720101d10 0x7f0720102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:32.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.855+0000 7f0725a50640 1 --2- 172.21.15.63:0/1603694982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0720100b10 0x7f0720100f10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:32.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.855+0000 7f0725a50640 1 -- 172.21.15.63:0/1603694982 >> 172.21.15.63:0/1603694982 conn(0x7f07200fc2a0 msgr2=0x7f07200fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.855+0000 7f0725a50640 1 -- 172.21.15.63:0/1603694982 shutdown_connections 2024-09-16T01:20:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.855+0000 7f0725a50640 1 -- 172.21.15.63:0/1603694982 wait complete. 2024-09-16T01:20:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.856+0000 7f0725a50640 1 Processor -- start 2024-09-16T01:20:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.856+0000 7f0725a50640 1 -- start start 2024-09-16T01:20:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f0725a50640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0720100b10 0x7f072019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f0725a50640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0720101d10 0x7f072019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f0725a50640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07201026d0 0x7f07201a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f0725a50640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f072010c6c0 con 0x7f0720100b10 2024-09-16T01:20:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f0725a50640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f072010c540 con 0x7f07201026d0 2024-09-16T01:20:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f0725a50640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f072010c840 con 0x7f0720101d10 2024-09-16T01:20:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0720100b10 0x7f072019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0720100b10 0x7f072019a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44160/0 (socket says 172.21.15.63:44160) 2024-09-16T01:20:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071effd640 1 -- 172.21.15.63:0/2239902924 learned_addr learned my addr 172.21.15.63:0/2239902924 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:20:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071e7fc640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0720101d10 0x7f072019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071f7fe640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07201026d0 0x7f07201a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071effd640 1 -- 172.21.15.63:0/2239902924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0720101d10 msgr2=0x7f072019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071effd640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0720101d10 0x7f072019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071effd640 1 -- 172.21.15.63:0/2239902924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07201026d0 msgr2=0x7f07201a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071effd640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07201026d0 0x7f07201a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071effd640 1 -- 172.21.15.63:0/2239902924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07201a1d00 con 0x7f0720100b10 2024-09-16T01:20:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.857+0000 7f071e7fc640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0720101d10 0x7f072019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:20:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.858+0000 7f071effd640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0720100b10 0x7f072019a0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f07100314e0 tx=0x7f0710031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.858+0000 7f0724a4e640 1 -- 172.21.15.63:0/2239902924 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071003f030 con 0x7f0720100b10 2024-09-16T01:20:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.858+0000 7f0724a4e640 1 -- 172.21.15.63:0/2239902924 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f07100044b0 con 0x7f0720100b10 2024-09-16T01:20:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.858+0000 7f0725a50640 1 -- 172.21.15.63:0/2239902924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07201a1f90 con 0x7f0720100b10 2024-09-16T01:20:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.858+0000 7f0724a4e640 1 -- 172.21.15.63:0/2239902924 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710035070 con 0x7f0720100b10 2024-09-16T01:20:32.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.858+0000 7f0725a50640 1 -- 172.21.15.63:0/2239902924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07201a2400 con 0x7f0720100b10 2024-09-16T01:20:32.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.859+0000 7f0725a50640 1 -- 172.21.15.63:0/2239902924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07201a26f0 con 0x7f0720100b10 2024-09-16T01:20:32.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.860+0000 7f0724a4e640 1 -- 172.21.15.63:0/2239902924 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0710042030 con 0x7f0720100b10 2024-09-16T01:20:32.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.861+0000 7f0724a4e640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f070c0a3270 0x7f070c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:32.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.861+0000 7f071e7fc640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f070c0a3270 0x7f070c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:32.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.861+0000 7f0724a4e640 1 -- 172.21.15.63:0/2239902924 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7f07100ef7d0 con 0x7f0720100b10 2024-09-16T01:20:32.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.862+0000 7f071e7fc640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f070c0a3270 0x7f070c0a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f072019b5f0 tx=0x7f0708005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:32.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:32.865+0000 7f0724a4e640 1 -- 172.21.15.63:0/2239902924 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07100bc480 con 0x7f0720100b10 2024-09-16T01:20:33.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.042+0000 7f0725a50640 1 -- 172.21.15.63:0/2239902924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f07201a29e0 con 0x7f0720100b10 2024-09-16T01:20:33.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.042+0000 7f0724a4e640 1 -- 172.21.15.63:0/2239902924 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f07100c0780 con 0x7f0720100b10 2024-09-16T01:20:33.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:20:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 -- 172.21.15.63:0/2239902924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f070c0a3270 msgr2=0x7f070c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f070c0a3270 0x7f070c0a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f072019b5f0 tx=0x7f0708005f90 comp rx=0 tx=0).stop 2024-09-16T01:20:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 -- 172.21.15.63:0/2239902924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0720100b10 msgr2=0x7f072019a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0720100b10 0x7f072019a0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f07100314e0 tx=0x7f0710031a30 comp rx=0 tx=0).stop 2024-09-16T01:20:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 -- 172.21.15.63:0/2239902924 shutdown_connections 2024-09-16T01:20:33.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f070c0a3270 0x7f070c0a5730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07201026d0 0x7f07201a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0720101d10 0x7f072019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 --2- 172.21.15.63:0/2239902924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0720100b10 0x7f072019a0d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 -- 172.21.15.63:0/2239902924 >> 172.21.15.63:0/2239902924 conn(0x7f07200fc2a0 msgr2=0x7f072006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 -- 172.21.15.63:0/2239902924 shutdown_connections 2024-09-16T01:20:33.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:33.045+0000 7f0725a50640 1 -- 172.21.15.63:0/2239902924 wait complete. 2024-09-16T01:20:33.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:33 smithi063 ceph-mon[31070]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:33.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:33.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:33 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:33.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:33 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2239902924' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T01:20:33.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:33 smithi192 ceph-mon[34775]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:33.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:33.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:33 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:33.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:33 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2239902924' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T01:20:33.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:33 smithi162 ceph-mon[34539]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:33.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:33.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:33 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:33.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:33 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2239902924' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T01:20:33.845 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726449610,"num_in_osds":12,"osd_in_since":1726449613,"num_remapped_pgs":0} 2024-09-16T01:20:33.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:20:33 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:20:33.651+0000 7f68cb75f640 -1 osd.11 0 log_to_monitors true 2024-09-16T01:20:34.068 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:34 smithi063 ceph-mon[31070]: from='osd.11 [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T01:20:34.069 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:34 smithi063 ceph-mon[31070]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T01:20:34.210 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:34 smithi192 ceph-mon[34775]: from='osd.11 [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T01:20:34.210 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:34 smithi192 ceph-mon[34775]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T01:20:34.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:34 smithi162 ceph-mon[34539]: from='osd.11 [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T01:20:34.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:34 smithi162 ceph-mon[34539]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-16T01:20:34.846 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T01:20:35.118 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:20:35.147 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:35 smithi192 ceph-mon[34775]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:35.147 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:35 smithi192 ceph-mon[34775]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-16T01:20:35.147 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:35 smithi192 ceph-mon[34775]: osdmap e74: 12 total, 11 up, 12 in 2024-09-16T01:20:35.147 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:35.148 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:35 smithi192 ceph-mon[34775]: from='osd.11 [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:20:35.148 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:35 smithi192 ceph-mon[34775]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:20:35.239 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:35 smithi063 ceph-mon[31070]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:35.239 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:35 smithi063 ceph-mon[31070]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-16T01:20:35.240 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:35 smithi063 ceph-mon[31070]: osdmap e74: 12 total, 11 up, 12 in 2024-09-16T01:20:35.240 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:35.240 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:35 smithi063 ceph-mon[31070]: from='osd.11 [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:20:35.240 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:35 smithi063 ceph-mon[31070]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:20:35.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:35 smithi162 ceph-mon[34539]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:35.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:35 smithi162 ceph-mon[34539]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-16T01:20:35.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:35 smithi162 ceph-mon[34539]: osdmap e74: 12 total, 11 up, 12 in 2024-09-16T01:20:35.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:35.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:35 smithi162 ceph-mon[34539]: from='osd.11 [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:20:35.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:35 smithi162 ceph-mon[34539]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-16T01:20:35.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.638+0000 7f43cf80b640 1 -- 172.21.15.63:0/3377350399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c81079b0 msgr2=0x7f43c8109da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.638+0000 7f43cf80b640 1 --2- 172.21.15.63:0/3377350399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c81079b0 0x7f43c8109da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009ca0 tx=0x7f43c002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.638+0000 7f43cf80b640 1 -- 172.21.15.63:0/3377350399 shutdown_connections 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.638+0000 7f43cf80b640 1 --2- 172.21.15.63:0/3377350399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c81079b0 0x7f43c8109da0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.638+0000 7f43cf80b640 1 --2- 172.21.15.63:0/3377350399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c8105080 0x7f43c8107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.638+0000 7f43cf80b640 1 --2- 172.21.15.63:0/3377350399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43c8102750 0x7f43c8104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.638+0000 7f43cf80b640 1 -- 172.21.15.63:0/3377350399 >> 172.21.15.63:0/3377350399 conn(0x7f43c80fc270 msgr2=0x7f43c80fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.638+0000 7f43cf80b640 1 -- 172.21.15.63:0/3377350399 shutdown_connections 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.638+0000 7f43cf80b640 1 -- 172.21.15.63:0/3377350399 wait complete. 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cf80b640 1 Processor -- start 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cf80b640 1 -- start start 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cf80b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43c8102750 0x7f43c8197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:35.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cf80b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c8105080 0x7f43c81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cf80b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c81079b0 0x7f43c819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cf80b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f43c810d840 con 0x7f43c81079b0 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cf80b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43c810d6c0 con 0x7f43c8105080 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cf80b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f43c810d9c0 con 0x7f43c8102750 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cdda8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c81079b0 0x7f43c819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cdda8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c81079b0 0x7f43c819f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44172/0 (socket says 172.21.15.63:44172) 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cdda8640 1 -- 172.21.15.63:0/2914299490 learned_addr learned my addr 172.21.15.63:0/2914299490 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43ccda6640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c8105080 0x7f43c81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.639+0000 7f43cd5a7640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43c8102750 0x7f43c8197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.640+0000 7f43cdda8640 1 -- 172.21.15.63:0/2914299490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43c8102750 msgr2=0x7f43c8197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.640+0000 7f43cdda8640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43c8102750 0x7f43c8197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.640+0000 7f43cdda8640 1 -- 172.21.15.63:0/2914299490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c8105080 msgr2=0x7f43c81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.640+0000 7f43cdda8640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c8105080 0x7f43c81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.640+0000 7f43cdda8640 1 -- 172.21.15.63:0/2914299490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c819fbe0 con 0x7f43c81079b0 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.640+0000 7f43ccda6640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c8105080 0x7f43c81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.640+0000 7f43cdda8640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c81079b0 0x7f43c819f570 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009dc0 tx=0x7f43c0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.642+0000 7f43be7fc640 1 -- 172.21.15.63:0/2914299490 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0004040 con 0x7f43c81079b0 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.642+0000 7f43cf80b640 1 -- 172.21.15.63:0/2914299490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c819fe70 con 0x7f43c81079b0 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.642+0000 7f43be7fc640 1 -- 172.21.15.63:0/2914299490 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f43c0004690 con 0x7f43c81079b0 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.642+0000 7f43be7fc640 1 -- 172.21.15.63:0/2914299490 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0030de0 con 0x7f43c81079b0 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.642+0000 7f43cf80b640 1 -- 172.21.15.63:0/2914299490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c81a03f0 con 0x7f43c81079b0 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.643+0000 7f43cf80b640 1 -- 172.21.15.63:0/2914299490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c80fdd60 con 0x7f43c81079b0 2024-09-16T01:20:35.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.644+0000 7f43be7fc640 1 -- 172.21.15.63:0/2914299490 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f43c00041e0 con 0x7f43c81079b0 2024-09-16T01:20:35.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.645+0000 7f43be7fc640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43b40a3270 0x7f43b40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:35.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.646+0000 7f43be7fc640 1 -- 172.21.15.63:0/2914299490 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6847+0+0 (secure 0 0 0) 0x7f43c00f0bf0 con 0x7f43c81079b0 2024-09-16T01:20:35.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.646+0000 7f43cd5a7640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43b40a3270 0x7f43b40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:35.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.647+0000 7f43cd5a7640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43b40a3270 0x7f43b40a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009890 tx=0x7f43c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:35.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.650+0000 7f43be7fc640 1 -- 172.21.15.63:0/2914299490 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43c004d3a0 con 0x7f43c81079b0 2024-09-16T01:20:35.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.825+0000 7f43cf80b640 1 -- 172.21.15.63:0/2914299490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f43c8062df0 con 0x7f43c81079b0 2024-09-16T01:20:35.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.826+0000 7f43be7fc640 1 -- 172.21.15.63:0/2914299490 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f43c00bded0 con 0x7f43c81079b0 2024-09-16T01:20:35.827 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:20:35.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 -- 172.21.15.63:0/2914299490 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43b40a3270 msgr2=0x7f43b40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:35.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43b40a3270 0x7f43b40a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009890 tx=0x7f43c4008040 comp rx=0 tx=0).stop 2024-09-16T01:20:35.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 -- 172.21.15.63:0/2914299490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c81079b0 msgr2=0x7f43c819f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:35.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c81079b0 0x7f43c819f570 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009dc0 tx=0x7f43c0003ba0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 -- 172.21.15.63:0/2914299490 shutdown_connections 2024-09-16T01:20:35.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f43b40a3270 0x7f43b40a5730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c81079b0 0x7f43c819f570 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43c8105080 0x7f43c81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 --2- 172.21.15.63:0/2914299490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43c8102750 0x7f43c8197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:35.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 -- 172.21.15.63:0/2914299490 >> 172.21.15.63:0/2914299490 conn(0x7f43c80fc270 msgr2=0x7f43c8102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:35.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 -- 172.21.15.63:0/2914299490 shutdown_connections 2024-09-16T01:20:35.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:35.828+0000 7f43cf80b640 1 -- 172.21.15.63:0/2914299490 wait complete. 2024-09-16T01:20:35.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:20:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:20:35.439+0000 7f68c76e2640 -1 osd.11 0 waiting for initial osdmap 2024-09-16T01:20:35.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:20:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:20:35.450+0000 7f68bf502640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:20:36.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:20:36.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: osdmap e75: 12 total, 11 up, 12 in 2024-09-16T01:20:36.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:36.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:36.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='osd.11 ' entity='osd.11' 2024-09-16T01:20:36.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:36.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:36.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:36.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:36.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:36.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:36 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2914299490' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T01:20:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:20:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: osdmap e75: 12 total, 11 up, 12 in 2024-09-16T01:20:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='osd.11 ' entity='osd.11' 2024-09-16T01:20:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:36.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:36.426 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.426 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:36 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2914299490' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T01:20:36.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-16T01:20:36.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: osdmap e75: 12 total, 11 up, 12 in 2024-09-16T01:20:36.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:36.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='osd.11 ' entity='osd.11' 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:36.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:36.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:36.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:36 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2914299490' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T01:20:36.640 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726449610,"num_in_osds":12,"osd_in_since":1726449613,"num_remapped_pgs":0} 2024-09-16T01:20:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:37 smithi063 ceph-mon[31070]: purged_snaps scrub starts 2024-09-16T01:20:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:37 smithi063 ceph-mon[31070]: purged_snaps scrub ok 2024-09-16T01:20:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:37 smithi063 ceph-mon[31070]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:37 smithi063 ceph-mon[31070]: Detected new or changed devices on smithi192 2024-09-16T01:20:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:37 smithi063 ceph-mon[31070]: Adjusting osd_memory_target on smithi192 to 4272M 2024-09-16T01:20:37.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:37 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:37.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:37 smithi063 ceph-mon[31070]: osd.11 [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] boot 2024-09-16T01:20:37.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:37 smithi063 ceph-mon[31070]: osdmap e76: 12 total, 12 up, 12 in 2024-09-16T01:20:37.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:37 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:37 smithi192 ceph-mon[34775]: purged_snaps scrub starts 2024-09-16T01:20:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:37 smithi192 ceph-mon[34775]: purged_snaps scrub ok 2024-09-16T01:20:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:37 smithi192 ceph-mon[34775]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:37.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:37 smithi192 ceph-mon[34775]: Detected new or changed devices on smithi192 2024-09-16T01:20:37.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:37 smithi192 ceph-mon[34775]: Adjusting osd_memory_target on smithi192 to 4272M 2024-09-16T01:20:37.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:37 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:37.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:37 smithi192 ceph-mon[34775]: osd.11 [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] boot 2024-09-16T01:20:37.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:37 smithi192 ceph-mon[34775]: osdmap e76: 12 total, 12 up, 12 in 2024-09-16T01:20:37.426 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:37 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:37 smithi162 ceph-mon[34539]: purged_snaps scrub starts 2024-09-16T01:20:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:37 smithi162 ceph-mon[34539]: purged_snaps scrub ok 2024-09-16T01:20:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:37 smithi162 ceph-mon[34539]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-16T01:20:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:37 smithi162 ceph-mon[34539]: Detected new or changed devices on smithi192 2024-09-16T01:20:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:37 smithi162 ceph-mon[34539]: Adjusting osd_memory_target on smithi192 to 4272M 2024-09-16T01:20:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:37 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:37.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:37 smithi162 ceph-mon[34539]: osd.11 [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] boot 2024-09-16T01:20:37.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:37 smithi162 ceph-mon[34539]: osdmap e76: 12 total, 12 up, 12 in 2024-09-16T01:20:37.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:37 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-16T01:20:37.641 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T01:20:37.908 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:20:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.393+0000 7f11ff53d640 1 -- 172.21.15.63:0/2726408281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f8105030 msgr2=0x7f11f8107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.393+0000 7f11ff53d640 1 --2- 172.21.15.63:0/2726408281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f8105030 0x7f11f8107420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009900 tx=0x7f11ec02a410 comp rx=0 tx=0).stop 2024-09-16T01:20:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 -- 172.21.15.63:0/2726408281 shutdown_connections 2024-09-16T01:20:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 --2- 172.21.15.63:0/2726408281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11f8107960 0x7f11f8109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 --2- 172.21.15.63:0/2726408281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f8105030 0x7f11f8107420 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 --2- 172.21.15.63:0/2726408281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11f8102700 0x7f11f8104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 -- 172.21.15.63:0/2726408281 >> 172.21.15.63:0/2726408281 conn(0x7f11f80fc280 msgr2=0x7f11f80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 -- 172.21.15.63:0/2726408281 shutdown_connections 2024-09-16T01:20:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 -- 172.21.15.63:0/2726408281 wait complete. 2024-09-16T01:20:38.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 Processor -- start 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 -- start start 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11f8102700 0x7f11f8197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11f8105030 0x7f11f8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.394+0000 7f11ff53d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f8107960 0x7f11f819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11ff53d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f11f810d760 con 0x7f11f8107960 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11ff53d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f11f810d5e0 con 0x7f11f8102700 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11ff53d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f11f810d8e0 con 0x7f11f8105030 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fdada640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f8107960 0x7f11f819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fdada640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f8107960 0x7f11f819f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44192/0 (socket says 172.21.15.63:44192) 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fdada640 1 -- 172.21.15.63:0/2815296167 learned_addr learned my addr 172.21.15.63:0/2815296167 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fcad8640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11f8105030 0x7f11f8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fd2d9640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11f8102700 0x7f11f8197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:38.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fdada640 1 -- 172.21.15.63:0/2815296167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11f8105030 msgr2=0x7f11f8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fdada640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11f8105030 0x7f11f8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fdada640 1 -- 172.21.15.63:0/2815296167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11f8102700 msgr2=0x7f11f8197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fdada640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11f8102700 0x7f11f8197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fdada640 1 -- 172.21.15.63:0/2815296167 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f819fa70 con 0x7f11f8107960 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fd2d9640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11f8102700 0x7f11f8197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11fdada640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f8107960 0x7f11f819f400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f11f000c970 tx=0x7f11f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11f67fc640 1 -- 172.21.15.63:0/2815296167 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0007bb0 con 0x7f11f8107960 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11ff53d640 1 -- 172.21.15.63:0/2815296167 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f819fd60 con 0x7f11f8107960 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11f67fc640 1 -- 172.21.15.63:0/2815296167 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f11f0007d50 con 0x7f11f8107960 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11f67fc640 1 -- 172.21.15.63:0/2815296167 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0018700 con 0x7f11f8107960 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.395+0000 7f11ff53d640 1 -- 172.21.15.63:0/2815296167 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f81a0290 con 0x7f11f8107960 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.396+0000 7f11ff53d640 1 -- 172.21.15.63:0/2815296167 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f80fdd70 con 0x7f11f8107960 2024-09-16T01:20:38.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.397+0000 7f11f67fc640 1 -- 172.21.15.63:0/2815296167 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f11f000fa20 con 0x7f11f8107960 2024-09-16T01:20:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.398+0000 7f11f67fc640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f11e00a3270 0x7f11e00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.398+0000 7f11fd2d9640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f11e00a3270 0x7f11e00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.398+0000 7f11f67fc640 1 -- 172.21.15.63:0/2815296167 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f11f00cf4d0 con 0x7f11f8107960 2024-09-16T01:20:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.399+0000 7f11fd2d9640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f11e00a3270 0x7f11e00a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f11e8007eb0 tx=0x7f11e80073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:38.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.402+0000 7f11f67fc640 1 -- 172.21.15.63:0/2815296167 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11f0014030 con 0x7f11f8107960 2024-09-16T01:20:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.579+0000 7f11ff53d640 1 -- 172.21.15.63:0/2815296167 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f11f8062df0 con 0x7f11f8107960 2024-09-16T01:20:38.581 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:38 smithi063 ceph-mon[31070]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:38.581 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:38 smithi063 ceph-mon[31070]: osdmap e77: 12 total, 12 up, 12 in 2024-09-16T01:20:38.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.580+0000 7f11f67fc640 1 -- 172.21.15.63:0/2815296167 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7f11f009c690 con 0x7f11f8107960 2024-09-16T01:20:38.582 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:20:38.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 -- 172.21.15.63:0/2815296167 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f11e00a3270 msgr2=0x7f11e00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:38.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f11e00a3270 0x7f11e00a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f11e8007eb0 tx=0x7f11e80073c0 comp rx=0 tx=0).stop 2024-09-16T01:20:38.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 -- 172.21.15.63:0/2815296167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f8107960 msgr2=0x7f11f819f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:38.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f8107960 0x7f11f819f400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f11f000c970 tx=0x7f11f000ce30 comp rx=0 tx=0).stop 2024-09-16T01:20:38.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 -- 172.21.15.63:0/2815296167 shutdown_connections 2024-09-16T01:20:38.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f11e00a3270 0x7f11e00a5730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:38.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11f8107960 0x7f11f819f400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:38.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11f8105030 0x7f11f8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:38.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 --2- 172.21.15.63:0/2815296167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11f8102700 0x7f11f8197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:38.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 -- 172.21.15.63:0/2815296167 >> 172.21.15.63:0/2815296167 conn(0x7f11f80fc280 msgr2=0x7f11f8103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:38.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 -- 172.21.15.63:0/2815296167 shutdown_connections 2024-09-16T01:20:38.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:38.582+0000 7f11ff53d640 1 -- 172.21.15.63:0/2815296167 wait complete. 2024-09-16T01:20:38.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:38 smithi192 ceph-mon[34775]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:38.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:38 smithi192 ceph-mon[34775]: osdmap e77: 12 total, 12 up, 12 in 2024-09-16T01:20:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:38 smithi162 ceph-mon[34539]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:38.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:38 smithi162 ceph-mon[34539]: osdmap e77: 12 total, 12 up, 12 in 2024-09-16T01:20:39.213 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1726449636,"num_in_osds":12,"osd_in_since":1726449613,"num_remapped_pgs":0} 2024-09-16T01:20:39.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:20:39.471 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:20:39.712 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:39 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2815296167' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T01:20:39.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:39 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2815296167' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T01:20:39.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:39 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2815296167' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T01:20:39.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.951+0000 7ff4cb293640 1 -- 172.21.15.63:0/4038247143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c4100e20 msgr2=0x7ff4c4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:39.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.951+0000 7ff4cb293640 1 --2- 172.21.15.63:0/4038247143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c4100e20 0x7ff4c4101200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc009900 tx=0x7ff4bc02a480 comp rx=0 tx=0).stop 2024-09-16T01:20:39.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.951+0000 7ff4cb293640 1 -- 172.21.15.63:0/4038247143 shutdown_connections 2024-09-16T01:20:39.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.951+0000 7ff4cb293640 1 --2- 172.21.15.63:0/4038247143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c4102ef0 0x7ff4c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:39.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.951+0000 7ff4cb293640 1 --2- 172.21.15.63:0/4038247143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4c4102570 0x7ff4c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:39.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.951+0000 7ff4cb293640 1 --2- 172.21.15.63:0/4038247143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c4100e20 0x7ff4c4101200 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:39.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.951+0000 7ff4cb293640 1 -- 172.21.15.63:0/4038247143 >> 172.21.15.63:0/4038247143 conn(0x7ff4c40fc7d0 msgr2=0x7ff4c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:39.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.951+0000 7ff4cb293640 1 -- 172.21.15.63:0/4038247143 shutdown_connections 2024-09-16T01:20:39.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.951+0000 7ff4cb293640 1 -- 172.21.15.63:0/4038247143 wait complete. 2024-09-16T01:20:39.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4cb293640 1 Processor -- start 2024-09-16T01:20:39.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4cb293640 1 -- start start 2024-09-16T01:20:39.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4cb293640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c4100e20 0x7ff4c4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:39.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4cb293640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c4102570 0x7ff4c4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:39.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4cb293640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4c4102ef0 0x7ff4c419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:39.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4cb293640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c4111f50 con 0x7ff4c4102570 2024-09-16T01:20:39.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4cb293640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c4111dd0 con 0x7ff4c4100e20 2024-09-16T01:20:39.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4cb293640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c41120d0 con 0x7ff4c4102ef0 2024-09-16T01:20:39.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4c882e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c4102570 0x7ff4c4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:39.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4c882e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c4102570 0x7ff4c4198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36698/0 (socket says 172.21.15.63:36698) 2024-09-16T01:20:39.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4c882e640 1 -- 172.21.15.63:0/1080732877 learned_addr learned my addr 172.21.15.63:0/1080732877 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4c902f640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c4100e20 0x7ff4c4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4c882e640 1 -- 172.21.15.63:0/1080732877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4c4102ef0 msgr2=0x7ff4c419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4c882e640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4c4102ef0 0x7ff4c419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4c882e640 1 -- 172.21.15.63:0/1080732877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c4100e20 msgr2=0x7ff4c4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4c882e640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c4100e20 0x7ff4c4198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4c882e640 1 -- 172.21.15.63:0/1080732877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c419d3e0 con 0x7ff4c4102570 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.952+0000 7ff4c902f640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c4100e20 0x7ff4c4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.953+0000 7ff4c882e640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c4102570 0x7ff4c4198970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800d770 tx=0x7ff4b800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.953+0000 7ff4c27fc640 1 -- 172.21.15.63:0/1080732877 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8017070 con 0x7ff4c4102570 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.953+0000 7ff4cb293640 1 -- 172.21.15.63:0/1080732877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c419d6d0 con 0x7ff4c4102570 2024-09-16T01:20:39.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.953+0000 7ff4c27fc640 1 -- 172.21.15.63:0/1080732877 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff4b80054d0 con 0x7ff4c4102570 2024-09-16T01:20:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.953+0000 7ff4c27fc640 1 -- 172.21.15.63:0/1080732877 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8004cf0 con 0x7ff4c4102570 2024-09-16T01:20:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.953+0000 7ff4cb293640 1 -- 172.21.15.63:0/1080732877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c41a4fb0 con 0x7ff4c4102570 2024-09-16T01:20:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.954+0000 7ff4cb293640 1 -- 172.21.15.63:0/1080732877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c4101200 con 0x7ff4c4102570 2024-09-16T01:20:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.955+0000 7ff4c27fc640 1 -- 172.21.15.63:0/1080732877 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff4b8004e90 con 0x7ff4c4102570 2024-09-16T01:20:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.956+0000 7ff4c27fc640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff4ac0a3240 0x7ff4ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.956+0000 7ff4c902f640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff4ac0a3240 0x7ff4ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.956+0000 7ff4c27fc640 1 -- 172.21.15.63:0/1080732877 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff4b80cf400 con 0x7ff4c4102570 2024-09-16T01:20:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.957+0000 7ff4c902f640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff4ac0a3240 0x7ff4ac0a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc005ab0 tx=0x7ff4bc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:39.960+0000 7ff4c27fc640 1 -- 172.21.15.63:0/1080732877 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff4b809c5a0 con 0x7ff4c4102570 2024-09-16T01:20:40.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.139+0000 7ff4cb293640 1 -- 172.21.15.63:0/1080732877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4c4109090 con 0x7ff4c4102570 2024-09-16T01:20:40.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.140+0000 7ff4c27fc640 1 -- 172.21.15.63:0/1080732877 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18420 (secure 0 0 0) 0x7ff4b809bea0 con 0x7ff4c4102570 2024-09-16T01:20:40.143 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:20:40.143 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":77,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:20:37.445906+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:20:40.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.142+0000 7ff4cb293640 1 -- 172.21.15.63:0/1080732877 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff4ac0a3240 msgr2=0x7ff4ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:40.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.142+0000 7ff4cb293640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff4ac0a3240 0x7ff4ac0a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc005ab0 tx=0x7ff4bc005a20 comp rx=0 tx=0).stop 2024-09-16T01:20:40.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.142+0000 7ff4cb293640 1 -- 172.21.15.63:0/1080732877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c4102570 msgr2=0x7ff4c4198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:40.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.142+0000 7ff4cb293640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c4102570 0x7ff4c4198970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800d770 tx=0x7ff4b800dc30 comp rx=0 tx=0).stop 2024-09-16T01:20:40.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.142+0000 7ff4cb293640 1 -- 172.21.15.63:0/1080732877 shutdown_connections 2024-09-16T01:20:40.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.142+0000 7ff4cb293640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff4ac0a3240 0x7ff4ac0a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:40.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.142+0000 7ff4cb293640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4c4102ef0 0x7ff4c419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:40.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.142+0000 7ff4cb293640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c4102570 0x7ff4c4198970 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:40.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.142+0000 7ff4cb293640 1 --2- 172.21.15.63:0/1080732877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c4100e20 0x7ff4c4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:40.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.142+0000 7ff4cb293640 1 -- 172.21.15.63:0/1080732877 >> 172.21.15.63:0/1080732877 conn(0x7ff4c40fc7d0 msgr2=0x7ff4c40fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:40.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.143+0000 7ff4cb293640 1 -- 172.21.15.63:0/1080732877 shutdown_connections 2024-09-16T01:20:40.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:40.143+0000 7ff4cb293640 1 -- 172.21.15.63:0/1080732877 wait complete. 2024-09-16T01:20:40.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:40 smithi063 ceph-mon[31070]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:40.809 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:40 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1080732877' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:20:40.841 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:16:51.610676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:20:40.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-16T01:20:40.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:40 smithi192 ceph-mon[34775]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:40.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:40 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1080732877' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:20:40.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:40 smithi162 ceph-mon[34539]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:40.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:40 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1080732877' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:20:41.097 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:20:41.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.703+0000 7f1e6a494640 1 -- 172.21.15.63:0/2507993791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e64102790 msgr2=0x7f1e641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.703+0000 7f1e6a494640 1 --2- 172.21.15.63:0/2507993791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e64102790 0x7f1e641067e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1e58009900 tx=0x7f1e5802a410 comp rx=0 tx=0).stop 2024-09-16T01:20:41.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.703+0000 7f1e6a494640 1 -- 172.21.15.63:0/2507993791 shutdown_connections 2024-09-16T01:20:41.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.703+0000 7f1e6a494640 1 --2- 172.21.15.63:0/2507993791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64106f10 0x7f1e6410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.703+0000 7f1e6a494640 1 --2- 172.21.15.63:0/2507993791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e64102790 0x7f1e641067e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.703+0000 7f1e6a494640 1 --2- 172.21.15.63:0/2507993791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e64101de0 0x7f1e641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.703+0000 7f1e6a494640 1 -- 172.21.15.63:0/2507993791 >> 172.21.15.63:0/2507993791 conn(0x7f1e640fd8c0 msgr2=0x7f1e640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.703+0000 7f1e6a494640 1 -- 172.21.15.63:0/2507993791 shutdown_connections 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.703+0000 7f1e6a494640 1 -- 172.21.15.63:0/2507993791 wait complete. 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.704+0000 7f1e6a494640 1 Processor -- start 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.704+0000 7f1e6a494640 1 -- start start 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.704+0000 7f1e6a494640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e64101de0 0x7f1e640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.704+0000 7f1e6a494640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e64102790 0x7f1e64074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.704+0000 7f1e6a494640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64106f10 0x7f1e64074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.704+0000 7f1e6a494640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1e64111e70 con 0x7f1e64101de0 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.704+0000 7f1e6a494640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e64111cf0 con 0x7f1e64102790 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.704+0000 7f1e6a494640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1e64111ff0 con 0x7f1e64106f10 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e64101de0 0x7f1e640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:41.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e63fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e64101de0 0x7f1e640744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36726/0 (socket says 172.21.15.63:36726) 2024-09-16T01:20:41.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e63fff640 1 -- 172.21.15.63:0/2052231163 learned_addr learned my addr 172.21.15.63:0/2052231163 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:20:41.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e68a31640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64106f10 0x7f1e64074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:41.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e637fe640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e64102790 0x7f1e64074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:41.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e63fff640 1 -- 172.21.15.63:0/2052231163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64106f10 msgr2=0x7f1e64074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e63fff640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64106f10 0x7f1e64074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e63fff640 1 -- 172.21.15.63:0/2052231163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e64102790 msgr2=0x7f1e64074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e63fff640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e64102790 0x7f1e64074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e63fff640 1 -- 172.21.15.63:0/2052231163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e641a6850 con 0x7f1e64101de0 2024-09-16T01:20:41.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e637fe640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e64102790 0x7f1e64074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:20:41.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e63fff640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e64101de0 0x7f1e640744f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400d950 tx=0x7f1e5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e617fa640 1 -- 172.21.15.63:0/2052231163 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e54017070 con 0x7f1e64101de0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e6a494640 1 -- 172.21.15.63:0/2052231163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e641a6b40 con 0x7f1e64101de0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e617fa640 1 -- 172.21.15.63:0/2052231163 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e54009c30 con 0x7f1e64101de0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e617fa640 1 -- 172.21.15.63:0/2052231163 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5400f620 con 0x7f1e64101de0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.705+0000 7f1e6a494640 1 -- 172.21.15.63:0/2052231163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e641a70a0 con 0x7f1e64101de0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.706+0000 7f1e6a494640 1 -- 172.21.15.63:0/2052231163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e641021c0 con 0x7f1e64101de0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.707+0000 7f1e617fa640 1 -- 172.21.15.63:0/2052231163 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1e540109a0 con 0x7f1e64101de0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.708+0000 7f1e617fa640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1e4c0a3240 0x7f1e4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.708+0000 7f1e637fe640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1e4c0a3240 0x7f1e4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.708+0000 7f1e617fa640 1 -- 172.21.15.63:0/2052231163 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f1e540cf040 con 0x7f1e64101de0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.709+0000 7f1e637fe640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1e4c0a3240 0x7f1e4c0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e58000c00 tx=0x7f1e58005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:41.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.711+0000 7f1e617fa640 1 -- 172.21.15.63:0/2052231163 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e54009de0 con 0x7f1e64101de0 2024-09-16T01:20:41.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.887+0000 7f1e6a494640 1 -- 172.21.15.63:0/2052231163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1e6410a0f0 con 0x7f1e64101de0 2024-09-16T01:20:41.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.888+0000 7f1e617fa640 1 -- 172.21.15.63:0/2052231163 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f1e5409c200 con 0x7f1e64101de0 2024-09-16T01:20:41.889 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-09-16T01:20:41.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 -- 172.21.15.63:0/2052231163 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1e4c0a3240 msgr2=0x7f1e4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1e4c0a3240 0x7f1e4c0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e58000c00 tx=0x7f1e58005a20 comp rx=0 tx=0).stop 2024-09-16T01:20:41.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 -- 172.21.15.63:0/2052231163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e64101de0 msgr2=0x7f1e640744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e64101de0 0x7f1e640744f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1e5400d950 tx=0x7f1e5400de10 comp rx=0 tx=0).stop 2024-09-16T01:20:41.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 -- 172.21.15.63:0/2052231163 shutdown_connections 2024-09-16T01:20:41.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1e4c0a3240 0x7f1e4c0a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e64106f10 0x7f1e64074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e64102790 0x7f1e64074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 --2- 172.21.15.63:0/2052231163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e64101de0 0x7f1e640744f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 -- 172.21.15.63:0/2052231163 >> 172.21.15.63:0/2052231163 conn(0x7f1e640fd8c0 msgr2=0x7f1e640fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:41.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 -- 172.21.15.63:0/2052231163 shutdown_connections 2024-09-16T01:20:41.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:41.890+0000 7f1e6a494640 1 -- 172.21.15.63:0/2052231163 wait complete. 2024-09-16T01:20:42.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:42 smithi063 ceph-mon[31070]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:42.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:42 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2052231163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:20:42.647 INFO:tasks.cephadm:Adding mds.a on smithi063 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.d on smithi063 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.g on smithi063 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.j on smithi063 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.b on smithi162 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.e on smithi162 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.h on smithi162 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.k on smithi162 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.c on smithi192 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.f on smithi192 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.i on smithi192 2024-09-16T01:20:42.648 INFO:tasks.cephadm:Adding mds.l on smithi192 2024-09-16T01:20:42.649 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l' 2024-09-16T01:20:42.909 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:20:42.923 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:42 smithi192 ceph-mon[34775]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:42.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:42 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2052231163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:20:42.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:42 smithi162 ceph-mon[34539]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:42.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:42 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2052231163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:20:43.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.360+0000 7f34c420e640 1 -- 172.21.15.192:0/2256204299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34bc100ad0 msgr2=0x7f34bc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:43.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.360+0000 7f34c420e640 1 --2- 172.21.15.192:0/2256204299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34bc100ad0 0x7f34bc100ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34b8009900 tx=0x7f34b802a410 comp rx=0 tx=0).stop 2024-09-16T01:20:43.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 -- 172.21.15.192:0/2256204299 shutdown_connections 2024-09-16T01:20:43.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 --2- 172.21.15.192:0/2256204299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc102690 0x7f34bc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:43.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 --2- 172.21.15.192:0/2256204299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34bc101cd0 0x7f34bc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:43.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 --2- 172.21.15.192:0/2256204299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34bc100ad0 0x7f34bc100ed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:43.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 -- 172.21.15.192:0/2256204299 >> 172.21.15.192:0/2256204299 conn(0x7f34bc0fc280 msgr2=0x7f34bc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:43.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 -- 172.21.15.192:0/2256204299 shutdown_connections 2024-09-16T01:20:43.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 -- 172.21.15.192:0/2256204299 wait complete. 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 Processor -- start 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 -- start start 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34bc100ad0 0x7f34bc10b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc101cd0 0x7f34bc109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34bc102690 0x7f34bc109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc10d730 con 0x7f34bc100ad0 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc10d5b0 con 0x7f34bc101cd0 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.361+0000 7f34c420e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc10d8b0 con 0x7f34bc102690 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c27ab640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34bc102690 0x7f34bc109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c27ab640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34bc102690 0x7f34bc109fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39962/0 (socket says 172.21.15.192:39962) 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c27ab640 1 -- 172.21.15.192:0/1610789159 learned_addr learned my addr 172.21.15.192:0/1610789159 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-16T01:20:43.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c17a9640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc101cd0 0x7f34bc109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c1faa640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34bc100ad0 0x7f34bc10b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c27ab640 1 -- 172.21.15.192:0/1610789159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc101cd0 msgr2=0x7f34bc109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c27ab640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc101cd0 0x7f34bc109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c27ab640 1 -- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34bc100ad0 msgr2=0x7f34bc10b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c27ab640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34bc100ad0 0x7f34bc10b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c27ab640 1 -- 172.21.15.192:0/1610789159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34bc10a8a0 con 0x7f34bc102690 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c1faa640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34bc100ad0 0x7f34bc10b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c27ab640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34bc102690 0x7f34bc109fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34b400cad0 tx=0x7f34b400cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34b2ffd640 1 -- 172.21.15.192:0/1610789159 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b400ae20 con 0x7f34bc102690 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34b2ffd640 1 -- 172.21.15.192:0/1610789159 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f34b4005020 con 0x7f34bc102690 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c420e640 1 -- 172.21.15.192:0/1610789159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34bc1a1fe0 con 0x7f34bc102690 2024-09-16T01:20:43.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34b2ffd640 1 -- 172.21.15.192:0/1610789159 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b400f6b0 con 0x7f34bc102690 2024-09-16T01:20:43.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.362+0000 7f34c420e640 1 -- 172.21.15.192:0/1610789159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34bc1a2490 con 0x7f34bc102690 2024-09-16T01:20:43.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.363+0000 7f34c420e640 1 -- 172.21.15.192:0/1610789159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34bc107f60 con 0x7f34bc102690 2024-09-16T01:20:43.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.365+0000 7f34b2ffd640 1 -- 172.21.15.192:0/1610789159 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f34b40051d0 con 0x7f34bc102690 2024-09-16T01:20:43.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.365+0000 7f34b2ffd640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f34a80a3240 0x7f34a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:43.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.365+0000 7f34b2ffd640 1 -- 172.21.15.192:0/1610789159 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f34b40cf8c0 con 0x7f34bc102690 2024-09-16T01:20:43.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.366+0000 7f34c1faa640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f34a80a3240 0x7f34a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:43.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.366+0000 7f34c1faa640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f34a80a3240 0x7f34a80a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f34b8006010 tx=0x7f34b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:43.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.373+0000 7f34b2ffd640 1 -- 172.21.15.192:0/1610789159 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34b4014030 con 0x7f34bc102690 2024-09-16T01:20:43.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.556+0000 7f34c420e640 1 -- 172.21.15.192:0/1610789159 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}) -- 0x7f34bc062730 con 0x7f34a80a3240 2024-09-16T01:20:43.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.563+0000 7f34b2ffd640 1 -- 172.21.15.192:0/1610789159 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f34bc062730 con 0x7f34a80a3240 2024-09-16T01:20:43.564 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mds.all update... 2024-09-16T01:20:43.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.565+0000 7f34c420e640 1 -- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f34a80a3240 msgr2=0x7f34a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:43.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.565+0000 7f34c420e640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f34a80a3240 0x7f34a80a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f34b8006010 tx=0x7f34b8000bc0 comp rx=0 tx=0).stop 2024-09-16T01:20:43.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.566+0000 7f34c420e640 1 -- 172.21.15.192:0/1610789159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34bc102690 msgr2=0x7f34bc109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:43.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.566+0000 7f34c420e640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34bc102690 0x7f34bc109fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34b400cad0 tx=0x7f34b400cf90 comp rx=0 tx=0).stop 2024-09-16T01:20:43.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.566+0000 7f34c420e640 1 -- 172.21.15.192:0/1610789159 shutdown_connections 2024-09-16T01:20:43.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.566+0000 7f34c420e640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f34a80a3240 0x7f34a80a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:43.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.566+0000 7f34c420e640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34bc102690 0x7f34bc109fe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:43.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.566+0000 7f34c420e640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34bc101cd0 0x7f34bc109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:43.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.566+0000 7f34c420e640 1 --2- 172.21.15.192:0/1610789159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34bc100ad0 0x7f34bc10b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:43.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.566+0000 7f34c420e640 1 -- 172.21.15.192:0/1610789159 >> 172.21.15.192:0/1610789159 conn(0x7f34bc0fc280 msgr2=0x7f34bc105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:43.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.566+0000 7f34c420e640 1 -- 172.21.15.192:0/1610789159 shutdown_connections 2024-09-16T01:20:43.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-16T01:20:43.566+0000 7f34c420e640 1 -- 172.21.15.192:0/1610789159 wait complete. 2024-09-16T01:20:44.270 DEBUG:teuthology.orchestra.run.smithi063:mds.a> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.a.service 2024-09-16T01:20:44.272 DEBUG:teuthology.orchestra.run.smithi063:mds.d> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.d.service 2024-09-16T01:20:44.315 DEBUG:teuthology.orchestra.run.smithi063:mds.g> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.g.service 2024-09-16T01:20:44.358 DEBUG:teuthology.orchestra.run.smithi063:mds.j> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.j.service 2024-09-16T01:20:44.401 DEBUG:teuthology.orchestra.run.smithi162:mds.b> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.b.service 2024-09-16T01:20:44.404 DEBUG:teuthology.orchestra.run.smithi162:mds.e> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.e.service 2024-09-16T01:20:44.448 DEBUG:teuthology.orchestra.run.smithi162:mds.h> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.h.service 2024-09-16T01:20:44.491 DEBUG:teuthology.orchestra.run.smithi162:mds.k> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.k.service 2024-09-16T01:20:44.534 DEBUG:teuthology.orchestra.run.smithi192:mds.c> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.c.service 2024-09-16T01:20:44.537 DEBUG:teuthology.orchestra.run.smithi192:mds.f> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.f.service 2024-09-16T01:20:44.580 DEBUG:teuthology.orchestra.run.smithi192:mds.i> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.i.service 2024-09-16T01:20:44.623 DEBUG:teuthology.orchestra.run.smithi192:mds.l> sudo journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.l.service 2024-09-16T01:20:44.666 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-16T01:20:44.666 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:20:44.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:44.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:20:44.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: Saving service mds.all spec with placement smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-16T01:20:44.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:44.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:44.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:44.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:44.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:44.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:44.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:44.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:44.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:44 smithi162 ceph-mon[34539]: Deploying daemon mds.l on smithi192 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: Saving service mds.all spec with placement smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:44.690 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:44.691 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:44 smithi063 ceph-mon[31070]: Deploying daemon mds.l on smithi192 2024-09-16T01:20:44.777 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:44.777 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:20:44.777 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: Saving service mds.all spec with placement smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-16T01:20:44.777 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:44.777 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:20:44.777 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:44.778 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:20:44.778 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:44.778 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:44.778 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:44.778 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:44.778 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:44 smithi192 ceph-mon[34775]: Deploying daemon mds.l on smithi192 2024-09-16T01:20:44.917 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:20:45.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.409+0000 7ff917afb640 1 -- 172.21.15.63:0/1330481784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff910101df0 msgr2=0x7ff910105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:45.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.409+0000 7ff917afb640 1 --2- 172.21.15.63:0/1330481784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff910101df0 0x7ff910105920 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff900009900 tx=0x7ff90002a410 comp rx=0 tx=0).stop 2024-09-16T01:20:45.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.409+0000 7ff917afb640 1 -- 172.21.15.63:0/1330481784 shutdown_connections 2024-09-16T01:20:45.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.409+0000 7ff917afb640 1 --2- 172.21.15.63:0/1330481784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff910106050 0x7ff91010dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:45.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.409+0000 7ff917afb640 1 --2- 172.21.15.63:0/1330481784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff910101df0 0x7ff910105920 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:45.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.409+0000 7ff917afb640 1 --2- 172.21.15.63:0/1330481784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff910101440 0x7ff910101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:45.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.409+0000 7ff917afb640 1 -- 172.21.15.63:0/1330481784 >> 172.21.15.63:0/1330481784 conn(0x7ff910077210 msgr2=0x7ff9100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:45.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.409+0000 7ff917afb640 1 -- 172.21.15.63:0/1330481784 shutdown_connections 2024-09-16T01:20:45.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.409+0000 7ff917afb640 1 -- 172.21.15.63:0/1330481784 wait complete. 2024-09-16T01:20:45.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff917afb640 1 Processor -- start 2024-09-16T01:20:45.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff917afb640 1 -- start start 2024-09-16T01:20:45.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff917afb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff910101440 0x7ff910197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:45.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff917afb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff910101df0 0x7ff9101976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:45.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff917afb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff910106050 0x7ff910197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:45.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff917afb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff910110f00 con 0x7ff910101df0 2024-09-16T01:20:45.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff917afb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff910110d80 con 0x7ff910101440 2024-09-16T01:20:45.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff917afb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff910111080 con 0x7ff910106050 2024-09-16T01:20:45.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff915096640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff910101df0 0x7ff9101976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:45.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff915096640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff910101df0 0x7ff9101976c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36736/0 (socket says 172.21.15.63:36736) 2024-09-16T01:20:45.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff915096640 1 -- 172.21.15.63:0/3259642632 learned_addr learned my addr 172.21.15.63:0/3259642632 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:20:45.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff915897640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff910101440 0x7ff910197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:45.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff915096640 1 -- 172.21.15.63:0/3259642632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff910106050 msgr2=0x7ff910197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:45.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff916098640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff910106050 0x7ff910197c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:45.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff915096640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff910106050 0x7ff910197c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:45.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff915096640 1 -- 172.21.15.63:0/3259642632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff910101440 msgr2=0x7ff910197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff915096640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff910101440 0x7ff910197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff915096640 1 -- 172.21.15.63:0/3259642632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9101a69f0 con 0x7ff910101df0 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff915897640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff910101440 0x7ff910197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.410+0000 7ff916098640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff910106050 0x7ff910197c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.411+0000 7ff915096640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff910101df0 0x7ff9101976c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff900005940 tx=0x7ff900004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.411+0000 7ff906ffd640 1 -- 172.21.15.63:0/3259642632 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90003f030 con 0x7ff910101df0 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.411+0000 7ff906ffd640 1 -- 172.21.15.63:0/3259642632 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff900003aa0 con 0x7ff910101df0 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.411+0000 7ff917afb640 1 -- 172.21.15.63:0/3259642632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9101a6c80 con 0x7ff910101df0 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.411+0000 7ff906ffd640 1 -- 172.21.15.63:0/3259642632 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff900035070 con 0x7ff910101df0 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.411+0000 7ff917afb640 1 -- 172.21.15.63:0/3259642632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9101a7160 con 0x7ff910101df0 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.412+0000 7ff917afb640 1 -- 172.21.15.63:0/3259642632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff910101820 con 0x7ff910101df0 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.413+0000 7ff906ffd640 1 -- 172.21.15.63:0/3259642632 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff900042030 con 0x7ff910101df0 2024-09-16T01:20:45.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.414+0000 7ff906ffd640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8fc0a3240 0x7ff8fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:45.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.414+0000 7ff915897640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8fc0a3240 0x7ff8fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:45.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.414+0000 7ff906ffd640 1 -- 172.21.15.63:0/3259642632 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff9000ef9a0 con 0x7ff910101df0 2024-09-16T01:20:45.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.414+0000 7ff915897640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8fc0a3240 0x7ff8fc0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00abe0 tx=0x7ff90c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:45.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.418+0000 7ff906ffd640 1 -- 172.21.15.63:0/3259642632 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9000bcb60 con 0x7ff910101df0 2024-09-16T01:20:45.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.629+0000 7ff917afb640 1 -- 172.21.15.63:0/3259642632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff910109290 con 0x7ff910101df0 2024-09-16T01:20:45.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.629+0000 7ff906ffd640 1 -- 172.21.15.63:0/3259642632 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7ff9000bc460 con 0x7ff910101df0 2024-09-16T01:20:45.632 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:20:45.632 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":1,"btime":"2024-09-16T01:13:51:098754+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-16T01:20:45.632 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 1 2024-09-16T01:20:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 -- 172.21.15.63:0/3259642632 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8fc0a3240 msgr2=0x7ff8fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8fc0a3240 0x7ff8fc0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00abe0 tx=0x7ff90c00a5c0 comp rx=0 tx=0).stop 2024-09-16T01:20:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 -- 172.21.15.63:0/3259642632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff910101df0 msgr2=0x7ff9101976c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:45.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff910101df0 0x7ff9101976c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff900005940 tx=0x7ff900004270 comp rx=0 tx=0).stop 2024-09-16T01:20:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 -- 172.21.15.63:0/3259642632 shutdown_connections 2024-09-16T01:20:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff8fc0a3240 0x7ff8fc0a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff910106050 0x7ff910197c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff910101df0 0x7ff9101976c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 --2- 172.21.15.63:0/3259642632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff910101440 0x7ff910197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 -- 172.21.15.63:0/3259642632 >> 172.21.15.63:0/3259642632 conn(0x7ff910077210 msgr2=0x7ff910104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 -- 172.21.15.63:0/3259642632 shutdown_connections 2024-09-16T01:20:45.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:45.632+0000 7ff917afb640 1 -- 172.21.15.63:0/3259642632 wait complete. 2024-09-16T01:20:46.142 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:20:45 smithi192 systemd[1]: Starting Ceph mds.l for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:20:46.403 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:20:46 smithi192 podman[63917]: 2024-09-16 01:20:46.04439681 +0000 UTC m=+0.015633161 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:20:46.403 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:20:46 smithi192 podman[63917]: 2024-09-16 01:20:46.150136108 +0000 UTC m=+0.121372446 container create 408d776c38a2d4bfaf79c04f1a754fec1ec6da4cf5dfd67c38e911aaaf44bd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-16T01:20:46.403 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:20:46 smithi192 podman[63917]: 2024-09-16 01:20:46.402966329 +0000 UTC m=+0.374202668 container init 408d776c38a2d4bfaf79c04f1a754fec1ec6da4cf5dfd67c38e911aaaf44bd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:20:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3259642632' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.192:6832/3923088697,v1:172.21.15.192:6833/3923088697] up:boot 2024-09-16T01:20:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: fsmap 1 up:standby 2024-09-16T01:20:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:20:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:46.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:46.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:46.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:46.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:46.675 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:20:46 smithi192 podman[63917]: 2024-09-16 01:20:46.405778019 +0000 UTC m=+0.377014356 container start 408d776c38a2d4bfaf79c04f1a754fec1ec6da4cf5dfd67c38e911aaaf44bd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:20:46.675 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-mds[63936]: -- 172.21.15.192:0/1680096135 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559d385c1c20 con 0x559d3859e800 2024-09-16T01:20:46.675 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:20:46 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-l[63932]: starting mds.l at 2024-09-16T01:20:46.675 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:20:46 smithi192 bash[63917]: 408d776c38a2d4bfaf79c04f1a754fec1ec6da4cf5dfd67c38e911aaaf44bd05 2024-09-16T01:20:46.675 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:20:46 smithi192 systemd[1]: Started Ceph mds.l for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:20:46.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:46.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3259642632' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:46.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.192:6832/3923088697,v1:172.21.15.192:6833/3923088697] up:boot 2024-09-16T01:20:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: fsmap 1 up:standby 2024-09-16T01:20:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:20:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:46.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:46 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:46.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:46.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3259642632' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:46.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.192:6832/3923088697,v1:172.21.15.192:6833/3923088697] up:boot 2024-09-16T01:20:46.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: fsmap 1 up:standby 2024-09-16T01:20:46.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-16T01:20:46.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:46.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:46.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:46.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:46.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:46.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:46 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:47.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:47 smithi063 ceph-mon[31070]: Deploying daemon mds.k on smithi162 2024-09-16T01:20:47.923 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:47 smithi192 ceph-mon[34775]: Deploying daemon mds.k on smithi162 2024-09-16T01:20:47.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:47 smithi162 ceph-mon[34539]: Deploying daemon mds.k on smithi162 2024-09-16T01:20:48.431 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:20:48.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:48 smithi162 ceph-mon[34539]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:48.684 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:20:48 smithi162 systemd[1]: Starting Ceph mds.k for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:20:48.700 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:20:48.821 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:48 smithi063 ceph-mon[31070]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:48.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:48 smithi192 ceph-mon[34775]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:49.157 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:20:48 smithi162 podman[63735]: 2024-09-16 01:20:48.750385243 +0000 UTC m=+0.016679616 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:20:49.158 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:20:48 smithi162 podman[63735]: 2024-09-16 01:20:48.896092891 +0000 UTC m=+0.162387317 container create a940b68fa6053dda096b7c5fbd2fbb05699aec66b9bdb3520fd1fbfbcf07ef80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:20:49.158 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:20:49 smithi162 podman[63735]: 2024-09-16 01:20:49.157133908 +0000 UTC m=+0.423428294 container init a940b68fa6053dda096b7c5fbd2fbb05699aec66b9bdb3520fd1fbfbcf07ef80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-16T01:20:49.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.217+0000 7ff9500c8640 1 -- 172.21.15.63:0/2431552586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff948109140 msgr2=0x7ff948110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:49.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.217+0000 7ff9500c8640 1 --2- 172.21.15.63:0/2431552586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff948109140 0x7ff948110cc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff940009ca0 tx=0x7ff94002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.217+0000 7ff9500c8640 1 -- 172.21.15.63:0/2431552586 shutdown_connections 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.217+0000 7ff9500c8640 1 --2- 172.21.15.63:0/2431552586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff948109140 0x7ff948110cc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.217+0000 7ff9500c8640 1 --2- 172.21.15.63:0/2431552586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9481049c0 0x7ff948108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.217+0000 7ff9500c8640 1 --2- 172.21.15.63:0/2431552586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff948104010 0x7ff9481043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.217+0000 7ff9500c8640 1 -- 172.21.15.63:0/2431552586 >> 172.21.15.63:0/2431552586 conn(0x7ff9480ffa50 msgr2=0x7ff948101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.217+0000 7ff9500c8640 1 -- 172.21.15.63:0/2431552586 shutdown_connections 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.217+0000 7ff9500c8640 1 -- 172.21.15.63:0/2431552586 wait complete. 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff9500c8640 1 Processor -- start 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff9500c8640 1 -- start start 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff9500c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff948104010 0x7ff94819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff9500c8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9481049c0 0x7ff94819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff9500c8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff948109140 0x7ff94819edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:49.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff9500c8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff948114000 con 0x7ff948109140 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff9500c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff948113e80 con 0x7ff948104010 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff9500c8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff948114180 con 0x7ff9481049c0 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94e665640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff948109140 0x7ff94819edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94e665640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff948109140 0x7ff94819edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33876/0 (socket says 172.21.15.63:33876) 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94e665640 1 -- 172.21.15.63:0/1861949288 learned_addr learned my addr 172.21.15.63:0/1861949288 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94de64640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff948104010 0x7ff94819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94d663640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9481049c0 0x7ff94819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94e665640 1 -- 172.21.15.63:0/1861949288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9481049c0 msgr2=0x7ff94819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94e665640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9481049c0 0x7ff94819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94e665640 1 -- 172.21.15.63:0/1861949288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff948104010 msgr2=0x7ff94819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94e665640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff948104010 0x7ff94819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94e665640 1 -- 172.21.15.63:0/1861949288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94819f4d0 con 0x7ff948109140 2024-09-16T01:20:49.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94d663640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9481049c0 0x7ff94819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.218+0000 7ff94de64640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff948104010 0x7ff94819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.219+0000 7ff94e665640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff948109140 0x7ff94819edf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff940009dc0 tx=0x7ff940032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.219+0000 7ff93effd640 1 -- 172.21.15.63:0/1861949288 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940003cf0 con 0x7ff948109140 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.219+0000 7ff93effd640 1 -- 172.21.15.63:0/1861949288 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff9400044f0 con 0x7ff948109140 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.219+0000 7ff93effd640 1 -- 172.21.15.63:0/1861949288 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940030bf0 con 0x7ff948109140 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.219+0000 7ff9500c8640 1 -- 172.21.15.63:0/1861949288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94819f760 con 0x7ff948109140 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.219+0000 7ff9500c8640 1 -- 172.21.15.63:0/1861949288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9481a70a0 con 0x7ff948109140 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.220+0000 7ff9500c8640 1 -- 172.21.15.63:0/1861949288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9481054f0 con 0x7ff948109140 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.222+0000 7ff93effd640 1 -- 172.21.15.63:0/1861949288 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff940004040 con 0x7ff948109140 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.223+0000 7ff93effd640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff9340a32c0 0x7ff9340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:49.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.223+0000 7ff94de64640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff9340a32c0 0x7ff9340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:49.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.223+0000 7ff93effd640 1 -- 172.21.15.63:0/1861949288 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7ff9400f0c40 con 0x7ff948109140 2024-09-16T01:20:49.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.223+0000 7ff94de64640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff9340a32c0 0x7ff9340a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff94400bfd0 tx=0x7ff94400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:49.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.226+0000 7ff93effd640 1 -- 172.21.15.63:0/1861949288 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9400bde00 con 0x7ff948109140 2024-09-16T01:20:49.433 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:20:49 smithi162 podman[63735]: 2024-09-16 01:20:49.160020033 +0000 UTC m=+0.426314407 container start a940b68fa6053dda096b7c5fbd2fbb05699aec66b9bdb3520fd1fbfbcf07ef80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-16T01:20:49.434 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:20:49 smithi162 ceph-mds[63754]: -- 172.21.15.162:0/2034653079 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56086d773860 con 0x56086d751400 2024-09-16T01:20:49.434 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:20:49 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-k[63750]: starting mds.k at 2024-09-16T01:20:49.434 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:20:49 smithi162 bash[63735]: a940b68fa6053dda096b7c5fbd2fbb05699aec66b9bdb3520fd1fbfbcf07ef80 2024-09-16T01:20:49.434 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:20:49 smithi162 systemd[1]: Started Ceph mds.k for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:20:49.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.459+0000 7ff9500c8640 1 -- 172.21.15.63:0/1861949288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9481043f0 con 0x7ff948109140 2024-09-16T01:20:49.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.459+0000 7ff93effd640 1 -- 172.21.15.63:0/1861949288 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7ff9481043f0 con 0x7ff948109140 2024-09-16T01:20:49.462 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:20:49.462 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":2,"btime":"2024-09-16T01:20:46:433556+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-16T01:20:49.462 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 2 2024-09-16T01:20:49.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 -- 172.21.15.63:0/1861949288 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff9340a32c0 msgr2=0x7ff9340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:49.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff9340a32c0 0x7ff9340a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff94400bfd0 tx=0x7ff94400b390 comp rx=0 tx=0).stop 2024-09-16T01:20:49.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 -- 172.21.15.63:0/1861949288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff948109140 msgr2=0x7ff94819edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:49.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff948109140 0x7ff94819edf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff940009dc0 tx=0x7ff940032ff0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 -- 172.21.15.63:0/1861949288 shutdown_connections 2024-09-16T01:20:49.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff9340a32c0 0x7ff9340a5780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff948109140 0x7ff94819edf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9481049c0 0x7ff94819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 --2- 172.21.15.63:0/1861949288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff948104010 0x7ff94819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:49.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 -- 172.21.15.63:0/1861949288 >> 172.21.15.63:0/1861949288 conn(0x7ff9480ffa50 msgr2=0x7ff948100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:49.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 -- 172.21.15.63:0/1861949288 shutdown_connections 2024-09-16T01:20:49.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:49.462+0000 7ff9500c8640 1 -- 172.21.15.63:0/1861949288 wait complete. 2024-09-16T01:20:50.551 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:50.551 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:50.551 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:50.552 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:50.552 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:50.552 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:50.552 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:50.552 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: Deploying daemon mds.j on smithi063 2024-09-16T01:20:50.552 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1861949288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:50.552 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.162:6832/4134893055,v1:172.21.15.162:6833/4134893055] up:boot 2024-09-16T01:20:50.552 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: fsmap 2 up:standby 2024-09-16T01:20:50.552 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:50 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:20:50.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:50.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:50.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:50.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:50.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:50.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:50.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:50.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: Deploying daemon mds.j on smithi063 2024-09-16T01:20:50.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1861949288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:50.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.162:6832/4134893055,v1:172.21.15.162:6833/4134893055] up:boot 2024-09-16T01:20:50.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: fsmap 2 up:standby 2024-09-16T01:20:50.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:50 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:20:50.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:50.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:50.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:50.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:50.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:50.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:50.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:50.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: Deploying daemon mds.j on smithi063 2024-09-16T01:20:50.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1861949288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:50.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.162:6832/4134893055,v1:172.21.15.162:6833/4134893055] up:boot 2024-09-16T01:20:50.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: fsmap 2 up:standby 2024-09-16T01:20:50.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:50 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-16T01:20:52.110 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:20:51 smithi063 systemd[1]: Starting Ceph mds.j for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:20:52.246 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:20:52.454 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:52 smithi063 ceph-mon[31070]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:52.454 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:20:52 smithi063 podman[70363]: 2024-09-16 01:20:52.089933473 +0000 UTC m=+0.016548300 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:20:52.454 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:20:52 smithi063 podman[70363]: 2024-09-16 01:20:52.200244222 +0000 UTC m=+0.126859044 container create 39662097d50c0b48ed05e623da88ee92414dedb5dd29d1e3af922623cf91244b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-j, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-16T01:20:52.454 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:20:52 smithi063 podman[70363]: 2024-09-16 01:20:52.453217201 +0000 UTC m=+0.379832026 container init 39662097d50c0b48ed05e623da88ee92414dedb5dd29d1e3af922623cf91244b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-16T01:20:52.642 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:20:52.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:52 smithi192 ceph-mon[34775]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:52.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:52 smithi162 ceph-mon[34539]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:52.765 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:20:52 smithi063 podman[70363]: 2024-09-16 01:20:52.456766822 +0000 UTC m=+0.383381655 container start 39662097d50c0b48ed05e623da88ee92414dedb5dd29d1e3af922623cf91244b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-16T01:20:52.765 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:20:52 smithi063 ceph-mds[70413]: -- 172.21.15.63:0/775283981 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bde1c91860 con 0x55bde1c6e800 2024-09-16T01:20:52.765 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:20:52 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-j[70396]: starting mds.j at 2024-09-16T01:20:52.765 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:20:52 smithi063 bash[70363]: 39662097d50c0b48ed05e623da88ee92414dedb5dd29d1e3af922623cf91244b 2024-09-16T01:20:52.765 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:20:52 smithi063 systemd[1]: Started Ceph mds.j for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:20:53.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.107+0000 7f803dd9d640 1 -- 172.21.15.63:0/3981864399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8038102380 msgr2=0x7f803810e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:53.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.107+0000 7f803dd9d640 1 --2- 172.21.15.63:0/3981864399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8038102380 0x7f803810e9c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8030009cd0 tx=0x7f803002a8e0 comp rx=0 tx=0).stop 2024-09-16T01:20:53.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.107+0000 7f803dd9d640 1 -- 172.21.15.63:0/3981864399 shutdown_connections 2024-09-16T01:20:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.107+0000 7f803dd9d640 1 --2- 172.21.15.63:0/3981864399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8038102380 0x7f803810e9c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.107+0000 7f803dd9d640 1 --2- 172.21.15.63:0/3981864399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80381019e0 0x7f8038101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.107+0000 7f803dd9d640 1 --2- 172.21.15.63:0/3981864399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8038107af0 0x7f8038107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.107+0000 7f803dd9d640 1 -- 172.21.15.63:0/3981864399 >> 172.21.15.63:0/3981864399 conn(0x7f80380fd700 msgr2=0x7f80380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:53.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.107+0000 7f803dd9d640 1 -- 172.21.15.63:0/3981864399 shutdown_connections 2024-09-16T01:20:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.107+0000 7f803dd9d640 1 -- 172.21.15.63:0/3981864399 wait complete. 2024-09-16T01:20:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f803dd9d640 1 Processor -- start 2024-09-16T01:20:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f803dd9d640 1 -- start start 2024-09-16T01:20:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f803dd9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80381019e0 0x7f80380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:53.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f803dd9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8038102380 0x7f8038074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f803dd9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8038107af0 0x7f8038074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f803dd9d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8038111da0 con 0x7f8038102380 2024-09-16T01:20:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f803dd9d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8038111c20 con 0x7f8038107af0 2024-09-16T01:20:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f803dd9d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8038111f20 con 0x7f80381019e0 2024-09-16T01:20:53.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f8037fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8038102380 0x7f8038074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f8037fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8038102380 0x7f8038074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33920/0 (socket says 172.21.15.63:33920) 2024-09-16T01:20:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f8037fff640 1 -- 172.21.15.63:0/3885329451 learned_addr learned my addr 172.21.15.63:0/3885329451 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:20:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f803d59c640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8038107af0 0x7f8038074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.108+0000 7f803cd9b640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80381019e0 0x7f80380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:53.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f8037fff640 1 -- 172.21.15.63:0/3885329451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80381019e0 msgr2=0x7f80380744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:53.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f8037fff640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80381019e0 0x7f80380744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:53.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f8037fff640 1 -- 172.21.15.63:0/3885329451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8038107af0 msgr2=0x7f8038074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:53.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f8037fff640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8038107af0 0x7f8038074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:53.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f8037fff640 1 -- 172.21.15.63:0/3885329451 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80381a6740 con 0x7f8038102380 2024-09-16T01:20:53.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f803cd9b640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80381019e0 0x7f80380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f803d59c640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8038107af0 0x7f8038074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f8037fff640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8038102380 0x7f8038074a30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f802400d770 tx=0x7f802400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f8035ffb640 1 -- 172.21.15.63:0/3885329451 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024017070 con 0x7f8038102380 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f803dd9d640 1 -- 172.21.15.63:0/3885329451 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80381a6a30 con 0x7f8038102380 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f8035ffb640 1 -- 172.21.15.63:0/3885329451 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f80240054d0 con 0x7f8038102380 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f8035ffb640 1 -- 172.21.15.63:0/3885329451 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024004cf0 con 0x7f8038102380 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.109+0000 7f803dd9d640 1 -- 172.21.15.63:0/3885329451 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80381a6f20 con 0x7f8038102380 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.110+0000 7f803dd9d640 1 -- 172.21.15.63:0/3885329451 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8038101e40 con 0x7f8038102380 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.112+0000 7f8035ffb640 1 -- 172.21.15.63:0/3885329451 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8024004e90 con 0x7f8038102380 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.112+0000 7f8035ffb640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80280a3240 0x7f80280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.112+0000 7f803cd9b640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80280a3240 0x7f80280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:53.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.112+0000 7f8035ffb640 1 -- 172.21.15.63:0/3885329451 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f80240cf3e0 con 0x7f8038102380 2024-09-16T01:20:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.113+0000 7f803cd9b640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80280a3240 0x7f80280a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f802c005fd0 tx=0x7f802c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:53.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.115+0000 7f8035ffb640 1 -- 172.21.15.63:0/3885329451 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f802409c5a0 con 0x7f8038102380 2024-09-16T01:20:53.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.332+0000 7f803dd9d640 1 -- 172.21.15.63:0/3885329451 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8038075a20 con 0x7f8038102380 2024-09-16T01:20:53.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.333+0000 7f8035ffb640 1 -- 172.21.15.63:0/3885329451 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f802409bea0 con 0x7f8038102380 2024-09-16T01:20:53.335 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:20:53.335 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":3,"btime":"2024-09-16T01:20:49:575759+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-16T01:20:53.336 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 3 2024-09-16T01:20:53.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 -- 172.21.15.63:0/3885329451 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80280a3240 msgr2=0x7f80280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:53.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80280a3240 0x7f80280a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f802c005fd0 tx=0x7f802c005850 comp rx=0 tx=0).stop 2024-09-16T01:20:53.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 -- 172.21.15.63:0/3885329451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8038102380 msgr2=0x7f8038074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8038102380 0x7f8038074a30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f802400d770 tx=0x7f802400dc30 comp rx=0 tx=0).stop 2024-09-16T01:20:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 -- 172.21.15.63:0/3885329451 shutdown_connections 2024-09-16T01:20:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80280a3240 0x7f80280a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8038107af0 0x7f8038074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8038102380 0x7f8038074a30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 --2- 172.21.15.63:0/3885329451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80381019e0 0x7f80380744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 -- 172.21.15.63:0/3885329451 >> 172.21.15.63:0/3885329451 conn(0x7f80380fd700 msgr2=0x7f80380fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 -- 172.21.15.63:0/3885329451 shutdown_connections 2024-09-16T01:20:53.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:53.335+0000 7f803dd9d640 1 -- 172.21.15.63:0/3885329451 wait complete. 2024-09-16T01:20:53.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:53.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:53.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:53.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:53.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:53.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:53.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: Deploying daemon mds.d on smithi063 2024-09-16T01:20:53.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3885329451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:53.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.63:6834/2088156309,v1:172.21.15.63:6835/2088156309] up:boot 2024-09-16T01:20:53.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: fsmap 3 up:standby 2024-09-16T01:20:53.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:53 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T01:20:53.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:53.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:53.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:53.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:53.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:53.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:53.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: Deploying daemon mds.d on smithi063 2024-09-16T01:20:53.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3885329451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:53.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.63:6834/2088156309,v1:172.21.15.63:6835/2088156309] up:boot 2024-09-16T01:20:53.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: fsmap 3 up:standby 2024-09-16T01:20:53.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:53 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T01:20:54.108 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:54.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:54.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:54.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:54.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:54.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:54.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: Deploying daemon mds.d on smithi063 2024-09-16T01:20:54.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3885329451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:54.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.63:6834/2088156309,v1:172.21.15.63:6835/2088156309] up:boot 2024-09-16T01:20:54.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: fsmap 3 up:standby 2024-09-16T01:20:54.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:53 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-16T01:20:54.814 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:54 smithi063 ceph-mon[31070]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:54.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:54 smithi192 ceph-mon[34775]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:54.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:54 smithi162 ceph-mon[34539]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:55.823 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:20:55 smithi063 systemd[1]: Starting Ceph mds.d for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:20:56.076 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:20:55 smithi063 podman[70776]: 2024-09-16 01:20:55.822235217 +0000 UTC m=+0.101536123 container create 9af031d7390e4426a6d9b116800f5d0ae2e755979793dc02a28c82f4fee97466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:20:56.076 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:20:55 smithi063 podman[70776]: 2024-09-16 01:20:55.737296503 +0000 UTC m=+0.016597410 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:20:56.077 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:20:56 smithi063 podman[70776]: 2024-09-16 01:20:56.074898844 +0000 UTC m=+0.354199751 container init 9af031d7390e4426a6d9b116800f5d0ae2e755979793dc02a28c82f4fee97466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-16T01:20:56.139 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:20:56.359 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:20:56 smithi063 podman[70776]: 2024-09-16 01:20:56.0780321 +0000 UTC m=+0.357333013 container start 9af031d7390e4426a6d9b116800f5d0ae2e755979793dc02a28c82f4fee97466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-16T01:20:56.359 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:20:56 smithi063 ceph-mds[70795]: -- 172.21.15.63:0/985188147 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56496cf39860 con 0x56496cf16800 2024-09-16T01:20:56.359 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:20:56 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-d[70791]: starting mds.d at 2024-09-16T01:20:56.360 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:20:56 smithi063 bash[70776]: 9af031d7390e4426a6d9b116800f5d0ae2e755979793dc02a28c82f4fee97466 2024-09-16T01:20:56.360 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:20:56 smithi063 systemd[1]: Started Ceph mds.d for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:20:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:20:56.803 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:56 smithi063 ceph-mon[31070]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:56.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:56.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:56.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:56.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:56.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:56.804 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:56 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:56.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.885+0000 7f6d009b8640 1 -- 172.21.15.63:0/4221001174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cfc102d30 msgr2=0x7f6cfc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:56.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.885+0000 7f6d009b8640 1 --2- 172.21.15.63:0/4221001174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cfc102d30 0x7f6cfc103110 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009930 tx=0x7f6cf402a440 comp rx=0 tx=0).stop 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.885+0000 7f6d009b8640 1 -- 172.21.15.63:0/4221001174 shutdown_connections 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.885+0000 7f6d009b8640 1 --2- 172.21.15.63:0/4221001174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc1082a0 0x7f6cfc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.885+0000 7f6d009b8640 1 --2- 172.21.15.63:0/4221001174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cfc1036e0 0x7f6cfc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.885+0000 7f6d009b8640 1 --2- 172.21.15.63:0/4221001174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cfc102d30 0x7f6cfc103110 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.885+0000 7f6d009b8640 1 -- 172.21.15.63:0/4221001174 >> 172.21.15.63:0/4221001174 conn(0x7f6cfc0fc7d0 msgr2=0x7f6cfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.885+0000 7f6d009b8640 1 -- 172.21.15.63:0/4221001174 shutdown_connections 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.885+0000 7f6d009b8640 1 -- 172.21.15.63:0/4221001174 wait complete. 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6d009b8640 1 Processor -- start 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6d009b8640 1 -- start start 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6d009b8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc102d30 0x7f6cfc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6d009b8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cfc1036e0 0x7f6cfc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:56.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6d009b8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cfc1082a0 0x7f6cfc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6d009b8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc111f90 con 0x7f6cfc1082a0 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6d009b8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc111e10 con 0x7f6cfc102d30 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6d009b8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc112110 con 0x7f6cfc1036e0 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6cfad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cfc1082a0 0x7f6cfc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6cfa59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc102d30 0x7f6cfc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6cfad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cfc1082a0 0x7f6cfc101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33944/0 (socket says 172.21.15.63:33944) 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.886+0000 7f6cfad9d640 1 -- 172.21.15.63:0/1571536437 learned_addr learned my addr 172.21.15.63:0/1571536437 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6cf9d9b640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cfc1036e0 0x7f6cfc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6cfad9d640 1 -- 172.21.15.63:0/1571536437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cfc1036e0 msgr2=0x7f6cfc100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6cfad9d640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cfc1036e0 0x7f6cfc100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6cfad9d640 1 -- 172.21.15.63:0/1571536437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc102d30 msgr2=0x7f6cfc100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6cfad9d640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc102d30 0x7f6cfc100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6cfad9d640 1 -- 172.21.15.63:0/1571536437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc1a6a30 con 0x7f6cfc1082a0 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6cfad9d640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cfc1082a0 0x7f6cfc101410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009fd0 tx=0x7f6cec00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6cf37fe640 1 -- 172.21.15.63:0/1571536437 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec017070 con 0x7f6cfc1082a0 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6cf37fe640 1 -- 172.21.15.63:0/1571536437 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cec003e20 con 0x7f6cfc1082a0 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6d009b8640 1 -- 172.21.15.63:0/1571536437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc1a6d20 con 0x7f6cfc1082a0 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6cf37fe640 1 -- 172.21.15.63:0/1571536437 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec010460 con 0x7f6cfc1082a0 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.887+0000 7f6d009b8640 1 -- 172.21.15.63:0/1571536437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc1a7210 con 0x7f6cfc1082a0 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.888+0000 7f6d009b8640 1 -- 172.21.15.63:0/1571536437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc06a850 con 0x7f6cfc1082a0 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.889+0000 7f6cf37fe640 1 -- 172.21.15.63:0/1571536437 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6cec003970 con 0x7f6cfc1082a0 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.890+0000 7f6cf37fe640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6ce80a3240 0x7f6ce80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.891+0000 7f6cfa59c640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6ce80a3240 0x7f6ce80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.891+0000 7f6cf37fe640 1 -- 172.21.15.63:0/1571536437 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f6cec0cf280 con 0x7f6cfc1082a0 2024-09-16T01:20:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.891+0000 7f6cfa59c640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6ce80a3240 0x7f6ce80a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009900 tx=0x7f6cf4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:56.895+0000 7f6cf37fe640 1 -- 172.21.15.63:0/1571536437 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6cec09c440 con 0x7f6cfc1082a0 2024-09-16T01:20:56.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:56 smithi192 ceph-mon[34775]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:56.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:56.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:56.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:56.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:56.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:56.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:56 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:56.927 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:56 smithi162 ceph-mon[34539]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:56.927 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:56.927 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:56.927 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:20:56.927 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:20:56.927 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:20:56.928 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:56 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:20:57.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.104+0000 7f6d009b8640 1 -- 172.21.15.63:0/1571536437 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cfc10a2b0 con 0x7f6cfc1082a0 2024-09-16T01:20:57.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.105+0000 7f6cf37fe640 1 -- 172.21.15.63:0/1571536437 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f6cec09bd40 con 0x7f6cfc1082a0 2024-09-16T01:20:57.107 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:20:57.107 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"btime":"2024-09-16T01:20:56:630106+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-16T01:20:57.108 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 5 2024-09-16T01:20:57.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 -- 172.21.15.63:0/1571536437 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6ce80a3240 msgr2=0x7f6ce80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:57.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6ce80a3240 0x7f6ce80a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009900 tx=0x7f6cf4000bc0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 -- 172.21.15.63:0/1571536437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cfc1082a0 msgr2=0x7f6cfc101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:57.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cfc1082a0 0x7f6cfc101410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009fd0 tx=0x7f6cec00b260 comp rx=0 tx=0).stop 2024-09-16T01:20:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 -- 172.21.15.63:0/1571536437 shutdown_connections 2024-09-16T01:20:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6ce80a3240 0x7f6ce80a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cfc1082a0 0x7f6cfc101410 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cfc1036e0 0x7f6cfc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 --2- 172.21.15.63:0/1571536437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cfc102d30 0x7f6cfc100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 -- 172.21.15.63:0/1571536437 >> 172.21.15.63:0/1571536437 conn(0x7f6cfc0fc7d0 msgr2=0x7f6cfc105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 -- 172.21.15.63:0/1571536437 shutdown_connections 2024-09-16T01:20:57.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:20:57.108+0000 7f6d009b8640 1 -- 172.21.15.63:0/1571536437 wait complete. 2024-09-16T01:20:57.857 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:57 smithi063 ceph-mon[31070]: Deploying daemon mds.e on smithi162 2024-09-16T01:20:57.858 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:57 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.63:6836/888614929,v1:172.21.15.63:6837/888614929] up:boot 2024-09-16T01:20:57.858 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:57 smithi063 ceph-mon[31070]: fsmap 4 up:standby 2024-09-16T01:20:57.858 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:57 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T01:20:57.858 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:57 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1571536437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:57.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:57 smithi192 ceph-mon[34775]: Deploying daemon mds.e on smithi162 2024-09-16T01:20:57.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:57 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.63:6836/888614929,v1:172.21.15.63:6837/888614929] up:boot 2024-09-16T01:20:57.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:57 smithi192 ceph-mon[34775]: fsmap 4 up:standby 2024-09-16T01:20:57.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:57 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T01:20:57.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:57 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1571536437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:57.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:57 smithi162 ceph-mon[34539]: Deploying daemon mds.e on smithi162 2024-09-16T01:20:57.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:57 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.63:6836/888614929,v1:172.21.15.63:6837/888614929] up:boot 2024-09-16T01:20:57.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:57 smithi162 ceph-mon[34539]: fsmap 4 up:standby 2024-09-16T01:20:57.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:57 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-16T01:20:57.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:57 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1571536437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:20:58.434 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:20:58 smithi162 systemd[1]: Starting Ceph mds.e for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:20:58.696 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:58 smithi162 ceph-mon[34539]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:58.697 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:20:58 smithi162 podman[64037]: 2024-09-16 01:20:58.340443049 +0000 UTC m=+0.016214303 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:20:58.697 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:20:58 smithi162 podman[64037]: 2024-09-16 01:20:58.442489813 +0000 UTC m=+0.118261053 container create 086ea1b0f9623cb459729ce848104e0f60d1ab5ad70091011426e92a2f48c215 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-16T01:20:58.697 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:20:58 smithi162 podman[64037]: 2024-09-16 01:20:58.670378707 +0000 UTC m=+0.346149948 container init 086ea1b0f9623cb459729ce848104e0f60d1ab5ad70091011426e92a2f48c215 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-16T01:20:58.697 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:20:58 smithi162 podman[64037]: 2024-09-16 01:20:58.673358618 +0000 UTC m=+0.349129860 container start 086ea1b0f9623cb459729ce848104e0f60d1ab5ad70091011426e92a2f48c215 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2) 2024-09-16T01:20:58.697 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:20:58 smithi162 ceph-mds[64056]: -- 172.21.15.162:0/3236154461 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a168813860 con 0x55a1687f0800 2024-09-16T01:20:58.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:58 smithi192 ceph-mon[34775]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:59.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:58 smithi063 ceph-mon[31070]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:20:59.184 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:20:58 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e[64052]: starting mds.e at 2024-09-16T01:20:59.184 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:20:58 smithi162 bash[64037]: 086ea1b0f9623cb459729ce848104e0f60d1ab5ad70091011426e92a2f48c215 2024-09-16T01:20:59.184 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:20:58 smithi162 systemd[1]: Started Ceph mds.e for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:20:59.886 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:21:00.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:00.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:00.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:59 smithi063 ceph-mon[31070]: Deploying daemon mds.f on smithi192 2024-09-16T01:21:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:59 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.162:6834/1954173887,v1:172.21.15.162:6835/1954173887] up:boot 2024-09-16T01:21:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:59 smithi063 ceph-mon[31070]: fsmap 5 up:standby 2024-09-16T01:21:00.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:20:59 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:21:00.158 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:00.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:00.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:00.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:59 smithi192 ceph-mon[34775]: Deploying daemon mds.f on smithi192 2024-09-16T01:21:00.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:59 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.162:6834/1954173887,v1:172.21.15.162:6835/1954173887] up:boot 2024-09-16T01:21:00.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:59 smithi192 ceph-mon[34775]: fsmap 5 up:standby 2024-09-16T01:21:00.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:20:59 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:21:00.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:00.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:00.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:00.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:00.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:00.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:00.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:59 smithi162 ceph-mon[34539]: Deploying daemon mds.f on smithi192 2024-09-16T01:21:00.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:59 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.162:6834/1954173887,v1:172.21.15.162:6835/1954173887] up:boot 2024-09-16T01:21:00.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:59 smithi162 ceph-mon[34539]: fsmap 5 up:standby 2024-09-16T01:21:00.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:20:59 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:21:00.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.624+0000 7f5818cce640 1 -- 172.21.15.63:0/496910270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58141082a0 msgr2=0x7f581410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:00.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.624+0000 7f5818cce640 1 --2- 172.21.15.63:0/496910270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58141082a0 0x7f581410ec40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f580c009930 tx=0x7f580c02a420 comp rx=0 tx=0).stop 2024-09-16T01:21:00.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.624+0000 7f5818cce640 1 -- 172.21.15.63:0/496910270 shutdown_connections 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.624+0000 7f5818cce640 1 --2- 172.21.15.63:0/496910270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58141082a0 0x7f581410ec40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.624+0000 7f5818cce640 1 --2- 172.21.15.63:0/496910270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58141036e0 0x7f5814107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.624+0000 7f5818cce640 1 --2- 172.21.15.63:0/496910270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5814102d30 0x7f5814103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.624+0000 7f5818cce640 1 -- 172.21.15.63:0/496910270 >> 172.21.15.63:0/496910270 conn(0x7f58140fc7d0 msgr2=0x7f58140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.624+0000 7f5818cce640 1 -- 172.21.15.63:0/496910270 shutdown_connections 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.624+0000 7f5818cce640 1 -- 172.21.15.63:0/496910270 wait complete. 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.624+0000 7f5818cce640 1 Processor -- start 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5818cce640 1 -- start start 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5818cce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5814102d30 0x7f5814198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5818cce640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58141036e0 0x7f58141989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5818cce640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58141082a0 0x7f581419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:00.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5818cce640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5814111f50 con 0x7f58141082a0 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5818cce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5814111dd0 con 0x7f5814102d30 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5818cce640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f58141120d0 con 0x7f58141036e0 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5812d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58141082a0 0x7f581419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5812d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58141082a0 0x7f581419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57228/0 (socket says 172.21.15.63:57228) 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5812d9d640 1 -- 172.21.15.63:0/1857408127 learned_addr learned my addr 172.21.15.63:0/1857408127 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f581259c640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5814102d30 0x7f5814198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5811d9b640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58141036e0 0x7f58141989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5812d9d640 1 -- 172.21.15.63:0/1857408127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58141036e0 msgr2=0x7f58141989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5812d9d640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58141036e0 0x7f58141989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5812d9d640 1 -- 172.21.15.63:0/1857408127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5814102d30 msgr2=0x7f5814198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5812d9d640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5814102d30 0x7f5814198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:00.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5812d9d640 1 -- 172.21.15.63:0/1857408127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581419d420 con 0x7f58141082a0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.625+0000 7f5812d9d640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58141082a0 0x7f581419cd40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f580c005940 tx=0x7f580c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.626+0000 7f580b7fe640 1 -- 172.21.15.63:0/1857408127 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c03f030 con 0x7f58141082a0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.626+0000 7f580b7fe640 1 -- 172.21.15.63:0/1857408127 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f580c003aa0 con 0x7f58141082a0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.626+0000 7f5818cce640 1 -- 172.21.15.63:0/1857408127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581419d6b0 con 0x7f58141082a0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.626+0000 7f580b7fe640 1 -- 172.21.15.63:0/1857408127 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c035070 con 0x7f58141082a0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.626+0000 7f5818cce640 1 -- 172.21.15.63:0/1857408127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58141a4ff0 con 0x7f58141082a0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.627+0000 7f5818cce640 1 -- 172.21.15.63:0/1857408127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f581406a850 con 0x7f58141082a0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.628+0000 7f580b7fe640 1 -- 172.21.15.63:0/1857408127 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f580c042030 con 0x7f58141082a0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.629+0000 7f580b7fe640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58000a3240 0x7f58000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.629+0000 7f581259c640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58000a3240 0x7f58000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.629+0000 7f580b7fe640 1 -- 172.21.15.63:0/1857408127 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f580c0efb80 con 0x7f58141082a0 2024-09-16T01:21:00.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.630+0000 7f581259c640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58000a3240 0x7f58000a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5804005fd0 tx=0x7f5804009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:00.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.633+0000 7f580b7fe640 1 -- 172.21.15.63:0/1857408127 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f580c0bcd40 con 0x7f58141082a0 2024-09-16T01:21:00.845 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:21:00 smithi192 systemd[1]: Starting Ceph mds.f for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:21:00.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.846+0000 7f5818cce640 1 -- 172.21.15.63:0/1857408127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f581410a2b0 con 0x7f58141082a0 2024-09-16T01:21:00.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.846+0000 7f580b7fe640 1 -- 172.21.15.63:0/1857408127 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7f580c0b8070 con 0x7f58141082a0 2024-09-16T01:21:00.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:00.848 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"btime":"2024-09-16T01:20:59:641453+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-16T01:21:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 6 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.848+0000 7f5818cce640 1 -- 172.21.15.63:0/1857408127 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58000a3240 msgr2=0x7f58000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.848+0000 7f5818cce640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58000a3240 0x7f58000a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5804005fd0 tx=0x7f5804009680 comp rx=0 tx=0).stop 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.848+0000 7f5818cce640 1 -- 172.21.15.63:0/1857408127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58141082a0 msgr2=0x7f581419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.848+0000 7f5818cce640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58141082a0 0x7f581419cd40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f580c005940 tx=0x7f580c004270 comp rx=0 tx=0).stop 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.848+0000 7f5818cce640 1 -- 172.21.15.63:0/1857408127 shutdown_connections 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.848+0000 7f5818cce640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58000a3240 0x7f58000a5700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.848+0000 7f5818cce640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58141082a0 0x7f581419cd40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.848+0000 7f5818cce640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58141036e0 0x7f58141989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.848+0000 7f5818cce640 1 --2- 172.21.15.63:0/1857408127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5814102d30 0x7f5814198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.848+0000 7f5818cce640 1 -- 172.21.15.63:0/1857408127 >> 172.21.15.63:0/1857408127 conn(0x7f58140fc7d0 msgr2=0x7f5814105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.849+0000 7f5818cce640 1 -- 172.21.15.63:0/1857408127 shutdown_connections 2024-09-16T01:21:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:00.849+0000 7f5818cce640 1 -- 172.21.15.63:0/1857408127 wait complete. 2024-09-16T01:21:01.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:00 smithi063 ceph-mon[31070]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:01.127 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:00 smithi192 ceph-mon[34775]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:01.127 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:21:00 smithi192 podman[64219]: 2024-09-16 01:21:00.891765769 +0000 UTC m=+0.015906256 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:21:01.127 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:21:01 smithi192 podman[64219]: 2024-09-16 01:21:01.004772215 +0000 UTC m=+0.128912692 container create 2b9e97fb37a864717791729c65e808772335f3b2a9fb18d31551c1b3e266eab9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-16T01:21:01.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:00 smithi162 ceph-mon[34539]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:01.674 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:21:01 smithi192 podman[64219]: 2024-09-16 01:21:01.24906292 +0000 UTC m=+0.373203397 container init 2b9e97fb37a864717791729c65e808772335f3b2a9fb18d31551c1b3e266eab9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-16T01:21:01.674 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:21:01 smithi192 podman[64219]: 2024-09-16 01:21:01.252070802 +0000 UTC m=+0.376211287 container start 2b9e97fb37a864717791729c65e808772335f3b2a9fb18d31551c1b3e266eab9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-16T01:21:01.674 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:21:01 smithi192 ceph-mds[64238]: -- 172.21.15.192:0/2459347657 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5575b1185c20 con 0x5575b1163000 2024-09-16T01:21:01.674 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:21:01 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f[64234]: starting mds.f at 2024-09-16T01:21:01.674 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:21:01 smithi192 bash[64219]: 2b9e97fb37a864717791729c65e808772335f3b2a9fb18d31551c1b3e266eab9 2024-09-16T01:21:01.674 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:21:01 smithi192 systemd[1]: Started Ceph mds.f for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:21:02.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:01 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1857408127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:02.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:01 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:02.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:01 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:02.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:01 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:02.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:01 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:02.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:01 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:02.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:01 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:02.119 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:01 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1857408127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:02.119 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:01 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:02.119 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:01 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:02.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:01 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:02.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:01 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:02.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:01 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:02.120 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:01 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:02.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:01 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1857408127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:02.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:01 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:02.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:01 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:02.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:01 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:02.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:01 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:02.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:01 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:02.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:01 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:03.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:02 smithi063 ceph-mon[31070]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:03.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:02 smithi063 ceph-mon[31070]: Deploying daemon mds.c on smithi192 2024-09-16T01:21:03.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:02 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.192:6834/383563245,v1:172.21.15.192:6835/383563245] up:boot 2024-09-16T01:21:03.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:02 smithi063 ceph-mon[31070]: fsmap 6 up:standby 2024-09-16T01:21:03.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:02 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:21:03.166 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:02 smithi192 ceph-mon[34775]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:03.166 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:02 smithi192 ceph-mon[34775]: Deploying daemon mds.c on smithi192 2024-09-16T01:21:03.166 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:02 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.192:6834/383563245,v1:172.21.15.192:6835/383563245] up:boot 2024-09-16T01:21:03.166 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:02 smithi192 ceph-mon[34775]: fsmap 6 up:standby 2024-09-16T01:21:03.166 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:02 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:21:03.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:02 smithi162 ceph-mon[34539]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:03.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:02 smithi162 ceph-mon[34539]: Deploying daemon mds.c on smithi192 2024-09-16T01:21:03.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:02 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.192:6834/383563245,v1:172.21.15.192:6835/383563245] up:boot 2024-09-16T01:21:03.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:02 smithi162 ceph-mon[34539]: fsmap 6 up:standby 2024-09-16T01:21:03.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:02 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:21:03.424 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:21:03 smithi192 systemd[1]: Starting Ceph mds.c for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:21:03.663 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:21:03.880 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:21:03 smithi192 podman[64518]: 2024-09-16 01:21:03.463951136 +0000 UTC m=+0.015676803 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:21:03.880 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:21:03 smithi192 podman[64518]: 2024-09-16 01:21:03.567873649 +0000 UTC m=+0.119599316 container create 71abd1eea68b744961de07181f875b7c50ca2847341c8d0e5f1c5d6c181924b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-16T01:21:03.880 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:21:03 smithi192 podman[64518]: 2024-09-16 01:21:03.879342974 +0000 UTC m=+0.431068640 container init 71abd1eea68b744961de07181f875b7c50ca2847341c8d0e5f1c5d6c181924b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-16T01:21:03.940 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:04.174 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:21:03 smithi192 podman[64518]: 2024-09-16 01:21:03.882276958 +0000 UTC m=+0.434002631 container start 71abd1eea68b744961de07181f875b7c50ca2847341c8d0e5f1c5d6c181924b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-16T01:21:04.174 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:21:03 smithi192 ceph-mds[64537]: -- 172.21.15.192:0/1292905729 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572382e3860 con 0x5572382c0800 2024-09-16T01:21:04.174 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:21:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c[64533]: starting mds.c at 2024-09-16T01:21:04.174 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:21:03 smithi192 bash[64518]: 71abd1eea68b744961de07181f875b7c50ca2847341c8d0e5f1c5d6c181924b8 2024-09-16T01:21:04.174 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:21:03 smithi192 systemd[1]: Started Ceph mds.c for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:21:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.427+0000 7fa83932d640 1 -- 172.21.15.63:0/3425515130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa834101420 msgr2=0x7fa83410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.427+0000 7fa83932d640 1 --2- 172.21.15.63:0/3425515130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa834101420 0x7fa83410d950 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009cd0 tx=0x7fa82c02a8e0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.427+0000 7fa83932d640 1 -- 172.21.15.63:0/3425515130 shutdown_connections 2024-09-16T01:21:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.427+0000 7fa83932d640 1 --2- 172.21.15.63:0/3425515130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa834101420 0x7fa83410d950 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.427+0000 7fa83932d640 1 --2- 172.21.15.63:0/3425515130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa834100a80 0x7fa834100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.427+0000 7fa83932d640 1 --2- 172.21.15.63:0/3425515130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa834106a80 0x7fa834106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.427+0000 7fa83932d640 1 -- 172.21.15.63:0/3425515130 >> 172.21.15.63:0/3425515130 conn(0x7fa8340fc7a0 msgr2=0x7fa8340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.427+0000 7fa83932d640 1 -- 172.21.15.63:0/3425515130 shutdown_connections 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.427+0000 7fa83932d640 1 -- 172.21.15.63:0/3425515130 wait complete. 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.428+0000 7fa83932d640 1 Processor -- start 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.428+0000 7fa83932d640 1 -- start start 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.428+0000 7fa83932d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa834100a80 0x7fa8340fce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.428+0000 7fa83932d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa834101420 0x7fa8340fd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.428+0000 7fa83932d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa834106a80 0x7fa8340fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.428+0000 7fa83932d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa834110d30 con 0x7fa834101420 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.428+0000 7fa83932d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa834110bb0 con 0x7fa834106a80 2024-09-16T01:21:04.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.428+0000 7fa83932d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa834110eb0 con 0x7fa834100a80 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa82bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa834101420 0x7fa8340fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa82bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa834101420 0x7fa8340fd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57252/0 (socket says 172.21.15.63:57252) 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa82bfff640 1 -- 172.21.15.63:0/2709157602 learned_addr learned my addr 172.21.15.63:0/2709157602 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa832ffd640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa834100a80 0x7fa8340fce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa8337fe640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa834106a80 0x7fa8340fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa82bfff640 1 -- 172.21.15.63:0/2709157602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa834100a80 msgr2=0x7fa8340fce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa82bfff640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa834100a80 0x7fa8340fce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa82bfff640 1 -- 172.21.15.63:0/2709157602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa834106a80 msgr2=0x7fa8340fd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa82bfff640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa834106a80 0x7fa8340fd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa82bfff640 1 -- 172.21.15.63:0/2709157602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8341a6880 con 0x7fa834101420 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa8337fe640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa834106a80 0x7fa8340fd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa82bfff640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa834101420 0x7fa8340fd3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00e9f0 tx=0x7fa81c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:04.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa830ff9640 1 -- 172.21.15.63:0/2709157602 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c00cd80 con 0x7fa834101420 2024-09-16T01:21:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa83932d640 1 -- 172.21.15.63:0/2709157602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8341a6b70 con 0x7fa834101420 2024-09-16T01:21:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa830ff9640 1 -- 172.21.15.63:0/2709157602 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa81c0108e0 con 0x7fa834101420 2024-09-16T01:21:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa830ff9640 1 -- 172.21.15.63:0/2709157602 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c018920 con 0x7fa834101420 2024-09-16T01:21:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.429+0000 7fa83932d640 1 -- 172.21.15.63:0/2709157602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8341a7100 con 0x7fa834101420 2024-09-16T01:21:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.430+0000 7fa83932d640 1 -- 172.21.15.63:0/2709157602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa834100ee0 con 0x7fa834101420 2024-09-16T01:21:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.432+0000 7fa830ff9640 1 -- 172.21.15.63:0/2709157602 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa81c010a90 con 0x7fa834101420 2024-09-16T01:21:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.432+0000 7fa830ff9640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8200a3240 0x7fa8200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.433+0000 7fa832ffd640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8200a3240 0x7fa8200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.433+0000 7fa830ff9640 1 -- 172.21.15.63:0/2709157602 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fa81c0cfdd0 con 0x7fa834101420 2024-09-16T01:21:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.433+0000 7fa832ffd640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8200a3240 0x7fa8200a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa824009ae0 tx=0x7fa824005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.436+0000 7fa830ff9640 1 -- 172.21.15.63:0/2709157602 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa81c09cf90 con 0x7fa834101420 2024-09-16T01:21:04.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.647+0000 7fa83932d640 1 -- 172.21.15.63:0/2709157602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa83410a000 con 0x7fa834101420 2024-09-16T01:21:04.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.647+0000 7fa830ff9640 1 -- 172.21.15.63:0/2709157602 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7fa81c09c890 con 0x7fa834101420 2024-09-16T01:21:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:04.649 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"btime":"2024-09-16T01:21:01:844309+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-16T01:21:04.649 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2024-09-16T01:21:04.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.649+0000 7fa83932d640 1 -- 172.21.15.63:0/2709157602 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8200a3240 msgr2=0x7fa8200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:04.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.649+0000 7fa83932d640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8200a3240 0x7fa8200a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa824009ae0 tx=0x7fa824005f90 comp rx=0 tx=0).stop 2024-09-16T01:21:04.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.650+0000 7fa83932d640 1 -- 172.21.15.63:0/2709157602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa834101420 msgr2=0x7fa8340fd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:04.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.650+0000 7fa83932d640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa834101420 0x7fa8340fd3b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00e9f0 tx=0x7fa81c00eeb0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.650+0000 7fa83932d640 1 -- 172.21.15.63:0/2709157602 shutdown_connections 2024-09-16T01:21:04.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.650+0000 7fa83932d640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa8200a3240 0x7fa8200a5700 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.650+0000 7fa83932d640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa834106a80 0x7fa8340fd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.650+0000 7fa83932d640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa834101420 0x7fa8340fd3b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.650+0000 7fa83932d640 1 --2- 172.21.15.63:0/2709157602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa834100a80 0x7fa8340fce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:04.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.650+0000 7fa83932d640 1 -- 172.21.15.63:0/2709157602 >> 172.21.15.63:0/2709157602 conn(0x7fa8340fc7a0 msgr2=0x7fa83406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:04.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.650+0000 7fa83932d640 1 -- 172.21.15.63:0/2709157602 shutdown_connections 2024-09-16T01:21:04.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:04.650+0000 7fa83932d640 1 -- 172.21.15.63:0/2709157602 wait complete. 2024-09-16T01:21:05.179 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:05.179 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:05.179 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:05.180 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:05.180 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:05.180 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:05.180 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:05.180 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: Deploying daemon mds.h on smithi162 2024-09-16T01:21:05.180 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2709157602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:05.180 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] up:boot 2024-09-16T01:21:05.180 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: fsmap 7 up:standby 2024-09-16T01:21:05.180 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:05 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:21:05.298 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:05.298 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:05.298 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:05.298 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:05.298 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:05.298 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:05.299 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:05.299 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: Deploying daemon mds.h on smithi162 2024-09-16T01:21:05.299 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2709157602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:05.299 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] up:boot 2024-09-16T01:21:05.299 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: fsmap 7 up:standby 2024-09-16T01:21:05.299 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:05 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:21:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:05.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: Deploying daemon mds.h on smithi162 2024-09-16T01:21:05.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2709157602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:05.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] up:boot 2024-09-16T01:21:05.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: fsmap 7 up:standby 2024-09-16T01:21:05.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:05 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:21:06.184 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:21:06 smithi162 systemd[1]: Starting Ceph mds.h for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:21:06.578 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:21:06 smithi162 podman[64338]: 2024-09-16 01:21:06.201309947 +0000 UTC m=+0.016509419 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:21:06.578 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:21:06 smithi162 podman[64338]: 2024-09-16 01:21:06.331752223 +0000 UTC m=+0.146951695 container create 485d109b5814b216c645bc44b18ac754c7aaf83822c5fb7cfe613cf025801cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-16T01:21:06.578 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:21:06 smithi162 podman[64338]: 2024-09-16 01:21:06.576367964 +0000 UTC m=+0.391567437 container init 485d109b5814b216c645bc44b18ac754c7aaf83822c5fb7cfe613cf025801cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-16T01:21:06.933 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:21:06 smithi162 podman[64338]: 2024-09-16 01:21:06.579386357 +0000 UTC m=+0.394585830 container start 485d109b5814b216c645bc44b18ac754c7aaf83822c5fb7cfe613cf025801cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-16T01:21:06.934 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:21:06 smithi162 ceph-mds[64357]: -- 172.21.15.162:0/3896052612 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d516dcd860 con 0x55d516dab400 2024-09-16T01:21:06.934 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:21:06 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h[64353]: starting mds.h at 2024-09-16T01:21:06.934 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:21:06 smithi162 bash[64338]: 485d109b5814b216c645bc44b18ac754c7aaf83822c5fb7cfe613cf025801cf9 2024-09-16T01:21:06.934 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:21:06 smithi162 systemd[1]: Started Ceph mds.h for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:21:07.306 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:07 smithi192 ceph-mon[34775]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:07.306 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:07 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:07.307 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:07 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:07.307 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:07 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:07.307 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:07 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:07.307 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:07 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:07.307 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:07 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:07.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:21:07.356 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:07 smithi063 ceph-mon[31070]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:07.357 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:07 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:07.357 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:07 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:07.357 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:07 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:07.357 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:07 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:07.357 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:07 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:07.357 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:07 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:07.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:07 smithi162 ceph-mon[34539]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:07.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:07 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:07.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:07 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:07.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:07 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:07.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:07 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:07.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:07 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:07.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:07 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:07.597 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:08.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.116+0000 7f42ea1a4640 1 -- 172.21.15.63:0/1731837850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e4102790 msgr2=0x7f42e41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.116+0000 7f42ea1a4640 1 --2- 172.21.15.63:0/1731837850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e4102790 0x7f42e41067e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f42d8009900 tx=0x7f42d802a410 comp rx=0 tx=0).stop 2024-09-16T01:21:08.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.116+0000 7f42ea1a4640 1 -- 172.21.15.63:0/1731837850 shutdown_connections 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.116+0000 7f42ea1a4640 1 --2- 172.21.15.63:0/1731837850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42e4106f10 0x7f42e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.116+0000 7f42ea1a4640 1 --2- 172.21.15.63:0/1731837850 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e4102790 0x7f42e41067e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.116+0000 7f42ea1a4640 1 --2- 172.21.15.63:0/1731837850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42e4101de0 0x7f42e41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.116+0000 7f42ea1a4640 1 -- 172.21.15.63:0/1731837850 >> 172.21.15.63:0/1731837850 conn(0x7f42e40fd8c0 msgr2=0x7f42e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.116+0000 7f42ea1a4640 1 -- 172.21.15.63:0/1731837850 shutdown_connections 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.116+0000 7f42ea1a4640 1 -- 172.21.15.63:0/1731837850 wait complete. 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.117+0000 7f42ea1a4640 1 Processor -- start 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.117+0000 7f42ea1a4640 1 -- start start 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42ea1a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e4101de0 0x7f42e4198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42ea1a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42e4102790 0x7f42e4198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42ea1a4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42e4106f10 0x7f42e419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:08.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42ea1a4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4111e40 con 0x7f42e4101de0 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42ea1a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4111cc0 con 0x7f42e4102790 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42ea1a4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4111fc0 con 0x7f42e4106f10 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e4101de0 0x7f42e4198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e4101de0 0x7f42e4198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57268/0 (socket says 172.21.15.63:57268) 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e37fe640 1 -- 172.21.15.63:0/750688071 learned_addr learned my addr 172.21.15.63:0/750688071 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e3fff640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42e4106f10 0x7f42e419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e2ffd640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42e4102790 0x7f42e4198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e37fe640 1 -- 172.21.15.63:0/750688071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42e4106f10 msgr2=0x7f42e419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e37fe640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42e4106f10 0x7f42e419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e37fe640 1 -- 172.21.15.63:0/750688071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42e4102790 msgr2=0x7f42e4198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e37fe640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42e4102790 0x7f42e4198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e37fe640 1 -- 172.21.15.63:0/750688071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e419d2d0 con 0x7f42e4101de0 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e2ffd640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42e4102790 0x7f42e4198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e37fe640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e4101de0 0x7f42e4198320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42d400c920 tx=0x7f42d400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e0ff9640 1 -- 172.21.15.63:0/750688071 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4007c70 con 0x7f42e4101de0 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e0ff9640 1 -- 172.21.15.63:0/750688071 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f42d4007e10 con 0x7f42e4101de0 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42ea1a4640 1 -- 172.21.15.63:0/750688071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e419d5c0 con 0x7f42e4101de0 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.118+0000 7f42e0ff9640 1 -- 172.21.15.63:0/750688071 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4018820 con 0x7f42e4101de0 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.119+0000 7f42ea1a4640 1 -- 172.21.15.63:0/750688071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e41a4ea0 con 0x7f42e4101de0 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.120+0000 7f42ea1a4640 1 -- 172.21.15.63:0/750688071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e41021c0 con 0x7f42e4101de0 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.121+0000 7f42e0ff9640 1 -- 172.21.15.63:0/750688071 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f42d40189c0 con 0x7f42e4101de0 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.122+0000 7f42e0ff9640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f42cc0a3240 0x7f42cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.122+0000 7f42e2ffd640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f42cc0a3240 0x7f42cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:08.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.122+0000 7f42e0ff9640 1 -- 172.21.15.63:0/750688071 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f42d40cf690 con 0x7f42e4101de0 2024-09-16T01:21:08.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.122+0000 7f42e2ffd640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f42cc0a3240 0x7f42cc0a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f42d8000c00 tx=0x7f42d8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:08.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.126+0000 7f42e0ff9640 1 -- 172.21.15.63:0/750688071 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42d4014030 con 0x7f42e4101de0 2024-09-16T01:21:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.337+0000 7f42ea1a4640 1 -- 172.21.15.63:0/750688071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42e4109b60 con 0x7f42e4101de0 2024-09-16T01:21:08.338 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:08 smithi063 ceph-mon[31070]: Deploying daemon mds.i on smithi192 2024-09-16T01:21:08.338 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:08 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.162:6836/1959030818,v1:172.21.15.162:6837/1959030818] up:boot 2024-09-16T01:21:08.338 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:08 smithi063 ceph-mon[31070]: fsmap 8 up:standby 2024-09-16T01:21:08.339 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:08 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:21:08.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.337+0000 7f42e0ff9640 1 -- 172.21.15.63:0/750688071 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7f42d409c850 con 0x7f42e4101de0 2024-09-16T01:21:08.339 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:08.339 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"btime":"2024-09-16T01:21:07:023364+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-16T01:21:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2024-09-16T01:21:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.339+0000 7f42ea1a4640 1 -- 172.21.15.63:0/750688071 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f42cc0a3240 msgr2=0x7f42cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.339+0000 7f42ea1a4640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f42cc0a3240 0x7f42cc0a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f42d8000c00 tx=0x7f42d8031400 comp rx=0 tx=0).stop 2024-09-16T01:21:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.339+0000 7f42ea1a4640 1 -- 172.21.15.63:0/750688071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e4101de0 msgr2=0x7f42e4198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.339+0000 7f42ea1a4640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e4101de0 0x7f42e4198320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42d400c920 tx=0x7f42d400cde0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.340+0000 7f42ea1a4640 1 -- 172.21.15.63:0/750688071 shutdown_connections 2024-09-16T01:21:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.340+0000 7f42ea1a4640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f42cc0a3240 0x7f42cc0a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.340+0000 7f42ea1a4640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42e4106f10 0x7f42e419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.340+0000 7f42ea1a4640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42e4102790 0x7f42e4198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.340+0000 7f42ea1a4640 1 --2- 172.21.15.63:0/750688071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42e4101de0 0x7f42e4198320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.340+0000 7f42ea1a4640 1 -- 172.21.15.63:0/750688071 >> 172.21.15.63:0/750688071 conn(0x7f42e40fd8c0 msgr2=0x7f42e40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:08.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.340+0000 7f42ea1a4640 1 -- 172.21.15.63:0/750688071 shutdown_connections 2024-09-16T01:21:08.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:08.340+0000 7f42ea1a4640 1 -- 172.21.15.63:0/750688071 wait complete. 2024-09-16T01:21:08.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:08 smithi192 ceph-mon[34775]: Deploying daemon mds.i on smithi192 2024-09-16T01:21:08.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:08 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.162:6836/1959030818,v1:172.21.15.162:6837/1959030818] up:boot 2024-09-16T01:21:08.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:08 smithi192 ceph-mon[34775]: fsmap 8 up:standby 2024-09-16T01:21:08.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:08 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:21:08.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:08 smithi162 ceph-mon[34539]: Deploying daemon mds.i on smithi192 2024-09-16T01:21:08.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:08 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.162:6836/1959030818,v1:172.21.15.162:6837/1959030818] up:boot 2024-09-16T01:21:08.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:08 smithi162 ceph-mon[34539]: fsmap 8 up:standby 2024-09-16T01:21:08.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:08 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:21:08.873 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:21:08 smithi192 systemd[1]: Starting Ceph mds.i for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:21:09.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:09 smithi063 ceph-mon[31070]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:09.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:09 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/750688071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:09.135 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:09 smithi192 ceph-mon[34775]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:09.135 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:09 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/750688071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:09.135 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:21:08 smithi192 podman[64818]: 2024-09-16 01:21:08.775272417 +0000 UTC m=+0.015702915 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:21:09.135 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:21:08 smithi192 podman[64818]: 2024-09-16 01:21:08.873594356 +0000 UTC m=+0.114024852 container create fbc85ec88b9c39a867af178943d8fdf9136e15001d53b973a3340442e25e13c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-16T01:21:09.424 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:21:09 smithi192 podman[64818]: 2024-09-16 01:21:09.134981384 +0000 UTC m=+0.375411872 container init fbc85ec88b9c39a867af178943d8fdf9136e15001d53b973a3340442e25e13c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-16T01:21:09.424 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:21:09 smithi192 podman[64818]: 2024-09-16 01:21:09.138130285 +0000 UTC m=+0.378560774 container start fbc85ec88b9c39a867af178943d8fdf9136e15001d53b973a3340442e25e13c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-09-16T01:21:09.424 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:21:09 smithi192 ceph-mds[64837]: -- 172.21.15.192:0/86622945 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561716d73860 con 0x561716d51400 2024-09-16T01:21:09.424 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:21:09 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i[64833]: starting mds.i at 2024-09-16T01:21:09.424 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:21:09 smithi192 bash[64818]: fbc85ec88b9c39a867af178943d8fdf9136e15001d53b973a3340442e25e13c6 2024-09-16T01:21:09.424 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:21:09 smithi192 systemd[1]: Started Ceph mds.i for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:21:09.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:09 smithi162 ceph-mon[34539]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:09.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:09 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/750688071' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:10.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:10.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:10.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:10.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:10.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:10.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:10.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:10.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: Deploying daemon mds.g on smithi063 2024-09-16T01:21:10.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] up:boot 2024-09-16T01:21:10.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: fsmap 9 up:standby 2024-09-16T01:21:10.611 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:10 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:21:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: Deploying daemon mds.g on smithi063 2024-09-16T01:21:10.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] up:boot 2024-09-16T01:21:10.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: fsmap 9 up:standby 2024-09-16T01:21:10.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:10 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:21:10.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:10.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:10.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:10.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:10.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:10.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:10.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:10.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: Deploying daemon mds.g on smithi063 2024-09-16T01:21:10.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] up:boot 2024-09-16T01:21:10.685 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: fsmap 9 up:standby 2024-09-16T01:21:10.685 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:10 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:21:11.003 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:21:11.267 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:21:11 smithi063 systemd[1]: Starting Ceph mds.g for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:21:11.288 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:11.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 -- 172.21.15.63:0/2395364053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102570 msgr2=0x7f0dfc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:11.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 --2- 172.21.15.63:0/2395364053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102570 0x7f0dfc1029b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009900 tx=0x7f0dec02a480 comp rx=0 tx=0).stop 2024-09-16T01:21:11.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 -- 172.21.15.63:0/2395364053 shutdown_connections 2024-09-16T01:21:11.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 --2- 172.21.15.63:0/2395364053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:11.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 --2- 172.21.15.63:0/2395364053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102570 0x7f0dfc1029b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:11.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 --2- 172.21.15.63:0/2395364053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc100e20 0x7f0dfc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:11.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 -- 172.21.15.63:0/2395364053 >> 172.21.15.63:0/2395364053 conn(0x7f0dfc0fc7d0 msgr2=0x7f0dfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 -- 172.21.15.63:0/2395364053 shutdown_connections 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 -- 172.21.15.63:0/2395364053 wait complete. 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 Processor -- start 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.814+0000 7f0e03ab1640 1 -- start start 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e03ab1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 0x7f0dfc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e03ab1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102570 0x7f0dfc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e03ab1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e03ab1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc110e30 con 0x7f0dfc102570 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e03ab1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc110cb0 con 0x7f0dfc102ef0 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e03ab1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc110fb0 con 0x7f0dfc100e20 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0104c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102570 0x7f0dfc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0104c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102570 0x7f0dfc0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48550/0 (socket says 172.21.15.63:48550) 2024-09-16T01:21:11.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0104c640 1 -- 172.21.15.63:0/1615398186 learned_addr learned my addr 172.21.15.63:0/1615398186 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:11.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0204e640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:11.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0184d640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 0x7f0dfc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:11.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0104c640 1 -- 172.21.15.63:0/1615398186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 msgr2=0x7f0dfc0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:11.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0104c640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 0x7f0dfc0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:11.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0104c640 1 -- 172.21.15.63:0/1615398186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102ef0 msgr2=0x7f0dfc0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:11.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0104c640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:11.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0104c640 1 -- 172.21.15.63:0/1615398186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dfc1a6970 con 0x7f0dfc102570 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0204e640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e0104c640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102570 0x7f0dfc0fd1c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0dec006010 tx=0x7f0dec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0df2ffd640 1 -- 172.21.15.63:0/1615398186 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec03f030 con 0x7f0dfc102570 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e03ab1640 1 -- 172.21.15.63:0/1615398186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dfc1a6c00 con 0x7f0dfc102570 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0df2ffd640 1 -- 172.21.15.63:0/1615398186 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0dec003cb0 con 0x7f0dfc102570 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0df2ffd640 1 -- 172.21.15.63:0/1615398186 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec035070 con 0x7f0dfc102570 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.815+0000 7f0e03ab1640 1 -- 172.21.15.63:0/1615398186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dfc1a70e0 con 0x7f0dfc102570 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.817+0000 7f0e03ab1640 1 -- 172.21.15.63:0/1615398186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dfc101200 con 0x7f0dfc102570 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.818+0000 7f0df2ffd640 1 -- 172.21.15.63:0/1615398186 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0dec042030 con 0x7f0dfc102570 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.818+0000 7f0df2ffd640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de80a3240 0x7f0de80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:11.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.819+0000 7f0e0184d640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de80a3240 0x7f0de80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.819+0000 7f0df2ffd640 1 -- 172.21.15.63:0/1615398186 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f0dec0ef9f0 con 0x7f0dfc102570 2024-09-16T01:21:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.819+0000 7f0e0184d640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de80a3240 0x7f0de80a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0df8005fd0 tx=0x7f0df8009470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:11.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:11.823+0000 7f0df2ffd640 1 -- 172.21.15.63:0/1615398186 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0dec0bcbb0 con 0x7f0dfc102570 2024-09-16T01:21:12.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.037+0000 7f0e03ab1640 1 -- 172.21.15.63:0/1615398186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dfc10a0a0 con 0x7f0dfc102570 2024-09-16T01:21:12.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.038+0000 7f0df2ffd640 1 -- 172.21.15.63:0/1615398186 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8046 (secure 0 0 0) 0x7f0dec0bc4b0 con 0x7f0dfc102570 2024-09-16T01:21:12.039 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:12.039 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"btime":"2024-09-16T01:21:10:037224+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24460,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-16T01:21:12.039 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 10 2024-09-16T01:21:12.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 -- 172.21.15.63:0/1615398186 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de80a3240 msgr2=0x7f0de80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de80a3240 0x7f0de80a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0df8005fd0 tx=0x7f0df8009470 comp rx=0 tx=0).stop 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 -- 172.21.15.63:0/1615398186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102570 msgr2=0x7f0dfc0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102570 0x7f0dfc0fd1c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0dec006010 tx=0x7f0dec0042f0 comp rx=0 tx=0).stop 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 -- 172.21.15.63:0/1615398186 shutdown_connections 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de80a3240 0x7f0de80a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102570 0x7f0dfc0fd1c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 --2- 172.21.15.63:0/1615398186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 0x7f0dfc0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 -- 172.21.15.63:0/1615398186 >> 172.21.15.63:0/1615398186 conn(0x7f0dfc0fc7d0 msgr2=0x7f0dfc06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 -- 172.21.15.63:0/1615398186 shutdown_connections 2024-09-16T01:21:12.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:12.040+0000 7f0e03ab1640 1 -- 172.21.15.63:0/1615398186 wait complete. 2024-09-16T01:21:12.327 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:12 smithi063 ceph-mon[31070]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:12.327 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:12 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1615398186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:12.328 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:21:12 smithi063 podman[71652]: 2024-09-16 01:21:11.95487741 +0000 UTC m=+0.017243648 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:21:12.328 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:21:12 smithi063 podman[71652]: 2024-09-16 01:21:12.069639281 +0000 UTC m=+0.132005519 container create 5b68f36a484931d5ed9a093dd4f6f088f7b331bacd3865a7d32a2b29989653fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-09-16T01:21:12.328 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:21:12 smithi063 podman[71652]: 2024-09-16 01:21:12.327013566 +0000 UTC m=+0.389379804 container init 5b68f36a484931d5ed9a093dd4f6f088f7b331bacd3865a7d32a2b29989653fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-16T01:21:12.609 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:21:12 smithi063 podman[71652]: 2024-09-16 01:21:12.330196727 +0000 UTC m=+0.392562966 container start 5b68f36a484931d5ed9a093dd4f6f088f7b331bacd3865a7d32a2b29989653fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-16T01:21:12.609 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:21:12 smithi063 ceph-mds[71685]: -- 172.21.15.63:0/3222389710 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56326a2dd860 con 0x56326a2ba800 2024-09-16T01:21:12.610 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:21:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-g[71681]: starting mds.g at 2024-09-16T01:21:12.610 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:21:12 smithi063 bash[71652]: 5b68f36a484931d5ed9a093dd4f6f088f7b331bacd3865a7d32a2b29989653fa 2024-09-16T01:21:12.610 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:21:12 smithi063 systemd[1]: Started Ceph mds.g for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:21:12.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:12 smithi192 ceph-mon[34775]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:12.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:12 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1615398186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:12.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:12 smithi162 ceph-mon[34539]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:12.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:12 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1615398186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:13.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:13 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:13.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:13 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:13.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:13 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:13.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:13 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:13.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:13 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:13.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:13 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:13.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:13 smithi063 ceph-mon[31070]: Deploying daemon mds.a on smithi063 2024-09-16T01:21:13.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:13 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.63:6838/37939833,v1:172.21.15.63:6839/37939833] up:boot 2024-09-16T01:21:13.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:13 smithi063 ceph-mon[31070]: fsmap 10 up:standby 2024-09-16T01:21:13.618 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:13 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:21:13.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:13 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:13.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:13 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:13.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:13 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:13.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:13 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:13.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:13 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:13.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:13 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:13.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:13 smithi192 ceph-mon[34775]: Deploying daemon mds.a on smithi063 2024-09-16T01:21:13.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:13 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.63:6838/37939833,v1:172.21.15.63:6839/37939833] up:boot 2024-09-16T01:21:13.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:13 smithi192 ceph-mon[34775]: fsmap 10 up:standby 2024-09-16T01:21:13.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:13 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:21:13.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:13 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:13.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:13 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:13.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:13 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:13.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:13 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:13.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:13 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:13.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:13 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:13.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:13 smithi162 ceph-mon[34539]: Deploying daemon mds.a on smithi063 2024-09-16T01:21:13.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:13 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.63:6838/37939833,v1:172.21.15.63:6839/37939833] up:boot 2024-09-16T01:21:13.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:13 smithi162 ceph-mon[34539]: fsmap 10 up:standby 2024-09-16T01:21:13.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:13 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-16T01:21:14.725 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:14 smithi063 ceph-mon[31070]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:14.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:14 smithi192 ceph-mon[34775]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:14.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:14 smithi162 ceph-mon[34539]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:15.076 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:21:14 smithi063 systemd[1]: Starting Ceph mds.a for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:21:15.152 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:21:15.359 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:21:15 smithi063 podman[71971]: 2024-09-16 01:21:15.023838062 +0000 UTC m=+0.016675087 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:21:15.359 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:21:15 smithi063 podman[71971]: 2024-09-16 01:21:15.147995609 +0000 UTC m=+0.140832631 container create 48e95a2d27554468856bf291235aeaff1d1c0266e07eacb227eb676a92628d03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:21:15.600 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:15.722 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:21:15 smithi063 podman[71971]: 2024-09-16 01:21:15.417359899 +0000 UTC m=+0.410196921 container init 48e95a2d27554468856bf291235aeaff1d1c0266e07eacb227eb676a92628d03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:21:15.722 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:21:15 smithi063 podman[71971]: 2024-09-16 01:21:15.420646169 +0000 UTC m=+0.413483198 container start 48e95a2d27554468856bf291235aeaff1d1c0266e07eacb227eb676a92628d03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:21:15.722 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:21:15 smithi063 ceph-mds[72020]: -- 172.21.15.63:0/1112439638 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640eb8db860 con 0x5640eb8b8800 2024-09-16T01:21:15.722 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:21:15 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-a[72004]: starting mds.a at 2024-09-16T01:21:15.722 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:21:15 smithi063 bash[71971]: 48e95a2d27554468856bf291235aeaff1d1c0266e07eacb227eb676a92628d03 2024-09-16T01:21:15.723 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:21:15 smithi063 systemd[1]: Started Ceph mds.a for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:21:16.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.078+0000 7f7d7be0c640 1 -- 172.21.15.63:0/625384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d74106a80 msgr2=0x7f7d74106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:16.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.078+0000 7f7d7be0c640 1 --2- 172.21.15.63:0/625384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d74106a80 0x7f7d74106e60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009930 tx=0x7f7d7002a420 comp rx=0 tx=0).stop 2024-09-16T01:21:16.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.078+0000 7f7d7be0c640 1 -- 172.21.15.63:0/625384 shutdown_connections 2024-09-16T01:21:16.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.078+0000 7f7d7be0c640 1 --2- 172.21.15.63:0/625384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d74101420 0x7f7d7410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 --2- 172.21.15.63:0/625384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d74100a80 0x7f7d74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 --2- 172.21.15.63:0/625384 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d74106a80 0x7f7d74106e60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 -- 172.21.15.63:0/625384 >> 172.21.15.63:0/625384 conn(0x7f7d740fc7a0 msgr2=0x7f7d740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:16.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 -- 172.21.15.63:0/625384 shutdown_connections 2024-09-16T01:21:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 -- 172.21.15.63:0/625384 wait complete. 2024-09-16T01:21:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 Processor -- start 2024-09-16T01:21:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 -- start start 2024-09-16T01:21:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d74100a80 0x7f7d741982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d74101420 0x7f7d74198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d74106a80 0x7f7d7419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74110cf0 con 0x7f7d74100a80 2024-09-16T01:21:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74110b70 con 0x7f7d74106a80 2024-09-16T01:21:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.079+0000 7f7d7be0c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74110e70 con 0x7f7d74101420 2024-09-16T01:21:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d79ba8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d74100a80 0x7f7d741982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d79ba8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d74100a80 0x7f7d741982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48602/0 (socket says 172.21.15.63:48602) 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d79ba8640 1 -- 172.21.15.63:0/1504932940 learned_addr learned my addr 172.21.15.63:0/1504932940 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d793a7640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d74101420 0x7f7d74198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d7a3a9640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d74106a80 0x7f7d7419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d79ba8640 1 -- 172.21.15.63:0/1504932940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d74101420 msgr2=0x7f7d74198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d79ba8640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d74101420 0x7f7d74198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d79ba8640 1 -- 172.21.15.63:0/1504932940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d74106a80 msgr2=0x7f7d7419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d79ba8640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d74106a80 0x7f7d7419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d79ba8640 1 -- 172.21.15.63:0/1504932940 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7419d2a0 con 0x7f7d74100a80 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d7a3a9640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d74106a80 0x7f7d7419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d79ba8640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d74100a80 0x7f7d741982f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7d70005940 tx=0x7f7d700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:16.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d6affd640 1 -- 172.21.15.63:0/1504932940 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7003f030 con 0x7f7d74100a80 2024-09-16T01:21:16.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d7be0c640 1 -- 172.21.15.63:0/1504932940 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7419d530 con 0x7f7d74100a80 2024-09-16T01:21:16.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d6affd640 1 -- 172.21.15.63:0/1504932940 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d70003cb0 con 0x7f7d74100a80 2024-09-16T01:21:16.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d6affd640 1 -- 172.21.15.63:0/1504932940 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d70035070 con 0x7f7d74100a80 2024-09-16T01:21:16.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.080+0000 7f7d7be0c640 1 -- 172.21.15.63:0/1504932940 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d741a4e70 con 0x7f7d74100a80 2024-09-16T01:21:16.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.081+0000 7f7d7be0c640 1 -- 172.21.15.63:0/1504932940 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d741021c0 con 0x7f7d74100a80 2024-09-16T01:21:16.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.082+0000 7f7d6affd640 1 -- 172.21.15.63:0/1504932940 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7d70042030 con 0x7f7d74100a80 2024-09-16T01:21:16.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.083+0000 7f7d6affd640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7d600a3240 0x7f7d600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:16.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.083+0000 7f7d793a7640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7d600a3240 0x7f7d600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:16.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.083+0000 7f7d6affd640 1 -- 172.21.15.63:0/1504932940 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f7d700efd00 con 0x7f7d74100a80 2024-09-16T01:21:16.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.084+0000 7f7d793a7640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7d600a3240 0x7f7d600a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7d741051f0 tx=0x7f7d6400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:16.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.086+0000 7f7d6affd640 1 -- 172.21.15.63:0/1504932940 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d700bce20 con 0x7f7d74100a80 2024-09-16T01:21:16.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.298+0000 7f7d7be0c640 1 -- 172.21.15.63:0/1504932940 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d74100ee0 con 0x7f7d74100a80 2024-09-16T01:21:16.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.299+0000 7f7d6affd640 1 -- 172.21.15.63:0/1504932940 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9692 (secure 0 0 0) 0x7f7d74100ee0 con 0x7f7d74100a80 2024-09-16T01:21:16.300 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:16.301 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"btime":"2024-09-16T01:21:15:512705+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24460,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-16T01:21:16.301 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2024-09-16T01:21:16.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 -- 172.21.15.63:0/1504932940 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7d600a3240 msgr2=0x7f7d600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:16.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7d600a3240 0x7f7d600a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7d741051f0 tx=0x7f7d6400a2d0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 -- 172.21.15.63:0/1504932940 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d74100a80 msgr2=0x7f7d741982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:16.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d74100a80 0x7f7d741982f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7d70005940 tx=0x7f7d700042f0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 -- 172.21.15.63:0/1504932940 shutdown_connections 2024-09-16T01:21:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7d600a3240 0x7f7d600a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d74106a80 0x7f7d7419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d74101420 0x7f7d74198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 --2- 172.21.15.63:0/1504932940 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d74100a80 0x7f7d741982f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 -- 172.21.15.63:0/1504932940 >> 172.21.15.63:0/1504932940 conn(0x7f7d740fc7a0 msgr2=0x7f7d7406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 -- 172.21.15.63:0/1504932940 shutdown_connections 2024-09-16T01:21:16.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:16.301+0000 7f7d7be0c640 1 -- 172.21.15.63:0/1504932940 wait complete. 2024-09-16T01:21:16.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.63:6840/1202342156,v1:172.21.15.63:6841/1202342156] up:boot 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: fsmap 11 up:standby 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: Deploying daemon mds.b on smithi162 2024-09-16T01:21:16.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:16 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1504932940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.63:6840/1202342156,v1:172.21.15.63:6841/1202342156] up:boot 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: fsmap 11 up:standby 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:16.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: Deploying daemon mds.b on smithi162 2024-09-16T01:21:16.685 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:16 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1504932940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.63:6840/1202342156,v1:172.21.15.63:6841/1202342156] up:boot 2024-09-16T01:21:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: fsmap 11 up:standby 2024-09-16T01:21:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-16T01:21:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:16.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T01:21:16.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T01:21:16.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:16.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: Deploying daemon mds.b on smithi162 2024-09-16T01:21:16.925 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:16 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1504932940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:17.684 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:17 smithi162 systemd[1]: Starting Ceph mds.b for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:21:18.073 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:17 smithi162 podman[64636]: 2024-09-16 01:21:17.70787631 +0000 UTC m=+0.015996618 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:21:18.074 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:17 smithi162 podman[64636]: 2024-09-16 01:21:17.813209034 +0000 UTC m=+0.121329379 container create bb65176f48e69b5042910bbc268895737eb52a87f25b02d9af9074e5da3f42d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-16T01:21:18.074 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:18 smithi162 podman[64636]: 2024-09-16 01:21:18.047050419 +0000 UTC m=+0.355170729 container init bb65176f48e69b5042910bbc268895737eb52a87f25b02d9af9074e5da3f42d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-16T01:21:18.074 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:18 smithi162 podman[64636]: 2024-09-16 01:21:18.049783367 +0000 UTC m=+0.357903669 container start bb65176f48e69b5042910bbc268895737eb52a87f25b02d9af9074e5da3f42d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-16T01:21:18.074 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:18 smithi162 ceph-mds[64655]: -- 172.21.15.162:0/1844672671 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604c6b75860 con 0x5604c6b53000 2024-09-16T01:21:18.433 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:18 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b[64651]: starting mds.b at 2024-09-16T01:21:18.433 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:18 smithi162 bash[64636]: bb65176f48e69b5042910bbc268895737eb52a87f25b02d9af9074e5da3f42d2 2024-09-16T01:21:18.433 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:18 smithi162 systemd[1]: Started Ceph mds.b for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:21:18.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:18 smithi063 ceph-mon[31070]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:18.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:18 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:21:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:18 smithi192 ceph-mon[34775]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:18 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:21:18.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:18 smithi162 ceph-mon[34539]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:18.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:18.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:18 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:21:19.034 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:21:19.534 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:19.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:19 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] up:boot 2024-09-16T01:21:19.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:19 smithi162 ceph-mon[34539]: fsmap 12 up:standby 2024-09-16T01:21:19.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:19 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:21:19.786 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:19 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] up:boot 2024-09-16T01:21:19.786 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:19 smithi063 ceph-mon[31070]: fsmap 12 up:standby 2024-09-16T01:21:19.786 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:19 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:21:19.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:19 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] up:boot 2024-09-16T01:21:19.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:19 smithi192 ceph-mon[34775]: fsmap 12 up:standby 2024-09-16T01:21:19.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:19 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:21:20.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.098+0000 7fd10b950640 1 -- 172.21.15.63:0/2380031358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd104103660 msgr2=0x7fd10410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:20.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.098+0000 7fd10b950640 1 --2- 172.21.15.63:0/2380031358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd104103660 0x7fd10410bb50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd100009900 tx=0x7fd10002a480 comp rx=0 tx=0).stop 2024-09-16T01:21:20.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.098+0000 7fd10b950640 1 -- 172.21.15.63:0/2380031358 shutdown_connections 2024-09-16T01:21:20.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.098+0000 7fd10b950640 1 --2- 172.21.15.63:0/2380031358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd10410c170 0x7fd10410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:20.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.098+0000 7fd10b950640 1 --2- 172.21.15.63:0/2380031358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd104103660 0x7fd10410bb50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:20.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.098+0000 7fd10b950640 1 --2- 172.21.15.63:0/2380031358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd104102d40 0x7fd104103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.098+0000 7fd10b950640 1 -- 172.21.15.63:0/2380031358 >> 172.21.15.63:0/2380031358 conn(0x7fd1040fc7a0 msgr2=0x7fd1040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.098+0000 7fd10b950640 1 -- 172.21.15.63:0/2380031358 shutdown_connections 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.098+0000 7fd10b950640 1 -- 172.21.15.63:0/2380031358 wait complete. 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd10b950640 1 Processor -- start 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd10b950640 1 -- start start 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd10b950640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd104102d40 0x7fd1041009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd10b950640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd104103660 0x7fd104100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd10b950640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10410c170 0x7fd104101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd10b950640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd104111e20 con 0x7fd10410c170 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd10b950640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd104111ca0 con 0x7fd104103660 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd10b950640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd104111fa0 con 0x7fd104102d40 2024-09-16T01:21:20.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd109eed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10410c170 0x7fd104101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:20.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd108eeb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd104103660 0x7fd104100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:20.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd109eed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10410c170 0x7fd104101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51712/0 (socket says 172.21.15.63:51712) 2024-09-16T01:21:20.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd1096ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd104102d40 0x7fd1041009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:20.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.099+0000 7fd109eed640 1 -- 172.21.15.63:0/1159253020 learned_addr learned my addr 172.21.15.63:0/1159253020 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:20.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd108eeb640 1 -- 172.21.15.63:0/1159253020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd104102d40 msgr2=0x7fd1041009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:20.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd108eeb640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd104102d40 0x7fd1041009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:20.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd108eeb640 1 -- 172.21.15.63:0/1159253020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10410c170 msgr2=0x7fd104101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:20.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd108eeb640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10410c170 0x7fd104101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:20.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd108eeb640 1 -- 172.21.15.63:0/1159253020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1041a68a0 con 0x7fd104103660 2024-09-16T01:21:20.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd109eed640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10410c170 0x7fd104101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd108eeb640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd104103660 0x7fd104100ee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd10002a9a0 tx=0x7fd100004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd0f67fc640 1 -- 172.21.15.63:0/1159253020 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10003f030 con 0x7fd104103660 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd10b950640 1 -- 172.21.15.63:0/1159253020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1041a6b30 con 0x7fd104103660 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd0f67fc640 1 -- 172.21.15.63:0/1159253020 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd100003aa0 con 0x7fd104103660 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd0f67fc640 1 -- 172.21.15.63:0/1159253020 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100035070 con 0x7fd104103660 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.100+0000 7fd10b950640 1 -- 172.21.15.63:0/1159253020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1041a7010 con 0x7fd104103660 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.101+0000 7fd10b950640 1 -- 172.21.15.63:0/1159253020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd104103120 con 0x7fd104103660 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.103+0000 7fd0f67fc640 1 -- 172.21.15.63:0/1159253020 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd100042030 con 0x7fd104103660 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.103+0000 7fd0f67fc640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd0f00a3240 0x7fd0f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.103+0000 7fd1096ec640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd0f00a3240 0x7fd0f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.103+0000 7fd0f67fc640 1 -- 172.21.15.63:0/1159253020 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fd1000efa40 con 0x7fd104103660 2024-09-16T01:21:20.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.104+0000 7fd1096ec640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd0f00a3240 0x7fd0f00a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8005fd0 tx=0x7fd0f8009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:20.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.106+0000 7fd0f67fc640 1 -- 172.21.15.63:0/1159253020 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1000bc510 con 0x7fd104103660 2024-09-16T01:21:20.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.344+0000 7fd10b950640 1 -- 172.21.15.63:0/1159253020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd104101ed0 con 0x7fd104103660 2024-09-16T01:21:20.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.344+0000 7fd0f67fc640 1 -- 172.21.15.63:0/1159253020 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10521 (secure 0 0 0) 0x7fd1000c0810 con 0x7fd104103660 2024-09-16T01:21:20.346 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:20.346 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":13,"btime":"2024-09-16T01:21:18:522446+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24443,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24460,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-16T01:21:20.346 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 13 2024-09-16T01:21:20.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 -- 172.21.15.63:0/1159253020 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd0f00a3240 msgr2=0x7fd0f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:20.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd0f00a3240 0x7fd0f00a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8005fd0 tx=0x7fd0f8009760 comp rx=0 tx=0).stop 2024-09-16T01:21:20.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 -- 172.21.15.63:0/1159253020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd104103660 msgr2=0x7fd104100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:20.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd104103660 0x7fd104100ee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd10002a9a0 tx=0x7fd100004040 comp rx=0 tx=0).stop 2024-09-16T01:21:20.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 -- 172.21.15.63:0/1159253020 shutdown_connections 2024-09-16T01:21:20.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd0f00a3240 0x7fd0f00a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:20.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10410c170 0x7fd104101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:20.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd104103660 0x7fd104100ee0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:20.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 --2- 172.21.15.63:0/1159253020 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd104102d40 0x7fd1041009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:20.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 -- 172.21.15.63:0/1159253020 >> 172.21.15.63:0/1159253020 conn(0x7fd1040fc7a0 msgr2=0x7fd1040fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:20.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 -- 172.21.15.63:0/1159253020 shutdown_connections 2024-09-16T01:21:20.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:20.347+0000 7fd10b950640 1 -- 172.21.15.63:0/1159253020 wait complete. 2024-09-16T01:21:21.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:21.011 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1159253020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:21.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:21.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:21:21.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.012 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:20 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:21:21.038 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-16T01:21:21.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:21.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1159253020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:21:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:20 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:21:21.173 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:21.173 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.173 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.173 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.174 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.174 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1159253020' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:21.174 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.174 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.174 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:21.174 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:21:21.174 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:21.174 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:20 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:21:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.399+0000 7f3c2d380640 1 -- 172.21.15.63:0/306951905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c28102790 msgr2=0x7f3c281067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:22.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.399+0000 7f3c2d380640 1 --2- 172.21.15.63:0/306951905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c28102790 0x7f3c281067e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009900 tx=0x7f3c1002a410 comp rx=0 tx=0).stop 2024-09-16T01:21:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.399+0000 7f3c2d380640 1 -- 172.21.15.63:0/306951905 shutdown_connections 2024-09-16T01:21:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.399+0000 7f3c2d380640 1 --2- 172.21.15.63:0/306951905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c28106f10 0x7f3c2810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.399+0000 7f3c2d380640 1 --2- 172.21.15.63:0/306951905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c28102790 0x7f3c281067e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.399+0000 7f3c2d380640 1 --2- 172.21.15.63:0/306951905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28101de0 0x7f3c281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.399+0000 7f3c2d380640 1 -- 172.21.15.63:0/306951905 >> 172.21.15.63:0/306951905 conn(0x7f3c280fd8c0 msgr2=0x7f3c280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.399+0000 7f3c2d380640 1 -- 172.21.15.63:0/306951905 shutdown_connections 2024-09-16T01:21:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.399+0000 7f3c2d380640 1 -- 172.21.15.63:0/306951905 wait complete. 2024-09-16T01:21:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c2d380640 1 Processor -- start 2024-09-16T01:21:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c2d380640 1 -- start start 2024-09-16T01:21:22.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c2d380640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c28101de0 0x7f3c28198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c2d380640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c28102790 0x7f3c281988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c2d380640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28106f10 0x7f3c2819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c2d380640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3c28111e40 con 0x7f3c28102790 2024-09-16T01:21:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c2d380640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c28111cc0 con 0x7f3c28101de0 2024-09-16T01:21:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c2d380640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3c28111fc0 con 0x7f3c28106f10 2024-09-16T01:21:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c267fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c28102790 0x7f3c281988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c267fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c28102790 0x7f3c281988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51726/0 (socket says 172.21.15.63:51726) 2024-09-16T01:21:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c267fc640 1 -- 172.21.15.63:0/639687330 learned_addr learned my addr 172.21.15.63:0/639687330 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:22.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c26ffd640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c28101de0 0x7f3c28198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c277fe640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28106f10 0x7f3c2819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c267fc640 1 -- 172.21.15.63:0/639687330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28106f10 msgr2=0x7f3c2819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c267fc640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28106f10 0x7f3c2819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c267fc640 1 -- 172.21.15.63:0/639687330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c28101de0 msgr2=0x7f3c28198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.400+0000 7f3c267fc640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c28101de0 0x7f3c28198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.401+0000 7f3c267fc640 1 -- 172.21.15.63:0/639687330 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2819d330 con 0x7f3c28102790 2024-09-16T01:21:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.401+0000 7f3c277fe640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28106f10 0x7f3c2819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.401+0000 7f3c267fc640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c28102790 0x7f3c281988c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3c10006010 tx=0x7f3c10004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.401+0000 7f3c1ffff640 1 -- 172.21.15.63:0/639687330 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1003f030 con 0x7f3c28102790 2024-09-16T01:21:22.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.401+0000 7f3c1ffff640 1 -- 172.21.15.63:0/639687330 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c100035f0 con 0x7f3c28102790 2024-09-16T01:21:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.401+0000 7f3c2d380640 1 -- 172.21.15.63:0/639687330 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2819d5c0 con 0x7f3c28102790 2024-09-16T01:21:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.401+0000 7f3c1ffff640 1 -- 172.21.15.63:0/639687330 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10035070 con 0x7f3c28102790 2024-09-16T01:21:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.401+0000 7f3c2d380640 1 -- 172.21.15.63:0/639687330 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c281a4f00 con 0x7f3c28102790 2024-09-16T01:21:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.402+0000 7f3c2d380640 1 -- 172.21.15.63:0/639687330 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c281021c0 con 0x7f3c28102790 2024-09-16T01:21:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.403+0000 7f3c1ffff640 1 -- 172.21.15.63:0/639687330 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3c10003b10 con 0x7f3c28102790 2024-09-16T01:21:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.404+0000 7f3c1ffff640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c140a3240 0x7f3c140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.404+0000 7f3c26ffd640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c140a3240 0x7f3c140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:22.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.404+0000 7f3c1ffff640 1 -- 172.21.15.63:0/639687330 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f3c100f00a0 con 0x7f3c28102790 2024-09-16T01:21:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.404+0000 7f3c26ffd640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c140a3240 0x7f3c140a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3c18007350 tx=0x7f3c180072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:22.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.408+0000 7f3c1ffff640 1 -- 172.21.15.63:0/639687330 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3c100bd260 con 0x7f3c28102790 2024-09-16T01:21:22.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.590+0000 7f3c2d380640 1 -- 172.21.15.63:0/639687330 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3c2810a0f0 con 0x7f3c28102790 2024-09-16T01:21:22.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.591+0000 7f3c1ffff640 1 -- 172.21.15.63:0/639687330 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7f3c100bcb60 con 0x7f3c28102790 2024-09-16T01:21:22.592 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:22.592 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-09-16T01:21:22.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:21:22.592 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-09-16T01:21:22.593 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-09-16T01:21:22.593 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:21:22.593 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-09-16T01:21:22.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 -- 172.21.15.63:0/639687330 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c140a3240 msgr2=0x7f3c140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:22.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c140a3240 0x7f3c140a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3c18007350 tx=0x7f3c180072e0 comp rx=0 tx=0).stop 2024-09-16T01:21:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 -- 172.21.15.63:0/639687330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c28102790 msgr2=0x7f3c281988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c28102790 0x7f3c281988c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3c10006010 tx=0x7f3c10004270 comp rx=0 tx=0).stop 2024-09-16T01:21:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 -- 172.21.15.63:0/639687330 shutdown_connections 2024-09-16T01:21:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c140a3240 0x7f3c140a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28106f10 0x7f3c2819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c28102790 0x7f3c281988c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 --2- 172.21.15.63:0/639687330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c28101de0 0x7f3c28198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 -- 172.21.15.63:0/639687330 >> 172.21.15.63:0/639687330 conn(0x7f3c280fd8c0 msgr2=0x7f3c280febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 -- 172.21.15.63:0/639687330 shutdown_connections 2024-09-16T01:21:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:22.593+0000 7f3c2d380640 1 -- 172.21.15.63:0/639687330 wait complete. 2024-09-16T01:21:23.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:22 smithi192 ceph-mon[34775]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:23.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:22 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:22 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:22 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:22 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:22 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:22 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/639687330' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-16T01:21:23.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:22 smithi162 ceph-mon[34539]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:23.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:22 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:22 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:22 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:22 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:22 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:22 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/639687330' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-16T01:21:23.296 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:22 smithi063 ceph-mon[31070]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:23.297 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:22 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.297 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:22 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.297 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:22 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.297 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:22 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.297 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:22 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:23.297 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:22 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/639687330' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-16T01:21:23.327 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:21:23.327 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:21:23.614 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:24.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.111+0000 7f80e7607640 1 -- 172.21.15.63:0/1863424926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80e0101de0 msgr2=0x7f80e01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.111+0000 7f80e7607640 1 --2- 172.21.15.63:0/1863424926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80e0101de0 0x7f80e01021c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009900 tx=0x7f80dc02a410 comp rx=0 tx=0).stop 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.111+0000 7f80e7607640 1 -- 172.21.15.63:0/1863424926 shutdown_connections 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.111+0000 7f80e7607640 1 --2- 172.21.15.63:0/1863424926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e0106f10 0x7f80e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.111+0000 7f80e7607640 1 --2- 172.21.15.63:0/1863424926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e0102790 0x7f80e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.111+0000 7f80e7607640 1 --2- 172.21.15.63:0/1863424926 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80e0101de0 0x7f80e01021c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.111+0000 7f80e7607640 1 -- 172.21.15.63:0/1863424926 >> 172.21.15.63:0/1863424926 conn(0x7f80e00fd8c0 msgr2=0x7f80e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.111+0000 7f80e7607640 1 -- 172.21.15.63:0/1863424926 shutdown_connections 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.111+0000 7f80e7607640 1 -- 172.21.15.63:0/1863424926 wait complete. 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e7607640 1 Processor -- start 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e7607640 1 -- start start 2024-09-16T01:21:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e7607640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e0101de0 0x7f80e0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e7607640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e0102790 0x7f80e0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e7607640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80e0106f10 0x7f80e019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e7607640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0111ec0 con 0x7f80e0106f10 2024-09-16T01:21:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e7607640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0111d40 con 0x7f80e0102790 2024-09-16T01:21:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e7607640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0112040 con 0x7f80e0101de0 2024-09-16T01:21:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e5ba4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80e0106f10 0x7f80e019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e5ba4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80e0106f10 0x7f80e019cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51752/0 (socket says 172.21.15.63:51752) 2024-09-16T01:21:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e5ba4640 1 -- 172.21.15.63:0/2759145855 learned_addr learned my addr 172.21.15.63:0/2759145855 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.112+0000 7f80e53a3640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e0101de0 0x7f80e0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80e4ba2640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e0102790 0x7f80e0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80e5ba4640 1 -- 172.21.15.63:0/2759145855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e0101de0 msgr2=0x7f80e0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80e5ba4640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e0101de0 0x7f80e0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80e5ba4640 1 -- 172.21.15.63:0/2759145855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e0102790 msgr2=0x7f80e0198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80e5ba4640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e0102790 0x7f80e0198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80e5ba4640 1 -- 172.21.15.63:0/2759145855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e019d4d0 con 0x7f80e0106f10 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80e5ba4640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80e0106f10 0x7f80e019cdf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f80d800b970 tx=0x7f80d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80d67fc640 1 -- 172.21.15.63:0/2759145855 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8019070 con 0x7f80e0106f10 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80d67fc640 1 -- 172.21.15.63:0/2759145855 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f80d8014440 con 0x7f80e0106f10 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80e7607640 1 -- 172.21.15.63:0/2759145855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e019d7c0 con 0x7f80e0106f10 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80d67fc640 1 -- 172.21.15.63:0/2759145855 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80075d0 con 0x7f80e0106f10 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.113+0000 7f80e7607640 1 -- 172.21.15.63:0/2759145855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e01a50a0 con 0x7f80e0106f10 2024-09-16T01:21:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.114+0000 7f80e7607640 1 -- 172.21.15.63:0/2759145855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e0102240 con 0x7f80e0106f10 2024-09-16T01:21:24.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.115+0000 7f80d67fc640 1 -- 172.21.15.63:0/2759145855 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f80d801c070 con 0x7f80e0106f10 2024-09-16T01:21:24.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.116+0000 7f80d67fc640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80cc0a32c0 0x7f80cc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:24.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.116+0000 7f80e53a3640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80cc0a32c0 0x7f80cc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:24.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.116+0000 7f80d67fc640 1 -- 172.21.15.63:0/2759145855 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f80d80ce940 con 0x7f80e0106f10 2024-09-16T01:21:24.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.117+0000 7f80e53a3640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80cc0a32c0 0x7f80cc0a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f80dc031440 tx=0x7f80dc005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:24.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.120+0000 7f80d67fc640 1 -- 172.21.15.63:0/2759145855 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80d809b4b0 con 0x7f80e0106f10 2024-09-16T01:21:24.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.296+0000 7f80e7607640 1 -- 172.21.15.63:0/2759145855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f80e002d7c0 con 0x7f80e0106f10 2024-09-16T01:21:24.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.900+0000 7f80d67fc640 1 -- 172.21.15.63:0/2759145855 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f80d809f7b0 con 0x7f80e0106f10 2024-09-16T01:21:24.901 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-09-16T01:21:24.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 -- 172.21.15.63:0/2759145855 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80cc0a32c0 msgr2=0x7f80cc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80cc0a32c0 0x7f80cc0a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f80dc031440 tx=0x7f80dc005e80 comp rx=0 tx=0).stop 2024-09-16T01:21:24.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 -- 172.21.15.63:0/2759145855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80e0106f10 msgr2=0x7f80e019cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80e0106f10 0x7f80e019cdf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f80d800b970 tx=0x7f80d800be30 comp rx=0 tx=0).stop 2024-09-16T01:21:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 -- 172.21.15.63:0/2759145855 shutdown_connections 2024-09-16T01:21:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f80cc0a32c0 0x7f80cc0a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80e0106f10 0x7f80e019cdf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80e0102790 0x7f80e0198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 --2- 172.21.15.63:0/2759145855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80e0101de0 0x7f80e0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 -- 172.21.15.63:0/2759145855 >> 172.21.15.63:0/2759145855 conn(0x7f80e00fd8c0 msgr2=0x7f80e00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:24.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 -- 172.21.15.63:0/2759145855 shutdown_connections 2024-09-16T01:21:24.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:24.902+0000 7f80e7607640 1 -- 172.21.15.63:0/2759145855 wait complete. 2024-09-16T01:21:25.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:24 smithi063 ceph-mon[31070]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:25.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:25.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:25.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:21:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:25.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:24 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2759145855' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-16T01:21:25.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:24 smithi192 ceph-mon[34775]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:25.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:25.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:25.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:25.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:21:25.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:25.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:24 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2759145855' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-16T01:21:25.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:24 smithi162 ceph-mon[34539]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:25.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:25.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:25.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:21:25.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:21:25.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:21:25.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:24 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2759145855' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-16T01:21:25.650 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:21:25.908 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:26.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:25 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2759145855' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-16T01:21:26.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:25 smithi192 ceph-mon[34775]: osdmap e78: 12 total, 12 up, 12 in 2024-09-16T01:21:26.175 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:25 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2759145855' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-16T01:21:26.175 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:25 smithi063 ceph-mon[31070]: osdmap e78: 12 total, 12 up, 12 in 2024-09-16T01:21:26.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:25 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2759145855' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-16T01:21:26.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:25 smithi162 ceph-mon[34539]: osdmap e78: 12 total, 12 up, 12 in 2024-09-16T01:21:26.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 -- 172.21.15.63:0/3303766519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf8108300 msgr2=0x7fadf810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 --2- 172.21.15.63:0/3303766519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf8108300 0x7fadf810ec70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fade8009cd0 tx=0x7fade802a8d0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 -- 172.21.15.63:0/3303766519 shutdown_connections 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 --2- 172.21.15.63:0/3303766519 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf8108300 0x7fadf810ec70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 --2- 172.21.15.63:0/3303766519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf8103780 0x7fadf8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 --2- 172.21.15.63:0/3303766519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadf8102dd0 0x7fadf81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 -- 172.21.15.63:0/3303766519 >> 172.21.15.63:0/3303766519 conn(0x7fadf80fc7d0 msgr2=0x7fadf80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 -- 172.21.15.63:0/3303766519 shutdown_connections 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 -- 172.21.15.63:0/3303766519 wait complete. 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 Processor -- start 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.387+0000 7fadffea7640 1 -- start start 2024-09-16T01:21:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadffea7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadf8102dd0 0x7fadf819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadffea7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf8103780 0x7fadf819ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadffea7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf8108300 0x7fadf819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadffea7640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8111fc0 con 0x7fadf8108300 2024-09-16T01:21:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadffea7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8111e40 con 0x7fadf8103780 2024-09-16T01:21:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadffea7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8112140 con 0x7fadf8102dd0 2024-09-16T01:21:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfe444640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf8108300 0x7fadf819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfe444640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf8108300 0x7fadf819eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51768/0 (socket says 172.21.15.63:51768) 2024-09-16T01:21:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfe444640 1 -- 172.21.15.63:0/1625475709 learned_addr learned my addr 172.21.15.63:0/1625475709 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfdc43640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadf8102dd0 0x7fadf819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfd442640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf8103780 0x7fadf819ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfe444640 1 -- 172.21.15.63:0/1625475709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadf8102dd0 msgr2=0x7fadf819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfe444640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadf8102dd0 0x7fadf819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfe444640 1 -- 172.21.15.63:0/1625475709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf8103780 msgr2=0x7fadf819ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfe444640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf8103780 0x7fadf819ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfe444640 1 -- 172.21.15.63:0/1625475709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf819f6d0 con 0x7fadf8108300 2024-09-16T01:21:26.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadfe444640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf8108300 0x7fadf819eff0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fade8005cc0 tx=0x7fade8032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:26.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadf6ffd640 1 -- 172.21.15.63:0/1625475709 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8003b70 con 0x7fadf8108300 2024-09-16T01:21:26.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadffea7640 1 -- 172.21.15.63:0/1625475709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf819f960 con 0x7fadf8108300 2024-09-16T01:21:26.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadf6ffd640 1 -- 172.21.15.63:0/1625475709 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fade8003d10 con 0x7fadf8108300 2024-09-16T01:21:26.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.388+0000 7fadf6ffd640 1 -- 172.21.15.63:0/1625475709 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade80307d0 con 0x7fadf8108300 2024-09-16T01:21:26.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.389+0000 7fadffea7640 1 -- 172.21.15.63:0/1625475709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf81a72a0 con 0x7fadf8108300 2024-09-16T01:21:26.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.390+0000 7fadffea7640 1 -- 172.21.15.63:0/1625475709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf81031b0 con 0x7fadf8108300 2024-09-16T01:21:26.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.391+0000 7fadf6ffd640 1 -- 172.21.15.63:0/1625475709 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fade80309d0 con 0x7fadf8108300 2024-09-16T01:21:26.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.392+0000 7fadf6ffd640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fade00a3240 0x7fade00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.392+0000 7fadfdc43640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fade00a3240 0x7fade00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.392+0000 7fadf6ffd640 1 -- 172.21.15.63:0/1625475709 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7fade80f0900 con 0x7fadf8108300 2024-09-16T01:21:26.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.392+0000 7fadfdc43640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fade00a3240 0x7fade00a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009890 tx=0x7fadf0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:26.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.395+0000 7fadf6ffd640 1 -- 172.21.15.63:0/1625475709 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fade803b410 con 0x7fadf8108300 2024-09-16T01:21:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:26.571+0000 7fadffea7640 1 -- 172.21.15.63:0/1625475709 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fadf810c2a0 con 0x7fadf8108300 2024-09-16T01:21:27.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.018+0000 7fadf6ffd640 1 -- 172.21.15.63:0/1625475709 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) ==== 170+0+0 (secure 0 0 0) 0x7fade80bd950 con 0x7fadf8108300 2024-09-16T01:21:27.020 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-09-16T01:21:27.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 -- 172.21.15.63:0/1625475709 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fade00a3240 msgr2=0x7fade00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fade00a3240 0x7fade00a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009890 tx=0x7fadf0008040 comp rx=0 tx=0).stop 2024-09-16T01:21:27.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 -- 172.21.15.63:0/1625475709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf8108300 msgr2=0x7fadf819eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf8108300 0x7fadf819eff0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fade8005cc0 tx=0x7fade8032cf0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 -- 172.21.15.63:0/1625475709 shutdown_connections 2024-09-16T01:21:27.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fade00a3240 0x7fade00a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadf8108300 0x7fadf819eff0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf8103780 0x7fadf819ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 --2- 172.21.15.63:0/1625475709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadf8102dd0 0x7fadf819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 -- 172.21.15.63:0/1625475709 >> 172.21.15.63:0/1625475709 conn(0x7fadf80fc7d0 msgr2=0x7fadf8100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:27.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 -- 172.21.15.63:0/1625475709 shutdown_connections 2024-09-16T01:21:27.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:27.021+0000 7fadffea7640 1 -- 172.21.15.63:0/1625475709 wait complete. 2024-09-16T01:21:27.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:27 smithi063 ceph-mon[31070]: pgmap v272: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:27.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:27 smithi063 ceph-mon[31070]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T01:21:27.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:27 smithi063 ceph-mon[31070]: osdmap e79: 12 total, 12 up, 12 in 2024-09-16T01:21:27.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:27 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1625475709' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-16T01:21:27.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:27 smithi192 ceph-mon[34775]: pgmap v272: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:27.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:27 smithi192 ceph-mon[34775]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T01:21:27.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:27 smithi192 ceph-mon[34775]: osdmap e79: 12 total, 12 up, 12 in 2024-09-16T01:21:27.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:27 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1625475709' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-16T01:21:27.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:27 smithi162 ceph-mon[34539]: pgmap v272: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:27.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:27 smithi162 ceph-mon[34539]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-16T01:21:27.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:27 smithi162 ceph-mon[34539]: osdmap e79: 12 total, 12 up, 12 in 2024-09-16T01:21:27.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:27 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1625475709' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-16T01:21:27.795 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:21:28.071 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:28.327 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:28 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1625475709' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-16T01:21:28.327 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:28 smithi063 ceph-mon[31070]: osdmap e80: 12 total, 12 up, 12 in 2024-09-16T01:21:28.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:28 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1625475709' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-16T01:21:28.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:28 smithi192 ceph-mon[34775]: osdmap e80: 12 total, 12 up, 12 in 2024-09-16T01:21:28.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:28 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1625475709' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-16T01:21:28.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:28 smithi162 ceph-mon[34539]: osdmap e80: 12 total, 12 up, 12 in 2024-09-16T01:21:28.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.548+0000 7f861e6b1640 1 -- 172.21.15.63:0/3469924853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8618106a80 msgr2=0x7f8618106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.548+0000 7f861e6b1640 1 --2- 172.21.15.63:0/3469924853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8618106a80 0x7f8618106e60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8608009930 tx=0x7f860802a420 comp rx=0 tx=0).stop 2024-09-16T01:21:28.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.548+0000 7f861e6b1640 1 -- 172.21.15.63:0/3469924853 shutdown_connections 2024-09-16T01:21:28.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.548+0000 7f861e6b1640 1 --2- 172.21.15.63:0/3469924853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8618101420 0x7f861810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.548+0000 7f861e6b1640 1 --2- 172.21.15.63:0/3469924853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8618100a80 0x7f8618100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.548+0000 7f861e6b1640 1 --2- 172.21.15.63:0/3469924853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8618106a80 0x7f8618106e60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.548+0000 7f861e6b1640 1 -- 172.21.15.63:0/3469924853 >> 172.21.15.63:0/3469924853 conn(0x7f86180fc7a0 msgr2=0x7f86180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.548+0000 7f861e6b1640 1 -- 172.21.15.63:0/3469924853 shutdown_connections 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.548+0000 7f861e6b1640 1 -- 172.21.15.63:0/3469924853 wait complete. 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.548+0000 7f861e6b1640 1 Processor -- start 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f861e6b1640 1 -- start start 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f861e6b1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8618100a80 0x7f861819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f861e6b1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8618101420 0x7f861819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f861e6b1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8618106a80 0x7f861819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f861e6b1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8618110d50 con 0x7f8618101420 2024-09-16T01:21:28.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f861e6b1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8618110bd0 con 0x7f8618106a80 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f861e6b1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8618110ed0 con 0x7f8618100a80 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f860ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8618101420 0x7f861819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f860ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8618101420 0x7f861819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43946/0 (socket says 172.21.15.63:43946) 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f860ffff640 1 -- 172.21.15.63:0/1119262091 learned_addr learned my addr 172.21.15.63:0/1119262091 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f861cc4e640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8618106a80 0x7f861819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f8617fff640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8618100a80 0x7f861819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f860ffff640 1 -- 172.21.15.63:0/1119262091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8618100a80 msgr2=0x7f861819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f860ffff640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8618100a80 0x7f861819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f860ffff640 1 -- 172.21.15.63:0/1119262091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8618106a80 msgr2=0x7f861819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f860ffff640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8618106a80 0x7f861819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f860ffff640 1 -- 172.21.15.63:0/1119262091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861819f5a0 con 0x7f8618101420 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.549+0000 7f860ffff640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8618101420 0x7f861819ab30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f860000d950 tx=0x7f860000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.550+0000 7f8615ffb640 1 -- 172.21.15.63:0/1119262091 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600017070 con 0x7f8618101420 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.550+0000 7f8615ffb640 1 -- 172.21.15.63:0/1119262091 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8600009c30 con 0x7f8618101420 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.550+0000 7f861e6b1640 1 -- 172.21.15.63:0/1119262091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861819f890 con 0x7f8618101420 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.550+0000 7f8615ffb640 1 -- 172.21.15.63:0/1119262091 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860000f620 con 0x7f8618101420 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.550+0000 7f861e6b1640 1 -- 172.21.15.63:0/1119262091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86181a7170 con 0x7f8618101420 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.551+0000 7f861e6b1640 1 -- 172.21.15.63:0/1119262091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8618100ee0 con 0x7f8618101420 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.552+0000 7f8615ffb640 1 -- 172.21.15.63:0/1119262091 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f86000109a0 con 0x7f8618101420 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.553+0000 7f8615ffb640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f86040a3240 0x7f86040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.553+0000 7f8617fff640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f86040a3240 0x7f86040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.553+0000 7f8615ffb640 1 -- 172.21.15.63:0/1119262091 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7f86000cf420 con 0x7f8618101420 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.553+0000 7f8617fff640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f86040a3240 0x7f86040a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8608000c00 tx=0x7f8608032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.556+0000 7f8615ffb640 1 -- 172.21.15.63:0/1119262091 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8600009de0 con 0x7f8618101420 2024-09-16T01:21:28.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:28.776+0000 7f861e6b1640 1 -- 172.21.15.63:0/1119262091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f86181a74a0 con 0x7f8618101420 2024-09-16T01:21:29.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.025+0000 7f8615ffb640 1 -- 172.21.15.63:0/1119262091 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f860009c2f0 con 0x7f8618101420 2024-09-16T01:21:29.027 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 2 and data pool 3 2024-09-16T01:21:29.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.028+0000 7f861e6b1640 1 -- 172.21.15.63:0/1119262091 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f86040a3240 msgr2=0x7f86040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.028+0000 7f861e6b1640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f86040a3240 0x7f86040a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8608000c00 tx=0x7f8608032c80 comp rx=0 tx=0).stop 2024-09-16T01:21:29.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.028+0000 7f861e6b1640 1 -- 172.21.15.63:0/1119262091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8618101420 msgr2=0x7f861819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.028+0000 7f861e6b1640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8618101420 0x7f861819ab30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f860000d950 tx=0x7f860000de10 comp rx=0 tx=0).stop 2024-09-16T01:21:29.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.028+0000 7f861e6b1640 1 -- 172.21.15.63:0/1119262091 shutdown_connections 2024-09-16T01:21:29.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.028+0000 7f861e6b1640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f86040a3240 0x7f86040a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.028+0000 7f861e6b1640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8618106a80 0x7f861819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.028+0000 7f861e6b1640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8618101420 0x7f861819ab30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.028+0000 7f861e6b1640 1 --2- 172.21.15.63:0/1119262091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8618100a80 0x7f861819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.028+0000 7f861e6b1640 1 -- 172.21.15.63:0/1119262091 >> 172.21.15.63:0/1119262091 conn(0x7f86180fc7a0 msgr2=0x7f861806a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:29.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.029+0000 7f861e6b1640 1 -- 172.21.15.63:0/1119262091 shutdown_connections 2024-09-16T01:21:29.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:29.029+0000 7f861e6b1640 1 -- 172.21.15.63:0/1119262091 wait complete. 2024-09-16T01:21:29.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:29 smithi063 ceph-mon[31070]: pgmap v275: 97 pgs: 4 creating+activating, 18 creating+peering, 15 active+clean, 60 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:29.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:29 smithi063 ceph-mon[31070]: osdmap e81: 12 total, 12 up, 12 in 2024-09-16T01:21:29.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:29 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1119262091' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-16T01:21:29.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:29 smithi063 ceph-mon[31070]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-16T01:21:29.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:29 smithi192 ceph-mon[34775]: pgmap v275: 97 pgs: 4 creating+activating, 18 creating+peering, 15 active+clean, 60 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:29.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:29 smithi192 ceph-mon[34775]: osdmap e81: 12 total, 12 up, 12 in 2024-09-16T01:21:29.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:29 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1119262091' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-16T01:21:29.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:29 smithi192 ceph-mon[34775]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-16T01:21:29.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:29 smithi162 ceph-mon[34539]: pgmap v275: 97 pgs: 4 creating+activating, 18 creating+peering, 15 active+clean, 60 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:29.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:29 smithi162 ceph-mon[34539]: osdmap e81: 12 total, 12 up, 12 in 2024-09-16T01:21:29.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:29 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1119262091' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-16T01:21:29.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:29 smithi162 ceph-mon[34539]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-16T01:21:29.820 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:21:30.084 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:30 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1119262091' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-16T01:21:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:30 smithi063 ceph-mon[31070]: osdmap e82: 12 total, 12 up, 12 in 2024-09-16T01:21:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:30 smithi063 ceph-mon[31070]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-16T01:21:30.333 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:30 smithi063 ceph-mon[31070]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-16T01:21:30.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:30 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1119262091' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-16T01:21:30.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:30 smithi192 ceph-mon[34775]: osdmap e82: 12 total, 12 up, 12 in 2024-09-16T01:21:30.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:30 smithi192 ceph-mon[34775]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-16T01:21:30.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:30 smithi192 ceph-mon[34775]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-16T01:21:30.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:30 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1119262091' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-16T01:21:30.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:30 smithi162 ceph-mon[34539]: osdmap e82: 12 total, 12 up, 12 in 2024-09-16T01:21:30.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:30 smithi162 ceph-mon[34539]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-16T01:21:30.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:30 smithi162 ceph-mon[34539]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-16T01:21:30.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/2508861857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a88102d90 msgr2=0x7f5a88103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:30.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 --2- 172.21.15.63:0/2508861857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a88102d90 0x7f5a88103170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009930 tx=0x7f5a7802a420 comp rx=0 tx=0).stop 2024-09-16T01:21:30.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/2508861857 shutdown_connections 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 --2- 172.21.15.63:0/2508861857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a88108290 0x7f5a8810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 --2- 172.21.15.63:0/2508861857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a88103740 0x7f5a88107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 --2- 172.21.15.63:0/2508861857 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a88102d90 0x7f5a88103170 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/2508861857 >> 172.21.15.63:0/2508861857 conn(0x7f5a880fc7d0 msgr2=0x7f5a880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/2508861857 shutdown_connections 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/2508861857 wait complete. 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 Processor -- start 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.552+0000 7f5a8e7ae640 1 -- start start 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a8e7ae640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a88102d90 0x7f5a881984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a8e7ae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a88103740 0x7f5a88198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:30.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a8e7ae640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a88108290 0x7f5a8819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a8e7ae640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5a88111f80 con 0x7f5a88102d90 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a8e7ae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a88111e00 con 0x7f5a88103740 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a8e7ae640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5a88112100 con 0x7f5a88108290 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a87fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a88102d90 0x7f5a881984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a87fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a88102d90 0x7f5a881984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43960/0 (socket says 172.21.15.63:43960) 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a87fff640 1 -- 172.21.15.63:0/3741378520 learned_addr learned my addr 172.21.15.63:0/3741378520 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a8cd4b640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a88108290 0x7f5a8819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a7ffff640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a88103740 0x7f5a88198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a87fff640 1 -- 172.21.15.63:0/3741378520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a88108290 msgr2=0x7f5a8819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a87fff640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a88108290 0x7f5a8819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a87fff640 1 -- 172.21.15.63:0/3741378520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a88103740 msgr2=0x7f5a88198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a87fff640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a88103740 0x7f5a88198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a87fff640 1 -- 172.21.15.63:0/3741378520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8819d490 con 0x7f5a88102d90 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a8cd4b640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a88108290 0x7f5a8819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.553+0000 7f5a87fff640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a88102d90 0x7f5a881984e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a78005940 tx=0x7f5a780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.554+0000 7f5a85ffb640 1 -- 172.21.15.63:0/3741378520 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7803f030 con 0x7f5a88102d90 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.554+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/3741378520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8819d720 con 0x7f5a88102d90 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.554+0000 7f5a85ffb640 1 -- 172.21.15.63:0/3741378520 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a78003cb0 con 0x7f5a88102d90 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.554+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/3741378520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a881a5060 con 0x7f5a88102d90 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.554+0000 7f5a85ffb640 1 -- 172.21.15.63:0/3741378520 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78035070 con 0x7f5a88102d90 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.555+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/3741378520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a8806a7f0 con 0x7f5a88102d90 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.556+0000 7f5a85ffb640 1 -- 172.21.15.63:0/3741378520 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5a78042030 con 0x7f5a88102d90 2024-09-16T01:21:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.556+0000 7f5a85ffb640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5a740a3240 0x7f5a740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:30.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.557+0000 7f5a7ffff640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5a740a3240 0x7f5a740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:30.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.557+0000 7f5a85ffb640 1 -- 172.21.15.63:0/3741378520 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f5a780f0070 con 0x7f5a88102d90 2024-09-16T01:21:30.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.557+0000 7f5a7ffff640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5a740a3240 0x7f5a740a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5a70005e10 tx=0x7f5a70005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:30.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.560+0000 7f5a85ffb640 1 -- 172.21.15.63:0/3741378520 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a780bcee0 con 0x7f5a88102d90 2024-09-16T01:21:30.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.736+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/3741378520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a8810a2a0 con 0x7f5a88102d90 2024-09-16T01:21:30.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.738+0000 7f5a85ffb640 1 -- 172.21.15.63:0/3741378520 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22231 (secure 0 0 0) 0x7f5a780bc7e0 con 0x7f5a88102d90 2024-09-16T01:21:30.739 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:30.739 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":82,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:28.777546+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/3741378520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5a740a3240 msgr2=0x7f5a740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5a740a3240 0x7f5a740a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5a70005e10 tx=0x7f5a70005da0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/3741378520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a88102d90 msgr2=0x7f5a881984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a88102d90 0x7f5a881984e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a78005940 tx=0x7f5a780042f0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/3741378520 shutdown_connections 2024-09-16T01:21:30.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5a740a3240 0x7f5a740a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a88108290 0x7f5a8819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a88103740 0x7f5a88198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 --2- 172.21.15.63:0/3741378520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a88102d90 0x7f5a881984e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/3741378520 >> 172.21.15.63:0/3741378520 conn(0x7f5a880fc7d0 msgr2=0x7f5a88106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/3741378520 shutdown_connections 2024-09-16T01:21:30.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:30.740+0000 7f5a8e7ae640 1 -- 172.21.15.63:0/3741378520 wait complete. 2024-09-16T01:21:31.358 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:31 smithi063 ceph-mon[31070]: pgmap v278: 97 pgs: 4 creating+activating, 18 creating+peering, 15 active+clean, 60 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:31.358 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:31 smithi063 ceph-mon[31070]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-16T01:21:31.358 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:31 smithi063 ceph-mon[31070]: Cluster is now healthy 2024-09-16T01:21:31.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:31 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] up:active 2024-09-16T01:21:31.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:31 smithi063 ceph-mon[31070]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:31.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:31 smithi063 ceph-mon[31070]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:31.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:31 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3741378520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:21:31.390 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:21:31.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:31 smithi192 ceph-mon[34775]: pgmap v278: 97 pgs: 4 creating+activating, 18 creating+peering, 15 active+clean, 60 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:31.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:31 smithi192 ceph-mon[34775]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-16T01:21:31.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:31 smithi192 ceph-mon[34775]: Cluster is now healthy 2024-09-16T01:21:31.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:31 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] up:active 2024-09-16T01:21:31.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:31 smithi192 ceph-mon[34775]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:31.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:31 smithi192 ceph-mon[34775]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:31.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:31 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3741378520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:21:31.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:31 smithi162 ceph-mon[34539]: pgmap v278: 97 pgs: 4 creating+activating, 18 creating+peering, 15 active+clean, 60 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:21:31.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:31 smithi162 ceph-mon[34539]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-16T01:21:31.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:31 smithi162 ceph-mon[34539]: Cluster is now healthy 2024-09-16T01:21:31.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:31 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] up:active 2024-09-16T01:21:31.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:31 smithi162 ceph-mon[34539]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:31.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:31 smithi162 ceph-mon[34539]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:31.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:31 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3741378520' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:21:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:32.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.126+0000 7fc76f65f640 1 -- 172.21.15.63:0/2906794234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc768074590 msgr2=0x7fc768074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.126+0000 7fc76f65f640 1 --2- 172.21.15.63:0/2906794234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc768074590 0x7fc768074970 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc764009900 tx=0x7fc76402a480 comp rx=0 tx=0).stop 2024-09-16T01:21:32.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.126+0000 7fc76f65f640 1 -- 172.21.15.63:0/2906794234 shutdown_connections 2024-09-16T01:21:32.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.126+0000 7fc76f65f640 1 --2- 172.21.15.63:0/2906794234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc768112ba0 0x7fc768114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.126+0000 7fc76f65f640 1 --2- 172.21.15.63:0/2906794234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc768074eb0 0x7fc768112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.126+0000 7fc76f65f640 1 --2- 172.21.15.63:0/2906794234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc768074590 0x7fc768074970 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.126+0000 7fc76f65f640 1 -- 172.21.15.63:0/2906794234 >> 172.21.15.63:0/2906794234 conn(0x7fc7680fd8b0 msgr2=0x7fc7680ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.126+0000 7fc76f65f640 1 -- 172.21.15.63:0/2906794234 shutdown_connections 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.126+0000 7fc76f65f640 1 -- 172.21.15.63:0/2906794234 wait complete. 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76f65f640 1 Processor -- start 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76f65f640 1 -- start start 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76f65f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc768074590 0x7fc7681a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76f65f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc768074eb0 0x7fc7681a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76f65f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc768112ba0 0x7fc76819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76f65f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc768118510 con 0x7fc768074eb0 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76f65f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc768118390 con 0x7fc768074590 2024-09-16T01:21:32.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76f65f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc768118690 con 0x7fc768112ba0 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76cbfa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc768074eb0 0x7fc7681a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76cbfa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc768074eb0 0x7fc7681a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43980/0 (socket says 172.21.15.63:43980) 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76cbfa640 1 -- 172.21.15.63:0/3680386513 learned_addr learned my addr 172.21.15.63:0/3680386513 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.127+0000 7fc76d3fb640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc768074590 0x7fc7681a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc76dbfc640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc768112ba0 0x7fc76819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc76cbfa640 1 -- 172.21.15.63:0/3680386513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc768112ba0 msgr2=0x7fc76819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc76cbfa640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc768112ba0 0x7fc76819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc76cbfa640 1 -- 172.21.15.63:0/3680386513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc768074590 msgr2=0x7fc7681a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc76cbfa640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc768074590 0x7fc7681a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc76cbfa640 1 -- 172.21.15.63:0/3680386513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76819f070 con 0x7fc768074eb0 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc76dbfc640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc768112ba0 0x7fc76819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc76cbfa640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc768074eb0 0x7fc7681a4cc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc75800b4a0 tx=0x7fc75800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc75e7fc640 1 -- 172.21.15.63:0/3680386513 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758014070 con 0x7fc768074eb0 2024-09-16T01:21:32.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc75e7fc640 1 -- 172.21.15.63:0/3680386513 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc758010ac0 con 0x7fc768074eb0 2024-09-16T01:21:32.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc76f65f640 1 -- 172.21.15.63:0/3680386513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76819f360 con 0x7fc768074eb0 2024-09-16T01:21:32.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc75e7fc640 1 -- 172.21.15.63:0/3680386513 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758017c30 con 0x7fc768074eb0 2024-09-16T01:21:32.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.128+0000 7fc76f65f640 1 -- 172.21.15.63:0/3680386513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7681ab650 con 0x7fc768074eb0 2024-09-16T01:21:32.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.129+0000 7fc76f65f640 1 -- 172.21.15.63:0/3680386513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7680749f0 con 0x7fc768074eb0 2024-09-16T01:21:32.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.130+0000 7fc75e7fc640 1 -- 172.21.15.63:0/3680386513 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc758017070 con 0x7fc768074eb0 2024-09-16T01:21:32.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.131+0000 7fc75e7fc640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc7540a3240 0x7fc7540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:32.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.131+0000 7fc76d3fb640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc7540a3240 0x7fc7540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:32.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.131+0000 7fc75e7fc640 1 -- 172.21.15.63:0/3680386513 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fc7580cebc0 con 0x7fc768074eb0 2024-09-16T01:21:32.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.132+0000 7fc76d3fb640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc7540a3240 0x7fc7540a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc764000c00 tx=0x7fc764005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.136+0000 7fc75e7fc640 1 -- 172.21.15.63:0/3680386513 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc75809ba30 con 0x7fc768074eb0 2024-09-16T01:21:32.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.314+0000 7fc76f65f640 1 -- 172.21.15.63:0/3680386513 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc76802d7c0 con 0x7fc768074eb0 2024-09-16T01:21:32.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.316+0000 7fc75e7fc640 1 -- 172.21.15.63:0/3680386513 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22231 (secure 0 0 0) 0x7fc75809b330 con 0x7fc768074eb0 2024-09-16T01:21:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:32.317 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":82,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:28.777546+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:32.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 -- 172.21.15.63:0/3680386513 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc7540a3240 msgr2=0x7fc7540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc7540a3240 0x7fc7540a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc764000c00 tx=0x7fc764005e80 comp rx=0 tx=0).stop 2024-09-16T01:21:32.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 -- 172.21.15.63:0/3680386513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc768074eb0 msgr2=0x7fc7681a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc768074eb0 0x7fc7681a4cc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc75800b4a0 tx=0x7fc75800b960 comp rx=0 tx=0).stop 2024-09-16T01:21:32.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 -- 172.21.15.63:0/3680386513 shutdown_connections 2024-09-16T01:21:32.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc7540a3240 0x7fc7540a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc768112ba0 0x7fc76819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc768074eb0 0x7fc7681a4cc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 --2- 172.21.15.63:0/3680386513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc768074590 0x7fc7681a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 -- 172.21.15.63:0/3680386513 >> 172.21.15.63:0/3680386513 conn(0x7fc7680fd8b0 msgr2=0x7fc7680ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:32.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 -- 172.21.15.63:0/3680386513 shutdown_connections 2024-09-16T01:21:32.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:32.318+0000 7fc76f65f640 1 -- 172.21.15.63:0/3680386513 wait complete. 2024-09-16T01:21:33.033 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:21:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:33.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:33 smithi063 ceph-mon[31070]: pgmap v279: 97 pgs: 1 creating+activating, 9 creating+peering, 73 active+clean, 14 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-16T01:21:33.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:33 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3680386513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:21:33.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:33 smithi192 ceph-mon[34775]: pgmap v279: 97 pgs: 1 creating+activating, 9 creating+peering, 73 active+clean, 14 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-16T01:21:33.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:33 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3680386513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:21:33.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:33 smithi162 ceph-mon[34539]: pgmap v279: 97 pgs: 1 creating+activating, 9 creating+peering, 73 active+clean, 14 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-16T01:21:33.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:33 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3680386513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:21:33.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.786+0000 7f98a5757640 1 -- 172.21.15.63:0/1889261731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98a010c160 msgr2=0x7f98a010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.786+0000 7f98a5757640 1 --2- 172.21.15.63:0/1889261731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98a010c160 0x7f98a010e600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9898009900 tx=0x7f989802a480 comp rx=0 tx=0).stop 2024-09-16T01:21:33.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.786+0000 7f98a5757640 1 -- 172.21.15.63:0/1889261731 shutdown_connections 2024-09-16T01:21:33.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.786+0000 7f98a5757640 1 --2- 172.21.15.63:0/1889261731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98a010c160 0x7f98a010e600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.786+0000 7f98a5757640 1 --2- 172.21.15.63:0/1889261731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a0103650 0x7f98a010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.786+0000 7f98a5757640 1 --2- 172.21.15.63:0/1889261731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a0102d30 0x7f98a0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.786+0000 7f98a5757640 1 -- 172.21.15.63:0/1889261731 >> 172.21.15.63:0/1889261731 conn(0x7f98a00fc790 msgr2=0x7f98a00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:33.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.786+0000 7f98a5757640 1 -- 172.21.15.63:0/1889261731 shutdown_connections 2024-09-16T01:21:33.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.786+0000 7f98a5757640 1 -- 172.21.15.63:0/1889261731 wait complete. 2024-09-16T01:21:33.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.786+0000 7f98a5757640 1 Processor -- start 2024-09-16T01:21:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f98a5757640 1 -- start start 2024-09-16T01:21:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f98a5757640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98a0102d30 0x7f98a019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f98a5757640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a0103650 0x7f98a019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f98a5757640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a010c160 0x7f98a019edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f98a5757640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f98a0111e20 con 0x7f98a0102d30 2024-09-16T01:21:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f98a5757640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98a0111ca0 con 0x7f98a010c160 2024-09-16T01:21:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f98a5757640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f98a0111fa0 con 0x7f98a0103650 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98a0102d30 0x7f98a019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98a0102d30 0x7f98a019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43996/0 (socket says 172.21.15.63:43996) 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989effd640 1 -- 172.21.15.63:0/1495046406 learned_addr learned my addr 172.21.15.63:0/1495046406 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989e7fc640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a0103650 0x7f98a019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989f7fe640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a010c160 0x7f98a019edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989effd640 1 -- 172.21.15.63:0/1495046406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a0103650 msgr2=0x7f98a019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989effd640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a0103650 0x7f98a019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989effd640 1 -- 172.21.15.63:0/1495046406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a010c160 msgr2=0x7f98a019edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989effd640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a010c160 0x7f98a019edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989effd640 1 -- 172.21.15.63:0/1495046406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a019f4a0 con 0x7f98a0102d30 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.787+0000 7f989f7fe640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a010c160 0x7f98a019edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.788+0000 7f989effd640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98a0102d30 0x7f98a019a4f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f989000eab0 tx=0x7f989000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.788+0000 7f9897fff640 1 -- 172.21.15.63:0/1495046406 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989000ce40 con 0x7f98a0102d30 2024-09-16T01:21:33.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.788+0000 7f98a5757640 1 -- 172.21.15.63:0/1495046406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a019f790 con 0x7f98a0102d30 2024-09-16T01:21:33.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.788+0000 7f9897fff640 1 -- 172.21.15.63:0/1495046406 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9890011920 con 0x7f98a0102d30 2024-09-16T01:21:33.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.788+0000 7f9897fff640 1 -- 172.21.15.63:0/1495046406 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890010a00 con 0x7f98a0102d30 2024-09-16T01:21:33.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.788+0000 7f98a5757640 1 -- 172.21.15.63:0/1495046406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a01a7070 con 0x7f98a0102d30 2024-09-16T01:21:33.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.789+0000 7f98a5757640 1 -- 172.21.15.63:0/1495046406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a0103110 con 0x7f98a0102d30 2024-09-16T01:21:33.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.790+0000 7f9897fff640 1 -- 172.21.15.63:0/1495046406 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9890011ad0 con 0x7f98a0102d30 2024-09-16T01:21:33.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.791+0000 7f9897fff640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f988c0a3240 0x7f988c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.791+0000 7f9897fff640 1 -- 172.21.15.63:0/1495046406 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f98900cfe40 con 0x7f98a0102d30 2024-09-16T01:21:33.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.791+0000 7f989e7fc640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f988c0a3240 0x7f988c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.791+0000 7f989e7fc640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f988c0a3240 0x7f988c0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f98a00febd0 tx=0x7f988800b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:33.795+0000 7f9897fff640 1 -- 172.21.15.63:0/1495046406 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9890016030 con 0x7f98a0102d30 2024-09-16T01:21:33.933 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:33 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b[64651]: 2024-09-16T01:21:33.539+0000 7f5a1ac90640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:21:34.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.007+0000 7f98a5757640 1 -- 172.21.15.63:0/1495046406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f98a01a7310 con 0x7f98a0102d30 2024-09-16T01:21:34.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.050+0000 7f9897fff640 1 -- 172.21.15.63:0/1495046406 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f989009ccb0 con 0x7f98a0102d30 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.052+0000 7f98a5757640 1 -- 172.21.15.63:0/1495046406 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f988c0a3240 msgr2=0x7f988c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.052+0000 7f98a5757640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f988c0a3240 0x7f988c0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f98a00febd0 tx=0x7f988800b2e0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.052+0000 7f98a5757640 1 -- 172.21.15.63:0/1495046406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98a0102d30 msgr2=0x7f98a019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.052+0000 7f98a5757640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98a0102d30 0x7f98a019a4f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f989000eab0 tx=0x7f989000ef70 comp rx=0 tx=0).stop 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.052+0000 7f98a5757640 1 -- 172.21.15.63:0/1495046406 shutdown_connections 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.053+0000 7f98a5757640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f988c0a3240 0x7f988c0a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.053+0000 7f98a5757640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a010c160 0x7f98a019edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.053+0000 7f98a5757640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a0103650 0x7f98a019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.053+0000 7f98a5757640 1 --2- 172.21.15.63:0/1495046406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98a0102d30 0x7f98a019a4f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.053+0000 7f98a5757640 1 -- 172.21.15.63:0/1495046406 >> 172.21.15.63:0/1495046406 conn(0x7f98a00fc790 msgr2=0x7f98a01008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.053+0000 7f98a5757640 1 -- 172.21.15.63:0/1495046406 shutdown_connections 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:34.053+0000 7f98a5757640 1 -- 172.21.15.63:0/1495046406 wait complete. 2024-09-16T01:21:34.355 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:34 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1495046406' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-16T01:21:34.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:34 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1495046406' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-16T01:21:34.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:34 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1495046406' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-16T01:21:34.785 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-16T01:21:34.787 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-16T01:21:35.057 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:35.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:35 smithi063 ceph-mon[31070]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-16T01:21:35.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:35 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1495046406' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-16T01:21:35.314 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:35 smithi063 ceph-mon[31070]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:35.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:35 smithi192 ceph-mon[34775]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-16T01:21:35.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:35 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1495046406' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-16T01:21:35.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:35 smithi192 ceph-mon[34775]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:35.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:35 smithi162 ceph-mon[34539]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-16T01:21:35.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:35 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1495046406' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-16T01:21:35.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:35 smithi162 ceph-mon[34539]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.519+0000 7f587f0c8640 1 -- 172.21.15.63:0/1690683034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5878106a80 msgr2=0x7f5878106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.519+0000 7f587f0c8640 1 --2- 172.21.15.63:0/1690683034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5878106a80 0x7f5878106e60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f586c009930 tx=0x7f586c02a420 comp rx=0 tx=0).stop 2024-09-16T01:21:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.519+0000 7f587f0c8640 1 -- 172.21.15.63:0/1690683034 shutdown_connections 2024-09-16T01:21:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.519+0000 7f587f0c8640 1 --2- 172.21.15.63:0/1690683034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5878101420 0x7f587810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.519+0000 7f587f0c8640 1 --2- 172.21.15.63:0/1690683034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5878100a80 0x7f5878100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.519+0000 7f587f0c8640 1 --2- 172.21.15.63:0/1690683034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5878106a80 0x7f5878106e60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.519+0000 7f587f0c8640 1 -- 172.21.15.63:0/1690683034 >> 172.21.15.63:0/1690683034 conn(0x7f58780fc7a0 msgr2=0x7f58780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.519+0000 7f587f0c8640 1 -- 172.21.15.63:0/1690683034 shutdown_connections 2024-09-16T01:21:35.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.519+0000 7f587f0c8640 1 -- 172.21.15.63:0/1690683034 wait complete. 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587f0c8640 1 Processor -- start 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587f0c8640 1 -- start start 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587f0c8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5878100a80 0x7f5878198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587f0c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5878101420 0x7f5878198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587f0c8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5878106a80 0x7f587819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587f0c8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5878111e10 con 0x7f5878100a80 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587f0c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5878111c90 con 0x7f5878101420 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587f0c8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5878111f90 con 0x7f5878106a80 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587ce64640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5878100a80 0x7f5878198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587ce64640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5878100a80 0x7f5878198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44022/0 (socket says 172.21.15.63:44022) 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.520+0000 7f587ce64640 1 -- 172.21.15.63:0/2788013807 learned_addr learned my addr 172.21.15.63:0/2788013807 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f587d665640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5878106a80 0x7f587819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f5877fff640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5878101420 0x7f5878198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f587ce64640 1 -- 172.21.15.63:0/2788013807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5878106a80 msgr2=0x7f587819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f587ce64640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5878106a80 0x7f587819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f587ce64640 1 -- 172.21.15.63:0/2788013807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5878101420 msgr2=0x7f5878198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f587ce64640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5878101420 0x7f5878198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f587ce64640 1 -- 172.21.15.63:0/2788013807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587819d2c0 con 0x7f5878100a80 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f5877fff640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5878101420 0x7f5878198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f587d665640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5878106a80 0x7f587819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f587ce64640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5878100a80 0x7f5878198310 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f586c004770 tx=0x7f586c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f5875ffb640 1 -- 172.21.15.63:0/2788013807 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c03f070 con 0x7f5878100a80 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f5875ffb640 1 -- 172.21.15.63:0/2788013807 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f586c03b460 con 0x7f5878100a80 2024-09-16T01:21:35.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f587f0c8640 1 -- 172.21.15.63:0/2788013807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587819d550 con 0x7f5878100a80 2024-09-16T01:21:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f5875ffb640 1 -- 172.21.15.63:0/2788013807 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c035070 con 0x7f5878100a80 2024-09-16T01:21:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.521+0000 7f587f0c8640 1 -- 172.21.15.63:0/2788013807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58781a4e90 con 0x7f5878100a80 2024-09-16T01:21:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.522+0000 7f587f0c8640 1 -- 172.21.15.63:0/2788013807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5878100ee0 con 0x7f5878100a80 2024-09-16T01:21:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.523+0000 7f5875ffb640 1 -- 172.21.15.63:0/2788013807 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f586c03b610 con 0x7f5878100a80 2024-09-16T01:21:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.524+0000 7f5875ffb640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58680a32c0 0x7f58680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.524+0000 7f5877fff640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58680a32c0 0x7f58680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.524+0000 7f5875ffb640 1 -- 172.21.15.63:0/2788013807 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f586c0efb60 con 0x7f5878100a80 2024-09-16T01:21:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.525+0000 7f5877fff640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58680a32c0 0x7f58680a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f58780fed70 tx=0x7f5864005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.528+0000 7f5875ffb640 1 -- 172.21.15.63:0/2788013807 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f586c0bc9d0 con 0x7f5878100a80 2024-09-16T01:21:35.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:35.742+0000 7f587f0c8640 1 -- 172.21.15.63:0/2788013807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f5878108ff0 con 0x7f5878100a80 2024-09-16T01:21:36.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.064+0000 7f5875ffb640 1 -- 172.21.15.63:0/2788013807 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f586c0bc2d0 con 0x7f5878100a80 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 -- 172.21.15.63:0/2788013807 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58680a32c0 msgr2=0x7f58680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58680a32c0 0x7f58680a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f58780fed70 tx=0x7f5864005d90 comp rx=0 tx=0).stop 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 -- 172.21.15.63:0/2788013807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5878100a80 msgr2=0x7f5878198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5878100a80 0x7f5878198310 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f586c004770 tx=0x7f586c0042f0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 -- 172.21.15.63:0/2788013807 shutdown_connections 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f58680a32c0 0x7f58680a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5878106a80 0x7f587819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5878101420 0x7f5878198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 --2- 172.21.15.63:0/2788013807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5878100a80 0x7f5878198310 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 -- 172.21.15.63:0/2788013807 >> 172.21.15.63:0/2788013807 conn(0x7f58780fc7a0 msgr2=0x7f58780fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 -- 172.21.15.63:0/2788013807 shutdown_connections 2024-09-16T01:21:36.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:36.066+0000 7f587f0c8640 1 -- 172.21.15.63:0/2788013807 wait complete. 2024-09-16T01:21:36.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:36 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2788013807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-16T01:21:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:36 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2788013807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-16T01:21:36.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:36 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2788013807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-16T01:21:36.826 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-16T01:21:37.091 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:37.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:37 smithi063 ceph-mon[31070]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-16T01:21:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:37 smithi063 ceph-mon[31070]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T01:21:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:37 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2788013807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-16T01:21:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:37 smithi063 ceph-mon[31070]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-16T01:21:37.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:37 smithi063 ceph-mon[31070]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:37.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:37 smithi063 ceph-mon[31070]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-16T01:21:37.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:37 smithi063 ceph-mon[31070]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-16T01:21:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:37 smithi192 ceph-mon[34775]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-16T01:21:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:37 smithi192 ceph-mon[34775]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T01:21:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:37 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2788013807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-16T01:21:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:37 smithi192 ceph-mon[34775]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-16T01:21:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:37 smithi192 ceph-mon[34775]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:37 smithi192 ceph-mon[34775]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-16T01:21:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:37 smithi192 ceph-mon[34775]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-16T01:21:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:37 smithi162 ceph-mon[34539]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-16T01:21:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:37 smithi162 ceph-mon[34539]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T01:21:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:37 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2788013807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-16T01:21:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:37 smithi162 ceph-mon[34539]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-16T01:21:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:37 smithi162 ceph-mon[34539]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-16T01:21:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:37 smithi162 ceph-mon[34539]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-16T01:21:37.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:37 smithi162 ceph-mon[34539]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-16T01:21:37.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.567+0000 7f5baf2f4640 1 -- 172.21.15.63:0/1107717956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ba8102d30 msgr2=0x7f5ba8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:37.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.567+0000 7f5baf2f4640 1 --2- 172.21.15.63:0/1107717956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ba8102d30 0x7f5ba8103110 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009930 tx=0x7f5ba402a420 comp rx=0 tx=0).stop 2024-09-16T01:21:37.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.567+0000 7f5baf2f4640 1 -- 172.21.15.63:0/1107717956 shutdown_connections 2024-09-16T01:21:37.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.567+0000 7f5baf2f4640 1 --2- 172.21.15.63:0/1107717956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ba81082a0 0x7f5ba810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:37.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.567+0000 7f5baf2f4640 1 --2- 172.21.15.63:0/1107717956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba81036e0 0x7f5ba8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:37.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.567+0000 7f5baf2f4640 1 --2- 172.21.15.63:0/1107717956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ba8102d30 0x7f5ba8103110 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.567+0000 7f5baf2f4640 1 -- 172.21.15.63:0/1107717956 >> 172.21.15.63:0/1107717956 conn(0x7f5ba80fc7d0 msgr2=0x7f5ba80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.567+0000 7f5baf2f4640 1 -- 172.21.15.63:0/1107717956 shutdown_connections 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.567+0000 7f5baf2f4640 1 -- 172.21.15.63:0/1107717956 wait complete. 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5baf2f4640 1 Processor -- start 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5baf2f4640 1 -- start start 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5baf2f4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5baf2f4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ba81036e0 0x7f5ba8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5baf2f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5baf2f4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8111f50 con 0x7f5ba8102d30 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5baf2f4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8111dd0 con 0x7f5ba81082a0 2024-09-16T01:21:37.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5baf2f4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba81120d0 con 0x7f5ba81036e0 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5bad090640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5bad090640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44048/0 (socket says 172.21.15.63:44048) 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5bad090640 1 -- 172.21.15.63:0/3721471260 learned_addr learned my addr 172.21.15.63:0/3721471260 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5bad891640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5bad090640 1 -- 172.21.15.63:0/3721471260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ba81036e0 msgr2=0x7f5ba8198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5bad090640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ba81036e0 0x7f5ba8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5bad090640 1 -- 172.21.15.63:0/3721471260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba81082a0 msgr2=0x7f5ba819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5bad090640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5bad090640 1 -- 172.21.15.63:0/3721471260 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba819d4c0 con 0x7f5ba8102d30 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.568+0000 7f5bad891640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.569+0000 7f5bad090640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4004770 tx=0x7f5ba40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:37.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.569+0000 7f5b9e7fc640 1 -- 172.21.15.63:0/3721471260 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba403f070 con 0x7f5ba8102d30 2024-09-16T01:21:37.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.569+0000 7f5baf2f4640 1 -- 172.21.15.63:0/3721471260 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba819d750 con 0x7f5ba8102d30 2024-09-16T01:21:37.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.569+0000 7f5b9e7fc640 1 -- 172.21.15.63:0/3721471260 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ba403b460 con 0x7f5ba8102d30 2024-09-16T01:21:37.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.569+0000 7f5b9e7fc640 1 -- 172.21.15.63:0/3721471260 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4035070 con 0x7f5ba8102d30 2024-09-16T01:21:37.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.569+0000 7f5baf2f4640 1 -- 172.21.15.63:0/3721471260 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba81a5090 con 0x7f5ba8102d30 2024-09-16T01:21:37.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.570+0000 7f5baf2f4640 1 -- 172.21.15.63:0/3721471260 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba8103110 con 0x7f5ba8102d30 2024-09-16T01:21:37.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.571+0000 7f5b9e7fc640 1 -- 172.21.15.63:0/3721471260 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5ba403b610 con 0x7f5ba8102d30 2024-09-16T01:21:37.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.572+0000 7f5b9e7fc640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5b940a3240 0x7f5b940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:37.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.572+0000 7f5bac88f640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5b940a3240 0x7f5b940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:37.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.572+0000 7f5b9e7fc640 1 -- 172.21.15.63:0/3721471260 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f5ba40eff00 con 0x7f5ba8102d30 2024-09-16T01:21:37.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.572+0000 7f5bac88f640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5b940a3240 0x7f5b940a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80fef20 tx=0x7f5b98005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:37.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.575+0000 7f5b9e7fc640 1 -- 172.21.15.63:0/3721471260 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ba40bcd70 con 0x7f5ba8102d30 2024-09-16T01:21:37.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:37.791+0000 7f5baf2f4640 1 -- 172.21.15.63:0/3721471260 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f5ba8199870 con 0x7f5ba8102d30 2024-09-16T01:21:38.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.083+0000 7f5b9e7fc640 1 -- 172.21.15.63:0/3721471260 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f5ba40bc670 con 0x7f5ba8102d30 2024-09-16T01:21:38.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.085+0000 7f5baf2f4640 1 -- 172.21.15.63:0/3721471260 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5b940a3240 msgr2=0x7f5b940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.085+0000 7f5baf2f4640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5b940a3240 0x7f5b940a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80fef20 tx=0x7f5b98005bf0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.085+0000 7f5baf2f4640 1 -- 172.21.15.63:0/3721471260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ba8102d30 msgr2=0x7f5ba8198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.085+0000 7f5baf2f4640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4004770 tx=0x7f5ba40042f0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.086+0000 7f5baf2f4640 1 -- 172.21.15.63:0/3721471260 shutdown_connections 2024-09-16T01:21:38.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.086+0000 7f5baf2f4640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5b940a3240 0x7f5b940a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.086+0000 7f5baf2f4640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba81082a0 0x7f5ba819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.086+0000 7f5baf2f4640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ba81036e0 0x7f5ba8198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.086+0000 7f5baf2f4640 1 --2- 172.21.15.63:0/3721471260 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ba8102d30 0x7f5ba8198510 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.086+0000 7f5baf2f4640 1 -- 172.21.15.63:0/3721471260 >> 172.21.15.63:0/3721471260 conn(0x7f5ba80fc7d0 msgr2=0x7f5ba8105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:38.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.086+0000 7f5baf2f4640 1 -- 172.21.15.63:0/3721471260 shutdown_connections 2024-09-16T01:21:38.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:38.086+0000 7f5baf2f4640 1 -- 172.21.15.63:0/3721471260 wait complete. 2024-09-16T01:21:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] up:active 2024-09-16T01:21:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-16T01:21:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T01:21:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: Cluster is now healthy 2024-09-16T01:21:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-16T01:21:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-16T01:21:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-16T01:21:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-16T01:21:38.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-16T01:21:38.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-16T01:21:38.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-16T01:21:38.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-09-16T01:21:38.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-16T01:21:38.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-16T01:21:38.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-16T01:21:38.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-16T01:21:38.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:38 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3721471260' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T01:21:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] up:active 2024-09-16T01:21:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-16T01:21:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: Cluster is now healthy 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-16T01:21:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-16T01:21:38.426 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:38 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3721471260' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T01:21:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] up:active 2024-09-16T01:21:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: Cluster is now healthy 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-16T01:21:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-09-16T01:21:38.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-16T01:21:38.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3721471260' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-16T01:21:38.790 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-16T01:21:38.933 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b[64651]: 2024-09-16T01:21:38.540+0000 7f5a1ac90640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-16T01:21:38.933 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:21:38 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b[64651]: 2024-09-16T01:21:38.540+0000 7f5a1ac90640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-16T01:21:39.047 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:39.094 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-09-16T01:21:39.094 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3721471260' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T01:21:39.347 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] up:active 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: osdmap e83: 12 total, 12 up, 12 in 2024-09-16T01:21:39.348 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:39 smithi063 ceph-mon[31070]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:21:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-09-16T01:21:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3721471260' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T01:21:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-16T01:21:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-16T01:21:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-16T01:21:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-16T01:21:39.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-09-16T01:21:39.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-16T01:21:39.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-16T01:21:39.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-16T01:21:39.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-16T01:21:39.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] up:active 2024-09-16T01:21:39.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-16T01:21:39.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: osdmap e83: 12 total, 12 up, 12 in 2024-09-16T01:21:39.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:39 smithi192 ceph-mon[34775]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:21:39.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-09-16T01:21:39.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3721471260' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-16T01:21:39.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] up:active 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: osdmap e83: 12 total, 12 up, 12 in 2024-09-16T01:21:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:39 smithi162 ceph-mon[34539]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:21:39.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 -- 172.21.15.63:0/1525549360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9320102ef0 msgr2=0x7f932010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:39.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 --2- 172.21.15.63:0/1525549360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9320102ef0 0x7f932010da40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9310009900 tx=0x7f931002a480 comp rx=0 tx=0).stop 2024-09-16T01:21:39.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 -- 172.21.15.63:0/1525549360 shutdown_connections 2024-09-16T01:21:39.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 --2- 172.21.15.63:0/1525549360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9320102ef0 0x7f932010da40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 --2- 172.21.15.63:0/1525549360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9320102570 0x7f93201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 --2- 172.21.15.63:0/1525549360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9320100e20 0x7f9320101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 -- 172.21.15.63:0/1525549360 >> 172.21.15.63:0/1525549360 conn(0x7f93200fc7d0 msgr2=0x7f93200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 -- 172.21.15.63:0/1525549360 shutdown_connections 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 -- 172.21.15.63:0/1525549360 wait complete. 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 Processor -- start 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.540+0000 7f9326aae640 1 -- start start 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f9326aae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9320100e20 0x7f932019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f9326aae640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9320102570 0x7f932019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f9326aae640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9320102ef0 0x7f932019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f9326aae640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9320110e30 con 0x7f9320102ef0 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f9326aae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9320110cb0 con 0x7f9320100e20 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f9326aae640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9320110fb0 con 0x7f9320102570 2024-09-16T01:21:39.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f932504b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9320102ef0 0x7f932019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f932504b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9320102ef0 0x7f932019eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36626/0 (socket says 172.21.15.63:36626) 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f932504b640 1 -- 172.21.15.63:0/4289745343 learned_addr learned my addr 172.21.15.63:0/4289745343 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f932484a640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9320100e20 0x7f932019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f932504b640 1 -- 172.21.15.63:0/4289745343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9320102570 msgr2=0x7f932019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f932504b640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9320102570 0x7f932019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f932504b640 1 -- 172.21.15.63:0/4289745343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9320100e20 msgr2=0x7f932019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f932504b640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9320100e20 0x7f932019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f932504b640 1 -- 172.21.15.63:0/4289745343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932019f580 con 0x7f9320102ef0 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f932504b640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9320102ef0 0x7f932019eea0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9310009230 tx=0x7f93100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f931dffb640 1 -- 172.21.15.63:0/4289745343 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931003f030 con 0x7f9320102ef0 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f931dffb640 1 -- 172.21.15.63:0/4289745343 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9310003800 con 0x7f9320102ef0 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f9326aae640 1 -- 172.21.15.63:0/4289745343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932019f810 con 0x7f9320102ef0 2024-09-16T01:21:39.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.541+0000 7f931dffb640 1 -- 172.21.15.63:0/4289745343 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310035070 con 0x7f9320102ef0 2024-09-16T01:21:39.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.542+0000 7f9326aae640 1 -- 172.21.15.63:0/4289745343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93201a7150 con 0x7f9320102ef0 2024-09-16T01:21:39.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.543+0000 7f9326aae640 1 -- 172.21.15.63:0/4289745343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93201021b0 con 0x7f9320102ef0 2024-09-16T01:21:39.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.544+0000 7f931dffb640 1 -- 172.21.15.63:0/4289745343 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f93100039b0 con 0x7f9320102ef0 2024-09-16T01:21:39.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.544+0000 7f931dffb640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93080a3240 0x7f93080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:39.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.545+0000 7f932484a640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93080a3240 0x7f93080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:39.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.545+0000 7f931dffb640 1 -- 172.21.15.63:0/4289745343 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f93100f0620 con 0x7f9320102ef0 2024-09-16T01:21:39.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.545+0000 7f932484a640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93080a3240 0x7f93080a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9318005c40 tx=0x7f931800a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:39.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.548+0000 7f931dffb640 1 -- 172.21.15.63:0/4289745343 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93100bd340 con 0x7f9320102ef0 2024-09-16T01:21:39.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:39.761+0000 7f9326aae640 1 -- 172.21.15.63:0/4289745343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f9320101200 con 0x7f9320102ef0 2024-09-16T01:21:40.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.099+0000 7f931dffb640 1 -- 172.21.15.63:0/4289745343 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f9320101200 con 0x7f9320102ef0 2024-09-16T01:21:40.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 -- 172.21.15.63:0/4289745343 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93080a3240 msgr2=0x7f93080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:40.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93080a3240 0x7f93080a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9318005c40 tx=0x7f931800a590 comp rx=0 tx=0).stop 2024-09-16T01:21:40.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 -- 172.21.15.63:0/4289745343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9320102ef0 msgr2=0x7f932019eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:40.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9320102ef0 0x7f932019eea0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9310009230 tx=0x7f93100042f0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 -- 172.21.15.63:0/4289745343 shutdown_connections 2024-09-16T01:21:40.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93080a3240 0x7f93080a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9320102ef0 0x7f932019eea0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9320102570 0x7f932019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 --2- 172.21.15.63:0/4289745343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9320100e20 0x7f932019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 -- 172.21.15.63:0/4289745343 >> 172.21.15.63:0/4289745343 conn(0x7f93200fc7d0 msgr2=0x7f9320069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:40.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 -- 172.21.15.63:0/4289745343 shutdown_connections 2024-09-16T01:21:40.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:40.102+0000 7f9326aae640 1 -- 172.21.15.63:0/4289745343 wait complete. 2024-09-16T01:21:40.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:40 smithi063 ceph-mon[31070]: osdmap e84: 12 total, 12 up, 12 in 2024-09-16T01:21:40.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:40 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/4289745343' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-16T01:21:40.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:40 smithi192 ceph-mon[34775]: osdmap e84: 12 total, 12 up, 12 in 2024-09-16T01:21:40.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:40 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/4289745343' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-16T01:21:40.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:40 smithi162 ceph-mon[34539]: osdmap e84: 12 total, 12 up, 12 in 2024-09-16T01:21:40.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:40 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/4289745343' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-16T01:21:40.792 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-16T01:21:40.792 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-16T01:21:41.052 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:41.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:41 smithi063 ceph-mon[31070]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 2 op/s 2024-09-16T01:21:41.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:41 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/4289745343' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-16T01:21:41.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:41 smithi063 ceph-mon[31070]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:21:41.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:41 smithi192 ceph-mon[34775]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 2 op/s 2024-09-16T01:21:41.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:41 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/4289745343' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-16T01:21:41.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:41 smithi192 ceph-mon[34775]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:21:41.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:41 smithi162 ceph-mon[34539]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 2 op/s 2024-09-16T01:21:41.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:41 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/4289745343' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-16T01:21:41.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:41 smithi162 ceph-mon[34539]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:21:41.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.546+0000 7fae1d066640 1 -- 172.21.15.63:0/3965081983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18100e20 msgr2=0x7fae18101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.546+0000 7fae1d066640 1 --2- 172.21.15.63:0/3965081983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18100e20 0x7fae18101200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae10009ca0 tx=0x7fae1002a950 comp rx=0 tx=0).stop 2024-09-16T01:21:41.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.546+0000 7fae1d066640 1 -- 172.21.15.63:0/3965081983 shutdown_connections 2024-09-16T01:21:41.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.546+0000 7fae1d066640 1 --2- 172.21.15.63:0/3965081983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18102ef0 0x7fae1810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.546+0000 7fae1d066640 1 --2- 172.21.15.63:0/3965081983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18102570 0x7fae181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.546+0000 7fae1d066640 1 --2- 172.21.15.63:0/3965081983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18100e20 0x7fae18101200 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.546+0000 7fae1d066640 1 -- 172.21.15.63:0/3965081983 >> 172.21.15.63:0/3965081983 conn(0x7fae180fc7d0 msgr2=0x7fae180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:41.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.546+0000 7fae1d066640 1 -- 172.21.15.63:0/3965081983 shutdown_connections 2024-09-16T01:21:41.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.546+0000 7fae1d066640 1 -- 172.21.15.63:0/3965081983 wait complete. 2024-09-16T01:21:41.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.546+0000 7fae1d066640 1 Processor -- start 2024-09-16T01:21:41.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1d066640 1 -- start start 2024-09-16T01:21:41.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1d066640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18100e20 0x7fae181992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1d066640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18102570 0x7fae18199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1d066640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18102ef0 0x7fae181a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1d066640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fae18110e50 con 0x7fae18102ef0 2024-09-16T01:21:41.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1d066640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae18110cd0 con 0x7fae18100e20 2024-09-16T01:21:41.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1d066640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae18110fd0 con 0x7fae18102570 2024-09-16T01:21:41.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1759e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18102ef0 0x7fae181a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1759e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18102ef0 0x7fae181a4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36638/0 (socket says 172.21.15.63:36638) 2024-09-16T01:21:41.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1759e640 1 -- 172.21.15.63:0/2206797784 learned_addr learned my addr 172.21.15.63:0/2206797784 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:41.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae16d9d640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18100e20 0x7fae181992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.547+0000 7fae1659c640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18102570 0x7fae18199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae1759e640 1 -- 172.21.15.63:0/2206797784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18102570 msgr2=0x7fae18199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae1759e640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18102570 0x7fae18199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae1759e640 1 -- 172.21.15.63:0/2206797784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18100e20 msgr2=0x7fae181992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae1759e640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18100e20 0x7fae181992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae1759e640 1 -- 172.21.15.63:0/2206797784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae181a48a0 con 0x7fae18102ef0 2024-09-16T01:21:41.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae1759e640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18102ef0 0x7fae181a4360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fae0800c970 tx=0x7fae0800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae0ffff640 1 -- 172.21.15.63:0/2206797784 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08007bb0 con 0x7fae18102ef0 2024-09-16T01:21:41.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae1d066640 1 -- 172.21.15.63:0/2206797784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae181a4a70 con 0x7fae18102ef0 2024-09-16T01:21:41.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae0ffff640 1 -- 172.21.15.63:0/2206797784 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae08007d50 con 0x7fae18102ef0 2024-09-16T01:21:41.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae0ffff640 1 -- 172.21.15.63:0/2206797784 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08018660 con 0x7fae18102ef0 2024-09-16T01:21:41.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.548+0000 7fae1d066640 1 -- 172.21.15.63:0/2206797784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae181a4f30 con 0x7fae18102ef0 2024-09-16T01:21:41.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.549+0000 7fae1d066640 1 -- 172.21.15.63:0/2206797784 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae18101200 con 0x7fae18102ef0 2024-09-16T01:21:41.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.550+0000 7fae0ffff640 1 -- 172.21.15.63:0/2206797784 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fae0800f450 con 0x7fae18102ef0 2024-09-16T01:21:41.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.551+0000 7fae0ffff640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a3240 0x7fae040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.551+0000 7fae16d9d640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a3240 0x7fae040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.551+0000 7fae0ffff640 1 -- 172.21.15.63:0/2206797784 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fae080cf8f0 con 0x7fae18102ef0 2024-09-16T01:21:41.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.552+0000 7fae16d9d640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a3240 0x7fae040a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae100093d0 tx=0x7fae10009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.555+0000 7fae0ffff640 1 -- 172.21.15.63:0/2206797784 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae08014030 con 0x7fae18102ef0 2024-09-16T01:21:41.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.754+0000 7fae1d066640 1 -- 172.21.15.63:0/2206797784 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fae18062630 con 0x7fae040a3240 2024-09-16T01:21:41.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.781+0000 7fae0ffff640 1 -- 172.21.15.63:0/2206797784 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fae18062630 con 0x7fae040a3240 2024-09-16T01:21:41.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 -- 172.21.15.63:0/2206797784 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a3240 msgr2=0x7fae040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a3240 0x7fae040a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae100093d0 tx=0x7fae10009360 comp rx=0 tx=0).stop 2024-09-16T01:21:41.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 -- 172.21.15.63:0/2206797784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18102ef0 msgr2=0x7fae181a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18102ef0 0x7fae181a4360 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fae0800c970 tx=0x7fae0800cd70 comp rx=0 tx=0).stop 2024-09-16T01:21:41.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 -- 172.21.15.63:0/2206797784 shutdown_connections 2024-09-16T01:21:41.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a3240 0x7fae040a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18102ef0 0x7fae181a4360 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18102570 0x7fae18199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 --2- 172.21.15.63:0/2206797784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18100e20 0x7fae181992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 -- 172.21.15.63:0/2206797784 >> 172.21.15.63:0/2206797784 conn(0x7fae180fc7d0 msgr2=0x7fae180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:41.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 -- 172.21.15.63:0/2206797784 shutdown_connections 2024-09-16T01:21:41.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:41.783+0000 7fae1d066640 1 -- 172.21.15.63:0/2206797784 wait complete. 2024-09-16T01:21:42.109 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:21:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:21:41.759+0000 7f55a9f4f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:21:42.110 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:21:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:21:41.759+0000 7f55a9f4f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:21:42.110 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:21:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:21:41.759+0000 7f55a9f4f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:21:42.110 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:21:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:21:41.759+0000 7f55a9f4f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:21:42.110 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:21:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:21:41.759+0000 7f55a9f4f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-16T01:21:42.507 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-16T01:21:42.768 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:43.141 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:43 smithi063 ceph-mon[31070]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:43.141 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:43 smithi063 ceph-mon[31070]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:43.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.223+0000 7fb64cb84640 1 -- 172.21.15.63:0/3433875121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb648103660 msgr2=0x7fb64810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.223+0000 7fb64cb84640 1 --2- 172.21.15.63:0/3433875121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb648103660 0x7fb64810bb50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009900 tx=0x7fb63c02a480 comp rx=0 tx=0).stop 2024-09-16T01:21:43.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.223+0000 7fb64cb84640 1 -- 172.21.15.63:0/3433875121 shutdown_connections 2024-09-16T01:21:43.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.223+0000 7fb64cb84640 1 --2- 172.21.15.63:0/3433875121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64810c170 0x7fb64810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.223+0000 7fb64cb84640 1 --2- 172.21.15.63:0/3433875121 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb648103660 0x7fb64810bb50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.223+0000 7fb64cb84640 1 --2- 172.21.15.63:0/3433875121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb648102d40 0x7fb648103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.223+0000 7fb64cb84640 1 -- 172.21.15.63:0/3433875121 >> 172.21.15.63:0/3433875121 conn(0x7fb6480fc7a0 msgr2=0x7fb6480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.223+0000 7fb64cb84640 1 -- 172.21.15.63:0/3433875121 shutdown_connections 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.223+0000 7fb64cb84640 1 -- 172.21.15.63:0/3433875121 wait complete. 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.224+0000 7fb64cb84640 1 Processor -- start 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.224+0000 7fb64cb84640 1 -- start start 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.224+0000 7fb64cb84640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb648102d40 0x7fb6481983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.224+0000 7fb64cb84640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb648103660 0x7fb648198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.224+0000 7fb64cb84640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64810c170 0x7fb64819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64cb84640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb648111e60 con 0x7fb648102d40 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64cb84640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb648111ce0 con 0x7fb648103660 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64cb84640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb648111fe0 con 0x7fb64810c170 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb648102d40 0x7fb6481983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb648102d40 0x7fb6481983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36652/0 (socket says 172.21.15.63:36652) 2024-09-16T01:21:43.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64659c640 1 -- 172.21.15.63:0/4110064115 learned_addr learned my addr 172.21.15.63:0/4110064115 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb646d9d640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64810c170 0x7fb64819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb645d9b640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb648103660 0x7fb648198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64659c640 1 -- 172.21.15.63:0/4110064115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64810c170 msgr2=0x7fb64819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64659c640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64810c170 0x7fb64819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64659c640 1 -- 172.21.15.63:0/4110064115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb648103660 msgr2=0x7fb648198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64659c640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb648103660 0x7fb648198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64659c640 1 -- 172.21.15.63:0/4110064115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64819d3a0 con 0x7fb648102d40 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb645d9b640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb648103660 0x7fb648198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64659c640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb648102d40 0x7fb6481983f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb63800d950 tx=0x7fb63800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb6377fe640 1 -- 172.21.15.63:0/4110064115 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638017070 con 0x7fb648102d40 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64cb84640 1 -- 172.21.15.63:0/4110064115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64819d690 con 0x7fb648102d40 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb6377fe640 1 -- 172.21.15.63:0/4110064115 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb638009c30 con 0x7fb648102d40 2024-09-16T01:21:43.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb6377fe640 1 -- 172.21.15.63:0/4110064115 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63800f620 con 0x7fb648102d40 2024-09-16T01:21:43.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.225+0000 7fb64cb84640 1 -- 172.21.15.63:0/4110064115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6481a4f70 con 0x7fb648102d40 2024-09-16T01:21:43.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.226+0000 7fb64cb84640 1 -- 172.21.15.63:0/4110064115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb648103120 con 0x7fb648102d40 2024-09-16T01:21:43.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.228+0000 7fb6377fe640 1 -- 172.21.15.63:0/4110064115 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb6380109a0 con 0x7fb648102d40 2024-09-16T01:21:43.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.228+0000 7fb6377fe640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb6300a3240 0x7fb6300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.228+0000 7fb645d9b640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb6300a3240 0x7fb6300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.228+0000 7fb6377fe640 1 -- 172.21.15.63:0/4110064115 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb6380cf520 con 0x7fb648102d40 2024-09-16T01:21:43.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.229+0000 7fb645d9b640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb6300a3240 0x7fb6300a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb63c031440 tx=0x7fb63c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.231+0000 7fb6377fe640 1 -- 172.21.15.63:0/4110064115 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb638009de0 con 0x7fb648102d40 2024-09-16T01:21:43.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:43 smithi192 ceph-mon[34775]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:43.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:43 smithi192 ceph-mon[34775]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:43.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:43 smithi162 ceph-mon[34539]: pgmap v286: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:43.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:43 smithi162 ceph-mon[34539]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:43.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.437+0000 7fb64cb84640 1 -- 172.21.15.63:0/4110064115 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb648107210 con 0x7fb6300a3240 2024-09-16T01:21:43.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.461+0000 7fb6377fe640 1 -- 172.21.15.63:0/4110064115 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb648107210 con 0x7fb6300a3240 2024-09-16T01:21:43.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 -- 172.21.15.63:0/4110064115 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb6300a3240 msgr2=0x7fb6300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb6300a3240 0x7fb6300a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb63c031440 tx=0x7fb63c005a20 comp rx=0 tx=0).stop 2024-09-16T01:21:43.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 -- 172.21.15.63:0/4110064115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb648102d40 msgr2=0x7fb6481983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb648102d40 0x7fb6481983f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb63800d950 tx=0x7fb63800de10 comp rx=0 tx=0).stop 2024-09-16T01:21:43.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 -- 172.21.15.63:0/4110064115 shutdown_connections 2024-09-16T01:21:43.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb6300a3240 0x7fb6300a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64810c170 0x7fb64819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb648103660 0x7fb648198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 --2- 172.21.15.63:0/4110064115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb648102d40 0x7fb6481983f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 -- 172.21.15.63:0/4110064115 >> 172.21.15.63:0/4110064115 conn(0x7fb6480fc7a0 msgr2=0x7fb6480fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:43.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 -- 172.21.15.63:0/4110064115 shutdown_connections 2024-09-16T01:21:43.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:43.463+0000 7fb64cb84640 1 -- 172.21.15.63:0/4110064115 wait complete. 2024-09-16T01:21:44.079 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-16T01:21:44.340 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.778+0000 7fb0d16b4640 1 -- 172.21.15.63:0/3155942950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0cc1036e0 msgr2=0x7fb0cc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.778+0000 7fb0d16b4640 1 --2- 172.21.15.63:0/3155942950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0cc1036e0 0x7fb0cc107b90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009930 tx=0x7fb0b402a420 comp rx=0 tx=0).stop 2024-09-16T01:21:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.779+0000 7fb0d16b4640 1 -- 172.21.15.63:0/3155942950 shutdown_connections 2024-09-16T01:21:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.779+0000 7fb0d16b4640 1 --2- 172.21.15.63:0/3155942950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0cc1082a0 0x7fb0cc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.779+0000 7fb0d16b4640 1 --2- 172.21.15.63:0/3155942950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0cc1036e0 0x7fb0cc107b90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.779+0000 7fb0d16b4640 1 --2- 172.21.15.63:0/3155942950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0cc102d30 0x7fb0cc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.779+0000 7fb0d16b4640 1 -- 172.21.15.63:0/3155942950 >> 172.21.15.63:0/3155942950 conn(0x7fb0cc0fc7d0 msgr2=0x7fb0cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.779+0000 7fb0d16b4640 1 -- 172.21.15.63:0/3155942950 shutdown_connections 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.779+0000 7fb0d16b4640 1 -- 172.21.15.63:0/3155942950 wait complete. 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.779+0000 7fb0d16b4640 1 Processor -- start 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0d16b4640 1 -- start start 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0d16b4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0cc102d30 0x7fb0cc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0d16b4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0cc1036e0 0x7fb0cc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0d16b4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0cc1082a0 0x7fb0cc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0d16b4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc111ff0 con 0x7fb0cc1082a0 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0d16b4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc111e70 con 0x7fb0cc102d30 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0d16b4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc112170 con 0x7fb0cc1036e0 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0cb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0cc1082a0 0x7fb0cc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0cb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0cc1082a0 0x7fb0cc101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36660/0 (socket says 172.21.15.63:36660) 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0cb7fe640 1 -- 172.21.15.63:0/589820105 learned_addr learned my addr 172.21.15.63:0/589820105 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0ca7fc640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0cc1036e0 0x7fb0cc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0cb7fe640 1 -- 172.21.15.63:0/589820105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0cc1036e0 msgr2=0x7fb0cc100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0cb7fe640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0cc1036e0 0x7fb0cc100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0cb7fe640 1 -- 172.21.15.63:0/589820105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0cc102d30 msgr2=0x7fb0cc100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0caffd640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0cc102d30 0x7fb0cc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0cb7fe640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0cc102d30 0x7fb0cc100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0cb7fe640 1 -- 172.21.15.63:0/589820105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0cc1a6b10 con 0x7fb0cc1082a0 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0caffd640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0cc102d30 0x7fb0cc100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.780+0000 7fb0cb7fe640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0cc1082a0 0x7fb0cc101410 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00b970 tx=0x7fb0bc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.781+0000 7fb0c3fff640 1 -- 172.21.15.63:0/589820105 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc019070 con 0x7fb0cc1082a0 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.781+0000 7fb0c3fff640 1 -- 172.21.15.63:0/589820105 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb0bc014440 con 0x7fb0cc1082a0 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.781+0000 7fb0d16b4640 1 -- 172.21.15.63:0/589820105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0cc1a6e00 con 0x7fb0cc1082a0 2024-09-16T01:21:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.781+0000 7fb0c3fff640 1 -- 172.21.15.63:0/589820105 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0075d0 con 0x7fb0cc1082a0 2024-09-16T01:21:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.781+0000 7fb0d16b4640 1 -- 172.21.15.63:0/589820105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0cc1a7260 con 0x7fb0cc1082a0 2024-09-16T01:21:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.782+0000 7fb0d16b4640 1 -- 172.21.15.63:0/589820105 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0cc103190 con 0x7fb0cc1082a0 2024-09-16T01:21:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.783+0000 7fb0c3fff640 1 -- 172.21.15.63:0/589820105 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb0bc01c070 con 0x7fb0cc1082a0 2024-09-16T01:21:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.784+0000 7fb0c3fff640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb0b80a32d0 0x7fb0b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.784+0000 7fb0caffd640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb0b80a32d0 0x7fb0b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.784+0000 7fb0c3fff640 1 -- 172.21.15.63:0/589820105 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb0bc0cef60 con 0x7fb0cc1082a0 2024-09-16T01:21:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.784+0000 7fb0caffd640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb0b80a32d0 0x7fb0b80a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4006fd0 tx=0x7fb0c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.788+0000 7fb0c3fff640 1 -- 172.21.15.63:0/589820105 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb0bc09bc30 con 0x7fb0cc1082a0 2024-09-16T01:21:44.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.990+0000 7fb0d16b4640 1 -- 172.21.15.63:0/589820105 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fb0cc062630 con 0x7fb0b80a32d0 2024-09-16T01:21:44.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.996+0000 7fb0c3fff640 1 -- 172.21.15.63:0/589820105 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb0cc062630 con 0x7fb0b80a32d0 2024-09-16T01:21:44.997 INFO:teuthology.orchestra.run.smithi063.stdout:/volumes/qa/sv_0/29322e8e-26e1-416a-815f-cea6840f89a2 2024-09-16T01:21:44.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 -- 172.21.15.63:0/589820105 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb0b80a32d0 msgr2=0x7fb0b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb0b80a32d0 0x7fb0b80a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4006fd0 tx=0x7fb0c4008040 comp rx=0 tx=0).stop 2024-09-16T01:21:45.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 -- 172.21.15.63:0/589820105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0cc1082a0 msgr2=0x7fb0cc101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0cc1082a0 0x7fb0cc101410 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00b970 tx=0x7fb0bc00be30 comp rx=0 tx=0).stop 2024-09-16T01:21:45.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 -- 172.21.15.63:0/589820105 shutdown_connections 2024-09-16T01:21:45.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb0b80a32d0 0x7fb0b80a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb0cc1082a0 0x7fb0cc101410 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0cc1036e0 0x7fb0cc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 --2- 172.21.15.63:0/589820105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0cc102d30 0x7fb0cc100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 -- 172.21.15.63:0/589820105 >> 172.21.15.63:0/589820105 conn(0x7fb0cc0fc7d0 msgr2=0x7fb0cc105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:45.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.998+0000 7fb0d16b4640 1 -- 172.21.15.63:0/589820105 shutdown_connections 2024-09-16T01:21:45.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:44.999+0000 7fb0d16b4640 1 -- 172.21.15.63:0/589820105 wait complete. 2024-09-16T01:21:45.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:45 smithi063 ceph-mon[31070]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.1 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:45.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:45 smithi063 ceph-mon[31070]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:45.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:45 smithi063 ceph-mon[31070]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-16T01:21:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:45 smithi192 ceph-mon[34775]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.1 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:45 smithi192 ceph-mon[34775]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:45 smithi192 ceph-mon[34775]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-16T01:21:45.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:45 smithi162 ceph-mon[34539]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.1 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:45.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:45 smithi162 ceph-mon[34539]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:45.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:45 smithi162 ceph-mon[34539]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-16T01:21:45.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-16T01:21:46.012 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:46.409 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:46 smithi063 ceph-mon[31070]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:46.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:46 smithi192 ceph-mon[34775]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:46.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:46 smithi162 ceph-mon[34539]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:46.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.495+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/189548998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d081002f0 msgr2=0x7f3d081006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.495+0000 7f3d0e4c0640 1 --2- 172.21.15.63:0/189548998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d081002f0 0x7f3d081006d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009930 tx=0x7f3cf802a420 comp rx=0 tx=0).stop 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.495+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/189548998 shutdown_connections 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.495+0000 7f3d0e4c0640 1 --2- 172.21.15.63:0/189548998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d08106f50 0x7f3d0810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.495+0000 7f3d0e4c0640 1 --2- 172.21.15.63:0/189548998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d08100ca0 0x7f3d08106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.495+0000 7f3d0e4c0640 1 --2- 172.21.15.63:0/189548998 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d081002f0 0x7f3d081006d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.496+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/189548998 >> 172.21.15.63:0/189548998 conn(0x7f3d08077210 msgr2=0x7f3d080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.496+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/189548998 shutdown_connections 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.496+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/189548998 wait complete. 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.496+0000 7f3d0e4c0640 1 Processor -- start 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.496+0000 7f3d0e4c0640 1 -- start start 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d0e4c0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d081002f0 0x7f3d08101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:46.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d0e4c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d08100ca0 0x7f3d081017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d0e4c0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d08106f50 0x7f3d08101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d0e4c0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d08111eb0 con 0x7f3d081002f0 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d0e4c0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3d08111d30 con 0x7f3d08100ca0 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d0e4c0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3d08112030 con 0x7f3d08106f50 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d07fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d081002f0 0x7f3d08101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d07fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d081002f0 0x7f3d08101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36688/0 (socket says 172.21.15.63:36688) 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d07fff640 1 -- 172.21.15.63:0/369160561 learned_addr learned my addr 172.21.15.63:0/369160561 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d077fe640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d08100ca0 0x7f3d081017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d0ca5d640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d08106f50 0x7f3d08101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d07fff640 1 -- 172.21.15.63:0/369160561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d08106f50 msgr2=0x7f3d08101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d07fff640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d08106f50 0x7f3d08101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d07fff640 1 -- 172.21.15.63:0/369160561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d08100ca0 msgr2=0x7f3d081017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d07fff640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d08100ca0 0x7f3d081017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d07fff640 1 -- 172.21.15.63:0/369160561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d081a68f0 con 0x7f3d081002f0 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d0ca5d640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d08106f50 0x7f3d08101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d07fff640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d081002f0 0x7f3d08101270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8005940 tx=0x7f3cf80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d057fa640 1 -- 172.21.15.63:0/369160561 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf803f030 con 0x7f3d081002f0 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d057fa640 1 -- 172.21.15.63:0/369160561 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3cf8003cb0 con 0x7f3d081002f0 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/369160561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d081a6b80 con 0x7f3d081002f0 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d057fa640 1 -- 172.21.15.63:0/369160561 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8035070 con 0x7f3d081002f0 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.497+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/369160561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d081a7060 con 0x7f3d081002f0 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.498+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/369160561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d081006d0 con 0x7f3d081002f0 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.500+0000 7f3d057fa640 1 -- 172.21.15.63:0/369160561 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3cf8042030 con 0x7f3d081002f0 2024-09-16T01:21:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.500+0000 7f3d057fa640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3cf00a32d0 0x7f3cf00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:46.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.500+0000 7f3d077fe640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3cf00a32d0 0x7f3cf00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:46.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.500+0000 7f3d057fa640 1 -- 172.21.15.63:0/369160561 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3cf80f0110 con 0x7f3d081002f0 2024-09-16T01:21:46.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.501+0000 7f3d077fe640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3cf00a32d0 0x7f3cf00a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d08102d00 tx=0x7f3cfc00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:46.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.504+0000 7f3d057fa640 1 -- 172.21.15.63:0/369160561 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3cf80bccd0 con 0x7f3d081002f0 2024-09-16T01:21:46.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.708+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/369160561 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3d08062630 con 0x7f3cf00a32d0 2024-09-16T01:21:46.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.734+0000 7f3d057fa640 1 -- 172.21.15.63:0/369160561 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3d08062630 con 0x7f3cf00a32d0 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.736+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/369160561 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3cf00a32d0 msgr2=0x7f3cf00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.736+0000 7f3d0e4c0640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3cf00a32d0 0x7f3cf00a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d08102d00 tx=0x7f3cfc00a4c0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.736+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/369160561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d081002f0 msgr2=0x7f3d08101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.736+0000 7f3d0e4c0640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d081002f0 0x7f3d08101270 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8005940 tx=0x7f3cf80042f0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.736+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/369160561 shutdown_connections 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.736+0000 7f3d0e4c0640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3cf00a32d0 0x7f3cf00a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.736+0000 7f3d0e4c0640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d08106f50 0x7f3d08101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.736+0000 7f3d0e4c0640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d08100ca0 0x7f3d081017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.736+0000 7f3d0e4c0640 1 --2- 172.21.15.63:0/369160561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d081002f0 0x7f3d08101270 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.736+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/369160561 >> 172.21.15.63:0/369160561 conn(0x7f3d08077210 msgr2=0x7f3d08105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.737+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/369160561 shutdown_connections 2024-09-16T01:21:46.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:46.737+0000 7f3d0e4c0640 1 -- 172.21.15.63:0/369160561 wait complete. 2024-09-16T01:21:47.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:47 smithi063 ceph-mon[31070]: pgmap v288: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:47.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:47 smithi063 ceph-mon[31070]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:47.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:47 smithi192 ceph-mon[34775]: pgmap v288: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:47.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:47 smithi192 ceph-mon[34775]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:47.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:47 smithi162 ceph-mon[34539]: pgmap v288: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.1 KiB/s wr, 13 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:47.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:47 smithi162 ceph-mon[34539]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:47.561 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-16T01:21:47.822 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:48.225 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:48 smithi063 ceph-mon[31070]: pgmap v289: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.6 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:48.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.312+0000 7f91b2409640 1 -- 172.21.15.63:0/3314804326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91ac101de0 msgr2=0x7f91ac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.312+0000 7f91b2409640 1 --2- 172.21.15.63:0/3314804326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91ac101de0 0x7f91ac1021c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f919c009900 tx=0x7f919c02a410 comp rx=0 tx=0).stop 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.312+0000 7f91b2409640 1 -- 172.21.15.63:0/3314804326 shutdown_connections 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.312+0000 7f91b2409640 1 --2- 172.21.15.63:0/3314804326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ac106f10 0x7f91ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.312+0000 7f91b2409640 1 --2- 172.21.15.63:0/3314804326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91ac102790 0x7f91ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.312+0000 7f91b2409640 1 --2- 172.21.15.63:0/3314804326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91ac101de0 0x7f91ac1021c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.312+0000 7f91b2409640 1 -- 172.21.15.63:0/3314804326 >> 172.21.15.63:0/3314804326 conn(0x7f91ac0fd8c0 msgr2=0x7f91ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.312+0000 7f91b2409640 1 -- 172.21.15.63:0/3314804326 shutdown_connections 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.312+0000 7f91b2409640 1 -- 172.21.15.63:0/3314804326 wait complete. 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91b2409640 1 Processor -- start 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91b2409640 1 -- start start 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91b2409640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91ac101de0 0x7f91ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91b2409640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91ac102790 0x7f91ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91b2409640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ac106f10 0x7f91ac074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91b2409640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac111e20 con 0x7f91ac102790 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91b2409640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac111ca0 con 0x7f91ac106f10 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91b2409640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac111fa0 con 0x7f91ac101de0 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91ab7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91ac102790 0x7f91ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91ab7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91ac102790 0x7f91ac074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36710/0 (socket says 172.21.15.63:36710) 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91ab7fe640 1 -- 172.21.15.63:0/916202696 learned_addr learned my addr 172.21.15.63:0/916202696 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91b09a6640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ac106f10 0x7f91ac074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.313+0000 7f91abfff640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91ac101de0 0x7f91ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91ab7fe640 1 -- 172.21.15.63:0/916202696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91ac101de0 msgr2=0x7f91ac0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91ab7fe640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91ac101de0 0x7f91ac0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91ab7fe640 1 -- 172.21.15.63:0/916202696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ac106f10 msgr2=0x7f91ac074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91ab7fe640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ac106f10 0x7f91ac074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91ab7fe640 1 -- 172.21.15.63:0/916202696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac1a6820 con 0x7f91ac102790 2024-09-16T01:21:48.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91ab7fe640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91ac102790 0x7f91ac074a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91a000d770 tx=0x7f91a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:48.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91a97fa640 1 -- 172.21.15.63:0/916202696 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0017070 con 0x7f91ac102790 2024-09-16T01:21:48.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91a97fa640 1 -- 172.21.15.63:0/916202696 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f91a00054d0 con 0x7f91ac102790 2024-09-16T01:21:48.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91a97fa640 1 -- 172.21.15.63:0/916202696 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0004cf0 con 0x7f91ac102790 2024-09-16T01:21:48.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91b2409640 1 -- 172.21.15.63:0/916202696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ac1a6b10 con 0x7f91ac102790 2024-09-16T01:21:48.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.314+0000 7f91b2409640 1 -- 172.21.15.63:0/916202696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ac1a7050 con 0x7f91ac102790 2024-09-16T01:21:48.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.315+0000 7f91b2409640 1 -- 172.21.15.63:0/916202696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91ac1021c0 con 0x7f91ac102790 2024-09-16T01:21:48.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.316+0000 7f91a97fa640 1 -- 172.21.15.63:0/916202696 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f91a0004e90 con 0x7f91ac102790 2024-09-16T01:21:48.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.317+0000 7f91a97fa640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f91940a3350 0x7f91940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.317+0000 7f91abfff640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f91940a3350 0x7f91940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.317+0000 7f91a97fa640 1 -- 172.21.15.63:0/916202696 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f91a00cf8e0 con 0x7f91ac102790 2024-09-16T01:21:48.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.318+0000 7f91abfff640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f91940a3350 0x7f91940a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f919c031440 tx=0x7f919c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:48.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.320+0000 7f91a97fa640 1 -- 172.21.15.63:0/916202696 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f91a009c520 con 0x7f91ac102790 2024-09-16T01:21:48.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:48 smithi192 ceph-mon[34775]: pgmap v289: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.6 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:48.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:48 smithi162 ceph-mon[34539]: pgmap v289: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.6 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.524+0000 7f91b2409640 1 -- 172.21.15.63:0/916202696 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f91ac062630 con 0x7f91940a3350 2024-09-16T01:21:48.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.528+0000 7f91a97fa640 1 -- 172.21.15.63:0/916202696 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f91ac062630 con 0x7f91940a3350 2024-09-16T01:21:48.530 INFO:teuthology.orchestra.run.smithi063.stdout:/volumes/qa/sv_1/48a1e069-331f-4c57-a53a-52fd7bd0ddaf 2024-09-16T01:21:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 -- 172.21.15.63:0/916202696 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f91940a3350 msgr2=0x7f91940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f91940a3350 0x7f91940a5810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f919c031440 tx=0x7f919c0095f0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 -- 172.21.15.63:0/916202696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91ac102790 msgr2=0x7f91ac074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91ac102790 0x7f91ac074a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91a000d770 tx=0x7f91a000dc30 comp rx=0 tx=0).stop 2024-09-16T01:21:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 -- 172.21.15.63:0/916202696 shutdown_connections 2024-09-16T01:21:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f91940a3350 0x7f91940a5810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91ac106f10 0x7f91ac074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91ac102790 0x7f91ac074a30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 --2- 172.21.15.63:0/916202696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91ac101de0 0x7f91ac0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 -- 172.21.15.63:0/916202696 >> 172.21.15.63:0/916202696 conn(0x7f91ac0fd8c0 msgr2=0x7f91ac0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 -- 172.21.15.63:0/916202696 shutdown_connections 2024-09-16T01:21:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:48.531+0000 7f91b2409640 1 -- 172.21.15.63:0/916202696 wait complete. 2024-09-16T01:21:49.329 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:49 smithi063 ceph-mon[31070]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:49.364 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:21:49.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:49 smithi192 ceph-mon[34775]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:49.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:49 smithi162 ceph-mon[34539]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:21:49.630 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.147+0000 7fba56a7c640 1 -- 172.21.15.63:0/3863865464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba50102790 msgr2=0x7fba501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.147+0000 7fba56a7c640 1 --2- 172.21.15.63:0/3863865464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba50102790 0x7fba501067e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba40009ca0 tx=0x7fba4002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.147+0000 7fba56a7c640 1 -- 172.21.15.63:0/3863865464 shutdown_connections 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.147+0000 7fba56a7c640 1 --2- 172.21.15.63:0/3863865464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba50106f10 0x7fba5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.147+0000 7fba56a7c640 1 --2- 172.21.15.63:0/3863865464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba50102790 0x7fba501067e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.147+0000 7fba56a7c640 1 --2- 172.21.15.63:0/3863865464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba50101de0 0x7fba501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.147+0000 7fba56a7c640 1 -- 172.21.15.63:0/3863865464 >> 172.21.15.63:0/3863865464 conn(0x7fba500fd8c0 msgr2=0x7fba500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.147+0000 7fba56a7c640 1 -- 172.21.15.63:0/3863865464 shutdown_connections 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.147+0000 7fba56a7c640 1 -- 172.21.15.63:0/3863865464 wait complete. 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba56a7c640 1 Processor -- start 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba56a7c640 1 -- start start 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba56a7c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba50101de0 0x7fba500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba56a7c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba50102790 0x7fba50074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba56a7c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba50106f10 0x7fba50074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba56a7c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fba50111e20 con 0x7fba50102790 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba56a7c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba50111ca0 con 0x7fba50106f10 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba56a7c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fba50111fa0 con 0x7fba50101de0 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba4ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba50102790 0x7fba50074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba4ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba50102790 0x7fba50074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42494/0 (socket says 172.21.15.63:42494) 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba4ffff640 1 -- 172.21.15.63:0/3242489267 learned_addr learned my addr 172.21.15.63:0/3242489267 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba54818640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba50101de0 0x7fba500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba55019640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba50106f10 0x7fba50074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba4ffff640 1 -- 172.21.15.63:0/3242489267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba50101de0 msgr2=0x7fba500744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba4ffff640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba50101de0 0x7fba500744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba4ffff640 1 -- 172.21.15.63:0/3242489267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba50106f10 msgr2=0x7fba50074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba4ffff640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba50106f10 0x7fba50074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba4ffff640 1 -- 172.21.15.63:0/3242489267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba501a6800 con 0x7fba50102790 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba55019640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba50106f10 0x7fba50074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.148+0000 7fba4ffff640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba50102790 0x7fba50074a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fba4002ade0 tx=0x7fba40032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.149+0000 7fba4dffb640 1 -- 172.21.15.63:0/3242489267 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40003cf0 con 0x7fba50102790 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.149+0000 7fba4dffb640 1 -- 172.21.15.63:0/3242489267 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba400044f0 con 0x7fba50102790 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.149+0000 7fba56a7c640 1 -- 172.21.15.63:0/3242489267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba501a6a90 con 0x7fba50102790 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.149+0000 7fba4dffb640 1 -- 172.21.15.63:0/3242489267 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40030c40 con 0x7fba50102790 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.149+0000 7fba56a7c640 1 -- 172.21.15.63:0/3242489267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba501a7020 con 0x7fba50102790 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.150+0000 7fba56a7c640 1 -- 172.21.15.63:0/3242489267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba501021c0 con 0x7fba50102790 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.151+0000 7fba4dffb640 1 -- 172.21.15.63:0/3242489267 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fba40004040 con 0x7fba50102790 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.152+0000 7fba4dffb640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba3c0a3350 0x7fba3c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.152+0000 7fba54818640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba3c0a3350 0x7fba3c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.152+0000 7fba4dffb640 1 -- 172.21.15.63:0/3242489267 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fba400f0ed0 con 0x7fba50102790 2024-09-16T01:21:50.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.152+0000 7fba54818640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba3c0a3350 0x7fba3c0a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fba3800bbe0 tx=0x7fba3800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.156+0000 7fba4dffb640 1 -- 172.21.15.63:0/3242489267 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba400bdba0 con 0x7fba50102790 2024-09-16T01:21:50.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:50 smithi063 ceph-mon[31070]: pgmap v290: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.370+0000 7fba56a7c640 1 -- 172.21.15.63:0/3242489267 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba5010a150 con 0x7fba50102790 2024-09-16T01:21:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.371+0000 7fba4dffb640 1 -- 172.21.15.63:0/3242489267 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11909 (secure 0 0 0) 0x7fba400bd4a0 con 0x7fba50102790 2024-09-16T01:21:50.372 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:50.372 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":24,"btime":"2024-09-16T01:21:40:093564+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:21:39.762667+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24445,24460,24467]},"id":1}]} 2024-09-16T01:21:50.373 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 24 2024-09-16T01:21:50.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 -- 172.21.15.63:0/3242489267 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba3c0a3350 msgr2=0x7fba3c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba3c0a3350 0x7fba3c0a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fba3800bbe0 tx=0x7fba3800b390 comp rx=0 tx=0).stop 2024-09-16T01:21:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 -- 172.21.15.63:0/3242489267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba50102790 msgr2=0x7fba50074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba50102790 0x7fba50074a30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fba4002ade0 tx=0x7fba40032ff0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 -- 172.21.15.63:0/3242489267 shutdown_connections 2024-09-16T01:21:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba3c0a3350 0x7fba3c0a5810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba50106f10 0x7fba50074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba50102790 0x7fba50074a30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 --2- 172.21.15.63:0/3242489267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba50101de0 0x7fba500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 -- 172.21.15.63:0/3242489267 >> 172.21.15.63:0/3242489267 conn(0x7fba500fd8c0 msgr2=0x7fba500feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 -- 172.21.15.63:0/3242489267 shutdown_connections 2024-09-16T01:21:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:50.373+0000 7fba56a7c640 1 -- 172.21.15.63:0/3242489267 wait complete. 2024-09-16T01:21:50.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:50 smithi192 ceph-mon[34775]: pgmap v290: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:50.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:50 smithi162 ceph-mon[34539]: pgmap v290: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.0 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:51.387 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:51 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3242489267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:51.423 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:21:51.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:51 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3242489267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:51.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:51 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3242489267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:21:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:52.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.154+0000 7f4d1cb98640 1 -- 172.21.15.63:0/3919952435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d18106f10 msgr2=0x7f4d1810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.154+0000 7f4d1cb98640 1 --2- 172.21.15.63:0/3919952435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d18106f10 0x7f4d1810ea90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009900 tx=0x7f4d0802a410 comp rx=0 tx=0).stop 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.154+0000 7f4d1cb98640 1 -- 172.21.15.63:0/3919952435 shutdown_connections 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.154+0000 7f4d1cb98640 1 --2- 172.21.15.63:0/3919952435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d18106f10 0x7f4d1810ea90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.154+0000 7f4d1cb98640 1 --2- 172.21.15.63:0/3919952435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d18102790 0x7f4d181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.154+0000 7f4d1cb98640 1 --2- 172.21.15.63:0/3919952435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d18101de0 0x7f4d181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.154+0000 7f4d1cb98640 1 -- 172.21.15.63:0/3919952435 >> 172.21.15.63:0/3919952435 conn(0x7f4d180fd8c0 msgr2=0x7f4d180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.154+0000 7f4d1cb98640 1 -- 172.21.15.63:0/3919952435 shutdown_connections 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.154+0000 7f4d1cb98640 1 -- 172.21.15.63:0/3919952435 wait complete. 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.154+0000 7f4d1cb98640 1 Processor -- start 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d1cb98640 1 -- start start 2024-09-16T01:21:52.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d1cb98640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d18101de0 0x7f4d18198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d1cb98640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d18102790 0x7f4d18198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d1cb98640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d18106f10 0x7f4d1819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d1cb98640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18111e40 con 0x7f4d18106f10 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d1cb98640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18111cc0 con 0x7f4d18101de0 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d1cb98640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18111fc0 con 0x7f4d18102790 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d16d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d18106f10 0x7f4d1819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d16d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d18106f10 0x7f4d1819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42516/0 (socket says 172.21.15.63:42516) 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d16d9d640 1 -- 172.21.15.63:0/795780301 learned_addr learned my addr 172.21.15.63:0/795780301 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d15d9b640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d18102790 0x7f4d18198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d1659c640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d18101de0 0x7f4d18198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d16d9d640 1 -- 172.21.15.63:0/795780301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d18102790 msgr2=0x7f4d18198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d16d9d640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d18102790 0x7f4d18198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d16d9d640 1 -- 172.21.15.63:0/795780301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d18101de0 msgr2=0x7f4d18198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d16d9d640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d18101de0 0x7f4d18198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d16d9d640 1 -- 172.21.15.63:0/795780301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1819d3b0 con 0x7f4d18106f10 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d15d9b640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d18102790 0x7f4d18198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.155+0000 7f4d16d9d640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d18106f10 0x7f4d1819ccd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009a20 tx=0x7f4d080042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.156+0000 7f4d0f7fe640 1 -- 172.21.15.63:0/795780301 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0803f030 con 0x7f4d18106f10 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.156+0000 7f4d0f7fe640 1 -- 172.21.15.63:0/795780301 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4d080044d0 con 0x7f4d18106f10 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.156+0000 7f4d1cb98640 1 -- 172.21.15.63:0/795780301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1819d640 con 0x7f4d18106f10 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.156+0000 7f4d0f7fe640 1 -- 172.21.15.63:0/795780301 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08035070 con 0x7f4d18106f10 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.156+0000 7f4d1cb98640 1 -- 172.21.15.63:0/795780301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d181a4f80 con 0x7f4d18106f10 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.157+0000 7f4d1cb98640 1 -- 172.21.15.63:0/795780301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d181021c0 con 0x7f4d18106f10 2024-09-16T01:21:52.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.158+0000 7f4d0f7fe640 1 -- 172.21.15.63:0/795780301 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4d08042030 con 0x7f4d18106f10 2024-09-16T01:21:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.159+0000 7f4d0f7fe640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4d040a32d0 0x7f4d040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.159+0000 7f4d1659c640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4d040a32d0 0x7f4d040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.159+0000 7f4d0f7fe640 1 -- 172.21.15.63:0/795780301 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4d080f04e0 con 0x7f4d18106f10 2024-09-16T01:21:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.160+0000 7f4d1659c640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4d040a32d0 0x7f4d040a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009f20 tx=0x7f4d100094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:52.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.163+0000 7f4d0f7fe640 1 -- 172.21.15.63:0/795780301 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d080bd0a0 con 0x7f4d18106f10 2024-09-16T01:21:52.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.339+0000 7f4d1cb98640 1 -- 172.21.15.63:0/795780301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d1810a0f0 con 0x7f4d18106f10 2024-09-16T01:21:52.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.341+0000 7f4d0f7fe640 1 -- 172.21.15.63:0/795780301 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22710 (secure 0 0 0) 0x7f4d080bc9a0 con 0x7f4d18106f10 2024-09-16T01:21:52.342 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:52.342 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:39.083854+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:52.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 -- 172.21.15.63:0/795780301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4d040a32d0 msgr2=0x7f4d040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4d040a32d0 0x7f4d040a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009f20 tx=0x7f4d100094f0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 -- 172.21.15.63:0/795780301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d18106f10 msgr2=0x7f4d1819ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d18106f10 0x7f4d1819ccd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009a20 tx=0x7f4d080042e0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 -- 172.21.15.63:0/795780301 shutdown_connections 2024-09-16T01:21:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4d040a32d0 0x7f4d040a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d18106f10 0x7f4d1819ccd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d18102790 0x7f4d18198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 --2- 172.21.15.63:0/795780301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d18101de0 0x7f4d18198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 -- 172.21.15.63:0/795780301 >> 172.21.15.63:0/795780301 conn(0x7f4d180fd8c0 msgr2=0x7f4d180fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 -- 172.21.15.63:0/795780301 shutdown_connections 2024-09-16T01:21:52.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:52.343+0000 7f4d1cb98640 1 -- 172.21.15.63:0/795780301 wait complete. 2024-09-16T01:21:52.949 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T01:21:52.949 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:21:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:53.328 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:53 smithi063 ceph-mon[31070]: pgmap v291: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.6 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:53.329 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:53 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/795780301' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:21:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:53 smithi192 ceph-mon[34775]: pgmap v291: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.6 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:53 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/795780301' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:21:53.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:53 smithi162 ceph-mon[34539]: pgmap v291: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.6 KiB/s wr, 15 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:53.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:53 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/795780301' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:21:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.694+0000 7f71ab06e640 1 -- 172.21.15.63:0/1205294785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71a4109140 msgr2=0x7f71a4110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.694+0000 7f71ab06e640 1 --2- 172.21.15.63:0/1205294785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71a4109140 0x7f71a4110cc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f719c009ca0 tx=0x7f719c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 -- 172.21.15.63:0/1205294785 shutdown_connections 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 --2- 172.21.15.63:0/1205294785 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71a4109140 0x7f71a4110cc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 --2- 172.21.15.63:0/1205294785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71a41049c0 0x7f71a4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 --2- 172.21.15.63:0/1205294785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a4104010 0x7f71a41043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 -- 172.21.15.63:0/1205294785 >> 172.21.15.63:0/1205294785 conn(0x7f71a40ffa50 msgr2=0x7f71a4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 -- 172.21.15.63:0/1205294785 shutdown_connections 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 -- 172.21.15.63:0/1205294785 wait complete. 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 Processor -- start 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 -- start start 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71a4104010 0x7f71a419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.695+0000 7f71ab06e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a41049c0 0x7f71a419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71ab06e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71a4109140 0x7f71a419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71ab06e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f71a4114020 con 0x7f71a4109140 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71ab06e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71a4113ea0 con 0x7f71a4104010 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71ab06e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71a41141a0 con 0x7f71a41049c0 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a960b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71a4109140 0x7f71a419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a960b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71a4109140 0x7f71a419ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42534/0 (socket says 172.21.15.63:42534) 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a960b640 1 -- 172.21.15.63:0/1889736932 learned_addr learned my addr 172.21.15.63:0/1889736932 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a3fff640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a41049c0 0x7f71a419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a8e0a640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71a4104010 0x7f71a419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a960b640 1 -- 172.21.15.63:0/1889736932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a41049c0 msgr2=0x7f71a419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a960b640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a41049c0 0x7f71a419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a960b640 1 -- 172.21.15.63:0/1889736932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71a4104010 msgr2=0x7f71a419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a960b640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71a4104010 0x7f71a419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a960b640 1 -- 172.21.15.63:0/1889736932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a419f570 con 0x7f71a4109140 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a960b640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71a4109140 0x7f71a419ee90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f719c009dc0 tx=0x7f719c032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a1ffb640 1 -- 172.21.15.63:0/1889736932 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c003cf0 con 0x7f71a4109140 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a1ffb640 1 -- 172.21.15.63:0/1889736932 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f719c0044f0 con 0x7f71a4109140 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71a1ffb640 1 -- 172.21.15.63:0/1889736932 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c030bf0 con 0x7f71a4109140 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.696+0000 7f71ab06e640 1 -- 172.21.15.63:0/1889736932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a419f800 con 0x7f71a4109140 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.697+0000 7f71ab06e640 1 -- 172.21.15.63:0/1889736932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a41a7140 con 0x7f71a4109140 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.698+0000 7f71ab06e640 1 -- 172.21.15.63:0/1889736932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a41043f0 con 0x7f71a4109140 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.699+0000 7f71a1ffb640 1 -- 172.21.15.63:0/1889736932 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f719c004040 con 0x7f71a4109140 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.700+0000 7f71a1ffb640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f71940a3350 0x7f71940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.700+0000 7f71a8e0a640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f71940a3350 0x7f71940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.700+0000 7f71a1ffb640 1 -- 172.21.15.63:0/1889736932 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f719c0f10b0 con 0x7f71a4109140 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.700+0000 7f71a8e0a640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f71940a3350 0x7f71940a5810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7198005fd0 tx=0x7f719800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.703+0000 7f71a1ffb640 1 -- 172.21.15.63:0/1889736932 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f719c0bdd80 con 0x7f71a4109140 2024-09-16T01:21:53.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.877+0000 7f71ab06e640 1 -- 172.21.15.63:0/1889736932 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71a410c3f0 con 0x7f71940a3350 2024-09-16T01:21:53.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.884+0000 7f71a1ffb640 1 -- 172.21.15.63:0/1889736932 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258957 (secure 0 0 0) 0x7f7198003890 con 0x7f71940a3350 2024-09-16T01:21:53.887 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:53.889 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-16T01:21:53.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.886+0000 7f71ab06e640 1 -- 172.21.15.63:0/1889736932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f71940a3350 msgr2=0x7f71940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.886+0000 7f71ab06e640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f71940a3350 0x7f71940a5810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7198005fd0 tx=0x7f719800b390 comp rx=0 tx=0).stop 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.887+0000 7f71ab06e640 1 -- 172.21.15.63:0/1889736932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71a4109140 msgr2=0x7f71a419ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.887+0000 7f71ab06e640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71a4109140 0x7f71a419ee90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f719c009dc0 tx=0x7f719c032ff0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.887+0000 7f71ab06e640 1 -- 172.21.15.63:0/1889736932 shutdown_connections 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.887+0000 7f71ab06e640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f71940a3350 0x7f71940a5810 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.887+0000 7f71ab06e640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71a4109140 0x7f71a419ee90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.887+0000 7f71ab06e640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a41049c0 0x7f71a419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.887+0000 7f71ab06e640 1 --2- 172.21.15.63:0/1889736932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71a4104010 0x7f71a419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.887+0000 7f71ab06e640 1 -- 172.21.15.63:0/1889736932 >> 172.21.15.63:0/1889736932 conn(0x7f71a40ffa50 msgr2=0x7f71a4100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.887+0000 7f71ab06e640 1 -- 172.21.15.63:0/1889736932 shutdown_connections 2024-09-16T01:21:53.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:53.887+0000 7f71ab06e640 1 -- 172.21.15.63:0/1889736932 wait complete. 2024-09-16T01:21:54.628 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-16T01:21:53.185128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641800,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":229,"num_read_kb":216,"num_write":337,"num_write_kb":3033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360364,"kb_used_data":11100,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581460,"statfs":{"total":1151940427776,"available":1151571415040,"internally_reserved":0,"allocated":11366400,"data_stored":7213704,"data_compressed":177609,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46210,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":79,"num_write":31,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003577"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090037+0000","last_change":"2024-09-16T01:21:28.051261+0000","last_active":"2024-09-16T01:21:39.090037+0000","last_peered":"2024-09-16T01:21:39.090037+0000","last_clean":"2024-09-16T01:21:39.090037+0000","last_became_active":"2024-09-16T01:21:28.049073+0000","last_became_peered":"2024-09-16T01:21:28.049073+0000","last_unstale":"2024-09-16T01:21:39.090037+0000","last_undegraded":"2024-09-16T01:21:39.090037+0000","last_fullsized":"2024-09-16T01:21:39.090037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:06.863766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093652+0000","last_change":"2024-09-16T01:21:28.049457+0000","last_active":"2024-09-16T01:21:39.093652+0000","last_peered":"2024-09-16T01:21:39.093652+0000","last_clean":"2024-09-16T01:21:39.093652+0000","last_became_active":"2024-09-16T01:21:28.048707+0000","last_became_peered":"2024-09-16T01:21:28.048707+0000","last_unstale":"2024-09-16T01:21:39.093652+0000","last_undegraded":"2024-09-16T01:21:39.093652+0000","last_fullsized":"2024-09-16T01:21:39.093652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:56.346506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093456+0000","last_change":"2024-09-16T01:21:28.052931+0000","last_active":"2024-09-16T01:21:39.093456+0000","last_peered":"2024-09-16T01:21:39.093456+0000","last_clean":"2024-09-16T01:21:39.093456+0000","last_became_active":"2024-09-16T01:21:28.052501+0000","last_became_peered":"2024-09-16T01:21:28.052501+0000","last_unstale":"2024-09-16T01:21:39.093456+0000","last_undegraded":"2024-09-16T01:21:39.093456+0000","last_fullsized":"2024-09-16T01:21:39.093456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:45:23.351452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.096667+0000","last_change":"2024-09-16T01:21:39.096279+0000","last_active":"2024-09-16T01:21:39.096667+0000","last_peered":"2024-09-16T01:21:39.096667+0000","last_clean":"2024-09-16T01:21:39.096667+0000","last_became_active":"2024-09-16T01:21:39.095886+0000","last_became_peered":"2024-09-16T01:21:39.095886+0000","last_unstale":"2024-09-16T01:21:39.096667+0000","last_undegraded":"2024-09-16T01:21:39.096667+0000","last_fullsized":"2024-09-16T01:21:39.096667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:56.530007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093192+0000","last_change":"2024-09-16T01:21:28.043473+0000","last_active":"2024-09-16T01:21:39.093192+0000","last_peered":"2024-09-16T01:21:39.093192+0000","last_clean":"2024-09-16T01:21:39.093192+0000","last_became_active":"2024-09-16T01:21:28.043127+0000","last_became_peered":"2024-09-16T01:21:28.043127+0000","last_unstale":"2024-09-16T01:21:39.093192+0000","last_undegraded":"2024-09-16T01:21:39.093192+0000","last_fullsized":"2024-09-16T01:21:39.093192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.714834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090192+0000","last_change":"2024-09-16T01:21:28.047210+0000","last_active":"2024-09-16T01:21:39.090192+0000","last_peered":"2024-09-16T01:21:39.090192+0000","last_clean":"2024-09-16T01:21:39.090192+0000","last_became_active":"2024-09-16T01:21:28.046872+0000","last_became_peered":"2024-09-16T01:21:28.046872+0000","last_unstale":"2024-09-16T01:21:39.090192+0000","last_undegraded":"2024-09-16T01:21:39.090192+0000","last_fullsized":"2024-09-16T01:21:39.090192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:22.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088806+0000","last_change":"2024-09-16T01:21:28.052212+0000","last_active":"2024-09-16T01:21:39.088806+0000","last_peered":"2024-09-16T01:21:39.088806+0000","last_clean":"2024-09-16T01:21:39.088806+0000","last_became_active":"2024-09-16T01:21:28.050307+0000","last_became_peered":"2024-09-16T01:21:28.050307+0000","last_unstale":"2024-09-16T01:21:39.088806+0000","last_undegraded":"2024-09-16T01:21:39.088806+0000","last_fullsized":"2024-09-16T01:21:39.088806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:21.869103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089494+0000","last_change":"2024-09-16T01:21:28.047980+0000","last_active":"2024-09-16T01:21:39.089494+0000","last_peered":"2024-09-16T01:21:39.089494+0000","last_clean":"2024-09-16T01:21:39.089494+0000","last_became_active":"2024-09-16T01:21:28.047671+0000","last_became_peered":"2024-09-16T01:21:28.047671+0000","last_unstale":"2024-09-16T01:21:39.089494+0000","last_undegraded":"2024-09-16T01:21:39.089494+0000","last_fullsized":"2024-09-16T01:21:39.089494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:30.501419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093245+0000","last_change":"2024-09-16T01:21:28.052468+0000","last_active":"2024-09-16T01:21:39.093245+0000","last_peered":"2024-09-16T01:21:39.093245+0000","last_clean":"2024-09-16T01:21:39.093245+0000","last_became_active":"2024-09-16T01:21:28.052156+0000","last_became_peered":"2024-09-16T01:21:28.052156+0000","last_unstale":"2024-09-16T01:21:39.093245+0000","last_undegraded":"2024-09-16T01:21:39.093245+0000","last_fullsized":"2024-09-16T01:21:39.093245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:44.631498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090981+0000","last_change":"2024-09-16T01:21:28.048278+0000","last_active":"2024-09-16T01:21:39.090981+0000","last_peered":"2024-09-16T01:21:39.090981+0000","last_clean":"2024-09-16T01:21:39.090981+0000","last_became_active":"2024-09-16T01:21:28.047892+0000","last_became_peered":"2024-09-16T01:21:28.047892+0000","last_unstale":"2024-09-16T01:21:39.090981+0000","last_undegraded":"2024-09-16T01:21:39.090981+0000","last_fullsized":"2024-09-16T01:21:39.090981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.949956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089369+0000","last_change":"2024-09-16T01:21:28.052814+0000","last_active":"2024-09-16T01:21:39.089369+0000","last_peered":"2024-09-16T01:21:39.089369+0000","last_clean":"2024-09-16T01:21:39.089369+0000","last_became_active":"2024-09-16T01:21:28.052440+0000","last_became_peered":"2024-09-16T01:21:28.052440+0000","last_unstale":"2024-09-16T01:21:39.089369+0000","last_undegraded":"2024-09-16T01:21:39.089369+0000","last_fullsized":"2024-09-16T01:21:39.089369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:47.470646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106734+0000","last_change":"2024-09-16T01:21:28.053917+0000","last_active":"2024-09-16T01:21:39.106734+0000","last_peered":"2024-09-16T01:21:39.106734+0000","last_clean":"2024-09-16T01:21:39.106734+0000","last_became_active":"2024-09-16T01:21:28.052625+0000","last_became_peered":"2024-09-16T01:21:28.052625+0000","last_unstale":"2024-09-16T01:21:39.106734+0000","last_undegraded":"2024-09-16T01:21:39.106734+0000","last_fullsized":"2024-09-16T01:21:39.106734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:32.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087092+0000","last_change":"2024-09-16T01:21:28.046588+0000","last_active":"2024-09-16T01:21:39.087092+0000","last_peered":"2024-09-16T01:21:39.087092+0000","last_clean":"2024-09-16T01:21:39.087092+0000","last_became_active":"2024-09-16T01:21:28.046268+0000","last_became_peered":"2024-09-16T01:21:28.046268+0000","last_unstale":"2024-09-16T01:21:39.087092+0000","last_undegraded":"2024-09-16T01:21:39.087092+0000","last_fullsized":"2024-09-16T01:21:39.087092+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:49.659707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093475+0000","last_change":"2024-09-16T01:21:28.051946+0000","last_active":"2024-09-16T01:21:39.093475+0000","last_peered":"2024-09-16T01:21:39.093475+0000","last_clean":"2024-09-16T01:21:39.093475+0000","last_became_active":"2024-09-16T01:21:28.051615+0000","last_became_peered":"2024-09-16T01:21:28.051615+0000","last_unstale":"2024-09-16T01:21:39.093475+0000","last_undegraded":"2024-09-16T01:21:39.093475+0000","last_fullsized":"2024-09-16T01:21:39.093475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.462830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093253+0000","last_change":"2024-09-16T01:21:28.047382+0000","last_active":"2024-09-16T01:21:39.093253+0000","last_peered":"2024-09-16T01:21:39.093253+0000","last_clean":"2024-09-16T01:21:39.093253+0000","last_became_active":"2024-09-16T01:21:28.045361+0000","last_became_peered":"2024-09-16T01:21:28.045361+0000","last_unstale":"2024-09-16T01:21:39.093253+0000","last_undegraded":"2024-09-16T01:21:39.093253+0000","last_fullsized":"2024-09-16T01:21:39.093253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:26.099519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091996+0000","last_change":"2024-09-16T01:21:28.054028+0000","last_active":"2024-09-16T01:21:39.091996+0000","last_peered":"2024-09-16T01:21:39.091996+0000","last_clean":"2024-09-16T01:21:39.091996+0000","last_became_active":"2024-09-16T01:21:28.052698+0000","last_became_peered":"2024-09-16T01:21:28.052698+0000","last_unstale":"2024-09-16T01:21:39.091996+0000","last_undegraded":"2024-09-16T01:21:39.091996+0000","last_fullsized":"2024-09-16T01:21:39.091996+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:01.745424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090073+0000","last_change":"2024-09-16T01:21:28.049032+0000","last_active":"2024-09-16T01:21:39.090073+0000","last_peered":"2024-09-16T01:21:39.090073+0000","last_clean":"2024-09-16T01:21:39.090073+0000","last_became_active":"2024-09-16T01:21:28.048357+0000","last_became_peered":"2024-09-16T01:21:28.048357+0000","last_unstale":"2024-09-16T01:21:39.090073+0000","last_undegraded":"2024-09-16T01:21:39.090073+0000","last_fullsized":"2024-09-16T01:21:39.090073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:17.963329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089030+0000","last_change":"2024-09-16T01:21:28.051126+0000","last_active":"2024-09-16T01:21:39.089030+0000","last_peered":"2024-09-16T01:21:39.089030+0000","last_clean":"2024-09-16T01:21:39.089030+0000","last_became_active":"2024-09-16T01:21:28.050789+0000","last_became_peered":"2024-09-16T01:21:28.050789+0000","last_unstale":"2024-09-16T01:21:39.089030+0000","last_undegraded":"2024-09-16T01:21:39.089030+0000","last_fullsized":"2024-09-16T01:21:39.089030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:35.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090443+0000","last_change":"2024-09-16T01:21:28.045569+0000","last_active":"2024-09-16T01:21:39.090443+0000","last_peered":"2024-09-16T01:21:39.090443+0000","last_clean":"2024-09-16T01:21:39.090443+0000","last_became_active":"2024-09-16T01:21:28.044496+0000","last_became_peered":"2024-09-16T01:21:28.044496+0000","last_unstale":"2024-09-16T01:21:39.090443+0000","last_undegraded":"2024-09-16T01:21:39.090443+0000","last_fullsized":"2024-09-16T01:21:39.090443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:10.665322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089790+0000","last_change":"2024-09-16T01:21:28.047522+0000","last_active":"2024-09-16T01:21:39.089790+0000","last_peered":"2024-09-16T01:21:39.089790+0000","last_clean":"2024-09-16T01:21:39.089790+0000","last_became_active":"2024-09-16T01:21:28.047192+0000","last_became_peered":"2024-09-16T01:21:28.047192+0000","last_unstale":"2024-09-16T01:21:39.089790+0000","last_undegraded":"2024-09-16T01:21:39.089790+0000","last_fullsized":"2024-09-16T01:21:39.089790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.044980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087099+0000","last_change":"2024-09-16T01:21:28.043184+0000","last_active":"2024-09-16T01:21:39.087099+0000","last_peered":"2024-09-16T01:21:39.087099+0000","last_clean":"2024-09-16T01:21:39.087099+0000","last_became_active":"2024-09-16T01:21:28.042787+0000","last_became_peered":"2024-09-16T01:21:28.042787+0000","last_unstale":"2024-09-16T01:21:39.087099+0000","last_undegraded":"2024-09-16T01:21:39.087099+0000","last_fullsized":"2024-09-16T01:21:39.087099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:00.633731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092704+0000","last_change":"2024-09-16T01:21:28.050141+0000","last_active":"2024-09-16T01:21:39.092704+0000","last_peered":"2024-09-16T01:21:39.092704+0000","last_clean":"2024-09-16T01:21:39.092704+0000","last_became_active":"2024-09-16T01:21:28.049843+0000","last_became_peered":"2024-09-16T01:21:28.049843+0000","last_unstale":"2024-09-16T01:21:39.092704+0000","last_undegraded":"2024-09-16T01:21:39.092704+0000","last_fullsized":"2024-09-16T01:21:39.092704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:39.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089783+0000","last_change":"2024-09-16T01:21:28.044260+0000","last_active":"2024-09-16T01:21:39.089783+0000","last_peered":"2024-09-16T01:21:39.089783+0000","last_clean":"2024-09-16T01:21:39.089783+0000","last_became_active":"2024-09-16T01:21:28.043959+0000","last_became_peered":"2024-09-16T01:21:28.043959+0000","last_unstale":"2024-09-16T01:21:39.089783+0000","last_undegraded":"2024-09-16T01:21:39.089783+0000","last_fullsized":"2024-09-16T01:21:39.089783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087679+0000","last_change":"2024-09-16T01:21:28.044143+0000","last_active":"2024-09-16T01:21:39.087679+0000","last_peered":"2024-09-16T01:21:39.087679+0000","last_clean":"2024-09-16T01:21:39.087679+0000","last_became_active":"2024-09-16T01:21:28.043767+0000","last_became_peered":"2024-09-16T01:21:28.043767+0000","last_unstale":"2024-09-16T01:21:39.087679+0000","last_undegraded":"2024-09-16T01:21:39.087679+0000","last_fullsized":"2024-09-16T01:21:39.087679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:25.269737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089450+0000","last_change":"2024-09-16T01:21:28.047663+0000","last_active":"2024-09-16T01:21:39.089450+0000","last_peered":"2024-09-16T01:21:39.089450+0000","last_clean":"2024-09-16T01:21:39.089450+0000","last_became_active":"2024-09-16T01:21:28.047044+0000","last_became_peered":"2024-09-16T01:21:28.047044+0000","last_unstale":"2024-09-16T01:21:39.089450+0000","last_undegraded":"2024-09-16T01:21:39.089450+0000","last_fullsized":"2024-09-16T01:21:39.089450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:44.539096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091431+0000","last_change":"2024-09-16T01:21:28.052740+0000","last_active":"2024-09-16T01:21:39.091431+0000","last_peered":"2024-09-16T01:21:39.091431+0000","last_clean":"2024-09-16T01:21:39.091431+0000","last_became_active":"2024-09-16T01:21:28.052396+0000","last_became_peered":"2024-09-16T01:21:28.052396+0000","last_unstale":"2024-09-16T01:21:39.091431+0000","last_undegraded":"2024-09-16T01:21:39.091431+0000","last_fullsized":"2024-09-16T01:21:39.091431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:49.021594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089633+0000","last_change":"2024-09-16T01:21:28.050867+0000","last_active":"2024-09-16T01:21:39.089633+0000","last_peered":"2024-09-16T01:21:39.089633+0000","last_clean":"2024-09-16T01:21:39.089633+0000","last_became_active":"2024-09-16T01:21:28.050412+0000","last_became_peered":"2024-09-16T01:21:28.050412+0000","last_unstale":"2024-09-16T01:21:39.089633+0000","last_undegraded":"2024-09-16T01:21:39.089633+0000","last_fullsized":"2024-09-16T01:21:39.089633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.286864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087224+0000","last_change":"2024-09-16T01:21:28.037593+0000","last_active":"2024-09-16T01:21:39.087224+0000","last_peered":"2024-09-16T01:21:39.087224+0000","last_clean":"2024-09-16T01:21:39.087224+0000","last_became_active":"2024-09-16T01:21:28.037268+0000","last_became_peered":"2024-09-16T01:21:28.037268+0000","last_unstale":"2024-09-16T01:21:39.087224+0000","last_undegraded":"2024-09-16T01:21:39.087224+0000","last_fullsized":"2024-09-16T01:21:39.087224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:09.625480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093471+0000","last_change":"2024-09-16T01:21:28.044744+0000","last_active":"2024-09-16T01:21:39.093471+0000","last_peered":"2024-09-16T01:21:39.093471+0000","last_clean":"2024-09-16T01:21:39.093471+0000","last_became_active":"2024-09-16T01:21:28.044440+0000","last_became_peered":"2024-09-16T01:21:28.044440+0000","last_unstale":"2024-09-16T01:21:39.093471+0000","last_undegraded":"2024-09-16T01:21:39.093471+0000","last_fullsized":"2024-09-16T01:21:39.093471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:20.404778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090655+0000","last_change":"2024-09-16T01:21:28.044498+0000","last_active":"2024-09-16T01:21:39.090655+0000","last_peered":"2024-09-16T01:21:39.090655+0000","last_clean":"2024-09-16T01:21:39.090655+0000","last_became_active":"2024-09-16T01:21:28.044028+0000","last_became_peered":"2024-09-16T01:21:28.044028+0000","last_unstale":"2024-09-16T01:21:39.090655+0000","last_undegraded":"2024-09-16T01:21:39.090655+0000","last_fullsized":"2024-09-16T01:21:39.090655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:46.134484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090743+0000","last_change":"2024-09-16T01:21:28.047796+0000","last_active":"2024-09-16T01:21:39.090743+0000","last_peered":"2024-09-16T01:21:39.090743+0000","last_clean":"2024-09-16T01:21:39.090743+0000","last_became_active":"2024-09-16T01:21:28.046289+0000","last_became_peered":"2024-09-16T01:21:28.046289+0000","last_unstale":"2024-09-16T01:21:39.090743+0000","last_undegraded":"2024-09-16T01:21:39.090743+0000","last_fullsized":"2024-09-16T01:21:39.090743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:53.709261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089792+0000","last_change":"2024-09-16T01:21:28.050767+0000","last_active":"2024-09-16T01:21:39.089792+0000","last_peered":"2024-09-16T01:21:39.089792+0000","last_clean":"2024-09-16T01:21:39.089792+0000","last_became_active":"2024-09-16T01:21:28.050430+0000","last_became_peered":"2024-09-16T01:21:28.050430+0000","last_unstale":"2024-09-16T01:21:39.089792+0000","last_undegraded":"2024-09-16T01:21:39.089792+0000","last_fullsized":"2024-09-16T01:21:39.089792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:37.436612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092925+0000","last_change":"2024-09-16T01:21:28.045374+0000","last_active":"2024-09-16T01:21:39.092925+0000","last_peered":"2024-09-16T01:21:39.092925+0000","last_clean":"2024-09-16T01:21:39.092925+0000","last_became_active":"2024-09-16T01:21:28.045072+0000","last_became_peered":"2024-09-16T01:21:28.045072+0000","last_unstale":"2024-09-16T01:21:39.092925+0000","last_undegraded":"2024-09-16T01:21:39.092925+0000","last_fullsized":"2024-09-16T01:21:39.092925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:10.579680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:48.115292+0000","last_change":"2024-09-16T01:21:25.922017+0000","last_active":"2024-09-16T01:21:48.115292+0000","last_peered":"2024-09-16T01:21:48.115292+0000","last_clean":"2024-09-16T01:21:48.115292+0000","last_became_active":"2024-09-16T01:21:25.921580+0000","last_became_peered":"2024-09-16T01:21:25.921580+0000","last_unstale":"2024-09-16T01:21:48.115292+0000","last_undegraded":"2024-09-16T01:21:48.115292+0000","last_fullsized":"2024-09-16T01:21:48.115292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.745844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094811+0000","last_change":"2024-09-16T01:21:39.094811+0000","last_active":"2024-09-16T01:21:39.094811+0000","last_peered":"2024-09-16T01:21:39.094811+0000","last_clean":"2024-09-16T01:21:39.094811+0000","last_became_active":"2024-09-16T01:21:39.094399+0000","last_became_peered":"2024-09-16T01:21:39.094399+0000","last_unstale":"2024-09-16T01:21:39.094811+0000","last_undegraded":"2024-09-16T01:21:39.094811+0000","last_fullsized":"2024-09-16T01:21:39.094811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:48.363791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.110226+0000","last_change":"2024-09-16T01:21:39.110226+0000","last_active":"2024-09-16T01:21:39.110226+0000","last_peered":"2024-09-16T01:21:39.110226+0000","last_clean":"2024-09-16T01:21:39.110226+0000","last_became_active":"2024-09-16T01:21:39.107676+0000","last_became_peered":"2024-09-16T01:21:39.107676+0000","last_unstale":"2024-09-16T01:21:39.110226+0000","last_undegraded":"2024-09-16T01:21:39.110226+0000","last_fullsized":"2024-09-16T01:21:39.110226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:57:14.854181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086856+0000","last_change":"2024-09-16T01:21:25.924434+0000","last_active":"2024-09-16T01:21:39.086856+0000","last_peered":"2024-09-16T01:21:39.086856+0000","last_clean":"2024-09-16T01:21:39.086856+0000","last_became_active":"2024-09-16T01:21:25.924092+0000","last_became_peered":"2024-09-16T01:21:25.924092+0000","last_unstale":"2024-09-16T01:21:39.086856+0000","last_undegraded":"2024-09-16T01:21:39.086856+0000","last_fullsized":"2024-09-16T01:21:39.086856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:20.956985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089603+0000","last_change":"2024-09-16T01:21:28.037273+0000","last_active":"2024-09-16T01:21:39.089603+0000","last_peered":"2024-09-16T01:21:39.089603+0000","last_clean":"2024-09-16T01:21:39.089603+0000","last_became_active":"2024-09-16T01:21:28.036958+0000","last_became_peered":"2024-09-16T01:21:28.036958+0000","last_unstale":"2024-09-16T01:21:39.089603+0000","last_undegraded":"2024-09-16T01:21:39.089603+0000","last_fullsized":"2024-09-16T01:21:39.089603+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:53.376640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088161+0000","last_change":"2024-09-16T01:21:25.923208+0000","last_active":"2024-09-16T01:21:39.088161+0000","last_peered":"2024-09-16T01:21:39.088161+0000","last_clean":"2024-09-16T01:21:39.088161+0000","last_became_active":"2024-09-16T01:21:25.922882+0000","last_became_peered":"2024-09-16T01:21:25.922882+0000","last_unstale":"2024-09-16T01:21:39.088161+0000","last_undegraded":"2024-09-16T01:21:39.088161+0000","last_fullsized":"2024-09-16T01:21:39.088161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:44.359615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088715+0000","last_change":"2024-09-16T01:21:28.035901+0000","last_active":"2024-09-16T01:21:39.088715+0000","last_peered":"2024-09-16T01:21:39.088715+0000","last_clean":"2024-09-16T01:21:39.088715+0000","last_became_active":"2024-09-16T01:21:28.035568+0000","last_became_peered":"2024-09-16T01:21:28.035568+0000","last_unstale":"2024-09-16T01:21:39.088715+0000","last_undegraded":"2024-09-16T01:21:39.088715+0000","last_fullsized":"2024-09-16T01:21:39.088715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:42.270380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:49.116093+0000","last_change":"2024-09-16T01:21:25.923692+0000","last_active":"2024-09-16T01:21:49.116093+0000","last_peered":"2024-09-16T01:21:49.116093+0000","last_clean":"2024-09-16T01:21:49.116093+0000","last_became_active":"2024-09-16T01:21:25.923325+0000","last_became_peered":"2024-09-16T01:21:25.923325+0000","last_unstale":"2024-09-16T01:21:49.116093+0000","last_undegraded":"2024-09-16T01:21:49.116093+0000","last_fullsized":"2024-09-16T01:21:49.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:55.075655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093337+0000","last_change":"2024-09-16T01:21:28.054697+0000","last_active":"2024-09-16T01:21:39.093337+0000","last_peered":"2024-09-16T01:21:39.093337+0000","last_clean":"2024-09-16T01:21:39.093337+0000","last_became_active":"2024-09-16T01:21:28.054416+0000","last_became_peered":"2024-09-16T01:21:28.054416+0000","last_unstale":"2024-09-16T01:21:39.093337+0000","last_undegraded":"2024-09-16T01:21:39.093337+0000","last_fullsized":"2024-09-16T01:21:39.093337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:42.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089652+0000","last_change":"2024-09-16T01:21:25.920939+0000","last_active":"2024-09-16T01:21:39.089652+0000","last_peered":"2024-09-16T01:21:39.089652+0000","last_clean":"2024-09-16T01:21:39.089652+0000","last_became_active":"2024-09-16T01:21:25.920574+0000","last_became_peered":"2024-09-16T01:21:25.920574+0000","last_unstale":"2024-09-16T01:21:39.089652+0000","last_undegraded":"2024-09-16T01:21:39.089652+0000","last_fullsized":"2024-09-16T01:21:39.089652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:15.640800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093972+0000","last_change":"2024-09-16T01:21:28.048981+0000","last_active":"2024-09-16T01:21:39.093972+0000","last_peered":"2024-09-16T01:21:39.093972+0000","last_clean":"2024-09-16T01:21:39.093972+0000","last_became_active":"2024-09-16T01:21:28.048675+0000","last_became_peered":"2024-09-16T01:21:28.048675+0000","last_unstale":"2024-09-16T01:21:39.093972+0000","last_undegraded":"2024-09-16T01:21:39.093972+0000","last_fullsized":"2024-09-16T01:21:39.093972+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:30.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088725+0000","last_change":"2024-09-16T01:21:26.660117+0000","last_active":"2024-09-16T01:21:39.088725+0000","last_peered":"2024-09-16T01:21:39.088725+0000","last_clean":"2024-09-16T01:21:39.088725+0000","last_became_active":"2024-09-16T01:21:26.659743+0000","last_became_peered":"2024-09-16T01:21:26.659743+0000","last_unstale":"2024-09-16T01:21:39.088725+0000","last_undegraded":"2024-09-16T01:21:39.088725+0000","last_fullsized":"2024-09-16T01:21:39.088725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:10.220612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092331+0000","last_change":"2024-09-16T01:21:28.051057+0000","last_active":"2024-09-16T01:21:39.092331+0000","last_peered":"2024-09-16T01:21:39.092331+0000","last_clean":"2024-09-16T01:21:39.092331+0000","last_became_active":"2024-09-16T01:21:28.050756+0000","last_became_peered":"2024-09-16T01:21:28.050756+0000","last_unstale":"2024-09-16T01:21:39.092331+0000","last_undegraded":"2024-09-16T01:21:39.092331+0000","last_fullsized":"2024-09-16T01:21:39.092331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:16.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'22","reported_seq":76,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:50.118653+0000","last_change":"2024-09-16T01:21:25.927384+0000","last_active":"2024-09-16T01:21:50.118653+0000","last_peered":"2024-09-16T01:21:50.118653+0000","last_clean":"2024-09-16T01:21:50.118653+0000","last_became_active":"2024-09-16T01:21:25.927017+0000","last_became_peered":"2024-09-16T01:21:25.927017+0000","last_unstale":"2024-09-16T01:21:50.118653+0000","last_undegraded":"2024-09-16T01:21:50.118653+0000","last_fullsized":"2024-09-16T01:21:50.118653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:03.267625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":61,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093543+0000","last_change":"2024-09-16T01:21:28.049410+0000","last_active":"2024-09-16T01:21:39.093543+0000","last_peered":"2024-09-16T01:21:39.093543+0000","last_clean":"2024-09-16T01:21:39.093543+0000","last_became_active":"2024-09-16T01:21:28.049058+0000","last_became_peered":"2024-09-16T01:21:28.049058+0000","last_unstale":"2024-09-16T01:21:39.093543+0000","last_undegraded":"2024-09-16T01:21:39.093543+0000","last_fullsized":"2024-09-16T01:21:39.093543+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091098+0000","last_change":"2024-09-16T01:21:25.922040+0000","last_active":"2024-09-16T01:21:39.091098+0000","last_peered":"2024-09-16T01:21:39.091098+0000","last_clean":"2024-09-16T01:21:39.091098+0000","last_became_active":"2024-09-16T01:21:25.921487+0000","last_became_peered":"2024-09-16T01:21:25.921487+0000","last_unstale":"2024-09-16T01:21:39.091098+0000","last_undegraded":"2024-09-16T01:21:39.091098+0000","last_fullsized":"2024-09-16T01:21:39.091098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:15.361010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086957+0000","last_change":"2024-09-16T01:21:28.043344+0000","last_active":"2024-09-16T01:21:39.086957+0000","last_peered":"2024-09-16T01:21:39.086957+0000","last_clean":"2024-09-16T01:21:39.086957+0000","last_became_active":"2024-09-16T01:21:28.042495+0000","last_became_peered":"2024-09-16T01:21:28.042495+0000","last_unstale":"2024-09-16T01:21:39.086957+0000","last_undegraded":"2024-09-16T01:21:39.086957+0000","last_fullsized":"2024-09-16T01:21:39.086957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:28.957975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087280+0000","last_change":"2024-09-16T01:21:25.924144+0000","last_active":"2024-09-16T01:21:39.087280+0000","last_peered":"2024-09-16T01:21:39.087280+0000","last_clean":"2024-09-16T01:21:39.087280+0000","last_became_active":"2024-09-16T01:21:25.923761+0000","last_became_peered":"2024-09-16T01:21:25.923761+0000","last_unstale":"2024-09-16T01:21:39.087280+0000","last_undegraded":"2024-09-16T01:21:39.087280+0000","last_fullsized":"2024-09-16T01:21:39.087280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.651575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088985+0000","last_change":"2024-09-16T01:21:28.049329+0000","last_active":"2024-09-16T01:21:39.088985+0000","last_peered":"2024-09-16T01:21:39.088985+0000","last_clean":"2024-09-16T01:21:39.088985+0000","last_became_active":"2024-09-16T01:21:28.048976+0000","last_became_peered":"2024-09-16T01:21:28.048976+0000","last_unstale":"2024-09-16T01:21:39.088985+0000","last_undegraded":"2024-09-16T01:21:39.088985+0000","last_fullsized":"2024-09-16T01:21:39.088985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:11.564388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:49.119021+0000","last_change":"2024-09-16T01:21:25.923608+0000","last_active":"2024-09-16T01:21:49.119021+0000","last_peered":"2024-09-16T01:21:49.119021+0000","last_clean":"2024-09-16T01:21:49.119021+0000","last_became_active":"2024-09-16T01:21:25.923284+0000","last_became_peered":"2024-09-16T01:21:25.923284+0000","last_unstale":"2024-09-16T01:21:49.119021+0000","last_undegraded":"2024-09-16T01:21:49.119021+0000","last_fullsized":"2024-09-16T01:21:49.119021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:41.195014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091872+0000","last_change":"2024-09-16T01:21:39.091872+0000","last_active":"2024-09-16T01:21:39.091872+0000","last_peered":"2024-09-16T01:21:39.091872+0000","last_clean":"2024-09-16T01:21:39.091872+0000","last_became_active":"2024-09-16T01:21:39.091480+0000","last_became_peered":"2024-09-16T01:21:39.091480+0000","last_unstale":"2024-09-16T01:21:39.091872+0000","last_undegraded":"2024-09-16T01:21:39.091872+0000","last_fullsized":"2024-09-16T01:21:39.091872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:23.606447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092805+0000","last_change":"2024-09-16T01:21:26.661446+0000","last_active":"2024-09-16T01:21:39.092805+0000","last_peered":"2024-09-16T01:21:39.092805+0000","last_clean":"2024-09-16T01:21:39.092805+0000","last_became_active":"2024-09-16T01:21:26.661047+0000","last_became_peered":"2024-09-16T01:21:26.661047+0000","last_unstale":"2024-09-16T01:21:39.092805+0000","last_undegraded":"2024-09-16T01:21:39.092805+0000","last_fullsized":"2024-09-16T01:21:39.092805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:22.983581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087298+0000","last_change":"2024-09-16T01:21:28.054663+0000","last_active":"2024-09-16T01:21:39.087298+0000","last_peered":"2024-09-16T01:21:39.087298+0000","last_clean":"2024-09-16T01:21:39.087298+0000","last_became_active":"2024-09-16T01:21:28.054350+0000","last_became_peered":"2024-09-16T01:21:28.054350+0000","last_unstale":"2024-09-16T01:21:39.087298+0000","last_undegraded":"2024-09-16T01:21:39.087298+0000","last_fullsized":"2024-09-16T01:21:39.087298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:22.963709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094004+0000","last_change":"2024-09-16T01:21:25.921910+0000","last_active":"2024-09-16T01:21:39.094004+0000","last_peered":"2024-09-16T01:21:39.094004+0000","last_clean":"2024-09-16T01:21:39.094004+0000","last_became_active":"2024-09-16T01:21:25.921578+0000","last_became_peered":"2024-09-16T01:21:25.921578+0000","last_unstale":"2024-09-16T01:21:39.094004+0000","last_undegraded":"2024-09-16T01:21:39.094004+0000","last_fullsized":"2024-09-16T01:21:39.094004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:20.210397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089644+0000","last_change":"2024-09-16T01:21:28.049953+0000","last_active":"2024-09-16T01:21:39.089644+0000","last_peered":"2024-09-16T01:21:39.089644+0000","last_clean":"2024-09-16T01:21:39.089644+0000","last_became_active":"2024-09-16T01:21:28.049450+0000","last_became_peered":"2024-09-16T01:21:28.049450+0000","last_unstale":"2024-09-16T01:21:39.089644+0000","last_undegraded":"2024-09-16T01:21:39.089644+0000","last_fullsized":"2024-09-16T01:21:39.089644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:49.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.098150+0000","last_change":"2024-09-16T01:21:39.098150+0000","last_active":"2024-09-16T01:21:39.098150+0000","last_peered":"2024-09-16T01:21:39.098150+0000","last_clean":"2024-09-16T01:21:39.098150+0000","last_became_active":"2024-09-16T01:21:39.094297+0000","last_became_peered":"2024-09-16T01:21:39.094297+0000","last_unstale":"2024-09-16T01:21:39.098150+0000","last_undegraded":"2024-09-16T01:21:39.098150+0000","last_fullsized":"2024-09-16T01:21:39.098150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:30:25.297230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091018+0000","last_change":"2024-09-16T01:21:28.053920+0000","last_active":"2024-09-16T01:21:39.091018+0000","last_peered":"2024-09-16T01:21:39.091018+0000","last_clean":"2024-09-16T01:21:39.091018+0000","last_became_active":"2024-09-16T01:21:28.053397+0000","last_became_peered":"2024-09-16T01:21:28.053397+0000","last_unstale":"2024-09-16T01:21:39.091018+0000","last_undegraded":"2024-09-16T01:21:39.091018+0000","last_fullsized":"2024-09-16T01:21:39.091018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:27.079374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088854+0000","last_change":"2024-09-16T01:21:25.920527+0000","last_active":"2024-09-16T01:21:39.088854+0000","last_peered":"2024-09-16T01:21:39.088854+0000","last_clean":"2024-09-16T01:21:39.088854+0000","last_became_active":"2024-09-16T01:21:25.920162+0000","last_became_peered":"2024-09-16T01:21:25.920162+0000","last_unstale":"2024-09-16T01:21:39.088854+0000","last_undegraded":"2024-09-16T01:21:39.088854+0000","last_fullsized":"2024-09-16T01:21:39.088854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:31.995141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089348+0000","last_change":"2024-09-16T01:21:28.050068+0000","last_active":"2024-09-16T01:21:39.089348+0000","last_peered":"2024-09-16T01:21:39.089348+0000","last_clean":"2024-09-16T01:21:39.089348+0000","last_became_active":"2024-09-16T01:21:28.049678+0000","last_became_peered":"2024-09-16T01:21:28.049678+0000","last_unstale":"2024-09-16T01:21:39.089348+0000","last_undegraded":"2024-09-16T01:21:39.089348+0000","last_fullsized":"2024-09-16T01:21:39.089348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:57.870550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091065+0000","last_change":"2024-09-16T01:21:26.663670+0000","last_active":"2024-09-16T01:21:39.091065+0000","last_peered":"2024-09-16T01:21:39.091065+0000","last_clean":"2024-09-16T01:21:39.091065+0000","last_became_active":"2024-09-16T01:21:26.663173+0000","last_became_peered":"2024-09-16T01:21:26.663173+0000","last_unstale":"2024-09-16T01:21:39.091065+0000","last_undegraded":"2024-09-16T01:21:39.091065+0000","last_fullsized":"2024-09-16T01:21:39.091065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:01.747039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089528+0000","last_change":"2024-09-16T01:21:28.053354+0000","last_active":"2024-09-16T01:21:39.089528+0000","last_peered":"2024-09-16T01:21:39.089528+0000","last_clean":"2024-09-16T01:21:39.089528+0000","last_became_active":"2024-09-16T01:21:28.052985+0000","last_became_peered":"2024-09-16T01:21:28.052985+0000","last_unstale":"2024-09-16T01:21:39.089528+0000","last_undegraded":"2024-09-16T01:21:39.089528+0000","last_fullsized":"2024-09-16T01:21:39.089528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:09.360220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":337,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:20:14.084036+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:20:14.083552+0000","last_became_peered":"2024-09-16T01:20:14.083552+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_clean_scrub_stamp":"2024-09-16T01:16:51.922126+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:37.598878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106614+0000","last_change":"2024-09-16T01:21:25.923170+0000","last_active":"2024-09-16T01:21:39.106614+0000","last_peered":"2024-09-16T01:21:39.106614+0000","last_clean":"2024-09-16T01:21:39.106614+0000","last_became_active":"2024-09-16T01:21:25.922555+0000","last_became_peered":"2024-09-16T01:21:25.922555+0000","last_unstale":"2024-09-16T01:21:39.106614+0000","last_undegraded":"2024-09-16T01:21:39.106614+0000","last_fullsized":"2024-09-16T01:21:39.106614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:14.948264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094536+0000","last_change":"2024-09-16T01:21:39.093752+0000","last_active":"2024-09-16T01:21:39.094536+0000","last_peered":"2024-09-16T01:21:39.094536+0000","last_clean":"2024-09-16T01:21:39.094536+0000","last_became_active":"2024-09-16T01:21:39.093394+0000","last_became_peered":"2024-09-16T01:21:39.093394+0000","last_unstale":"2024-09-16T01:21:39.094536+0000","last_undegraded":"2024-09-16T01:21:39.094536+0000","last_fullsized":"2024-09-16T01:21:39.094536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:32.703408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:21:25.925009+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:21:25.924661+0000","last_became_peered":"2024-09-16T01:21:25.924661+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.703241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086849+0000","last_change":"2024-09-16T01:21:28.045745+0000","last_active":"2024-09-16T01:21:39.086849+0000","last_peered":"2024-09-16T01:21:39.086849+0000","last_clean":"2024-09-16T01:21:39.086849+0000","last_became_active":"2024-09-16T01:21:28.045398+0000","last_became_peered":"2024-09-16T01:21:28.045398+0000","last_unstale":"2024-09-16T01:21:39.086849+0000","last_undegraded":"2024-09-16T01:21:39.086849+0000","last_fullsized":"2024-09-16T01:21:39.086849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:17.422858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:49.118472+0000","last_change":"2024-09-16T01:21:26.660859+0000","last_active":"2024-09-16T01:21:49.118472+0000","last_peered":"2024-09-16T01:21:49.118472+0000","last_clean":"2024-09-16T01:21:49.118472+0000","last_became_active":"2024-09-16T01:21:26.660515+0000","last_became_peered":"2024-09-16T01:21:26.660515+0000","last_unstale":"2024-09-16T01:21:49.118472+0000","last_undegraded":"2024-09-16T01:21:49.118472+0000","last_fullsized":"2024-09-16T01:21:49.118472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:57.301546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092617+0000","last_change":"2024-09-16T01:21:39.092617+0000","last_active":"2024-09-16T01:21:39.092617+0000","last_peered":"2024-09-16T01:21:39.092617+0000","last_clean":"2024-09-16T01:21:39.092617+0000","last_became_active":"2024-09-16T01:21:39.092212+0000","last_became_peered":"2024-09-16T01:21:39.092212+0000","last_unstale":"2024-09-16T01:21:39.092617+0000","last_undegraded":"2024-09-16T01:21:39.092617+0000","last_fullsized":"2024-09-16T01:21:39.092617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.894975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089151+0000","last_change":"2024-09-16T01:21:25.924485+0000","last_active":"2024-09-16T01:21:39.089151+0000","last_peered":"2024-09-16T01:21:39.089151+0000","last_clean":"2024-09-16T01:21:39.089151+0000","last_became_active":"2024-09-16T01:21:25.924075+0000","last_became_peered":"2024-09-16T01:21:25.924075+0000","last_unstale":"2024-09-16T01:21:39.089151+0000","last_undegraded":"2024-09-16T01:21:39.089151+0000","last_fullsized":"2024-09-16T01:21:39.089151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:13.034668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090273+0000","last_change":"2024-09-16T01:21:28.048152+0000","last_active":"2024-09-16T01:21:39.090273+0000","last_peered":"2024-09-16T01:21:39.090273+0000","last_clean":"2024-09-16T01:21:39.090273+0000","last_became_active":"2024-09-16T01:21:28.047818+0000","last_became_peered":"2024-09-16T01:21:28.047818+0000","last_unstale":"2024-09-16T01:21:39.090273+0000","last_undegraded":"2024-09-16T01:21:39.090273+0000","last_fullsized":"2024-09-16T01:21:39.090273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:19.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089286+0000","last_change":"2024-09-16T01:21:26.660336+0000","last_active":"2024-09-16T01:21:39.089286+0000","last_peered":"2024-09-16T01:21:39.089286+0000","last_clean":"2024-09-16T01:21:39.089286+0000","last_became_active":"2024-09-16T01:21:26.660005+0000","last_became_peered":"2024-09-16T01:21:26.660005+0000","last_unstale":"2024-09-16T01:21:39.089286+0000","last_undegraded":"2024-09-16T01:21:39.089286+0000","last_fullsized":"2024-09-16T01:21:39.089286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:37.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090412+0000","last_change":"2024-09-16T01:21:28.043112+0000","last_active":"2024-09-16T01:21:39.090412+0000","last_peered":"2024-09-16T01:21:39.090412+0000","last_clean":"2024-09-16T01:21:39.090412+0000","last_became_active":"2024-09-16T01:21:28.042752+0000","last_became_peered":"2024-09-16T01:21:28.042752+0000","last_unstale":"2024-09-16T01:21:39.090412+0000","last_undegraded":"2024-09-16T01:21:39.090412+0000","last_fullsized":"2024-09-16T01:21:39.090412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:57.379826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093748+0000","last_change":"2024-09-16T01:21:26.661003+0000","last_active":"2024-09-16T01:21:39.093748+0000","last_peered":"2024-09-16T01:21:39.093748+0000","last_clean":"2024-09-16T01:21:39.093748+0000","last_became_active":"2024-09-16T01:21:26.660407+0000","last_became_peered":"2024-09-16T01:21:26.660407+0000","last_unstale":"2024-09-16T01:21:39.093748+0000","last_undegraded":"2024-09-16T01:21:39.093748+0000","last_fullsized":"2024-09-16T01:21:39.093748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:52.229473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087273+0000","last_change":"2024-09-16T01:21:28.046938+0000","last_active":"2024-09-16T01:21:39.087273+0000","last_peered":"2024-09-16T01:21:39.087273+0000","last_clean":"2024-09-16T01:21:39.087273+0000","last_became_active":"2024-09-16T01:21:28.046620+0000","last_became_peered":"2024-09-16T01:21:28.046620+0000","last_unstale":"2024-09-16T01:21:39.087273+0000","last_undegraded":"2024-09-16T01:21:39.087273+0000","last_fullsized":"2024-09-16T01:21:39.087273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:04.845341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:51.037077+0000","last_change":"2024-09-16T01:21:25.915315+0000","last_active":"2024-09-16T01:21:51.037077+0000","last_peered":"2024-09-16T01:21:51.037077+0000","last_clean":"2024-09-16T01:21:51.037077+0000","last_became_active":"2024-09-16T01:21:25.915001+0000","last_became_peered":"2024-09-16T01:21:25.915001+0000","last_unstale":"2024-09-16T01:21:51.037077+0000","last_undegraded":"2024-09-16T01:21:51.037077+0000","last_fullsized":"2024-09-16T01:21:51.037077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:30.163050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089535+0000","last_change":"2024-09-16T01:21:28.047157+0000","last_active":"2024-09-16T01:21:39.089535+0000","last_peered":"2024-09-16T01:21:39.089535+0000","last_clean":"2024-09-16T01:21:39.089535+0000","last_became_active":"2024-09-16T01:21:28.046583+0000","last_became_peered":"2024-09-16T01:21:28.046583+0000","last_unstale":"2024-09-16T01:21:39.089535+0000","last_undegraded":"2024-09-16T01:21:39.089535+0000","last_fullsized":"2024-09-16T01:21:39.089535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:47.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106885+0000","last_change":"2024-09-16T01:21:26.663047+0000","last_active":"2024-09-16T01:21:39.106885+0000","last_peered":"2024-09-16T01:21:39.106885+0000","last_clean":"2024-09-16T01:21:39.106885+0000","last_became_active":"2024-09-16T01:21:26.662627+0000","last_became_peered":"2024-09-16T01:21:26.662627+0000","last_unstale":"2024-09-16T01:21:39.106885+0000","last_undegraded":"2024-09-16T01:21:39.106885+0000","last_fullsized":"2024-09-16T01:21:39.106885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:59.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093738+0000","last_change":"2024-09-16T01:21:28.046954+0000","last_active":"2024-09-16T01:21:39.093738+0000","last_peered":"2024-09-16T01:21:39.093738+0000","last_clean":"2024-09-16T01:21:39.093738+0000","last_became_active":"2024-09-16T01:21:28.046550+0000","last_became_peered":"2024-09-16T01:21:28.046550+0000","last_unstale":"2024-09-16T01:21:39.093738+0000","last_undegraded":"2024-09-16T01:21:39.093738+0000","last_fullsized":"2024-09-16T01:21:39.093738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:30.880672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.100910+0000","last_change":"2024-09-16T01:21:39.100910+0000","last_active":"2024-09-16T01:21:39.100910+0000","last_peered":"2024-09-16T01:21:39.100910+0000","last_clean":"2024-09-16T01:21:39.100910+0000","last_became_active":"2024-09-16T01:21:39.095257+0000","last_became_peered":"2024-09-16T01:21:39.095257+0000","last_unstale":"2024-09-16T01:21:39.100910+0000","last_undegraded":"2024-09-16T01:21:39.100910+0000","last_fullsized":"2024-09-16T01:21:39.100910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:17.957295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092774+0000","last_change":"2024-09-16T01:21:28.052061+0000","last_active":"2024-09-16T01:21:39.092774+0000","last_peered":"2024-09-16T01:21:39.092774+0000","last_clean":"2024-09-16T01:21:39.092774+0000","last_became_active":"2024-09-16T01:21:28.051705+0000","last_became_peered":"2024-09-16T01:21:28.051705+0000","last_unstale":"2024-09-16T01:21:39.092774+0000","last_undegraded":"2024-09-16T01:21:39.092774+0000","last_fullsized":"2024-09-16T01:21:39.092774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:05.546846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090258+0000","last_change":"2024-09-16T01:21:25.921635+0000","last_active":"2024-09-16T01:21:39.090258+0000","last_peered":"2024-09-16T01:21:39.090258+0000","last_clean":"2024-09-16T01:21:39.090258+0000","last_became_active":"2024-09-16T01:21:25.921281+0000","last_became_peered":"2024-09-16T01:21:25.921281+0000","last_unstale":"2024-09-16T01:21:39.090258+0000","last_undegraded":"2024-09-16T01:21:39.090258+0000","last_fullsized":"2024-09-16T01:21:39.090258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:02.933803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089886+0000","last_change":"2024-09-16T01:21:28.043636+0000","last_active":"2024-09-16T01:21:39.089886+0000","last_peered":"2024-09-16T01:21:39.089886+0000","last_clean":"2024-09-16T01:21:39.089886+0000","last_became_active":"2024-09-16T01:21:28.043273+0000","last_became_peered":"2024-09-16T01:21:28.043273+0000","last_unstale":"2024-09-16T01:21:39.089886+0000","last_undegraded":"2024-09-16T01:21:39.089886+0000","last_fullsized":"2024-09-16T01:21:39.089886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:05.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090771+0000","last_change":"2024-09-16T01:21:25.917934+0000","last_active":"2024-09-16T01:21:39.090771+0000","last_peered":"2024-09-16T01:21:39.090771+0000","last_clean":"2024-09-16T01:21:39.090771+0000","last_became_active":"2024-09-16T01:21:25.917545+0000","last_became_peered":"2024-09-16T01:21:25.917545+0000","last_unstale":"2024-09-16T01:21:39.090771+0000","last_undegraded":"2024-09-16T01:21:39.090771+0000","last_fullsized":"2024-09-16T01:21:39.090771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:07.119546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089851+0000","last_change":"2024-09-16T01:21:28.043270+0000","last_active":"2024-09-16T01:21:39.089851+0000","last_peered":"2024-09-16T01:21:39.089851+0000","last_clean":"2024-09-16T01:21:39.089851+0000","last_became_active":"2024-09-16T01:21:28.042957+0000","last_became_peered":"2024-09-16T01:21:28.042957+0000","last_unstale":"2024-09-16T01:21:39.089851+0000","last_undegraded":"2024-09-16T01:21:39.089851+0000","last_fullsized":"2024-09-16T01:21:39.089851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:11.052387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093263+0000","last_change":"2024-09-16T01:21:25.923224+0000","last_active":"2024-09-16T01:21:39.093263+0000","last_peered":"2024-09-16T01:21:39.093263+0000","last_clean":"2024-09-16T01:21:39.093263+0000","last_became_active":"2024-09-16T01:21:25.922873+0000","last_became_peered":"2024-09-16T01:21:25.922873+0000","last_unstale":"2024-09-16T01:21:39.093263+0000","last_undegraded":"2024-09-16T01:21:39.093263+0000","last_fullsized":"2024-09-16T01:21:39.093263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:14.747752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088910+0000","last_change":"2024-09-16T01:21:28.054706+0000","last_active":"2024-09-16T01:21:39.088910+0000","last_peered":"2024-09-16T01:21:39.088910+0000","last_clean":"2024-09-16T01:21:39.088910+0000","last_became_active":"2024-09-16T01:21:28.054382+0000","last_became_peered":"2024-09-16T01:21:28.054382+0000","last_unstale":"2024-09-16T01:21:39.088910+0000","last_undegraded":"2024-09-16T01:21:39.088910+0000","last_fullsized":"2024-09-16T01:21:39.088910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.908252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088713+0000","last_change":"2024-09-16T01:21:28.051807+0000","last_active":"2024-09-16T01:21:39.088713+0000","last_peered":"2024-09-16T01:21:39.088713+0000","last_clean":"2024-09-16T01:21:39.088713+0000","last_became_active":"2024-09-16T01:21:28.051474+0000","last_became_peered":"2024-09-16T01:21:28.051474+0000","last_unstale":"2024-09-16T01:21:39.088713+0000","last_undegraded":"2024-09-16T01:21:39.088713+0000","last_fullsized":"2024-09-16T01:21:39.088713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:48.006691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.101161+0000","last_change":"2024-09-16T01:21:39.100723+0000","last_active":"2024-09-16T01:21:39.101161+0000","last_peered":"2024-09-16T01:21:39.101161+0000","last_clean":"2024-09-16T01:21:39.101161+0000","last_became_active":"2024-09-16T01:21:39.094895+0000","last_became_peered":"2024-09-16T01:21:39.094895+0000","last_unstale":"2024-09-16T01:21:39.101161+0000","last_undegraded":"2024-09-16T01:21:39.101161+0000","last_fullsized":"2024-09-16T01:21:39.101161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.663815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092318+0000","last_change":"2024-09-16T01:21:28.055506+0000","last_active":"2024-09-16T01:21:39.092318+0000","last_peered":"2024-09-16T01:21:39.092318+0000","last_clean":"2024-09-16T01:21:39.092318+0000","last_became_active":"2024-09-16T01:21:28.055167+0000","last_became_peered":"2024-09-16T01:21:28.055167+0000","last_unstale":"2024-09-16T01:21:39.092318+0000","last_undegraded":"2024-09-16T01:21:39.092318+0000","last_fullsized":"2024-09-16T01:21:39.092318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:38.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093642+0000","last_change":"2024-09-16T01:21:25.920611+0000","last_active":"2024-09-16T01:21:39.093642+0000","last_peered":"2024-09-16T01:21:39.093642+0000","last_clean":"2024-09-16T01:21:39.093642+0000","last_became_active":"2024-09-16T01:21:25.920255+0000","last_became_peered":"2024-09-16T01:21:25.920255+0000","last_unstale":"2024-09-16T01:21:39.093642+0000","last_undegraded":"2024-09-16T01:21:39.093642+0000","last_fullsized":"2024-09-16T01:21:39.093642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:17.268621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093932+0000","last_change":"2024-09-16T01:21:28.054009+0000","last_active":"2024-09-16T01:21:39.093932+0000","last_peered":"2024-09-16T01:21:39.093932+0000","last_clean":"2024-09-16T01:21:39.093932+0000","last_became_active":"2024-09-16T01:21:28.053631+0000","last_became_peered":"2024-09-16T01:21:28.053631+0000","last_unstale":"2024-09-16T01:21:39.093932+0000","last_undegraded":"2024-09-16T01:21:39.093932+0000","last_fullsized":"2024-09-16T01:21:39.093932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:28.298398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090095+0000","last_change":"2024-09-16T01:21:26.659753+0000","last_active":"2024-09-16T01:21:39.090095+0000","last_peered":"2024-09-16T01:21:39.090095+0000","last_clean":"2024-09-16T01:21:39.090095+0000","last_became_active":"2024-09-16T01:21:26.659343+0000","last_became_peered":"2024-09-16T01:21:26.659343+0000","last_unstale":"2024-09-16T01:21:39.090095+0000","last_undegraded":"2024-09-16T01:21:39.090095+0000","last_fullsized":"2024-09-16T01:21:39.090095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:47.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089898+0000","last_change":"2024-09-16T01:21:28.050748+0000","last_active":"2024-09-16T01:21:39.089898+0000","last_peered":"2024-09-16T01:21:39.089898+0000","last_clean":"2024-09-16T01:21:39.089898+0000","last_became_active":"2024-09-16T01:21:28.050457+0000","last_became_peered":"2024-09-16T01:21:28.050457+0000","last_unstale":"2024-09-16T01:21:39.089898+0000","last_undegraded":"2024-09-16T01:21:39.089898+0000","last_fullsized":"2024-09-16T01:21:39.089898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:21.552080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089346+0000","last_change":"2024-09-16T01:21:25.924505+0000","last_active":"2024-09-16T01:21:39.089346+0000","last_peered":"2024-09-16T01:21:39.089346+0000","last_clean":"2024-09-16T01:21:39.089346+0000","last_became_active":"2024-09-16T01:21:25.924076+0000","last_became_peered":"2024-09-16T01:21:25.924076+0000","last_unstale":"2024-09-16T01:21:39.089346+0000","last_undegraded":"2024-09-16T01:21:39.089346+0000","last_fullsized":"2024-09-16T01:21:39.089346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:00.630772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":51198,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":103,"num_read_kb":107,"num_write":154,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":153594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282677,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514514,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":441274,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":1079950,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441510,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135905,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441430,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364836,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1033755,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528363,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":440899,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757294,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1033046,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920821,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":441729,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":441210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":489237,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":487494,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":929792,"data_stored":442170,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:21:54.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:21:54.891 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:55.279 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:55 smithi063 ceph-mon[31070]: pgmap v292: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:55.279 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:55 smithi063 ceph-mon[31070]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:21:55.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.359+0000 7fcb1e15e640 1 -- 172.21.15.63:0/276895745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb1810c170 msgr2=0x7fcb1810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.359+0000 7fcb1e15e640 1 --2- 172.21.15.63:0/276895745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb1810c170 0x7fcb1810e610 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009ca0 tx=0x7fcb1002a950 comp rx=0 tx=0).stop 2024-09-16T01:21:55.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.360+0000 7fcb1e15e640 1 -- 172.21.15.63:0/276895745 shutdown_connections 2024-09-16T01:21:55.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.360+0000 7fcb1e15e640 1 --2- 172.21.15.63:0/276895745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb1810c170 0x7fcb1810e610 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.360+0000 7fcb1e15e640 1 --2- 172.21.15.63:0/276895745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb18103660 0x7fcb1810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.360+0000 7fcb1e15e640 1 --2- 172.21.15.63:0/276895745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb18102d40 0x7fcb18103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.360+0000 7fcb1e15e640 1 -- 172.21.15.63:0/276895745 >> 172.21.15.63:0/276895745 conn(0x7fcb180fc7a0 msgr2=0x7fcb180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:55.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.360+0000 7fcb1e15e640 1 -- 172.21.15.63:0/276895745 shutdown_connections 2024-09-16T01:21:55.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.360+0000 7fcb1e15e640 1 -- 172.21.15.63:0/276895745 wait complete. 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.360+0000 7fcb1e15e640 1 Processor -- start 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.360+0000 7fcb1e15e640 1 -- start start 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb1e15e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb18102d40 0x7fcb1819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb1e15e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb18103660 0x7fcb1819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb1e15e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb1810c170 0x7fcb1819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb1e15e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18111e00 con 0x7fcb18103660 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb1e15e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18111c80 con 0x7fcb1810c170 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb1e15e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18111f80 con 0x7fcb18102d40 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb16ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb18103660 0x7fcb1819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb16ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb18103660 0x7fcb1819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42542/0 (socket says 172.21.15.63:42542) 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb16ffd640 1 -- 172.21.15.63:0/2751096050 learned_addr learned my addr 172.21.15.63:0/2751096050 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb177fe640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb18102d40 0x7fcb1819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb16ffd640 1 -- 172.21.15.63:0/2751096050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb18102d40 msgr2=0x7fcb1819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb16ffd640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb18102d40 0x7fcb1819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb16ffd640 1 -- 172.21.15.63:0/2751096050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb1810c170 msgr2=0x7fcb1819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb16ffd640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb1810c170 0x7fcb1819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb16ffd640 1 -- 172.21.15.63:0/2751096050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1819f420 con 0x7fcb18103660 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb177fe640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb18102d40 0x7fcb1819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb16ffd640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb18103660 0x7fcb1819a9b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00d750 tx=0x7fcb0c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb14ff9640 1 -- 172.21.15.63:0/2751096050 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c017070 con 0x7fcb18103660 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb14ff9640 1 -- 172.21.15.63:0/2751096050 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb0c005020 con 0x7fcb18103660 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb1e15e640 1 -- 172.21.15.63:0/2751096050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1819f710 con 0x7fcb18103660 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb14ff9640 1 -- 172.21.15.63:0/2751096050 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c004c60 con 0x7fcb18103660 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.361+0000 7fcb1e15e640 1 -- 172.21.15.63:0/2751096050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb181a6ff0 con 0x7fcb18103660 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.362+0000 7fcb1e15e640 1 -- 172.21.15.63:0/2751096050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb18103120 con 0x7fcb18103660 2024-09-16T01:21:55.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.363+0000 7fcb14ff9640 1 -- 172.21.15.63:0/2751096050 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcb0c009a30 con 0x7fcb18103660 2024-09-16T01:21:55.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.364+0000 7fcb14ff9640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb000a3350 0x7fcb000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.365+0000 7fcb177fe640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb000a3350 0x7fcb000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.365+0000 7fcb14ff9640 1 -- 172.21.15.63:0/2751096050 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcb0c0cf3f0 con 0x7fcb18103660 2024-09-16T01:21:55.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.365+0000 7fcb177fe640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb000a3350 0x7fcb000a5810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800abe0 tx=0x7fcb0800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.369+0000 7fcb14ff9640 1 -- 172.21.15.63:0/2751096050 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb0c09bfb0 con 0x7fcb18103660 2024-09-16T01:21:55.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:55 smithi192 ceph-mon[34775]: pgmap v292: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:55.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:55 smithi192 ceph-mon[34775]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:21:55.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:55 smithi162 ceph-mon[34539]: pgmap v292: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-16T01:21:55.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:55 smithi162 ceph-mon[34539]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:21:55.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.541+0000 7fcb1e15e640 1 -- 172.21.15.63:0/2751096050 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb180fe2a0 con 0x7fcb000a3350 2024-09-16T01:21:55.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.547+0000 7fcb14ff9640 1 -- 172.21.15.63:0/2751096050 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258957 (secure 0 0 0) 0x7fcb180fe2a0 con 0x7fcb000a3350 2024-09-16T01:21:55.550 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:55.551 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-16T01:21:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 -- 172.21.15.63:0/2751096050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb000a3350 msgr2=0x7fcb000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb000a3350 0x7fcb000a5810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800abe0 tx=0x7fcb0800a5c0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 -- 172.21.15.63:0/2751096050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb18103660 msgr2=0x7fcb1819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb18103660 0x7fcb1819a9b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00d750 tx=0x7fcb0c00dc10 comp rx=0 tx=0).stop 2024-09-16T01:21:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 -- 172.21.15.63:0/2751096050 shutdown_connections 2024-09-16T01:21:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb000a3350 0x7fcb000a5810 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb1810c170 0x7fcb1819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb18103660 0x7fcb1819a9b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 --2- 172.21.15.63:0/2751096050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb18102d40 0x7fcb1819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 -- 172.21.15.63:0/2751096050 >> 172.21.15.63:0/2751096050 conn(0x7fcb180fc7a0 msgr2=0x7fcb180fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:55.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 -- 172.21.15.63:0/2751096050 shutdown_connections 2024-09-16T01:21:55.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:55.550+0000 7fcb1e15e640 1 -- 172.21.15.63:0/2751096050 wait complete. 2024-09-16T01:21:56.272 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-16T01:21:55.185667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641800,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":234,"num_read_kb":216,"num_write":337,"num_write_kb":3033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360364,"kb_used_data":11100,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581460,"statfs":{"total":1151940427776,"available":1151571415040,"internally_reserved":0,"allocated":11366400,"data_stored":7213704,"data_compressed":177609,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46210,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":78,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003627"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090037+0000","last_change":"2024-09-16T01:21:28.051261+0000","last_active":"2024-09-16T01:21:39.090037+0000","last_peered":"2024-09-16T01:21:39.090037+0000","last_clean":"2024-09-16T01:21:39.090037+0000","last_became_active":"2024-09-16T01:21:28.049073+0000","last_became_peered":"2024-09-16T01:21:28.049073+0000","last_unstale":"2024-09-16T01:21:39.090037+0000","last_undegraded":"2024-09-16T01:21:39.090037+0000","last_fullsized":"2024-09-16T01:21:39.090037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:06.863766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093652+0000","last_change":"2024-09-16T01:21:28.049457+0000","last_active":"2024-09-16T01:21:39.093652+0000","last_peered":"2024-09-16T01:21:39.093652+0000","last_clean":"2024-09-16T01:21:39.093652+0000","last_became_active":"2024-09-16T01:21:28.048707+0000","last_became_peered":"2024-09-16T01:21:28.048707+0000","last_unstale":"2024-09-16T01:21:39.093652+0000","last_undegraded":"2024-09-16T01:21:39.093652+0000","last_fullsized":"2024-09-16T01:21:39.093652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:56.346506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093456+0000","last_change":"2024-09-16T01:21:28.052931+0000","last_active":"2024-09-16T01:21:39.093456+0000","last_peered":"2024-09-16T01:21:39.093456+0000","last_clean":"2024-09-16T01:21:39.093456+0000","last_became_active":"2024-09-16T01:21:28.052501+0000","last_became_peered":"2024-09-16T01:21:28.052501+0000","last_unstale":"2024-09-16T01:21:39.093456+0000","last_undegraded":"2024-09-16T01:21:39.093456+0000","last_fullsized":"2024-09-16T01:21:39.093456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:45:23.351452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.096667+0000","last_change":"2024-09-16T01:21:39.096279+0000","last_active":"2024-09-16T01:21:39.096667+0000","last_peered":"2024-09-16T01:21:39.096667+0000","last_clean":"2024-09-16T01:21:39.096667+0000","last_became_active":"2024-09-16T01:21:39.095886+0000","last_became_peered":"2024-09-16T01:21:39.095886+0000","last_unstale":"2024-09-16T01:21:39.096667+0000","last_undegraded":"2024-09-16T01:21:39.096667+0000","last_fullsized":"2024-09-16T01:21:39.096667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:56.530007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093192+0000","last_change":"2024-09-16T01:21:28.043473+0000","last_active":"2024-09-16T01:21:39.093192+0000","last_peered":"2024-09-16T01:21:39.093192+0000","last_clean":"2024-09-16T01:21:39.093192+0000","last_became_active":"2024-09-16T01:21:28.043127+0000","last_became_peered":"2024-09-16T01:21:28.043127+0000","last_unstale":"2024-09-16T01:21:39.093192+0000","last_undegraded":"2024-09-16T01:21:39.093192+0000","last_fullsized":"2024-09-16T01:21:39.093192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.714834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090192+0000","last_change":"2024-09-16T01:21:28.047210+0000","last_active":"2024-09-16T01:21:39.090192+0000","last_peered":"2024-09-16T01:21:39.090192+0000","last_clean":"2024-09-16T01:21:39.090192+0000","last_became_active":"2024-09-16T01:21:28.046872+0000","last_became_peered":"2024-09-16T01:21:28.046872+0000","last_unstale":"2024-09-16T01:21:39.090192+0000","last_undegraded":"2024-09-16T01:21:39.090192+0000","last_fullsized":"2024-09-16T01:21:39.090192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:22.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088806+0000","last_change":"2024-09-16T01:21:28.052212+0000","last_active":"2024-09-16T01:21:39.088806+0000","last_peered":"2024-09-16T01:21:39.088806+0000","last_clean":"2024-09-16T01:21:39.088806+0000","last_became_active":"2024-09-16T01:21:28.050307+0000","last_became_peered":"2024-09-16T01:21:28.050307+0000","last_unstale":"2024-09-16T01:21:39.088806+0000","last_undegraded":"2024-09-16T01:21:39.088806+0000","last_fullsized":"2024-09-16T01:21:39.088806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:21.869103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089494+0000","last_change":"2024-09-16T01:21:28.047980+0000","last_active":"2024-09-16T01:21:39.089494+0000","last_peered":"2024-09-16T01:21:39.089494+0000","last_clean":"2024-09-16T01:21:39.089494+0000","last_became_active":"2024-09-16T01:21:28.047671+0000","last_became_peered":"2024-09-16T01:21:28.047671+0000","last_unstale":"2024-09-16T01:21:39.089494+0000","last_undegraded":"2024-09-16T01:21:39.089494+0000","last_fullsized":"2024-09-16T01:21:39.089494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:30.501419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093245+0000","last_change":"2024-09-16T01:21:28.052468+0000","last_active":"2024-09-16T01:21:39.093245+0000","last_peered":"2024-09-16T01:21:39.093245+0000","last_clean":"2024-09-16T01:21:39.093245+0000","last_became_active":"2024-09-16T01:21:28.052156+0000","last_became_peered":"2024-09-16T01:21:28.052156+0000","last_unstale":"2024-09-16T01:21:39.093245+0000","last_undegraded":"2024-09-16T01:21:39.093245+0000","last_fullsized":"2024-09-16T01:21:39.093245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:44.631498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090981+0000","last_change":"2024-09-16T01:21:28.048278+0000","last_active":"2024-09-16T01:21:39.090981+0000","last_peered":"2024-09-16T01:21:39.090981+0000","last_clean":"2024-09-16T01:21:39.090981+0000","last_became_active":"2024-09-16T01:21:28.047892+0000","last_became_peered":"2024-09-16T01:21:28.047892+0000","last_unstale":"2024-09-16T01:21:39.090981+0000","last_undegraded":"2024-09-16T01:21:39.090981+0000","last_fullsized":"2024-09-16T01:21:39.090981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.949956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089369+0000","last_change":"2024-09-16T01:21:28.052814+0000","last_active":"2024-09-16T01:21:39.089369+0000","last_peered":"2024-09-16T01:21:39.089369+0000","last_clean":"2024-09-16T01:21:39.089369+0000","last_became_active":"2024-09-16T01:21:28.052440+0000","last_became_peered":"2024-09-16T01:21:28.052440+0000","last_unstale":"2024-09-16T01:21:39.089369+0000","last_undegraded":"2024-09-16T01:21:39.089369+0000","last_fullsized":"2024-09-16T01:21:39.089369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:47.470646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106734+0000","last_change":"2024-09-16T01:21:28.053917+0000","last_active":"2024-09-16T01:21:39.106734+0000","last_peered":"2024-09-16T01:21:39.106734+0000","last_clean":"2024-09-16T01:21:39.106734+0000","last_became_active":"2024-09-16T01:21:28.052625+0000","last_became_peered":"2024-09-16T01:21:28.052625+0000","last_unstale":"2024-09-16T01:21:39.106734+0000","last_undegraded":"2024-09-16T01:21:39.106734+0000","last_fullsized":"2024-09-16T01:21:39.106734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:32.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087092+0000","last_change":"2024-09-16T01:21:28.046588+0000","last_active":"2024-09-16T01:21:39.087092+0000","last_peered":"2024-09-16T01:21:39.087092+0000","last_clean":"2024-09-16T01:21:39.087092+0000","last_became_active":"2024-09-16T01:21:28.046268+0000","last_became_peered":"2024-09-16T01:21:28.046268+0000","last_unstale":"2024-09-16T01:21:39.087092+0000","last_undegraded":"2024-09-16T01:21:39.087092+0000","last_fullsized":"2024-09-16T01:21:39.087092+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:49.659707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093475+0000","last_change":"2024-09-16T01:21:28.051946+0000","last_active":"2024-09-16T01:21:39.093475+0000","last_peered":"2024-09-16T01:21:39.093475+0000","last_clean":"2024-09-16T01:21:39.093475+0000","last_became_active":"2024-09-16T01:21:28.051615+0000","last_became_peered":"2024-09-16T01:21:28.051615+0000","last_unstale":"2024-09-16T01:21:39.093475+0000","last_undegraded":"2024-09-16T01:21:39.093475+0000","last_fullsized":"2024-09-16T01:21:39.093475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.462830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093253+0000","last_change":"2024-09-16T01:21:28.047382+0000","last_active":"2024-09-16T01:21:39.093253+0000","last_peered":"2024-09-16T01:21:39.093253+0000","last_clean":"2024-09-16T01:21:39.093253+0000","last_became_active":"2024-09-16T01:21:28.045361+0000","last_became_peered":"2024-09-16T01:21:28.045361+0000","last_unstale":"2024-09-16T01:21:39.093253+0000","last_undegraded":"2024-09-16T01:21:39.093253+0000","last_fullsized":"2024-09-16T01:21:39.093253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:26.099519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091996+0000","last_change":"2024-09-16T01:21:28.054028+0000","last_active":"2024-09-16T01:21:39.091996+0000","last_peered":"2024-09-16T01:21:39.091996+0000","last_clean":"2024-09-16T01:21:39.091996+0000","last_became_active":"2024-09-16T01:21:28.052698+0000","last_became_peered":"2024-09-16T01:21:28.052698+0000","last_unstale":"2024-09-16T01:21:39.091996+0000","last_undegraded":"2024-09-16T01:21:39.091996+0000","last_fullsized":"2024-09-16T01:21:39.091996+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:01.745424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090073+0000","last_change":"2024-09-16T01:21:28.049032+0000","last_active":"2024-09-16T01:21:39.090073+0000","last_peered":"2024-09-16T01:21:39.090073+0000","last_clean":"2024-09-16T01:21:39.090073+0000","last_became_active":"2024-09-16T01:21:28.048357+0000","last_became_peered":"2024-09-16T01:21:28.048357+0000","last_unstale":"2024-09-16T01:21:39.090073+0000","last_undegraded":"2024-09-16T01:21:39.090073+0000","last_fullsized":"2024-09-16T01:21:39.090073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:17.963329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089030+0000","last_change":"2024-09-16T01:21:28.051126+0000","last_active":"2024-09-16T01:21:39.089030+0000","last_peered":"2024-09-16T01:21:39.089030+0000","last_clean":"2024-09-16T01:21:39.089030+0000","last_became_active":"2024-09-16T01:21:28.050789+0000","last_became_peered":"2024-09-16T01:21:28.050789+0000","last_unstale":"2024-09-16T01:21:39.089030+0000","last_undegraded":"2024-09-16T01:21:39.089030+0000","last_fullsized":"2024-09-16T01:21:39.089030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:35.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090443+0000","last_change":"2024-09-16T01:21:28.045569+0000","last_active":"2024-09-16T01:21:39.090443+0000","last_peered":"2024-09-16T01:21:39.090443+0000","last_clean":"2024-09-16T01:21:39.090443+0000","last_became_active":"2024-09-16T01:21:28.044496+0000","last_became_peered":"2024-09-16T01:21:28.044496+0000","last_unstale":"2024-09-16T01:21:39.090443+0000","last_undegraded":"2024-09-16T01:21:39.090443+0000","last_fullsized":"2024-09-16T01:21:39.090443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:10.665322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089790+0000","last_change":"2024-09-16T01:21:28.047522+0000","last_active":"2024-09-16T01:21:39.089790+0000","last_peered":"2024-09-16T01:21:39.089790+0000","last_clean":"2024-09-16T01:21:39.089790+0000","last_became_active":"2024-09-16T01:21:28.047192+0000","last_became_peered":"2024-09-16T01:21:28.047192+0000","last_unstale":"2024-09-16T01:21:39.089790+0000","last_undegraded":"2024-09-16T01:21:39.089790+0000","last_fullsized":"2024-09-16T01:21:39.089790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.044980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087099+0000","last_change":"2024-09-16T01:21:28.043184+0000","last_active":"2024-09-16T01:21:39.087099+0000","last_peered":"2024-09-16T01:21:39.087099+0000","last_clean":"2024-09-16T01:21:39.087099+0000","last_became_active":"2024-09-16T01:21:28.042787+0000","last_became_peered":"2024-09-16T01:21:28.042787+0000","last_unstale":"2024-09-16T01:21:39.087099+0000","last_undegraded":"2024-09-16T01:21:39.087099+0000","last_fullsized":"2024-09-16T01:21:39.087099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:00.633731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092704+0000","last_change":"2024-09-16T01:21:28.050141+0000","last_active":"2024-09-16T01:21:39.092704+0000","last_peered":"2024-09-16T01:21:39.092704+0000","last_clean":"2024-09-16T01:21:39.092704+0000","last_became_active":"2024-09-16T01:21:28.049843+0000","last_became_peered":"2024-09-16T01:21:28.049843+0000","last_unstale":"2024-09-16T01:21:39.092704+0000","last_undegraded":"2024-09-16T01:21:39.092704+0000","last_fullsized":"2024-09-16T01:21:39.092704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:39.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089783+0000","last_change":"2024-09-16T01:21:28.044260+0000","last_active":"2024-09-16T01:21:39.089783+0000","last_peered":"2024-09-16T01:21:39.089783+0000","last_clean":"2024-09-16T01:21:39.089783+0000","last_became_active":"2024-09-16T01:21:28.043959+0000","last_became_peered":"2024-09-16T01:21:28.043959+0000","last_unstale":"2024-09-16T01:21:39.089783+0000","last_undegraded":"2024-09-16T01:21:39.089783+0000","last_fullsized":"2024-09-16T01:21:39.089783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087679+0000","last_change":"2024-09-16T01:21:28.044143+0000","last_active":"2024-09-16T01:21:39.087679+0000","last_peered":"2024-09-16T01:21:39.087679+0000","last_clean":"2024-09-16T01:21:39.087679+0000","last_became_active":"2024-09-16T01:21:28.043767+0000","last_became_peered":"2024-09-16T01:21:28.043767+0000","last_unstale":"2024-09-16T01:21:39.087679+0000","last_undegraded":"2024-09-16T01:21:39.087679+0000","last_fullsized":"2024-09-16T01:21:39.087679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:25.269737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089450+0000","last_change":"2024-09-16T01:21:28.047663+0000","last_active":"2024-09-16T01:21:39.089450+0000","last_peered":"2024-09-16T01:21:39.089450+0000","last_clean":"2024-09-16T01:21:39.089450+0000","last_became_active":"2024-09-16T01:21:28.047044+0000","last_became_peered":"2024-09-16T01:21:28.047044+0000","last_unstale":"2024-09-16T01:21:39.089450+0000","last_undegraded":"2024-09-16T01:21:39.089450+0000","last_fullsized":"2024-09-16T01:21:39.089450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:44.539096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091431+0000","last_change":"2024-09-16T01:21:28.052740+0000","last_active":"2024-09-16T01:21:39.091431+0000","last_peered":"2024-09-16T01:21:39.091431+0000","last_clean":"2024-09-16T01:21:39.091431+0000","last_became_active":"2024-09-16T01:21:28.052396+0000","last_became_peered":"2024-09-16T01:21:28.052396+0000","last_unstale":"2024-09-16T01:21:39.091431+0000","last_undegraded":"2024-09-16T01:21:39.091431+0000","last_fullsized":"2024-09-16T01:21:39.091431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:49.021594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089633+0000","last_change":"2024-09-16T01:21:28.050867+0000","last_active":"2024-09-16T01:21:39.089633+0000","last_peered":"2024-09-16T01:21:39.089633+0000","last_clean":"2024-09-16T01:21:39.089633+0000","last_became_active":"2024-09-16T01:21:28.050412+0000","last_became_peered":"2024-09-16T01:21:28.050412+0000","last_unstale":"2024-09-16T01:21:39.089633+0000","last_undegraded":"2024-09-16T01:21:39.089633+0000","last_fullsized":"2024-09-16T01:21:39.089633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.286864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087224+0000","last_change":"2024-09-16T01:21:28.037593+0000","last_active":"2024-09-16T01:21:39.087224+0000","last_peered":"2024-09-16T01:21:39.087224+0000","last_clean":"2024-09-16T01:21:39.087224+0000","last_became_active":"2024-09-16T01:21:28.037268+0000","last_became_peered":"2024-09-16T01:21:28.037268+0000","last_unstale":"2024-09-16T01:21:39.087224+0000","last_undegraded":"2024-09-16T01:21:39.087224+0000","last_fullsized":"2024-09-16T01:21:39.087224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:09.625480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093471+0000","last_change":"2024-09-16T01:21:28.044744+0000","last_active":"2024-09-16T01:21:39.093471+0000","last_peered":"2024-09-16T01:21:39.093471+0000","last_clean":"2024-09-16T01:21:39.093471+0000","last_became_active":"2024-09-16T01:21:28.044440+0000","last_became_peered":"2024-09-16T01:21:28.044440+0000","last_unstale":"2024-09-16T01:21:39.093471+0000","last_undegraded":"2024-09-16T01:21:39.093471+0000","last_fullsized":"2024-09-16T01:21:39.093471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:20.404778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090655+0000","last_change":"2024-09-16T01:21:28.044498+0000","last_active":"2024-09-16T01:21:39.090655+0000","last_peered":"2024-09-16T01:21:39.090655+0000","last_clean":"2024-09-16T01:21:39.090655+0000","last_became_active":"2024-09-16T01:21:28.044028+0000","last_became_peered":"2024-09-16T01:21:28.044028+0000","last_unstale":"2024-09-16T01:21:39.090655+0000","last_undegraded":"2024-09-16T01:21:39.090655+0000","last_fullsized":"2024-09-16T01:21:39.090655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:46.134484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090743+0000","last_change":"2024-09-16T01:21:28.047796+0000","last_active":"2024-09-16T01:21:39.090743+0000","last_peered":"2024-09-16T01:21:39.090743+0000","last_clean":"2024-09-16T01:21:39.090743+0000","last_became_active":"2024-09-16T01:21:28.046289+0000","last_became_peered":"2024-09-16T01:21:28.046289+0000","last_unstale":"2024-09-16T01:21:39.090743+0000","last_undegraded":"2024-09-16T01:21:39.090743+0000","last_fullsized":"2024-09-16T01:21:39.090743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:53.709261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089792+0000","last_change":"2024-09-16T01:21:28.050767+0000","last_active":"2024-09-16T01:21:39.089792+0000","last_peered":"2024-09-16T01:21:39.089792+0000","last_clean":"2024-09-16T01:21:39.089792+0000","last_became_active":"2024-09-16T01:21:28.050430+0000","last_became_peered":"2024-09-16T01:21:28.050430+0000","last_unstale":"2024-09-16T01:21:39.089792+0000","last_undegraded":"2024-09-16T01:21:39.089792+0000","last_fullsized":"2024-09-16T01:21:39.089792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:37.436612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092925+0000","last_change":"2024-09-16T01:21:28.045374+0000","last_active":"2024-09-16T01:21:39.092925+0000","last_peered":"2024-09-16T01:21:39.092925+0000","last_clean":"2024-09-16T01:21:39.092925+0000","last_became_active":"2024-09-16T01:21:28.045072+0000","last_became_peered":"2024-09-16T01:21:28.045072+0000","last_unstale":"2024-09-16T01:21:39.092925+0000","last_undegraded":"2024-09-16T01:21:39.092925+0000","last_fullsized":"2024-09-16T01:21:39.092925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:10.579680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":48,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:53.122501+0000","last_change":"2024-09-16T01:21:25.922017+0000","last_active":"2024-09-16T01:21:53.122501+0000","last_peered":"2024-09-16T01:21:53.122501+0000","last_clean":"2024-09-16T01:21:53.122501+0000","last_became_active":"2024-09-16T01:21:25.921580+0000","last_became_peered":"2024-09-16T01:21:25.921580+0000","last_unstale":"2024-09-16T01:21:53.122501+0000","last_undegraded":"2024-09-16T01:21:53.122501+0000","last_fullsized":"2024-09-16T01:21:53.122501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.745844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094811+0000","last_change":"2024-09-16T01:21:39.094811+0000","last_active":"2024-09-16T01:21:39.094811+0000","last_peered":"2024-09-16T01:21:39.094811+0000","last_clean":"2024-09-16T01:21:39.094811+0000","last_became_active":"2024-09-16T01:21:39.094399+0000","last_became_peered":"2024-09-16T01:21:39.094399+0000","last_unstale":"2024-09-16T01:21:39.094811+0000","last_undegraded":"2024-09-16T01:21:39.094811+0000","last_fullsized":"2024-09-16T01:21:39.094811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:48.363791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.110226+0000","last_change":"2024-09-16T01:21:39.110226+0000","last_active":"2024-09-16T01:21:39.110226+0000","last_peered":"2024-09-16T01:21:39.110226+0000","last_clean":"2024-09-16T01:21:39.110226+0000","last_became_active":"2024-09-16T01:21:39.107676+0000","last_became_peered":"2024-09-16T01:21:39.107676+0000","last_unstale":"2024-09-16T01:21:39.110226+0000","last_undegraded":"2024-09-16T01:21:39.110226+0000","last_fullsized":"2024-09-16T01:21:39.110226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:57:14.854181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086856+0000","last_change":"2024-09-16T01:21:25.924434+0000","last_active":"2024-09-16T01:21:39.086856+0000","last_peered":"2024-09-16T01:21:39.086856+0000","last_clean":"2024-09-16T01:21:39.086856+0000","last_became_active":"2024-09-16T01:21:25.924092+0000","last_became_peered":"2024-09-16T01:21:25.924092+0000","last_unstale":"2024-09-16T01:21:39.086856+0000","last_undegraded":"2024-09-16T01:21:39.086856+0000","last_fullsized":"2024-09-16T01:21:39.086856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:20.956985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089603+0000","last_change":"2024-09-16T01:21:28.037273+0000","last_active":"2024-09-16T01:21:39.089603+0000","last_peered":"2024-09-16T01:21:39.089603+0000","last_clean":"2024-09-16T01:21:39.089603+0000","last_became_active":"2024-09-16T01:21:28.036958+0000","last_became_peered":"2024-09-16T01:21:28.036958+0000","last_unstale":"2024-09-16T01:21:39.089603+0000","last_undegraded":"2024-09-16T01:21:39.089603+0000","last_fullsized":"2024-09-16T01:21:39.089603+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:53.376640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088161+0000","last_change":"2024-09-16T01:21:25.923208+0000","last_active":"2024-09-16T01:21:39.088161+0000","last_peered":"2024-09-16T01:21:39.088161+0000","last_clean":"2024-09-16T01:21:39.088161+0000","last_became_active":"2024-09-16T01:21:25.922882+0000","last_became_peered":"2024-09-16T01:21:25.922882+0000","last_unstale":"2024-09-16T01:21:39.088161+0000","last_undegraded":"2024-09-16T01:21:39.088161+0000","last_fullsized":"2024-09-16T01:21:39.088161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:44.359615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088715+0000","last_change":"2024-09-16T01:21:28.035901+0000","last_active":"2024-09-16T01:21:39.088715+0000","last_peered":"2024-09-16T01:21:39.088715+0000","last_clean":"2024-09-16T01:21:39.088715+0000","last_became_active":"2024-09-16T01:21:28.035568+0000","last_became_peered":"2024-09-16T01:21:28.035568+0000","last_unstale":"2024-09-16T01:21:39.088715+0000","last_undegraded":"2024-09-16T01:21:39.088715+0000","last_fullsized":"2024-09-16T01:21:39.088715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:42.270380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:49.116093+0000","last_change":"2024-09-16T01:21:25.923692+0000","last_active":"2024-09-16T01:21:49.116093+0000","last_peered":"2024-09-16T01:21:49.116093+0000","last_clean":"2024-09-16T01:21:49.116093+0000","last_became_active":"2024-09-16T01:21:25.923325+0000","last_became_peered":"2024-09-16T01:21:25.923325+0000","last_unstale":"2024-09-16T01:21:49.116093+0000","last_undegraded":"2024-09-16T01:21:49.116093+0000","last_fullsized":"2024-09-16T01:21:49.116093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:55.075655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093337+0000","last_change":"2024-09-16T01:21:28.054697+0000","last_active":"2024-09-16T01:21:39.093337+0000","last_peered":"2024-09-16T01:21:39.093337+0000","last_clean":"2024-09-16T01:21:39.093337+0000","last_became_active":"2024-09-16T01:21:28.054416+0000","last_became_peered":"2024-09-16T01:21:28.054416+0000","last_unstale":"2024-09-16T01:21:39.093337+0000","last_undegraded":"2024-09-16T01:21:39.093337+0000","last_fullsized":"2024-09-16T01:21:39.093337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:42.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089652+0000","last_change":"2024-09-16T01:21:25.920939+0000","last_active":"2024-09-16T01:21:39.089652+0000","last_peered":"2024-09-16T01:21:39.089652+0000","last_clean":"2024-09-16T01:21:39.089652+0000","last_became_active":"2024-09-16T01:21:25.920574+0000","last_became_peered":"2024-09-16T01:21:25.920574+0000","last_unstale":"2024-09-16T01:21:39.089652+0000","last_undegraded":"2024-09-16T01:21:39.089652+0000","last_fullsized":"2024-09-16T01:21:39.089652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:15.640800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093972+0000","last_change":"2024-09-16T01:21:28.048981+0000","last_active":"2024-09-16T01:21:39.093972+0000","last_peered":"2024-09-16T01:21:39.093972+0000","last_clean":"2024-09-16T01:21:39.093972+0000","last_became_active":"2024-09-16T01:21:28.048675+0000","last_became_peered":"2024-09-16T01:21:28.048675+0000","last_unstale":"2024-09-16T01:21:39.093972+0000","last_undegraded":"2024-09-16T01:21:39.093972+0000","last_fullsized":"2024-09-16T01:21:39.093972+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:30.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088725+0000","last_change":"2024-09-16T01:21:26.660117+0000","last_active":"2024-09-16T01:21:39.088725+0000","last_peered":"2024-09-16T01:21:39.088725+0000","last_clean":"2024-09-16T01:21:39.088725+0000","last_became_active":"2024-09-16T01:21:26.659743+0000","last_became_peered":"2024-09-16T01:21:26.659743+0000","last_unstale":"2024-09-16T01:21:39.088725+0000","last_undegraded":"2024-09-16T01:21:39.088725+0000","last_fullsized":"2024-09-16T01:21:39.088725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:10.220612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092331+0000","last_change":"2024-09-16T01:21:28.051057+0000","last_active":"2024-09-16T01:21:39.092331+0000","last_peered":"2024-09-16T01:21:39.092331+0000","last_clean":"2024-09-16T01:21:39.092331+0000","last_became_active":"2024-09-16T01:21:28.050756+0000","last_became_peered":"2024-09-16T01:21:28.050756+0000","last_unstale":"2024-09-16T01:21:39.092331+0000","last_undegraded":"2024-09-16T01:21:39.092331+0000","last_fullsized":"2024-09-16T01:21:39.092331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:16.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'22","reported_seq":76,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:50.118653+0000","last_change":"2024-09-16T01:21:25.927384+0000","last_active":"2024-09-16T01:21:50.118653+0000","last_peered":"2024-09-16T01:21:50.118653+0000","last_clean":"2024-09-16T01:21:50.118653+0000","last_became_active":"2024-09-16T01:21:25.927017+0000","last_became_peered":"2024-09-16T01:21:25.927017+0000","last_unstale":"2024-09-16T01:21:50.118653+0000","last_undegraded":"2024-09-16T01:21:50.118653+0000","last_fullsized":"2024-09-16T01:21:50.118653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:03.267625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":61,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093543+0000","last_change":"2024-09-16T01:21:28.049410+0000","last_active":"2024-09-16T01:21:39.093543+0000","last_peered":"2024-09-16T01:21:39.093543+0000","last_clean":"2024-09-16T01:21:39.093543+0000","last_became_active":"2024-09-16T01:21:28.049058+0000","last_became_peered":"2024-09-16T01:21:28.049058+0000","last_unstale":"2024-09-16T01:21:39.093543+0000","last_undegraded":"2024-09-16T01:21:39.093543+0000","last_fullsized":"2024-09-16T01:21:39.093543+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091098+0000","last_change":"2024-09-16T01:21:25.922040+0000","last_active":"2024-09-16T01:21:39.091098+0000","last_peered":"2024-09-16T01:21:39.091098+0000","last_clean":"2024-09-16T01:21:39.091098+0000","last_became_active":"2024-09-16T01:21:25.921487+0000","last_became_peered":"2024-09-16T01:21:25.921487+0000","last_unstale":"2024-09-16T01:21:39.091098+0000","last_undegraded":"2024-09-16T01:21:39.091098+0000","last_fullsized":"2024-09-16T01:21:39.091098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:15.361010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086957+0000","last_change":"2024-09-16T01:21:28.043344+0000","last_active":"2024-09-16T01:21:39.086957+0000","last_peered":"2024-09-16T01:21:39.086957+0000","last_clean":"2024-09-16T01:21:39.086957+0000","last_became_active":"2024-09-16T01:21:28.042495+0000","last_became_peered":"2024-09-16T01:21:28.042495+0000","last_unstale":"2024-09-16T01:21:39.086957+0000","last_undegraded":"2024-09-16T01:21:39.086957+0000","last_fullsized":"2024-09-16T01:21:39.086957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:28.957975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087280+0000","last_change":"2024-09-16T01:21:25.924144+0000","last_active":"2024-09-16T01:21:39.087280+0000","last_peered":"2024-09-16T01:21:39.087280+0000","last_clean":"2024-09-16T01:21:39.087280+0000","last_became_active":"2024-09-16T01:21:25.923761+0000","last_became_peered":"2024-09-16T01:21:25.923761+0000","last_unstale":"2024-09-16T01:21:39.087280+0000","last_undegraded":"2024-09-16T01:21:39.087280+0000","last_fullsized":"2024-09-16T01:21:39.087280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.651575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088985+0000","last_change":"2024-09-16T01:21:28.049329+0000","last_active":"2024-09-16T01:21:39.088985+0000","last_peered":"2024-09-16T01:21:39.088985+0000","last_clean":"2024-09-16T01:21:39.088985+0000","last_became_active":"2024-09-16T01:21:28.048976+0000","last_became_peered":"2024-09-16T01:21:28.048976+0000","last_unstale":"2024-09-16T01:21:39.088985+0000","last_undegraded":"2024-09-16T01:21:39.088985+0000","last_fullsized":"2024-09-16T01:21:39.088985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:11.564388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:49.119021+0000","last_change":"2024-09-16T01:21:25.923608+0000","last_active":"2024-09-16T01:21:49.119021+0000","last_peered":"2024-09-16T01:21:49.119021+0000","last_clean":"2024-09-16T01:21:49.119021+0000","last_became_active":"2024-09-16T01:21:25.923284+0000","last_became_peered":"2024-09-16T01:21:25.923284+0000","last_unstale":"2024-09-16T01:21:49.119021+0000","last_undegraded":"2024-09-16T01:21:49.119021+0000","last_fullsized":"2024-09-16T01:21:49.119021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:41.195014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091872+0000","last_change":"2024-09-16T01:21:39.091872+0000","last_active":"2024-09-16T01:21:39.091872+0000","last_peered":"2024-09-16T01:21:39.091872+0000","last_clean":"2024-09-16T01:21:39.091872+0000","last_became_active":"2024-09-16T01:21:39.091480+0000","last_became_peered":"2024-09-16T01:21:39.091480+0000","last_unstale":"2024-09-16T01:21:39.091872+0000","last_undegraded":"2024-09-16T01:21:39.091872+0000","last_fullsized":"2024-09-16T01:21:39.091872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:23.606447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092805+0000","last_change":"2024-09-16T01:21:26.661446+0000","last_active":"2024-09-16T01:21:39.092805+0000","last_peered":"2024-09-16T01:21:39.092805+0000","last_clean":"2024-09-16T01:21:39.092805+0000","last_became_active":"2024-09-16T01:21:26.661047+0000","last_became_peered":"2024-09-16T01:21:26.661047+0000","last_unstale":"2024-09-16T01:21:39.092805+0000","last_undegraded":"2024-09-16T01:21:39.092805+0000","last_fullsized":"2024-09-16T01:21:39.092805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:22.983581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087298+0000","last_change":"2024-09-16T01:21:28.054663+0000","last_active":"2024-09-16T01:21:39.087298+0000","last_peered":"2024-09-16T01:21:39.087298+0000","last_clean":"2024-09-16T01:21:39.087298+0000","last_became_active":"2024-09-16T01:21:28.054350+0000","last_became_peered":"2024-09-16T01:21:28.054350+0000","last_unstale":"2024-09-16T01:21:39.087298+0000","last_undegraded":"2024-09-16T01:21:39.087298+0000","last_fullsized":"2024-09-16T01:21:39.087298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:22.963709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094004+0000","last_change":"2024-09-16T01:21:25.921910+0000","last_active":"2024-09-16T01:21:39.094004+0000","last_peered":"2024-09-16T01:21:39.094004+0000","last_clean":"2024-09-16T01:21:39.094004+0000","last_became_active":"2024-09-16T01:21:25.921578+0000","last_became_peered":"2024-09-16T01:21:25.921578+0000","last_unstale":"2024-09-16T01:21:39.094004+0000","last_undegraded":"2024-09-16T01:21:39.094004+0000","last_fullsized":"2024-09-16T01:21:39.094004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:20.210397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089644+0000","last_change":"2024-09-16T01:21:28.049953+0000","last_active":"2024-09-16T01:21:39.089644+0000","last_peered":"2024-09-16T01:21:39.089644+0000","last_clean":"2024-09-16T01:21:39.089644+0000","last_became_active":"2024-09-16T01:21:28.049450+0000","last_became_peered":"2024-09-16T01:21:28.049450+0000","last_unstale":"2024-09-16T01:21:39.089644+0000","last_undegraded":"2024-09-16T01:21:39.089644+0000","last_fullsized":"2024-09-16T01:21:39.089644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:49.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.098150+0000","last_change":"2024-09-16T01:21:39.098150+0000","last_active":"2024-09-16T01:21:39.098150+0000","last_peered":"2024-09-16T01:21:39.098150+0000","last_clean":"2024-09-16T01:21:39.098150+0000","last_became_active":"2024-09-16T01:21:39.094297+0000","last_became_peered":"2024-09-16T01:21:39.094297+0000","last_unstale":"2024-09-16T01:21:39.098150+0000","last_undegraded":"2024-09-16T01:21:39.098150+0000","last_fullsized":"2024-09-16T01:21:39.098150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:30:25.297230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091018+0000","last_change":"2024-09-16T01:21:28.053920+0000","last_active":"2024-09-16T01:21:39.091018+0000","last_peered":"2024-09-16T01:21:39.091018+0000","last_clean":"2024-09-16T01:21:39.091018+0000","last_became_active":"2024-09-16T01:21:28.053397+0000","last_became_peered":"2024-09-16T01:21:28.053397+0000","last_unstale":"2024-09-16T01:21:39.091018+0000","last_undegraded":"2024-09-16T01:21:39.091018+0000","last_fullsized":"2024-09-16T01:21:39.091018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:27.079374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088854+0000","last_change":"2024-09-16T01:21:25.920527+0000","last_active":"2024-09-16T01:21:39.088854+0000","last_peered":"2024-09-16T01:21:39.088854+0000","last_clean":"2024-09-16T01:21:39.088854+0000","last_became_active":"2024-09-16T01:21:25.920162+0000","last_became_peered":"2024-09-16T01:21:25.920162+0000","last_unstale":"2024-09-16T01:21:39.088854+0000","last_undegraded":"2024-09-16T01:21:39.088854+0000","last_fullsized":"2024-09-16T01:21:39.088854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:31.995141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089348+0000","last_change":"2024-09-16T01:21:28.050068+0000","last_active":"2024-09-16T01:21:39.089348+0000","last_peered":"2024-09-16T01:21:39.089348+0000","last_clean":"2024-09-16T01:21:39.089348+0000","last_became_active":"2024-09-16T01:21:28.049678+0000","last_became_peered":"2024-09-16T01:21:28.049678+0000","last_unstale":"2024-09-16T01:21:39.089348+0000","last_undegraded":"2024-09-16T01:21:39.089348+0000","last_fullsized":"2024-09-16T01:21:39.089348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:57.870550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091065+0000","last_change":"2024-09-16T01:21:26.663670+0000","last_active":"2024-09-16T01:21:39.091065+0000","last_peered":"2024-09-16T01:21:39.091065+0000","last_clean":"2024-09-16T01:21:39.091065+0000","last_became_active":"2024-09-16T01:21:26.663173+0000","last_became_peered":"2024-09-16T01:21:26.663173+0000","last_unstale":"2024-09-16T01:21:39.091065+0000","last_undegraded":"2024-09-16T01:21:39.091065+0000","last_fullsized":"2024-09-16T01:21:39.091065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:01.747039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089528+0000","last_change":"2024-09-16T01:21:28.053354+0000","last_active":"2024-09-16T01:21:39.089528+0000","last_peered":"2024-09-16T01:21:39.089528+0000","last_clean":"2024-09-16T01:21:39.089528+0000","last_became_active":"2024-09-16T01:21:28.052985+0000","last_became_peered":"2024-09-16T01:21:28.052985+0000","last_unstale":"2024-09-16T01:21:39.089528+0000","last_undegraded":"2024-09-16T01:21:39.089528+0000","last_fullsized":"2024-09-16T01:21:39.089528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:09.360220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":337,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:20:14.084036+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:20:14.083552+0000","last_became_peered":"2024-09-16T01:20:14.083552+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_clean_scrub_stamp":"2024-09-16T01:16:51.922126+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:37.598878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106614+0000","last_change":"2024-09-16T01:21:25.923170+0000","last_active":"2024-09-16T01:21:39.106614+0000","last_peered":"2024-09-16T01:21:39.106614+0000","last_clean":"2024-09-16T01:21:39.106614+0000","last_became_active":"2024-09-16T01:21:25.922555+0000","last_became_peered":"2024-09-16T01:21:25.922555+0000","last_unstale":"2024-09-16T01:21:39.106614+0000","last_undegraded":"2024-09-16T01:21:39.106614+0000","last_fullsized":"2024-09-16T01:21:39.106614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:14.948264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094536+0000","last_change":"2024-09-16T01:21:39.093752+0000","last_active":"2024-09-16T01:21:39.094536+0000","last_peered":"2024-09-16T01:21:39.094536+0000","last_clean":"2024-09-16T01:21:39.094536+0000","last_became_active":"2024-09-16T01:21:39.093394+0000","last_became_peered":"2024-09-16T01:21:39.093394+0000","last_unstale":"2024-09-16T01:21:39.094536+0000","last_undegraded":"2024-09-16T01:21:39.094536+0000","last_fullsized":"2024-09-16T01:21:39.094536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:32.703408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:21:25.925009+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:21:25.924661+0000","last_became_peered":"2024-09-16T01:21:25.924661+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.703241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086849+0000","last_change":"2024-09-16T01:21:28.045745+0000","last_active":"2024-09-16T01:21:39.086849+0000","last_peered":"2024-09-16T01:21:39.086849+0000","last_clean":"2024-09-16T01:21:39.086849+0000","last_became_active":"2024-09-16T01:21:28.045398+0000","last_became_peered":"2024-09-16T01:21:28.045398+0000","last_unstale":"2024-09-16T01:21:39.086849+0000","last_undegraded":"2024-09-16T01:21:39.086849+0000","last_fullsized":"2024-09-16T01:21:39.086849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:17.422858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:49.118472+0000","last_change":"2024-09-16T01:21:26.660859+0000","last_active":"2024-09-16T01:21:49.118472+0000","last_peered":"2024-09-16T01:21:49.118472+0000","last_clean":"2024-09-16T01:21:49.118472+0000","last_became_active":"2024-09-16T01:21:26.660515+0000","last_became_peered":"2024-09-16T01:21:26.660515+0000","last_unstale":"2024-09-16T01:21:49.118472+0000","last_undegraded":"2024-09-16T01:21:49.118472+0000","last_fullsized":"2024-09-16T01:21:49.118472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:57.301546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092617+0000","last_change":"2024-09-16T01:21:39.092617+0000","last_active":"2024-09-16T01:21:39.092617+0000","last_peered":"2024-09-16T01:21:39.092617+0000","last_clean":"2024-09-16T01:21:39.092617+0000","last_became_active":"2024-09-16T01:21:39.092212+0000","last_became_peered":"2024-09-16T01:21:39.092212+0000","last_unstale":"2024-09-16T01:21:39.092617+0000","last_undegraded":"2024-09-16T01:21:39.092617+0000","last_fullsized":"2024-09-16T01:21:39.092617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.894975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089151+0000","last_change":"2024-09-16T01:21:25.924485+0000","last_active":"2024-09-16T01:21:39.089151+0000","last_peered":"2024-09-16T01:21:39.089151+0000","last_clean":"2024-09-16T01:21:39.089151+0000","last_became_active":"2024-09-16T01:21:25.924075+0000","last_became_peered":"2024-09-16T01:21:25.924075+0000","last_unstale":"2024-09-16T01:21:39.089151+0000","last_undegraded":"2024-09-16T01:21:39.089151+0000","last_fullsized":"2024-09-16T01:21:39.089151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:13.034668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090273+0000","last_change":"2024-09-16T01:21:28.048152+0000","last_active":"2024-09-16T01:21:39.090273+0000","last_peered":"2024-09-16T01:21:39.090273+0000","last_clean":"2024-09-16T01:21:39.090273+0000","last_became_active":"2024-09-16T01:21:28.047818+0000","last_became_peered":"2024-09-16T01:21:28.047818+0000","last_unstale":"2024-09-16T01:21:39.090273+0000","last_undegraded":"2024-09-16T01:21:39.090273+0000","last_fullsized":"2024-09-16T01:21:39.090273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:19.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089286+0000","last_change":"2024-09-16T01:21:26.660336+0000","last_active":"2024-09-16T01:21:39.089286+0000","last_peered":"2024-09-16T01:21:39.089286+0000","last_clean":"2024-09-16T01:21:39.089286+0000","last_became_active":"2024-09-16T01:21:26.660005+0000","last_became_peered":"2024-09-16T01:21:26.660005+0000","last_unstale":"2024-09-16T01:21:39.089286+0000","last_undegraded":"2024-09-16T01:21:39.089286+0000","last_fullsized":"2024-09-16T01:21:39.089286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:37.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090412+0000","last_change":"2024-09-16T01:21:28.043112+0000","last_active":"2024-09-16T01:21:39.090412+0000","last_peered":"2024-09-16T01:21:39.090412+0000","last_clean":"2024-09-16T01:21:39.090412+0000","last_became_active":"2024-09-16T01:21:28.042752+0000","last_became_peered":"2024-09-16T01:21:28.042752+0000","last_unstale":"2024-09-16T01:21:39.090412+0000","last_undegraded":"2024-09-16T01:21:39.090412+0000","last_fullsized":"2024-09-16T01:21:39.090412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:57.379826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093748+0000","last_change":"2024-09-16T01:21:26.661003+0000","last_active":"2024-09-16T01:21:39.093748+0000","last_peered":"2024-09-16T01:21:39.093748+0000","last_clean":"2024-09-16T01:21:39.093748+0000","last_became_active":"2024-09-16T01:21:26.660407+0000","last_became_peered":"2024-09-16T01:21:26.660407+0000","last_unstale":"2024-09-16T01:21:39.093748+0000","last_undegraded":"2024-09-16T01:21:39.093748+0000","last_fullsized":"2024-09-16T01:21:39.093748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:52.229473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087273+0000","last_change":"2024-09-16T01:21:28.046938+0000","last_active":"2024-09-16T01:21:39.087273+0000","last_peered":"2024-09-16T01:21:39.087273+0000","last_clean":"2024-09-16T01:21:39.087273+0000","last_became_active":"2024-09-16T01:21:28.046620+0000","last_became_peered":"2024-09-16T01:21:28.046620+0000","last_unstale":"2024-09-16T01:21:39.087273+0000","last_undegraded":"2024-09-16T01:21:39.087273+0000","last_fullsized":"2024-09-16T01:21:39.087273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:04.845341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:51.037077+0000","last_change":"2024-09-16T01:21:25.915315+0000","last_active":"2024-09-16T01:21:51.037077+0000","last_peered":"2024-09-16T01:21:51.037077+0000","last_clean":"2024-09-16T01:21:51.037077+0000","last_became_active":"2024-09-16T01:21:25.915001+0000","last_became_peered":"2024-09-16T01:21:25.915001+0000","last_unstale":"2024-09-16T01:21:51.037077+0000","last_undegraded":"2024-09-16T01:21:51.037077+0000","last_fullsized":"2024-09-16T01:21:51.037077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:30.163050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089535+0000","last_change":"2024-09-16T01:21:28.047157+0000","last_active":"2024-09-16T01:21:39.089535+0000","last_peered":"2024-09-16T01:21:39.089535+0000","last_clean":"2024-09-16T01:21:39.089535+0000","last_became_active":"2024-09-16T01:21:28.046583+0000","last_became_peered":"2024-09-16T01:21:28.046583+0000","last_unstale":"2024-09-16T01:21:39.089535+0000","last_undegraded":"2024-09-16T01:21:39.089535+0000","last_fullsized":"2024-09-16T01:21:39.089535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:47.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106885+0000","last_change":"2024-09-16T01:21:26.663047+0000","last_active":"2024-09-16T01:21:39.106885+0000","last_peered":"2024-09-16T01:21:39.106885+0000","last_clean":"2024-09-16T01:21:39.106885+0000","last_became_active":"2024-09-16T01:21:26.662627+0000","last_became_peered":"2024-09-16T01:21:26.662627+0000","last_unstale":"2024-09-16T01:21:39.106885+0000","last_undegraded":"2024-09-16T01:21:39.106885+0000","last_fullsized":"2024-09-16T01:21:39.106885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:59.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093738+0000","last_change":"2024-09-16T01:21:28.046954+0000","last_active":"2024-09-16T01:21:39.093738+0000","last_peered":"2024-09-16T01:21:39.093738+0000","last_clean":"2024-09-16T01:21:39.093738+0000","last_became_active":"2024-09-16T01:21:28.046550+0000","last_became_peered":"2024-09-16T01:21:28.046550+0000","last_unstale":"2024-09-16T01:21:39.093738+0000","last_undegraded":"2024-09-16T01:21:39.093738+0000","last_fullsized":"2024-09-16T01:21:39.093738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:30.880672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.100910+0000","last_change":"2024-09-16T01:21:39.100910+0000","last_active":"2024-09-16T01:21:39.100910+0000","last_peered":"2024-09-16T01:21:39.100910+0000","last_clean":"2024-09-16T01:21:39.100910+0000","last_became_active":"2024-09-16T01:21:39.095257+0000","last_became_peered":"2024-09-16T01:21:39.095257+0000","last_unstale":"2024-09-16T01:21:39.100910+0000","last_undegraded":"2024-09-16T01:21:39.100910+0000","last_fullsized":"2024-09-16T01:21:39.100910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:17.957295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092774+0000","last_change":"2024-09-16T01:21:28.052061+0000","last_active":"2024-09-16T01:21:39.092774+0000","last_peered":"2024-09-16T01:21:39.092774+0000","last_clean":"2024-09-16T01:21:39.092774+0000","last_became_active":"2024-09-16T01:21:28.051705+0000","last_became_peered":"2024-09-16T01:21:28.051705+0000","last_unstale":"2024-09-16T01:21:39.092774+0000","last_undegraded":"2024-09-16T01:21:39.092774+0000","last_fullsized":"2024-09-16T01:21:39.092774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:05.546846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090258+0000","last_change":"2024-09-16T01:21:25.921635+0000","last_active":"2024-09-16T01:21:39.090258+0000","last_peered":"2024-09-16T01:21:39.090258+0000","last_clean":"2024-09-16T01:21:39.090258+0000","last_became_active":"2024-09-16T01:21:25.921281+0000","last_became_peered":"2024-09-16T01:21:25.921281+0000","last_unstale":"2024-09-16T01:21:39.090258+0000","last_undegraded":"2024-09-16T01:21:39.090258+0000","last_fullsized":"2024-09-16T01:21:39.090258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:02.933803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089886+0000","last_change":"2024-09-16T01:21:28.043636+0000","last_active":"2024-09-16T01:21:39.089886+0000","last_peered":"2024-09-16T01:21:39.089886+0000","last_clean":"2024-09-16T01:21:39.089886+0000","last_became_active":"2024-09-16T01:21:28.043273+0000","last_became_peered":"2024-09-16T01:21:28.043273+0000","last_unstale":"2024-09-16T01:21:39.089886+0000","last_undegraded":"2024-09-16T01:21:39.089886+0000","last_fullsized":"2024-09-16T01:21:39.089886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:05.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090771+0000","last_change":"2024-09-16T01:21:25.917934+0000","last_active":"2024-09-16T01:21:39.090771+0000","last_peered":"2024-09-16T01:21:39.090771+0000","last_clean":"2024-09-16T01:21:39.090771+0000","last_became_active":"2024-09-16T01:21:25.917545+0000","last_became_peered":"2024-09-16T01:21:25.917545+0000","last_unstale":"2024-09-16T01:21:39.090771+0000","last_undegraded":"2024-09-16T01:21:39.090771+0000","last_fullsized":"2024-09-16T01:21:39.090771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:07.119546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089851+0000","last_change":"2024-09-16T01:21:28.043270+0000","last_active":"2024-09-16T01:21:39.089851+0000","last_peered":"2024-09-16T01:21:39.089851+0000","last_clean":"2024-09-16T01:21:39.089851+0000","last_became_active":"2024-09-16T01:21:28.042957+0000","last_became_peered":"2024-09-16T01:21:28.042957+0000","last_unstale":"2024-09-16T01:21:39.089851+0000","last_undegraded":"2024-09-16T01:21:39.089851+0000","last_fullsized":"2024-09-16T01:21:39.089851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:11.052387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093263+0000","last_change":"2024-09-16T01:21:25.923224+0000","last_active":"2024-09-16T01:21:39.093263+0000","last_peered":"2024-09-16T01:21:39.093263+0000","last_clean":"2024-09-16T01:21:39.093263+0000","last_became_active":"2024-09-16T01:21:25.922873+0000","last_became_peered":"2024-09-16T01:21:25.922873+0000","last_unstale":"2024-09-16T01:21:39.093263+0000","last_undegraded":"2024-09-16T01:21:39.093263+0000","last_fullsized":"2024-09-16T01:21:39.093263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:14.747752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088910+0000","last_change":"2024-09-16T01:21:28.054706+0000","last_active":"2024-09-16T01:21:39.088910+0000","last_peered":"2024-09-16T01:21:39.088910+0000","last_clean":"2024-09-16T01:21:39.088910+0000","last_became_active":"2024-09-16T01:21:28.054382+0000","last_became_peered":"2024-09-16T01:21:28.054382+0000","last_unstale":"2024-09-16T01:21:39.088910+0000","last_undegraded":"2024-09-16T01:21:39.088910+0000","last_fullsized":"2024-09-16T01:21:39.088910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.908252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088713+0000","last_change":"2024-09-16T01:21:28.051807+0000","last_active":"2024-09-16T01:21:39.088713+0000","last_peered":"2024-09-16T01:21:39.088713+0000","last_clean":"2024-09-16T01:21:39.088713+0000","last_became_active":"2024-09-16T01:21:28.051474+0000","last_became_peered":"2024-09-16T01:21:28.051474+0000","last_unstale":"2024-09-16T01:21:39.088713+0000","last_undegraded":"2024-09-16T01:21:39.088713+0000","last_fullsized":"2024-09-16T01:21:39.088713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:48.006691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.101161+0000","last_change":"2024-09-16T01:21:39.100723+0000","last_active":"2024-09-16T01:21:39.101161+0000","last_peered":"2024-09-16T01:21:39.101161+0000","last_clean":"2024-09-16T01:21:39.101161+0000","last_became_active":"2024-09-16T01:21:39.094895+0000","last_became_peered":"2024-09-16T01:21:39.094895+0000","last_unstale":"2024-09-16T01:21:39.101161+0000","last_undegraded":"2024-09-16T01:21:39.101161+0000","last_fullsized":"2024-09-16T01:21:39.101161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.663815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092318+0000","last_change":"2024-09-16T01:21:28.055506+0000","last_active":"2024-09-16T01:21:39.092318+0000","last_peered":"2024-09-16T01:21:39.092318+0000","last_clean":"2024-09-16T01:21:39.092318+0000","last_became_active":"2024-09-16T01:21:28.055167+0000","last_became_peered":"2024-09-16T01:21:28.055167+0000","last_unstale":"2024-09-16T01:21:39.092318+0000","last_undegraded":"2024-09-16T01:21:39.092318+0000","last_fullsized":"2024-09-16T01:21:39.092318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:38.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093642+0000","last_change":"2024-09-16T01:21:25.920611+0000","last_active":"2024-09-16T01:21:39.093642+0000","last_peered":"2024-09-16T01:21:39.093642+0000","last_clean":"2024-09-16T01:21:39.093642+0000","last_became_active":"2024-09-16T01:21:25.920255+0000","last_became_peered":"2024-09-16T01:21:25.920255+0000","last_unstale":"2024-09-16T01:21:39.093642+0000","last_undegraded":"2024-09-16T01:21:39.093642+0000","last_fullsized":"2024-09-16T01:21:39.093642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:17.268621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093932+0000","last_change":"2024-09-16T01:21:28.054009+0000","last_active":"2024-09-16T01:21:39.093932+0000","last_peered":"2024-09-16T01:21:39.093932+0000","last_clean":"2024-09-16T01:21:39.093932+0000","last_became_active":"2024-09-16T01:21:28.053631+0000","last_became_peered":"2024-09-16T01:21:28.053631+0000","last_unstale":"2024-09-16T01:21:39.093932+0000","last_undegraded":"2024-09-16T01:21:39.093932+0000","last_fullsized":"2024-09-16T01:21:39.093932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:28.298398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090095+0000","last_change":"2024-09-16T01:21:26.659753+0000","last_active":"2024-09-16T01:21:39.090095+0000","last_peered":"2024-09-16T01:21:39.090095+0000","last_clean":"2024-09-16T01:21:39.090095+0000","last_became_active":"2024-09-16T01:21:26.659343+0000","last_became_peered":"2024-09-16T01:21:26.659343+0000","last_unstale":"2024-09-16T01:21:39.090095+0000","last_undegraded":"2024-09-16T01:21:39.090095+0000","last_fullsized":"2024-09-16T01:21:39.090095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:47.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089898+0000","last_change":"2024-09-16T01:21:28.050748+0000","last_active":"2024-09-16T01:21:39.089898+0000","last_peered":"2024-09-16T01:21:39.089898+0000","last_clean":"2024-09-16T01:21:39.089898+0000","last_became_active":"2024-09-16T01:21:28.050457+0000","last_became_peered":"2024-09-16T01:21:28.050457+0000","last_unstale":"2024-09-16T01:21:39.089898+0000","last_undegraded":"2024-09-16T01:21:39.089898+0000","last_fullsized":"2024-09-16T01:21:39.089898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:21.552080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089346+0000","last_change":"2024-09-16T01:21:25.924505+0000","last_active":"2024-09-16T01:21:39.089346+0000","last_peered":"2024-09-16T01:21:39.089346+0000","last_clean":"2024-09-16T01:21:39.089346+0000","last_became_active":"2024-09-16T01:21:25.924076+0000","last_became_peered":"2024-09-16T01:21:25.924076+0000","last_unstale":"2024-09-16T01:21:39.089346+0000","last_undegraded":"2024-09-16T01:21:39.089346+0000","last_fullsized":"2024-09-16T01:21:39.089346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:00.630772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":51198,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":108,"num_read_kb":107,"num_write":154,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":153594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282677,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514514,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":441274,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1044480,"data_stored":1079950,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441510,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135905,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441430,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364837,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1033755,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528363,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":440899,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1033046,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920821,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":441729,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":441210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":489237,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":487494,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":929792,"data_stored":442170,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:21:56.276 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T01:21:56.277 INFO:tasks.cephadm:Setting up client nodes... 2024-09-16T01:21:56.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-16T01:21:56.534 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.060+0000 7f9e79268640 1 -- 172.21.15.63:0/192529301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e74100ad0 msgr2=0x7f9e74100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.060+0000 7f9e79268640 1 --2- 172.21.15.63:0/192529301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e74100ad0 0x7f9e74100ed0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009900 tx=0x7f9e6402a410 comp rx=0 tx=0).stop 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.060+0000 7f9e79268640 1 -- 172.21.15.63:0/192529301 shutdown_connections 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.060+0000 7f9e79268640 1 --2- 172.21.15.63:0/192529301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74102690 0x7f9e74108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.060+0000 7f9e79268640 1 --2- 172.21.15.63:0/192529301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e74101cd0 0x7f9e74102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.060+0000 7f9e79268640 1 --2- 172.21.15.63:0/192529301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e74100ad0 0x7f9e74100ed0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.060+0000 7f9e79268640 1 -- 172.21.15.63:0/192529301 >> 172.21.15.63:0/192529301 conn(0x7f9e740fc280 msgr2=0x7f9e740fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.060+0000 7f9e79268640 1 -- 172.21.15.63:0/192529301 shutdown_connections 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.060+0000 7f9e79268640 1 -- 172.21.15.63:0/192529301 wait complete. 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e79268640 1 Processor -- start 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e79268640 1 -- start start 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e79268640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e74100ad0 0x7f9e7410b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e79268640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e74101cd0 0x7f9e74109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e79268640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74102690 0x7f9e74109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e79268640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7410d7f0 con 0x7f9e74100ad0 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e79268640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7410d670 con 0x7f9e74101cd0 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e79268640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7410d970 con 0x7f9e74102690 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e74100ad0 0x7f9e7410b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e72ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e74100ad0 0x7f9e7410b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42550/0 (socket says 172.21.15.63:42550) 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e72ffd640 1 -- 172.21.15.63:0/2911826055 learned_addr learned my addr 172.21.15.63:0/2911826055 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e6bfff640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e74101cd0 0x7f9e74109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.061+0000 7f9e737fe640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74102690 0x7f9e74109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e72ffd640 1 -- 172.21.15.63:0/2911826055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74102690 msgr2=0x7f9e74109fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e72ffd640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74102690 0x7f9e74109fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e72ffd640 1 -- 172.21.15.63:0/2911826055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e74101cd0 msgr2=0x7f9e74109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e72ffd640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e74101cd0 0x7f9e74109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e72ffd640 1 -- 172.21.15.63:0/2911826055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7410a8a0 con 0x7f9e74100ad0 2024-09-16T01:21:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e72ffd640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e74100ad0 0x7f9e7410b450 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009230 tx=0x7f9e64004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e70ff9640 1 -- 172.21.15.63:0/2911826055 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6403f030 con 0x7f9e74100ad0 2024-09-16T01:21:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e70ff9640 1 -- 172.21.15.63:0/2911826055 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e64003cb0 con 0x7f9e74100ad0 2024-09-16T01:21:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e79268640 1 -- 172.21.15.63:0/2911826055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e741a20b0 con 0x7f9e74100ad0 2024-09-16T01:21:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e70ff9640 1 -- 172.21.15.63:0/2911826055 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64035070 con 0x7f9e74100ad0 2024-09-16T01:21:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.062+0000 7f9e79268640 1 -- 172.21.15.63:0/2911826055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e741a25e0 con 0x7f9e74100ad0 2024-09-16T01:21:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.063+0000 7f9e79268640 1 -- 172.21.15.63:0/2911826055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e74108010 con 0x7f9e74100ad0 2024-09-16T01:21:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.064+0000 7f9e70ff9640 1 -- 172.21.15.63:0/2911826055 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9e64042030 con 0x7f9e74100ad0 2024-09-16T01:21:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.065+0000 7f9e70ff9640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e600a32d0 0x7f9e600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.065+0000 7f9e70ff9640 1 -- 172.21.15.63:0/2911826055 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f9e640effa0 con 0x7f9e74100ad0 2024-09-16T01:21:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.065+0000 7f9e6bfff640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e600a32d0 0x7f9e600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.065+0000 7f9e6bfff640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e600a32d0 0x7f9e600a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e7410b1d0 tx=0x7f9e5c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:57.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.069+0000 7f9e70ff9640 1 -- 172.21.15.63:0/2911826055 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e640bcc20 con 0x7f9e74100ad0 2024-09-16T01:21:57.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.309+0000 7f9e79268640 1 -- 172.21.15.63:0/2911826055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f9e7402d7c0 con 0x7f9e74100ad0 2024-09-16T01:21:57.311 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:57 smithi063 ceph-mon[31070]: pgmap v293: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-16T01:21:57.311 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:57 smithi063 ceph-mon[31070]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:21:57.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.314+0000 7f9e70ff9640 1 -- 172.21.15.63:0/2911826055 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f9e640bc520 con 0x7f9e74100ad0 2024-09-16T01:21:57.315 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-09-16T01:21:57.315 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQA1iOdm+xCLEhAArx4M9euZEMakxcJ0jkQJ1g== 2024-09-16T01:21:57.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 -- 172.21.15.63:0/2911826055 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e600a32d0 msgr2=0x7f9e600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:57.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e600a32d0 0x7f9e600a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e7410b1d0 tx=0x7f9e5c009110 comp rx=0 tx=0).stop 2024-09-16T01:21:57.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 -- 172.21.15.63:0/2911826055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e74100ad0 msgr2=0x7f9e7410b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:57.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e74100ad0 0x7f9e7410b450 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009230 tx=0x7f9e64004340 comp rx=0 tx=0).stop 2024-09-16T01:21:57.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 -- 172.21.15.63:0/2911826055 shutdown_connections 2024-09-16T01:21:57.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e600a32d0 0x7f9e600a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74102690 0x7f9e74109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e74101cd0 0x7f9e74109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 --2- 172.21.15.63:0/2911826055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e74100ad0 0x7f9e7410b450 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 -- 172.21.15.63:0/2911826055 >> 172.21.15.63:0/2911826055 conn(0x7f9e740fc280 msgr2=0x7f9e741051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:57.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 -- 172.21.15.63:0/2911826055 shutdown_connections 2024-09-16T01:21:57.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:57.316+0000 7f9e79268640 1 -- 172.21.15.63:0/2911826055 wait complete. 2024-09-16T01:21:57.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:57 smithi192 ceph-mon[34775]: pgmap v293: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-16T01:21:57.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:57 smithi192 ceph-mon[34775]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:21:57.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:57 smithi162 ceph-mon[34539]: pgmap v293: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-16T01:21:57.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:57 smithi162 ceph-mon[34539]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:21:58.098 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:21:58.098 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-16T01:21:58.098 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T01:21:58.140 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T01:21:58.140 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-16T01:21:58.140 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-16T01:21:58.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:58 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2911826055' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T01:21:58.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:58 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2911826055' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T01:21:58.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:58 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2911826055' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T01:21:58.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:58 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2911826055' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T01:21:58.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:58 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2911826055' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T01:21:58.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:58 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2911826055' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T01:21:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:21:58.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.916+0000 7fd4d6e49640 1 -- 172.21.15.63:0/3383400220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4d0102570 msgr2=0x7fd4d01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.916+0000 7fd4d6e49640 1 --2- 172.21.15.63:0/3383400220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4d0102570 0x7fd4d01029b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009900 tx=0x7fd4bc02a480 comp rx=0 tx=0).stop 2024-09-16T01:21:58.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.916+0000 7fd4d6e49640 1 -- 172.21.15.63:0/3383400220 shutdown_connections 2024-09-16T01:21:58.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.916+0000 7fd4d6e49640 1 --2- 172.21.15.63:0/3383400220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d0102ef0 0x7fd4d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.916+0000 7fd4d6e49640 1 --2- 172.21.15.63:0/3383400220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4d0102570 0x7fd4d01029b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.916+0000 7fd4d6e49640 1 --2- 172.21.15.63:0/3383400220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0100e20 0x7fd4d0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.916+0000 7fd4d6e49640 1 -- 172.21.15.63:0/3383400220 >> 172.21.15.63:0/3383400220 conn(0x7fd4d00fc7d0 msgr2=0x7fd4d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.916+0000 7fd4d6e49640 1 -- 172.21.15.63:0/3383400220 shutdown_connections 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.916+0000 7fd4d6e49640 1 -- 172.21.15.63:0/3383400220 wait complete. 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d6e49640 1 Processor -- start 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d6e49640 1 -- start start 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d6e49640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d0100e20 0x7fd4d00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d6e49640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4d0102570 0x7fd4d00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d6e49640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0102ef0 0x7fd4d00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d6e49640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d0110e50 con 0x7fd4d0102570 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d6e49640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d0110cd0 con 0x7fd4d0102ef0 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d6e49640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d0110fd0 con 0x7fd4d0100e20 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4cffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4d0102570 0x7fd4d00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4cffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4d0102570 0x7fd4d00fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35730/0 (socket says 172.21.15.63:35730) 2024-09-16T01:21:58.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4cffff640 1 -- 172.21.15.63:0/2443957991 learned_addr learned my addr 172.21.15.63:0/2443957991 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d53e6640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0102ef0 0x7fd4d00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4cffff640 1 -- 172.21.15.63:0/2443957991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d0100e20 msgr2=0x7fd4d00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d4be5640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d0100e20 0x7fd4d00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4cffff640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d0100e20 0x7fd4d00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4cffff640 1 -- 172.21.15.63:0/2443957991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0102ef0 msgr2=0x7fd4d00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4cffff640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0102ef0 0x7fd4d00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4cffff640 1 -- 172.21.15.63:0/2443957991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d01a6940 con 0x7fd4d0102570 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d4be5640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d0100e20 0x7fd4d00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.917+0000 7fd4d53e6640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0102ef0 0x7fd4d00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.918+0000 7fd4cffff640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4d0102570 0x7fd4d00fd1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc006010 tx=0x7fd4bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.918+0000 7fd4cdffb640 1 -- 172.21.15.63:0/2443957991 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc03f030 con 0x7fd4d0102570 2024-09-16T01:21:58.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.918+0000 7fd4d6e49640 1 -- 172.21.15.63:0/2443957991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d01a6bd0 con 0x7fd4d0102570 2024-09-16T01:21:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.918+0000 7fd4cdffb640 1 -- 172.21.15.63:0/2443957991 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd4bc003cb0 con 0x7fd4d0102570 2024-09-16T01:21:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.918+0000 7fd4cdffb640 1 -- 172.21.15.63:0/2443957991 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc035070 con 0x7fd4d0102570 2024-09-16T01:21:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.918+0000 7fd4d6e49640 1 -- 172.21.15.63:0/2443957991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d01a70b0 con 0x7fd4d0102570 2024-09-16T01:21:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.919+0000 7fd4d6e49640 1 -- 172.21.15.63:0/2443957991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d0101200 con 0x7fd4d0102570 2024-09-16T01:21:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.920+0000 7fd4cdffb640 1 -- 172.21.15.63:0/2443957991 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd4bc042030 con 0x7fd4d0102570 2024-09-16T01:21:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.921+0000 7fd4cdffb640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd4c00a32d0 0x7fd4c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.921+0000 7fd4d4be5640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd4c00a32d0 0x7fd4c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.921+0000 7fd4cdffb640 1 -- 172.21.15.63:0/2443957991 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd4bc0f0020 con 0x7fd4d0102570 2024-09-16T01:21:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.921+0000 7fd4d4be5640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd4c00a32d0 0x7fd4c00a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4005d00 tx=0x7fd4c4009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:58.925+0000 7fd4cdffb640 1 -- 172.21.15.63:0/2443957991 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4bc0bcbe0 con 0x7fd4d0102570 2024-09-16T01:21:59.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:21:59 smithi063 ceph-mon[31070]: pgmap v294: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-09-16T01:21:59.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.149+0000 7fd4d6e49640 1 -- 172.21.15.63:0/2443957991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd4d010a0d0 con 0x7fd4d0102570 2024-09-16T01:21:59.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.154+0000 7fd4cdffb640 1 -- 172.21.15.63:0/2443957991 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264048 (secure 0 0 0) 0x7fd4bc0bc4e0 con 0x7fd4d0102570 2024-09-16T01:21:59.159 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:21:59.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 -- 172.21.15.63:0/2443957991 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd4c00a32d0 msgr2=0x7fd4c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:59.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd4c00a32d0 0x7fd4c00a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4005d00 tx=0x7fd4c4009550 comp rx=0 tx=0).stop 2024-09-16T01:21:59.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 -- 172.21.15.63:0/2443957991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4d0102570 msgr2=0x7fd4d00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:59.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4d0102570 0x7fd4d00fd1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc006010 tx=0x7fd4bc0042f0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 -- 172.21.15.63:0/2443957991 shutdown_connections 2024-09-16T01:21:59.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd4c00a32d0 0x7fd4c00a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4d0102ef0 0x7fd4d00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4d0102570 0x7fd4d00fd1c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 --2- 172.21.15.63:0/2443957991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4d0100e20 0x7fd4d00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 -- 172.21.15.63:0/2443957991 >> 172.21.15.63:0/2443957991 conn(0x7fd4d00fc7d0 msgr2=0x7fd4d006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:59.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 -- 172.21.15.63:0/2443957991 shutdown_connections 2024-09-16T01:21:59.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:21:59.157+0000 7fd4d6e49640 1 -- 172.21.15.63:0/2443957991 wait complete. 2024-09-16T01:21:59.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:21:59 smithi192 ceph-mon[34775]: pgmap v294: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-09-16T01:21:59.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:21:59 smithi162 ceph-mon[34539]: pgmap v294: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-09-16T01:21:59.910 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3860332424},{"type":"v1","addr":"172.21.15.63:6801","nonce":3860332424}]},"active_addr":"172.21.15.63:6801/3860332424","active_change":"2024-09-16T01:14:37.096415+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24128,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.63:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":1012006669}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":228564475}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3983534819}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":108118133}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":2255684858}]}]} 2024-09-16T01:21:59.915 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-16T01:21:59.916 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-16T01:21:59.916 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:22:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:00.296 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:00 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2443957991' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T01:22:00.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:00 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2443957991' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T01:22:00.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:00 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2443957991' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T01:22:00.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.718+0000 7fa3e9c49640 1 -- 172.21.15.63:0/1982117768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e4103660 msgr2=0x7fa3e410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.718+0000 7fa3e9c49640 1 --2- 172.21.15.63:0/1982117768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e4103660 0x7fa3e410bb50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009900 tx=0x7fa3d802a480 comp rx=0 tx=0).stop 2024-09-16T01:22:00.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.718+0000 7fa3e9c49640 1 -- 172.21.15.63:0/1982117768 shutdown_connections 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.718+0000 7fa3e9c49640 1 --2- 172.21.15.63:0/1982117768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e410c170 0x7fa3e410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.718+0000 7fa3e9c49640 1 --2- 172.21.15.63:0/1982117768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e4103660 0x7fa3e410bb50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.718+0000 7fa3e9c49640 1 --2- 172.21.15.63:0/1982117768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e4102d40 0x7fa3e4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.718+0000 7fa3e9c49640 1 -- 172.21.15.63:0/1982117768 >> 172.21.15.63:0/1982117768 conn(0x7fa3e40fc7a0 msgr2=0x7fa3e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.718+0000 7fa3e9c49640 1 -- 172.21.15.63:0/1982117768 shutdown_connections 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.718+0000 7fa3e9c49640 1 -- 172.21.15.63:0/1982117768 wait complete. 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.719+0000 7fa3e9c49640 1 Processor -- start 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.719+0000 7fa3e9c49640 1 -- start start 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.719+0000 7fa3e9c49640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e4102d40 0x7fa3e41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.719+0000 7fa3e9c49640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e4103660 0x7fa3e4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.719+0000 7fa3e9c49640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e410c170 0x7fa3e4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:00.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.719+0000 7fa3e9c49640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4111e20 con 0x7fa3e4103660 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.719+0000 7fa3e9c49640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4111ca0 con 0x7fa3e4102d40 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.719+0000 7fa3e9c49640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e4111fa0 con 0x7fa3e410c170 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.719+0000 7fa3e2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e4103660 0x7fa3e4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.719+0000 7fa3e2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e4103660 0x7fa3e4100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35750/0 (socket says 172.21.15.63:35750) 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e2ffd640 1 -- 172.21.15.63:0/4047219069 learned_addr learned my addr 172.21.15.63:0/4047219069 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e3fff640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e410c170 0x7fa3e4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e37fe640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e4102d40 0x7fa3e41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e2ffd640 1 -- 172.21.15.63:0/4047219069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e410c170 msgr2=0x7fa3e4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e2ffd640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e410c170 0x7fa3e4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e2ffd640 1 -- 172.21.15.63:0/4047219069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e4102d40 msgr2=0x7fa3e41009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e2ffd640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e4102d40 0x7fa3e41009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e2ffd640 1 -- 172.21.15.63:0/4047219069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e41a6830 con 0x7fa3e4103660 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e2ffd640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e4103660 0x7fa3e4100ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005940 tx=0x7fa3d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e0ff9640 1 -- 172.21.15.63:0/4047219069 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d803f030 con 0x7fa3e4103660 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e9c49640 1 -- 172.21.15.63:0/4047219069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e41a6ac0 con 0x7fa3e4103660 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e0ff9640 1 -- 172.21.15.63:0/4047219069 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa3d8003cb0 con 0x7fa3e4103660 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e0ff9640 1 -- 172.21.15.63:0/4047219069 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8035070 con 0x7fa3e4103660 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.720+0000 7fa3e9c49640 1 -- 172.21.15.63:0/4047219069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e41a6fa0 con 0x7fa3e4103660 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.721+0000 7fa3e9c49640 1 -- 172.21.15.63:0/4047219069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e4103120 con 0x7fa3e4103660 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.722+0000 7fa3e0ff9640 1 -- 172.21.15.63:0/4047219069 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa3d8042030 con 0x7fa3e4103660 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.723+0000 7fa3e0ff9640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3cc0a32d0 0x7fa3cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.723+0000 7fa3e37fe640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3cc0a32d0 0x7fa3cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:00.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.723+0000 7fa3e0ff9640 1 -- 172.21.15.63:0/4047219069 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa3d80efef0 con 0x7fa3e4103660 2024-09-16T01:22:00.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.724+0000 7fa3e37fe640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3cc0a32d0 0x7fa3cc0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005fd0 tx=0x7fa3d4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:00.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.727+0000 7fa3e0ff9640 1 -- 172.21.15.63:0/4047219069 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3d80bcab0 con 0x7fa3e4103660 2024-09-16T01:22:00.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.905+0000 7fa3e9c49640 1 -- 172.21.15.63:0/4047219069 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3e402d7c0 con 0x7fa3e4103660 2024-09-16T01:22:00.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.908+0000 7fa3e0ff9640 1 -- 172.21.15.63:0/4047219069 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22710 (secure 0 0 0) 0x7fa3d80bc3b0 con 0x7fa3e4103660 2024-09-16T01:22:00.909 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:00.909 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:39.083854+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:00.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 -- 172.21.15.63:0/4047219069 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3cc0a32d0 msgr2=0x7fa3cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3cc0a32d0 0x7fa3cc0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4005fd0 tx=0x7fa3d4005850 comp rx=0 tx=0).stop 2024-09-16T01:22:00.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 -- 172.21.15.63:0/4047219069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e4103660 msgr2=0x7fa3e4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e4103660 0x7fa3e4100ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005940 tx=0x7fa3d80042f0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 -- 172.21.15.63:0/4047219069 shutdown_connections 2024-09-16T01:22:00.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3cc0a32d0 0x7fa3cc0a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e410c170 0x7fa3e4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3e4103660 0x7fa3e4100ee0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 --2- 172.21.15.63:0/4047219069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e4102d40 0x7fa3e41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 -- 172.21.15.63:0/4047219069 >> 172.21.15.63:0/4047219069 conn(0x7fa3e40fc7a0 msgr2=0x7fa3e40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:00.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 -- 172.21.15.63:0/4047219069 shutdown_connections 2024-09-16T01:22:00.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:00.910+0000 7fa3e9c49640 1 -- 172.21.15.63:0/4047219069 wait complete. 2024-09-16T01:22:01.344 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:01 smithi063 ceph-mon[31070]: pgmap v295: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-16T01:22:01.344 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:01 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/4047219069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:22:01.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:01 smithi192 ceph-mon[34775]: pgmap v295: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-16T01:22:01.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:01 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/4047219069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:22:01.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:01 smithi162 ceph-mon[34539]: pgmap v295: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-16T01:22:01.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:01 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/4047219069' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:22:01.703 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-16T01:22:01.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:22:01.965 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.441+0000 7f236a50e640 1 -- 172.21.15.63:0/1836999968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2364101de0 msgr2=0x7f23641021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.441+0000 7f236a50e640 1 --2- 172.21.15.63:0/1836999968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2364101de0 0x7f23641021c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2354009900 tx=0x7f235402a410 comp rx=0 tx=0).stop 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.441+0000 7f236a50e640 1 -- 172.21.15.63:0/1836999968 shutdown_connections 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.441+0000 7f236a50e640 1 --2- 172.21.15.63:0/1836999968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2364106f10 0x7f236410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.441+0000 7f236a50e640 1 --2- 172.21.15.63:0/1836999968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2364102790 0x7f23641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.441+0000 7f236a50e640 1 --2- 172.21.15.63:0/1836999968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2364101de0 0x7f23641021c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.441+0000 7f236a50e640 1 -- 172.21.15.63:0/1836999968 >> 172.21.15.63:0/1836999968 conn(0x7f23640fd8c0 msgr2=0x7f23640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.441+0000 7f236a50e640 1 -- 172.21.15.63:0/1836999968 shutdown_connections 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.441+0000 7f236a50e640 1 -- 172.21.15.63:0/1836999968 wait complete. 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f236a50e640 1 Processor -- start 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f236a50e640 1 -- start start 2024-09-16T01:22:02.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f236a50e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2364101de0 0x7f23641984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f236a50e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2364102790 0x7f2364198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f236a50e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2364106f10 0x7f236419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f236a50e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2364111ec0 con 0x7f2364101de0 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f236a50e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2364111d40 con 0x7f2364102790 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f236a50e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2364112040 con 0x7f2364106f10 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f2363fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2364101de0 0x7f23641984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f2363fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2364101de0 0x7f23641984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35772/0 (socket says 172.21.15.63:35772) 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f2363fff640 1 -- 172.21.15.63:0/342037883 learned_addr learned my addr 172.21.15.63:0/342037883 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f23637fe640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2364102790 0x7f2364198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f2363fff640 1 -- 172.21.15.63:0/342037883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2364106f10 msgr2=0x7f236419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f2368aab640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2364106f10 0x7f236419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:02.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f2363fff640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2364106f10 0x7f236419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f2363fff640 1 -- 172.21.15.63:0/342037883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2364102790 msgr2=0x7f2364198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f2363fff640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2364102790 0x7f2364198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f2363fff640 1 -- 172.21.15.63:0/342037883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236419d470 con 0x7f2364101de0 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f2368aab640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2364106f10 0x7f236419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.442+0000 7f23637fe640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2364102790 0x7f2364198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.443+0000 7f2363fff640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2364101de0 0x7f23641984c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2354006010 tx=0x7f2354004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.443+0000 7f23617fa640 1 -- 172.21.15.63:0/342037883 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235403f030 con 0x7f2364101de0 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.443+0000 7f23617fa640 1 -- 172.21.15.63:0/342037883 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23540035f0 con 0x7f2364101de0 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.443+0000 7f236a50e640 1 -- 172.21.15.63:0/342037883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236419d700 con 0x7f2364101de0 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.443+0000 7f23617fa640 1 -- 172.21.15.63:0/342037883 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354035070 con 0x7f2364101de0 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.443+0000 7f236a50e640 1 -- 172.21.15.63:0/342037883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23641a5040 con 0x7f2364101de0 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.444+0000 7f236a50e640 1 -- 172.21.15.63:0/342037883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2364102240 con 0x7f2364101de0 2024-09-16T01:22:02.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.445+0000 7f23617fa640 1 -- 172.21.15.63:0/342037883 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2354003b10 con 0x7f2364101de0 2024-09-16T01:22:02.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.446+0000 7f23617fa640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f234c0a3350 0x7f234c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:02.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.446+0000 7f23637fe640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f234c0a3350 0x7f234c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:02.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.446+0000 7f23617fa640 1 -- 172.21.15.63:0/342037883 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f23540f0880 con 0x7f2364101de0 2024-09-16T01:22:02.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.446+0000 7f23637fe640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f234c0a3350 0x7f234c0a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23640fff00 tx=0x7f2358008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:02.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.449+0000 7f23617fa640 1 -- 172.21.15.63:0/342037883 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23540bd440 con 0x7f2364101de0 2024-09-16T01:22:02.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.625+0000 7f236a50e640 1 -- 172.21.15.63:0/342037883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f236410a0f0 con 0x7f2364101de0 2024-09-16T01:22:02.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.627+0000 7f23617fa640 1 -- 172.21.15.63:0/342037883 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22710 (secure 0 0 0) 0x7f23540bcd40 con 0x7f2364101de0 2024-09-16T01:22:02.628 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:02.628 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:39.083854+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:02.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 -- 172.21.15.63:0/342037883 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f234c0a3350 msgr2=0x7f234c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f234c0a3350 0x7f234c0a5810 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f23640fff00 tx=0x7f2358008040 comp rx=0 tx=0).stop 2024-09-16T01:22:02.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 -- 172.21.15.63:0/342037883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2364101de0 msgr2=0x7f23641984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2364101de0 0x7f23641984c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2354006010 tx=0x7f2354004270 comp rx=0 tx=0).stop 2024-09-16T01:22:02.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 -- 172.21.15.63:0/342037883 shutdown_connections 2024-09-16T01:22:02.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f234c0a3350 0x7f234c0a5810 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2364106f10 0x7f236419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2364102790 0x7f2364198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 --2- 172.21.15.63:0/342037883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2364101de0 0x7f23641984c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 -- 172.21.15.63:0/342037883 >> 172.21.15.63:0/342037883 conn(0x7f23640fd8c0 msgr2=0x7f23640fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:02.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 -- 172.21.15.63:0/342037883 shutdown_connections 2024-09-16T01:22:02.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:02.629+0000 7f236a50e640 1 -- 172.21.15.63:0/342037883 wait complete. 2024-09-16T01:22:03.306 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:03 smithi063 ceph-mon[31070]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-16T01:22:03.306 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:03 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/342037883' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:22:03.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-16T01:22:03.342 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-16T01:22:03.342 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-16T01:22:03.342 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-16T01:22:03.343 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-16T01:22:03.343 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-16T01:22:03.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-16T01:22:03.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-16T01:22:03.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-16T01:22:03.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-16T01:22:03.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-16T01:22:03.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-16T01:22:03.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:03 smithi192 ceph-mon[34775]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-16T01:22:03.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:03 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/342037883' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:22:03.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:03 smithi162 ceph-mon[34539]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-16T01:22:03.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:03 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/342037883' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:22:04.085 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:04.133 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:04.134 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:04.134 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:04.134 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:04.867 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:05.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.182+0000 7f2559ee6640 1 -- 172.21.15.63:0/2738693650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2554102d30 msgr2=0x7f2554103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.182+0000 7f2559ee6640 1 --2- 172.21.15.63:0/2738693650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2554102d30 0x7f2554103110 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2544009cd0 tx=0x7f254402a910 comp rx=0 tx=0).stop 2024-09-16T01:22:05.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.182+0000 7f2559ee6640 1 -- 172.21.15.63:0/2738693650 shutdown_connections 2024-09-16T01:22:05.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.182+0000 7f2559ee6640 1 --2- 172.21.15.63:0/2738693650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25541082a0 0x7f255410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.182+0000 7f2559ee6640 1 --2- 172.21.15.63:0/2738693650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25541036e0 0x7f2554107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.182+0000 7f2559ee6640 1 --2- 172.21.15.63:0/2738693650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2554102d30 0x7f2554103110 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.182+0000 7f2559ee6640 1 -- 172.21.15.63:0/2738693650 >> 172.21.15.63:0/2738693650 conn(0x7f25540fc7d0 msgr2=0x7f25540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.182+0000 7f2559ee6640 1 -- 172.21.15.63:0/2738693650 shutdown_connections 2024-09-16T01:22:05.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.182+0000 7f2559ee6640 1 -- 172.21.15.63:0/2738693650 wait complete. 2024-09-16T01:22:05.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.183+0000 7f2559ee6640 1 Processor -- start 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.183+0000 7f2559ee6640 1 -- start start 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.183+0000 7f2559ee6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2554102d30 0x7f2554198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.183+0000 7f2559ee6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25541036e0 0x7f2554198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.183+0000 7f2559ee6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25541082a0 0x7f255419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.183+0000 7f2559ee6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2554111f90 con 0x7f25541082a0 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.183+0000 7f2559ee6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2554111e10 con 0x7f25541036e0 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.183+0000 7f2559ee6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2554112110 con 0x7f2554102d30 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2553fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25541082a0 0x7f255419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2553fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25541082a0 0x7f255419ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35796/0 (socket says 172.21.15.63:35796) 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2553fff640 1 -- 172.21.15.63:0/3772911844 learned_addr learned my addr 172.21.15.63:0/3772911844 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f25537fe640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2554102d30 0x7f2554198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2552ffd640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25541036e0 0x7f2554198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2553fff640 1 -- 172.21.15.63:0/3772911844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2554102d30 msgr2=0x7f2554198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2553fff640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2554102d30 0x7f2554198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2553fff640 1 -- 172.21.15.63:0/3772911844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25541036e0 msgr2=0x7f2554198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2553fff640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25541036e0 0x7f2554198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2553fff640 1 -- 172.21.15.63:0/3772911844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255419d540 con 0x7f25541082a0 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2552ffd640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25541036e0 0x7f2554198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2553fff640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25541082a0 0x7f255419ce60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f254c00d950 tx=0x7f254c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2550ff9640 1 -- 172.21.15.63:0/3772911844 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c017030 con 0x7f25541082a0 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255419d830 con 0x7f25541082a0 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2550ff9640 1 -- 172.21.15.63:0/3772911844 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f254c004020 con 0x7f25541082a0 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2550ff9640 1 -- 172.21.15.63:0/3772911844 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c003b20 con 0x7f25541082a0 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.184+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25541008c0 con 0x7f25541082a0 2024-09-16T01:22:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.185+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2554062980 con 0x7f25541082a0 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.187+0000 7f2550ff9640 1 -- 172.21.15.63:0/3772911844 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f254c01a070 con 0x7f25541082a0 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.188+0000 7f2550ff9640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f253c0a76e0 0x7f253c0a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.188+0000 7f25537fe640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f253c0a76e0 0x7f253c0a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.188+0000 7f2550ff9640 1 -- 172.21.15.63:0/3772911844 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f254c0cfa90 con 0x7f25541082a0 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.188+0000 7f2550ff9640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] conn(0x7f253c0b1310 0x7f253c0b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.188+0000 7f2550ff9640 1 -- 172.21.15.63:0/3772911844 --> [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f254c01de70 con 0x7f253c0b1310 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.188+0000 7f2550ff9640 1 -- 172.21.15.63:0/3772911844 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f254c0cfec0 con 0x7f25541082a0 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.189+0000 7f2552ffd640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] conn(0x7f253c0b1310 0x7f253c0b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.189+0000 7f25537fe640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f253c0a76e0 0x7f253c0a9ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2544005e30 tx=0x7f2544009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.189+0000 7f2552ffd640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] conn(0x7f253c0b1310 0x7f253c0b37b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.190+0000 7f2550ff9640 1 -- 172.21.15.63:0/3772911844 <== osd.6 v2:172.21.15.63:6818/558859237 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f254c01de70 con 0x7f253c0b1310 2024-09-16T01:22:05.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.215+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 --> [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2554062e00 con 0x7f253c0b1310 2024-09-16T01:22:05.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.215+0000 7f2550ff9640 1 -- 172.21.15.63:0/3772911844 <== osd.6 v2:172.21.15.63:6818/558859237 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2554062e00 con 0x7f253c0b1310 2024-09-16T01:22:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] conn(0x7f253c0b1310 msgr2=0x7f253c0b37b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2559ee6640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] conn(0x7f253c0b1310 0x7f253c0b37b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f253c0a76e0 msgr2=0x7f253c0a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2559ee6640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f253c0a76e0 0x7f253c0a9ba0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2544005e30 tx=0x7f2544009360 comp rx=0 tx=0).stop 2024-09-16T01:22:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25541082a0 msgr2=0x7f255419ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2559ee6640 1 --2- 172.21.15.63:0/3772911844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25541082a0 0x7f255419ce60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f254c00d950 tx=0x7f254c00de10 comp rx=0 tx=0).stop 2024-09-16T01:22:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2553fff640 1 -- 172.21.15.63:0/3772911844 reap_dead start 2024-09-16T01:22:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 shutdown_connections 2024-09-16T01:22:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 >> 172.21.15.63:0/3772911844 conn(0x7f25540fc7d0 msgr2=0x7f2554105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 shutdown_connections 2024-09-16T01:22:05.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.216+0000 7f2559ee6640 1 -- 172.21.15.63:0/3772911844 wait complete. 2024-09-16T01:22:05.299 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:05 smithi063 ceph-mon[31070]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-16T01:22:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:05 smithi192 ceph-mon[34775]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-16T01:22:05.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/3805092006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d04100e20 msgr2=0x7f1d04101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 --2- 172.21.15.63:0/3805092006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d04100e20 0x7f1d04101200 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009ca0 tx=0x7f1cf802a950 comp rx=0 tx=0).stop 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/3805092006 shutdown_connections 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 --2- 172.21.15.63:0/3805092006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d04102ef0 0x7f1d0410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 --2- 172.21.15.63:0/3805092006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d04102570 0x7f1d041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 --2- 172.21.15.63:0/3805092006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d04100e20 0x7f1d04101200 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/3805092006 >> 172.21.15.63:0/3805092006 conn(0x7f1d040fc7d0 msgr2=0x7f1d040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/3805092006 shutdown_connections 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/3805092006 wait complete. 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 Processor -- start 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.383+0000 7f1d0bbe4640 1 -- start start 2024-09-16T01:22:05.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0bbe4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d04100e20 0x7f1d04199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0bbe4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d04102570 0x7f1d04199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0bbe4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d04102ef0 0x7f1d041a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0bbe4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04110e30 con 0x7f1d04102570 2024-09-16T01:22:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0bbe4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04110cb0 con 0x7f1d04100e20 2024-09-16T01:22:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0bbe4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1d04110fb0 con 0x7f1d04102ef0 2024-09-16T01:22:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0917f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d04102570 0x7f1d04199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0917f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d04102570 0x7f1d04199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35810/0 (socket says 172.21.15.63:35810) 2024-09-16T01:22:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0917f640 1 -- 172.21.15.63:0/2379651209 learned_addr learned my addr 172.21.15.63:0/2379651209 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0a181640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d04102ef0 0x7f1d041a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d09980640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d04100e20 0x7f1d04199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0917f640 1 -- 172.21.15.63:0/2379651209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d04102ef0 msgr2=0x7f1d041a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0917f640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d04102ef0 0x7f1d041a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0917f640 1 -- 172.21.15.63:0/2379651209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d04100e20 msgr2=0x7f1d04199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0917f640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d04100e20 0x7f1d04199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0917f640 1 -- 172.21.15.63:0/2379651209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d041a48e0 con 0x7f1d04102570 2024-09-16T01:22:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1d0917f640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d04102570 0x7f1d04199860 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000c890 tx=0x7f1d0000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.384+0000 7f1cf6ffd640 1 -- 172.21.15.63:0/2379651209 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00004220 con 0x7f1d04102570 2024-09-16T01:22:05.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.385+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d04197110 con 0x7f1d04102570 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.385+0000 7f1cf6ffd640 1 -- 172.21.15.63:0/2379651209 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d000043c0 con 0x7f1d04102570 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.385+0000 7f1cf6ffd640 1 -- 172.21.15.63:0/2379651209 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00004a00 con 0x7f1d04102570 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.385+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d04197650 con 0x7f1d04102570 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.386+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1d04062900 con 0x7f1d04102570 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.387+0000 7f1cf6ffd640 1 -- 172.21.15.63:0/2379651209 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1d00004ba0 con 0x7f1d04102570 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.388+0000 7f1cf6ffd640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1cf00a32d0 0x7f1cf00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.388+0000 7f1d09980640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1cf00a32d0 0x7f1cf00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.388+0000 7f1cf6ffd640 1 -- 172.21.15.63:0/2379651209 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1d000cfc60 con 0x7f1d04102570 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.388+0000 7f1cf6ffd640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] conn(0x7f1cf00acf00 0x7f1cf00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.388+0000 7f1cf6ffd640 1 -- 172.21.15.63:0/2379651209 --> [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d00023ef0 con 0x7f1cf00acf00 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.388+0000 7f1cf6ffd640 1 -- 172.21.15.63:0/2379651209 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f1d000d0090 con 0x7f1d04102570 2024-09-16T01:22:05.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.388+0000 7f1d09980640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1cf00a32d0 0x7f1cf00a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009a60 tx=0x7f1cf8009890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.388+0000 7f1d0a181640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] conn(0x7f1cf00acf00 0x7f1cf00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.389+0000 7f1d0a181640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] conn(0x7f1cf00acf00 0x7f1cf00af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.390+0000 7f1cf6ffd640 1 -- 172.21.15.63:0/2379651209 <== osd.4 v2:172.21.15.162:6808/3400523772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d00023ef0 con 0x7f1cf00acf00 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.403+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 --> [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1d04062d80 con 0x7f1cf00acf00 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1cf6ffd640 1 -- 172.21.15.63:0/2379651209 <== osd.4 v2:172.21.15.162:6808/3400523772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1d04062d80 con 0x7f1cf00acf00 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 >> [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] conn(0x7f1cf00acf00 msgr2=0x7f1cf00af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0bbe4640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] conn(0x7f1cf00acf00 0x7f1cf00af3a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1cf00a32d0 msgr2=0x7f1cf00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0bbe4640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1cf00a32d0 0x7f1cf00a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009a60 tx=0x7f1cf8009890 comp rx=0 tx=0).stop 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d04102570 msgr2=0x7f1d04199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0bbe4640 1 --2- 172.21.15.63:0/2379651209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d04102570 0x7f1d04199860 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000c890 tx=0x7f1d0000cd50 comp rx=0 tx=0).stop 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0a181640 1 -- 172.21.15.63:0/2379651209 reap_dead start 2024-09-16T01:22:05.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 shutdown_connections 2024-09-16T01:22:05.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 >> 172.21.15.63:0/2379651209 conn(0x7f1d040fc7d0 msgr2=0x7f1d040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 shutdown_connections 2024-09-16T01:22:05.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:05.404+0000 7f1d0bbe4640 1 -- 172.21.15.63:0/2379651209 wait complete. 2024-09-16T01:22:05.438 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:05 smithi162 ceph-mon[34539]: pgmap v297: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-16T01:22:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:141733920824 2024-09-16T01:22:06.174 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-16T01:22:06.834 INFO:teuthology.orchestra.run.smithi063.stdout:193273528366 2024-09-16T01:22:06.835 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-16T01:22:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.054+0000 7f8d2e36e640 1 -- 172.21.15.63:0/3530415884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d28102ef0 msgr2=0x7f8d2810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.054+0000 7f8d2e36e640 1 --2- 172.21.15.63:0/3530415884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d28102ef0 0x7f8d2810da40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009ca0 tx=0x7f8d2002a950 comp rx=0 tx=0).stop 2024-09-16T01:22:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.054+0000 7f8d2e36e640 1 -- 172.21.15.63:0/3530415884 shutdown_connections 2024-09-16T01:22:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.054+0000 7f8d2e36e640 1 --2- 172.21.15.63:0/3530415884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d28102ef0 0x7f8d2810da40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.054+0000 7f8d2e36e640 1 --2- 172.21.15.63:0/3530415884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d28102570 0x7f8d281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.054+0000 7f8d2e36e640 1 --2- 172.21.15.63:0/3530415884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d28100e20 0x7f8d28101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.054+0000 7f8d2e36e640 1 -- 172.21.15.63:0/3530415884 >> 172.21.15.63:0/3530415884 conn(0x7f8d280fc7d0 msgr2=0x7f8d280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.054+0000 7f8d2e36e640 1 -- 172.21.15.63:0/3530415884 shutdown_connections 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.054+0000 7f8d2e36e640 1 -- 172.21.15.63:0/3530415884 wait complete. 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d2e36e640 1 Processor -- start 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d2e36e640 1 -- start start 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d2e36e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d28100e20 0x7f8d281983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d2e36e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d28102570 0x7f8d281988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d2e36e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d28102ef0 0x7f8d2819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d2e36e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28110e80 con 0x7f8d28100e20 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d2e36e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28110d00 con 0x7f8d28102570 2024-09-16T01:22:07.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d2e36e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28111000 con 0x7f8d28102ef0 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d28100e20 0x7f8d281983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d27fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d28100e20 0x7f8d281983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35838/0 (socket says 172.21.15.63:35838) 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d27fff640 1 -- 172.21.15.63:0/2053487924 learned_addr learned my addr 172.21.15.63:0/2053487924 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.055+0000 7f8d277fe640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d28102570 0x7f8d281988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d2c90b640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d28102ef0 0x7f8d2819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d27fff640 1 -- 172.21.15.63:0/2053487924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d28102ef0 msgr2=0x7f8d2819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d27fff640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d28102ef0 0x7f8d2819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d27fff640 1 -- 172.21.15.63:0/2053487924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d28102570 msgr2=0x7f8d281988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d27fff640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d28102570 0x7f8d281988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d27fff640 1 -- 172.21.15.63:0/2053487924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2819d360 con 0x7f8d28100e20 2024-09-16T01:22:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d27fff640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d28100e20 0x7f8d281983b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800d770 tx=0x7f8d1800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d257fa640 1 -- 172.21.15.63:0/2053487924 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18017070 con 0x7f8d28100e20 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d257fa640 1 -- 172.21.15.63:0/2053487924 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d180054d0 con 0x7f8d28100e20 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2819d650 con 0x7f8d28100e20 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d257fa640 1 -- 172.21.15.63:0/2053487924 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18004cf0 con 0x7f8d28100e20 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.056+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d281a4f30 con 0x7f8d28100e20 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.057+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d28062940 con 0x7f8d28100e20 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.058+0000 7f8d257fa640 1 -- 172.21.15.63:0/2053487924 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8d18004e90 con 0x7f8d28100e20 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.059+0000 7f8d257fa640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d140a32d0 0x7f8d140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.059+0000 7f8d277fe640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d140a32d0 0x7f8d140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.059+0000 7f8d257fa640 1 -- 172.21.15.63:0/2053487924 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8d180cf840 con 0x7f8d28100e20 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.059+0000 7f8d257fa640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] conn(0x7f8d140acf00 0x7f8d140af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.059+0000 7f8d257fa640 1 -- 172.21.15.63:0/2053487924 --> [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d18005320 con 0x7f8d140acf00 2024-09-16T01:22:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.059+0000 7f8d257fa640 1 -- 172.21.15.63:0/2053487924 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f8d180cfc70 con 0x7f8d28100e20 2024-09-16T01:22:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.060+0000 7f8d2c90b640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] conn(0x7f8d140acf00 0x7f8d140af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.060+0000 7f8d277fe640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d140a32d0 0x7f8d140a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8d280fff70 tx=0x7f8d1000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.060+0000 7f8d2c90b640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] conn(0x7f8d140acf00 0x7f8d140af3a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.061+0000 7f8d257fa640 1 -- 172.21.15.63:0/2053487924 <== osd.2 v2:172.21.15.192:6800/166209023 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d18005320 con 0x7f8d140acf00 2024-09-16T01:22:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.075+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 --> [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8d28062dc0 con 0x7f8d140acf00 2024-09-16T01:22:07.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.075+0000 7f8d257fa640 1 -- 172.21.15.63:0/2053487924 <== osd.2 v2:172.21.15.192:6800/166209023 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8d28062dc0 con 0x7f8d140acf00 2024-09-16T01:22:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.075+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 >> [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] conn(0x7f8d140acf00 msgr2=0x7f8d140af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.075+0000 7f8d2e36e640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] conn(0x7f8d140acf00 0x7f8d140af3a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.075+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d140a32d0 msgr2=0x7f8d140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.075+0000 7f8d2e36e640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d140a32d0 0x7f8d140a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8d280fff70 tx=0x7f8d1000b390 comp rx=0 tx=0).stop 2024-09-16T01:22:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.075+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d28100e20 msgr2=0x7f8d281983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.075+0000 7f8d2e36e640 1 --2- 172.21.15.63:0/2053487924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d28100e20 0x7f8d281983b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800d770 tx=0x7f8d1800dc30 comp rx=0 tx=0).stop 2024-09-16T01:22:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.075+0000 7f8d2c90b640 1 -- 172.21.15.63:0/2053487924 reap_dead start 2024-09-16T01:22:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.076+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 shutdown_connections 2024-09-16T01:22:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.076+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 >> 172.21.15.63:0/2053487924 conn(0x7f8d280fc7d0 msgr2=0x7f8d2806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.076+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 shutdown_connections 2024-09-16T01:22:07.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:07.076+0000 7f8d2e36e640 1 -- 172.21.15.63:0/2053487924 wait complete. 2024-09-16T01:22:07.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:07 smithi063 ceph-mon[31070]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-16T01:22:07.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:07 smithi192 ceph-mon[34775]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-16T01:22:07.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:07 smithi162 ceph-mon[34539]: pgmap v298: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-16T01:22:07.960 INFO:teuthology.orchestra.run.smithi063.stdout:77309411395 2024-09-16T01:22:07.960 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-16T01:22:08.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.265+0000 7f574f64e640 1 -- 172.21.15.63:0/559512868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574810e480 msgr2=0x7f5748110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.265+0000 7f574f64e640 1 --2- 172.21.15.63:0/559512868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574810e480 0x7f5748110870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5740009ca0 tx=0x7f574002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.265+0000 7f574f64e640 1 -- 172.21.15.63:0/559512868 shutdown_connections 2024-09-16T01:22:08.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.265+0000 7f574f64e640 1 --2- 172.21.15.63:0/559512868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574810e480 0x7f5748110870 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.265+0000 7f574f64e640 1 --2- 172.21.15.63:0/559512868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5748101280 0x7f574810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.265+0000 7f574f64e640 1 --2- 172.21.15.63:0/559512868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57481008d0 0x7f5748100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.265+0000 7f574f64e640 1 -- 172.21.15.63:0/559512868 >> 172.21.15.63:0/559512868 conn(0x7f57480fc7a0 msgr2=0x7f57480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.265+0000 7f574f64e640 1 -- 172.21.15.63:0/559512868 shutdown_connections 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.265+0000 7f574f64e640 1 -- 172.21.15.63:0/559512868 wait complete. 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574f64e640 1 Processor -- start 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574f64e640 1 -- start start 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574f64e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57481008d0 0x7f574819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574f64e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5748101280 0x7f574819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574f64e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574810e480 0x7f574819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574f64e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f57481140f0 con 0x7f574810e480 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574f64e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5748113f70 con 0x7f57481008d0 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574f64e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5748114270 con 0x7f5748101280 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574dbeb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574810e480 0x7f574819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574dbeb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574810e480 0x7f574819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35860/0 (socket says 172.21.15.63:35860) 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574dbeb640 1 -- 172.21.15.63:0/3453518438 learned_addr learned my addr 172.21.15.63:0/3453518438 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574d3ea640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57481008d0 0x7f574819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.266+0000 7f574cbe9640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5748101280 0x7f574819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f574dbeb640 1 -- 172.21.15.63:0/3453518438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5748101280 msgr2=0x7f574819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f574dbeb640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5748101280 0x7f574819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f574dbeb640 1 -- 172.21.15.63:0/3453518438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57481008d0 msgr2=0x7f574819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f574dbeb640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57481008d0 0x7f574819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f574dbeb640 1 -- 172.21.15.63:0/3453518438 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574819f620 con 0x7f574810e480 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f574d3ea640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57481008d0 0x7f574819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f574cbe9640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5748101280 0x7f574819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f574dbeb640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574810e480 0x7f574819ef40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5740003ba0 tx=0x7f5740003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f573e7fc640 1 -- 172.21.15.63:0/3453518438 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740004040 con 0x7f574810e480 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f573e7fc640 1 -- 172.21.15.63:0/3453518438 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5740004690 con 0x7f574810e480 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574819f8b0 con 0x7f574810e480 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f573e7fc640 1 -- 172.21.15.63:0/3453518438 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740030d90 con 0x7f574810e480 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.267+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57481a71f0 con 0x7f574810e480 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.268+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5748062900 con 0x7f574810e480 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.269+0000 7f573e7fc640 1 -- 172.21.15.63:0/3453518438 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f57400305c0 con 0x7f574810e480 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.270+0000 7f573e7fc640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57340a3350 0x7f57340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.270+0000 7f574d3ea640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57340a3350 0x7f57340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.270+0000 7f573e7fc640 1 -- 172.21.15.63:0/3453518438 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f57400f1420 con 0x7f574810e480 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.270+0000 7f573e7fc640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] conn(0x7f57340ace50 0x7f57340af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.270+0000 7f573e7fc640 1 -- 172.21.15.63:0/3453518438 --> [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57340af9c0 con 0x7f57340ace50 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.270+0000 7f573e7fc640 1 -- 172.21.15.63:0/3453518438 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f57400f1850 con 0x7f574810e480 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.270+0000 7f574d3ea640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57340a3350 0x7f57340a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5744009930 tx=0x7f5744008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.270+0000 7f574cbe9640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] conn(0x7f57340ace50 0x7f57340af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.271+0000 7f574cbe9640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] conn(0x7f57340ace50 0x7f57340af2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.272+0000 7f573e7fc640 1 -- 172.21.15.63:0/3453518438 <== osd.10 v2:172.21.15.162:6824/3603743801 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f57340af9c0 con 0x7f57340ace50 2024-09-16T01:22:08.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.285+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 --> [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5748062d00 con 0x7f57340ace50 2024-09-16T01:22:08.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.286+0000 7f573e7fc640 1 -- 172.21.15.63:0/3453518438 <== osd.10 v2:172.21.15.162:6824/3603743801 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5748062d00 con 0x7f57340ace50 2024-09-16T01:22:08.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.286+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 >> [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] conn(0x7f57340ace50 msgr2=0x7f57340af2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.286+0000 7f574f64e640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] conn(0x7f57340ace50 0x7f57340af2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.286+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57340a3350 msgr2=0x7f57340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.286+0000 7f574f64e640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f57340a3350 0x7f57340a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5744009930 tx=0x7f5744008040 comp rx=0 tx=0).stop 2024-09-16T01:22:08.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.286+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574810e480 msgr2=0x7f574819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.286+0000 7f574f64e640 1 --2- 172.21.15.63:0/3453518438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f574810e480 0x7f574819ef40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5740003ba0 tx=0x7f5740003bd0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.286+0000 7f574dbeb640 1 -- 172.21.15.63:0/3453518438 reap_dead start 2024-09-16T01:22:08.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.286+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 shutdown_connections 2024-09-16T01:22:08.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.286+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 >> 172.21.15.63:0/3453518438 conn(0x7f57480fc7a0 msgr2=0x7f57480feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:08.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.287+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 shutdown_connections 2024-09-16T01:22:08.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:08.287+0000 7f574f64e640 1 -- 172.21.15.63:0/3453518438 wait complete. 2024-09-16T01:22:09.082 INFO:teuthology.orchestra.run.smithi063.stdout:296352743450 2024-09-16T01:22:09.083 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-16T01:22:09.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.230+0000 7f6191746640 1 -- 172.21.15.63:0/81944146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f618c103650 msgr2=0x7f618c10bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.230+0000 7f6191746640 1 --2- 172.21.15.63:0/81944146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f618c103650 0x7f618c10bb40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6180009900 tx=0x7f618002a480 comp rx=0 tx=0).stop 2024-09-16T01:22:09.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.230+0000 7f6191746640 1 -- 172.21.15.63:0/81944146 shutdown_connections 2024-09-16T01:22:09.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.230+0000 7f6191746640 1 --2- 172.21.15.63:0/81944146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f618c10c160 0x7f618c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.230+0000 7f6191746640 1 --2- 172.21.15.63:0/81944146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f618c103650 0x7f618c10bb40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.230+0000 7f6191746640 1 --2- 172.21.15.63:0/81944146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c102d30 0x7f618c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.230+0000 7f6191746640 1 -- 172.21.15.63:0/81944146 >> 172.21.15.63:0/81944146 conn(0x7f618c0fc790 msgr2=0x7f618c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:09.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.230+0000 7f6191746640 1 -- 172.21.15.63:0/81944146 shutdown_connections 2024-09-16T01:22:09.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.231+0000 7f6191746640 1 -- 172.21.15.63:0/81944146 wait complete. 2024-09-16T01:22:09.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.231+0000 7f6191746640 1 Processor -- start 2024-09-16T01:22:09.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.231+0000 7f6191746640 1 -- start start 2024-09-16T01:22:09.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f6191746640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c102d30 0x7f618c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f6191746640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f618c103650 0x7f618c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f6191746640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f618c10c160 0x7f618c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f6191746640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f618c111e60 con 0x7f618c103650 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f6191746640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f618c111ce0 con 0x7f618c10c160 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f6191746640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f618c111fe0 con 0x7f618c102d30 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f618c103650 0x7f618c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f618c103650 0x7f618c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33352/0 (socket says 172.21.15.63:33352) 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618a7fc640 1 -- 172.21.15.63:0/2854255305 learned_addr learned my addr 172.21.15.63:0/2854255305 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618affd640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c102d30 0x7f618c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618b7fe640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f618c10c160 0x7f618c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618affd640 1 -- 172.21.15.63:0/2854255305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f618c10c160 msgr2=0x7f618c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618affd640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f618c10c160 0x7f618c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618affd640 1 -- 172.21.15.63:0/2854255305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f618c103650 msgr2=0x7f618c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618affd640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f618c103650 0x7f618c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618affd640 1 -- 172.21.15.63:0/2854255305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c1a6840 con 0x7f618c102d30 2024-09-16T01:22:09.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.232+0000 7f618a7fc640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f618c103650 0x7f618c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:09.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.233+0000 7f618affd640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c102d30 0x7f618c100990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f617c00d6d0 tx=0x7f617c00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.233+0000 7f6173fff640 1 -- 172.21.15.63:0/2854255305 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c017070 con 0x7f618c102d30 2024-09-16T01:22:09.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.233+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c1a6b30 con 0x7f618c102d30 2024-09-16T01:22:09.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.233+0000 7f6173fff640 1 -- 172.21.15.63:0/2854255305 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f617c009820 con 0x7f618c102d30 2024-09-16T01:22:09.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.233+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c1a7070 con 0x7f618c102d30 2024-09-16T01:22:09.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.233+0000 7f6173fff640 1 -- 172.21.15.63:0/2854255305 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c004c40 con 0x7f618c102d30 2024-09-16T01:22:09.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.234+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f618c062900 con 0x7f618c102d30 2024-09-16T01:22:09.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.236+0000 7f6173fff640 1 -- 172.21.15.63:0/2854255305 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f617c0099d0 con 0x7f618c102d30 2024-09-16T01:22:09.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.237+0000 7f6173fff640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f61740a3320 0x7f61740a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.237+0000 7f618a7fc640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f61740a3320 0x7f61740a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.237+0000 7f6173fff640 1 -- 172.21.15.63:0/2854255305 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f617c0cf990 con 0x7f618c102d30 2024-09-16T01:22:09.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.237+0000 7f6173fff640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] conn(0x7f61740acf50 0x7f61740af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.237+0000 7f6173fff640 1 -- 172.21.15.63:0/2854255305 --> [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f617c00fec0 con 0x7f61740acf50 2024-09-16T01:22:09.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.237+0000 7f6173fff640 1 -- 172.21.15.63:0/2854255305 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f617c0cfdc0 con 0x7f618c102d30 2024-09-16T01:22:09.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.237+0000 7f618a7fc640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f61740a3320 0x7f61740a57e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6180004730 tx=0x7f61800046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.237+0000 7f618b7fe640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] conn(0x7f61740acf50 0x7f61740af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.238+0000 7f618b7fe640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] conn(0x7f61740acf50 0x7f61740af3f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.239+0000 7f6173fff640 1 -- 172.21.15.63:0/2854255305 <== osd.11 v2:172.21.15.192:6824/508338152 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f617c00fec0 con 0x7f61740acf50 2024-09-16T01:22:09.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.252+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 --> [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f618c062d80 con 0x7f61740acf50 2024-09-16T01:22:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6173fff640 1 -- 172.21.15.63:0/2854255305 <== osd.11 v2:172.21.15.192:6824/508338152 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f618c062d80 con 0x7f61740acf50 2024-09-16T01:22:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 >> [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] conn(0x7f61740acf50 msgr2=0x7f61740af3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6191746640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] conn(0x7f61740acf50 0x7f61740af3f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f61740a3320 msgr2=0x7f61740a57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6191746640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f61740a3320 0x7f61740a57e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6180004730 tx=0x7f61800046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c102d30 msgr2=0x7f618c100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6191746640 1 --2- 172.21.15.63:0/2854255305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f618c102d30 0x7f618c100990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f617c00d6d0 tx=0x7f617c00db90 comp rx=0 tx=0).stop 2024-09-16T01:22:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f618b7fe640 1 -- 172.21.15.63:0/2854255305 reap_dead start 2024-09-16T01:22:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 shutdown_connections 2024-09-16T01:22:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 >> 172.21.15.63:0/2854255305 conn(0x7f618c0fc790 msgr2=0x7f618c0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 shutdown_connections 2024-09-16T01:22:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:09.253+0000 7f6191746640 1 -- 172.21.15.63:0/2854255305 wait complete. 2024-09-16T01:22:09.323 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:09 smithi063 ceph-mon[31070]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-16T01:22:09.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:09 smithi192 ceph-mon[34775]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-16T01:22:09.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:09 smithi162 ceph-mon[34539]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-16T01:22:09.600 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:09.601 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.556+0000 7f7f25e9b640 1 -- 172.21.15.63:0/604195989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f20102790 msgr2=0x7f7f201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.556+0000 7f7f25e9b640 1 --2- 172.21.15.63:0/604195989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f20102790 0x7f7f201067e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009900 tx=0x7f7f0802a410 comp rx=0 tx=0).stop 2024-09-16T01:22:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.556+0000 7f7f25e9b640 1 -- 172.21.15.63:0/604195989 shutdown_connections 2024-09-16T01:22:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.556+0000 7f7f25e9b640 1 --2- 172.21.15.63:0/604195989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f20106f10 0x7f7f2010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.556+0000 7f7f25e9b640 1 --2- 172.21.15.63:0/604195989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f20102790 0x7f7f201067e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.556+0000 7f7f25e9b640 1 --2- 172.21.15.63:0/604195989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f20101de0 0x7f7f201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.556+0000 7f7f25e9b640 1 -- 172.21.15.63:0/604195989 >> 172.21.15.63:0/604195989 conn(0x7f7f200fd8c0 msgr2=0x7f7f200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.556+0000 7f7f25e9b640 1 -- 172.21.15.63:0/604195989 shutdown_connections 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.556+0000 7f7f25e9b640 1 -- 172.21.15.63:0/604195989 wait complete. 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f25e9b640 1 Processor -- start 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f25e9b640 1 -- start start 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f25e9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f20101de0 0x7f7f201983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f25e9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f20102790 0x7f7f20198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f25e9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f20106f10 0x7f7f2019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f25e9b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7f20111de0 con 0x7f7f20101de0 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f25e9b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f20111c60 con 0x7f7f20102790 2024-09-16T01:22:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f25e9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7f20111f60 con 0x7f7f20106f10 2024-09-16T01:22:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f1f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f20101de0 0x7f7f201983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f1f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f20101de0 0x7f7f201983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33386/0 (socket says 172.21.15.63:33386) 2024-09-16T01:22:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f1f7fe640 1 -- 172.21.15.63:0/3690321725 learned_addr learned my addr 172.21.15.63:0/3690321725 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f1ffff640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f20106f10 0x7f7f2019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.557+0000 7f7f17fff640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f20102790 0x7f7f20198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f1f7fe640 1 -- 172.21.15.63:0/3690321725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f20106f10 msgr2=0x7f7f2019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f1f7fe640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f20106f10 0x7f7f2019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f1f7fe640 1 -- 172.21.15.63:0/3690321725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f20102790 msgr2=0x7f7f20198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f1f7fe640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f20102790 0x7f7f20198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f1f7fe640 1 -- 172.21.15.63:0/3690321725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2019d370 con 0x7f7f20101de0 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f1f7fe640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f20101de0 0x7f7f201983c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000d950 tx=0x7f7f1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f1d7fa640 1 -- 172.21.15.63:0/3690321725 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f10017070 con 0x7f7f20101de0 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f1d7fa640 1 -- 172.21.15.63:0/3690321725 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f10009c30 con 0x7f7f20101de0 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2019d660 con 0x7f7f20101de0 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f1d7fa640 1 -- 172.21.15.63:0/3690321725 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000f620 con 0x7f7f20101de0 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.558+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f201a4f40 con 0x7f7f20101de0 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.559+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f20062980 con 0x7f7f20101de0 2024-09-16T01:22:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.560+0000 7f7f1d7fa640 1 -- 172.21.15.63:0/3690321725 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7f100109a0 con 0x7f7f20101de0 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.561+0000 7f7f1d7fa640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7f0c0a32d0 0x7f7f0c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.561+0000 7f7f17fff640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7f0c0a32d0 0x7f7f0c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.561+0000 7f7f1d7fa640 1 -- 172.21.15.63:0/3690321725 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7f100cfb30 con 0x7f7f20101de0 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.561+0000 7f7f1d7fa640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] conn(0x7f7f0c0acf00 0x7f7f0c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.561+0000 7f7f1d7fa640 1 -- 172.21.15.63:0/3690321725 --> [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f0c0afa70 con 0x7f7f0c0acf00 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.561+0000 7f7f1d7fa640 1 -- 172.21.15.63:0/3690321725 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f7f100cff60 con 0x7f7f20101de0 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.562+0000 7f7f17fff640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7f0c0a32d0 0x7f7f0c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f08031440 tx=0x7f7f080095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.562+0000 7f7f1ffff640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] conn(0x7f7f0c0acf00 0x7f7f0c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.562+0000 7f7f1ffff640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] conn(0x7f7f0c0acf00 0x7f7f0c0af3a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.563+0000 7f7f1d7fa640 1 -- 172.21.15.63:0/3690321725 <== osd.1 v2:172.21.15.162:6800/94832668 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f0c0afa70 con 0x7f7f0c0acf00 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.576+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 --> [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f20062e00 con 0x7f7f0c0acf00 2024-09-16T01:22:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f1d7fa640 1 -- 172.21.15.63:0/3690321725 <== osd.1 v2:172.21.15.162:6800/94832668 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7f20062e00 con 0x7f7f0c0acf00 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 >> [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] conn(0x7f7f0c0acf00 msgr2=0x7f7f0c0af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f25e9b640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] conn(0x7f7f0c0acf00 0x7f7f0c0af3a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7f0c0a32d0 msgr2=0x7f7f0c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f25e9b640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7f0c0a32d0 0x7f7f0c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f08031440 tx=0x7f7f080095f0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f20101de0 msgr2=0x7f7f201983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f25e9b640 1 --2- 172.21.15.63:0/3690321725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f20101de0 0x7f7f201983c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000d950 tx=0x7f7f1000de10 comp rx=0 tx=0).stop 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f1ffff640 1 -- 172.21.15.63:0/3690321725 reap_dead start 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 shutdown_connections 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 >> 172.21.15.63:0/3690321725 conn(0x7f7f200fd8c0 msgr2=0x7f7f200fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 shutdown_connections 2024-09-16T01:22:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.577+0000 7f7f25e9b640 1 -- 172.21.15.63:0/3690321725 wait complete. 2024-09-16T01:22:11.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.035+0000 7f6a0d760640 1 -- 172.21.15.63:0/1712358682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a08102d90 msgr2=0x7f6a08103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:11.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.035+0000 7f6a0d760640 1 --2- 172.21.15.63:0/1712358682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a08102d90 0x7f6a08103170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009930 tx=0x7f69f802a420 comp rx=0 tx=0).stop 2024-09-16T01:22:11.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.035+0000 7f6a0d760640 1 -- 172.21.15.63:0/1712358682 shutdown_connections 2024-09-16T01:22:11.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.035+0000 7f6a0d760640 1 --2- 172.21.15.63:0/1712358682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a08108290 0x7f6a0810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:11.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.035+0000 7f6a0d760640 1 --2- 172.21.15.63:0/1712358682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a08103740 0x7f6a08107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:11.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.035+0000 7f6a0d760640 1 --2- 172.21.15.63:0/1712358682 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a08102d90 0x7f6a08103170 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.035+0000 7f6a0d760640 1 -- 172.21.15.63:0/1712358682 >> 172.21.15.63:0/1712358682 conn(0x7f6a080fc7d0 msgr2=0x7f6a080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.035+0000 7f6a0d760640 1 -- 172.21.15.63:0/1712358682 shutdown_connections 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.035+0000 7f6a0d760640 1 -- 172.21.15.63:0/1712358682 wait complete. 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.036+0000 7f6a0d760640 1 Processor -- start 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.036+0000 7f6a0d760640 1 -- start start 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a0d760640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a08102d90 0x7f6a081984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a0d760640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a08103740 0x7f6a08198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a0d760640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a08108290 0x7f6a0819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a0d760640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08111f40 con 0x7f6a08103740 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a0d760640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08111dc0 con 0x7f6a08108290 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a0d760640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6a081120c0 con 0x7f6a08102d90 2024-09-16T01:22:11.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a067fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a08103740 0x7f6a08198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a067fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a08103740 0x7f6a08198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33392/0 (socket says 172.21.15.63:33392) 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a067fc640 1 -- 172.21.15.63:0/4016797567 learned_addr learned my addr 172.21.15.63:0/4016797567 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a06ffd640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a08102d90 0x7f6a081984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a077fe640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a08108290 0x7f6a0819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a067fc640 1 -- 172.21.15.63:0/4016797567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a08102d90 msgr2=0x7f6a081984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a067fc640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a08102d90 0x7f6a081984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a067fc640 1 -- 172.21.15.63:0/4016797567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a08108290 msgr2=0x7f6a0819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a067fc640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a08108290 0x7f6a0819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a067fc640 1 -- 172.21.15.63:0/4016797567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0819d490 con 0x7f6a08103740 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f6a067fc640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a08103740 0x7f6a08198a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00d770 tx=0x7f69fc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.037+0000 7f69effff640 1 -- 172.21.15.63:0/4016797567 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc017070 con 0x7f6a08103740 2024-09-16T01:22:11.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.038+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0819d780 con 0x7f6a08103740 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.038+0000 7f69effff640 1 -- 172.21.15.63:0/4016797567 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69fc009c30 con 0x7f6a08103740 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.038+0000 7f69effff640 1 -- 172.21.15.63:0/4016797567 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00f620 con 0x7f6a08103740 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.038+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a081a5060 con 0x7f6a08103740 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.039+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a08062980 con 0x7f6a08103740 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.040+0000 7f69effff640 1 -- 172.21.15.63:0/4016797567 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f69fc01a070 con 0x7f6a08103740 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.040+0000 7f69effff640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f69f00a32d0 0x7f69f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.040+0000 7f6a06ffd640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f69f00a32d0 0x7f69f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.041+0000 7f69effff640 1 -- 172.21.15.63:0/4016797567 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f69fc0cf9c0 con 0x7f6a08103740 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.041+0000 7f69effff640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] conn(0x7f69f00acf00 0x7f69f00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.041+0000 7f69effff640 1 -- 172.21.15.63:0/4016797567 --> [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69fc01de50 con 0x7f69f00acf00 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.041+0000 7f69effff640 1 -- 172.21.15.63:0/4016797567 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f69fc0cfdf0 con 0x7f6a08103740 2024-09-16T01:22:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.041+0000 7f6a077fe640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] conn(0x7f69f00acf00 0x7f69f00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:11.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.041+0000 7f6a06ffd640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f69f00a32d0 0x7f69f00a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009900 tx=0x7f69f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:11.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.041+0000 7f6a077fe640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] conn(0x7f69f00acf00 0x7f69f00af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:11.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.042+0000 7f69effff640 1 -- 172.21.15.63:0/4016797567 <== osd.9 v2:172.21.15.63:6826/2226037893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f69fc01de50 con 0x7f69f00acf00 2024-09-16T01:22:11.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.056+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 --> [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6a08062d80 con 0x7f69f00acf00 2024-09-16T01:22:11.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.056+0000 7f69effff640 1 -- 172.21.15.63:0/4016797567 <== osd.9 v2:172.21.15.63:6826/2226037893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6a08062d80 con 0x7f69f00acf00 2024-09-16T01:22:11.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] conn(0x7f69f00acf00 msgr2=0x7f69f00af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:11.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a0d760640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] conn(0x7f69f00acf00 0x7f69f00af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:11.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f69f00a32d0 msgr2=0x7f69f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:11.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a0d760640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f69f00a32d0 0x7f69f00a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009900 tx=0x7f69f8000bc0 comp rx=0 tx=0).stop 2024-09-16T01:22:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a08103740 msgr2=0x7f6a08198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a0d760640 1 --2- 172.21.15.63:0/4016797567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a08103740 0x7f6a08198a20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00d770 tx=0x7f69fc00dc30 comp rx=0 tx=0).stop 2024-09-16T01:22:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a077fe640 1 -- 172.21.15.63:0/4016797567 reap_dead start 2024-09-16T01:22:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 shutdown_connections 2024-09-16T01:22:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 >> 172.21.15.63:0/4016797567 conn(0x7f6a080fc7d0 msgr2=0x7f6a08106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 shutdown_connections 2024-09-16T01:22:11.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:11.057+0000 7f6a0d760640 1 -- 172.21.15.63:0/4016797567 wait complete. 2024-09-16T01:22:11.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:11 smithi063 ceph-mon[31070]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-16T01:22:11.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:11 smithi192 ceph-mon[34775]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-16T01:22:11.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:11 smithi162 ceph-mon[34539]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-16T01:22:11.915 INFO:teuthology.orchestra.run.smithi063.stdout:274877906976 2024-09-16T01:22:11.915 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-16T01:22:12.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.462+0000 7fb658da2640 1 -- 172.21.15.63:0/2362562309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654106f10 msgr2=0x7fb65410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.462+0000 7fb658da2640 1 --2- 172.21.15.63:0/2362562309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654106f10 0x7fb65410ea90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009ca0 tx=0x7fb64c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.463+0000 7fb658da2640 1 -- 172.21.15.63:0/2362562309 shutdown_connections 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.463+0000 7fb658da2640 1 --2- 172.21.15.63:0/2362562309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654106f10 0x7fb65410ea90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.463+0000 7fb658da2640 1 --2- 172.21.15.63:0/2362562309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb654102790 0x7fb6541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.463+0000 7fb658da2640 1 --2- 172.21.15.63:0/2362562309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb654101de0 0x7fb6541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.463+0000 7fb658da2640 1 -- 172.21.15.63:0/2362562309 >> 172.21.15.63:0/2362562309 conn(0x7fb6540fd8c0 msgr2=0x7fb6540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.463+0000 7fb658da2640 1 -- 172.21.15.63:0/2362562309 shutdown_connections 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.463+0000 7fb658da2640 1 -- 172.21.15.63:0/2362562309 wait complete. 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.463+0000 7fb658da2640 1 Processor -- start 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb658da2640 1 -- start start 2024-09-16T01:22:12.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb658da2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb654101de0 0x7fb654198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb658da2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb654102790 0x7fb6541989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb658da2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654106f10 0x7fb65419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb658da2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb654111ec0 con 0x7fb654106f10 2024-09-16T01:22:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb658da2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb654111d40 con 0x7fb654101de0 2024-09-16T01:22:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb658da2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb654112040 con 0x7fb654102790 2024-09-16T01:22:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb652d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654106f10 0x7fb65419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb652d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654106f10 0x7fb65419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33370/0 (socket says 172.21.15.63:33370) 2024-09-16T01:22:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb652d9d640 1 -- 172.21.15.63:0/2403704520 learned_addr learned my addr 172.21.15.63:0/2403704520 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:12.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb651d9b640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb654102790 0x7fb6541989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb65259c640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb654101de0 0x7fb654198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb652d9d640 1 -- 172.21.15.63:0/2403704520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb654102790 msgr2=0x7fb6541989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb652d9d640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb654102790 0x7fb6541989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb652d9d640 1 -- 172.21.15.63:0/2403704520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb654101de0 msgr2=0x7fb654198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb652d9d640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb654101de0 0x7fb654198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.464+0000 7fb652d9d640 1 -- 172.21.15.63:0/2403704520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65419d430 con 0x7fb654106f10 2024-09-16T01:22:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.465+0000 7fb652d9d640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654106f10 0x7fb65419cd50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009dc0 tx=0x7fb64c032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.465+0000 7fb6437fe640 1 -- 172.21.15.63:0/2403704520 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c004040 con 0x7fb654106f10 2024-09-16T01:22:12.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.465+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65419d6c0 con 0x7fb654106f10 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.465+0000 7fb6437fe640 1 -- 172.21.15.63:0/2403704520 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb64c004690 con 0x7fb654106f10 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.466+0000 7fb6437fe640 1 -- 172.21.15.63:0/2403704520 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c030cf0 con 0x7fb654106f10 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.466+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb654074420 con 0x7fb654106f10 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.467+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb654062900 con 0x7fb654106f10 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.468+0000 7fb6437fe640 1 -- 172.21.15.63:0/2403704520 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb64c02f4c0 con 0x7fb654106f10 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.469+0000 7fb6437fe640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb63c0a3350 0x7fb63c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.469+0000 7fb6437fe640 1 -- 172.21.15.63:0/2403704520 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb64c0f9ea0 con 0x7fb654106f10 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.469+0000 7fb65259c640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb63c0a3350 0x7fb63c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.469+0000 7fb6437fe640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] conn(0x7fb63c0ace50 0x7fb63c0af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.469+0000 7fb6437fe640 1 -- 172.21.15.63:0/2403704520 --> [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb64c0020b0 con 0x7fb63c0ace50 2024-09-16T01:22:12.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.469+0000 7fb6437fe640 1 -- 172.21.15.63:0/2403704520 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fb64c0fc540 con 0x7fb654106f10 2024-09-16T01:22:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.469+0000 7fb651d9b640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] conn(0x7fb63c0ace50 0x7fb63c0af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.470+0000 7fb65259c640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb63c0a3350 0x7fb63c0a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb644009990 tx=0x7fb644009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.470+0000 7fb651d9b640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] conn(0x7fb63c0ace50 0x7fb63c0af2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.471+0000 7fb6437fe640 1 -- 172.21.15.63:0/2403704520 <== osd.5 v2:172.21.15.192:6808/88086565 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb64c0020b0 con 0x7fb63c0ace50 2024-09-16T01:22:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.484+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 --> [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb654062d80 con 0x7fb63c0ace50 2024-09-16T01:22:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.485+0000 7fb6437fe640 1 -- 172.21.15.63:0/2403704520 <== osd.5 v2:172.21.15.192:6808/88086565 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb654062d80 con 0x7fb63c0ace50 2024-09-16T01:22:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.485+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 >> [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] conn(0x7fb63c0ace50 msgr2=0x7fb63c0af2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.485+0000 7fb658da2640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] conn(0x7fb63c0ace50 0x7fb63c0af2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.485+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb63c0a3350 msgr2=0x7fb63c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:12.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.485+0000 7fb658da2640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb63c0a3350 0x7fb63c0a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb644009990 tx=0x7fb644009110 comp rx=0 tx=0).stop 2024-09-16T01:22:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.485+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654106f10 msgr2=0x7fb65419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.485+0000 7fb658da2640 1 --2- 172.21.15.63:0/2403704520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654106f10 0x7fb65419cd50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009dc0 tx=0x7fb64c032f00 comp rx=0 tx=0).stop 2024-09-16T01:22:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.485+0000 7fb652d9d640 1 -- 172.21.15.63:0/2403704520 reap_dead start 2024-09-16T01:22:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.485+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 shutdown_connections 2024-09-16T01:22:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.485+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 >> 172.21.15.63:0/2403704520 conn(0x7fb6540fd8c0 msgr2=0x7fb6540fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.486+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 shutdown_connections 2024-09-16T01:22:12.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:10.486+0000 7fb658da2640 1 -- 172.21.15.63:0/2403704520 wait complete. 2024-09-16T01:22:12.774 INFO:teuthology.orchestra.run.smithi063.stdout:326417514518 2024-09-16T01:22:12.774 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-16T01:22:13.170 INFO:teuthology.orchestra.run.smithi063.stdout:163208757299 2024-09-16T01:22:13.170 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-16T01:22:13.237 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:13.237 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:13.238 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:13.241 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:13.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:13 smithi063 ceph-mon[31070]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-16T01:22:13.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:13 smithi192 ceph-mon[34775]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-16T01:22:13.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:13 smithi162 ceph-mon[34539]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-16T01:22:14.880 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:14.881 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:14.916 INFO:teuthology.orchestra.run.smithi063.stdout:55834574919 2024-09-16T01:22:14.916 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-16T01:22:15.105 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:15 smithi063 ceph-mon[31070]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T01:22:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.173+0000 7f4719b99640 1 -- 172.21.15.63:0/3900594341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4714102ef0 msgr2=0x7f471410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.173+0000 7f4719b99640 1 --2- 172.21.15.63:0/3900594341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4714102ef0 0x7f471410da40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f470c009ca0 tx=0x7f470c02a950 comp rx=0 tx=0).stop 2024-09-16T01:22:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.173+0000 7f4719b99640 1 -- 172.21.15.63:0/3900594341 shutdown_connections 2024-09-16T01:22:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.173+0000 7f4719b99640 1 --2- 172.21.15.63:0/3900594341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4714102ef0 0x7f471410da40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.173+0000 7f4719b99640 1 --2- 172.21.15.63:0/3900594341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714102570 0x7f47141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.173+0000 7f4719b99640 1 --2- 172.21.15.63:0/3900594341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4714100e20 0x7f4714101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.173+0000 7f4719b99640 1 -- 172.21.15.63:0/3900594341 >> 172.21.15.63:0/3900594341 conn(0x7f47140fc7d0 msgr2=0x7f47140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.173+0000 7f4719b99640 1 -- 172.21.15.63:0/3900594341 shutdown_connections 2024-09-16T01:22:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.173+0000 7f4719b99640 1 -- 172.21.15.63:0/3900594341 wait complete. 2024-09-16T01:22:15.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.173+0000 7f4719b99640 1 Processor -- start 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4719b99640 1 -- start start 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4719b99640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714100e20 0x7f47140fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4719b99640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4714102570 0x7f47140fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4719b99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4719b99640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4714110e30 con 0x7f4714102ef0 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4719b99640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4714110cb0 con 0x7f4714102570 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4719b99640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4714110fb0 con 0x7f4714100e20 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4713fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4713fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33430/0 (socket says 172.21.15.63:33430) 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4713fff640 1 -- 172.21.15.63:0/3160601503 learned_addr learned my addr 172.21.15.63:0/3160601503 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4712ffd640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4714102570 0x7f47140fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4713fff640 1 -- 172.21.15.63:0/3160601503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714100e20 msgr2=0x7f47140fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4713fff640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714100e20 0x7f47140fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4713fff640 1 -- 172.21.15.63:0/3160601503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4714102570 msgr2=0x7f47140fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4713fff640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4714102570 0x7f47140fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4713fff640 1 -- 172.21.15.63:0/3160601503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47141a68c0 con 0x7f4714102ef0 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.174+0000 7f4713fff640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f470c004af0 tx=0x7f470c031f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.175+0000 7f4710ff9640 1 -- 172.21.15.63:0/3160601503 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c034040 con 0x7f4714102ef0 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.175+0000 7f4710ff9640 1 -- 172.21.15.63:0/3160601503 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f470c0308f0 con 0x7f4714102ef0 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.175+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47141a6b50 con 0x7f4714102ef0 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.175+0000 7f4710ff9640 1 -- 172.21.15.63:0/3160601503 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c004600 con 0x7f4714102ef0 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.175+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47141a7080 con 0x7f4714102ef0 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.176+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4714062980 con 0x7f4714102ef0 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.177+0000 7f4710ff9640 1 -- 172.21.15.63:0/3160601503 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f470c037020 con 0x7f4714102ef0 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.178+0000 7f4710ff9640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f47000a3350 0x7f47000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.178+0000 7f47137fe640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f47000a3350 0x7f47000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.178+0000 7f4710ff9640 1 -- 172.21.15.63:0/3160601503 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f470c0f0b00 con 0x7f4714102ef0 2024-09-16T01:22:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.178+0000 7f4710ff9640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] conn(0x7f47000acf80 0x7f47000af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.178+0000 7f4710ff9640 1 -- 172.21.15.63:0/3160601503 --> [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47000afaf0 con 0x7f47000acf80 2024-09-16T01:22:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.178+0000 7f4710ff9640 1 -- 172.21.15.63:0/3160601503 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f470c0f0f30 con 0x7f4714102ef0 2024-09-16T01:22:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.178+0000 7f47137fe640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f47000a3350 0x7f47000a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0058c0 tx=0x7f46fc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.178+0000 7f4712ffd640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] conn(0x7f47000acf80 0x7f47000af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.179+0000 7f4712ffd640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] conn(0x7f47000acf80 0x7f47000af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.180+0000 7f4710ff9640 1 -- 172.21.15.63:0/3160601503 <== osd.7 v2:172.21.15.162:6816/4217268335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47000afaf0 con 0x7f47000acf80 2024-09-16T01:22:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.193+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 --> [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4714062d80 con 0x7f47000acf80 2024-09-16T01:22:15.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.194+0000 7f4710ff9640 1 -- 172.21.15.63:0/3160601503 <== osd.7 v2:172.21.15.162:6816/4217268335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4714062d80 con 0x7f47000acf80 2024-09-16T01:22:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 >> [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] conn(0x7f47000acf80 msgr2=0x7f47000af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4719b99640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] conn(0x7f47000acf80 0x7f47000af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f47000a3350 msgr2=0x7f47000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4719b99640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f47000a3350 0x7f47000a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0058c0 tx=0x7f46fc005850 comp rx=0 tx=0).stop 2024-09-16T01:22:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4714102ef0 msgr2=0x7f47140fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4719b99640 1 --2- 172.21.15.63:0/3160601503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4714102ef0 0x7f47140fd700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f470c004af0 tx=0x7f470c031f70 comp rx=0 tx=0).stop 2024-09-16T01:22:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4713fff640 1 -- 172.21.15.63:0/3160601503 reap_dead start 2024-09-16T01:22:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 shutdown_connections 2024-09-16T01:22:15.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 >> 172.21.15.63:0/3160601503 conn(0x7f47140fc7d0 msgr2=0x7f471406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:15.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 shutdown_connections 2024-09-16T01:22:15.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.195+0000 7f4719b99640 1 -- 172.21.15.63:0/3160601503 wait complete. 2024-09-16T01:22:15.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:15 smithi192 ceph-mon[34775]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T01:22:15.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:15 smithi162 ceph-mon[34539]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T01:22:15.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.416+0000 7f039082e640 1 -- 172.21.15.63:0/1442782695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f038c1082a0 msgr2=0x7f038c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.416+0000 7f039082e640 1 --2- 172.21.15.63:0/1442782695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f038c1082a0 0x7f038c10ec40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0384009cd0 tx=0x7f038402a8e0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.416+0000 7f039082e640 1 -- 172.21.15.63:0/1442782695 shutdown_connections 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.416+0000 7f039082e640 1 --2- 172.21.15.63:0/1442782695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f038c1082a0 0x7f038c10ec40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.416+0000 7f039082e640 1 --2- 172.21.15.63:0/1442782695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c1036e0 0x7f038c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.416+0000 7f039082e640 1 --2- 172.21.15.63:0/1442782695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f038c102d30 0x7f038c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.416+0000 7f039082e640 1 -- 172.21.15.63:0/1442782695 >> 172.21.15.63:0/1442782695 conn(0x7f038c0fc7d0 msgr2=0x7f038c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.416+0000 7f039082e640 1 -- 172.21.15.63:0/1442782695 shutdown_connections 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.416+0000 7f039082e640 1 -- 172.21.15.63:0/1442782695 wait complete. 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f039082e640 1 Processor -- start 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f039082e640 1 -- start start 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f039082e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c102d30 0x7f038c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f039082e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f038c1036e0 0x7f038c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f039082e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f038c1082a0 0x7f038c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f039082e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f038c111f50 con 0x7f038c1082a0 2024-09-16T01:22:15.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f039082e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f038c111dd0 con 0x7f038c102d30 2024-09-16T01:22:15.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f039082e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f038c1120d0 con 0x7f038c1036e0 2024-09-16T01:22:15.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f038ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f038c1082a0 0x7f038c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f038ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f038c1082a0 0x7f038c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33452/0 (socket says 172.21.15.63:33452) 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.417+0000 7f038ad9d640 1 -- 172.21.15.63:0/3343288742 learned_addr learned my addr 172.21.15.63:0/3343288742 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f038a59c640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c102d30 0x7f038c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f0383fff640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f038c1036e0 0x7f038c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f038ad9d640 1 -- 172.21.15.63:0/3343288742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f038c1036e0 msgr2=0x7f038c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f038ad9d640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f038c1036e0 0x7f038c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f038ad9d640 1 -- 172.21.15.63:0/3343288742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c102d30 msgr2=0x7f038c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f038ad9d640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c102d30 0x7f038c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f038ad9d640 1 -- 172.21.15.63:0/3343288742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c1a68a0 con 0x7f038c1082a0 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f0383fff640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f038c1036e0 0x7f038c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f038ad9d640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f038c1082a0 0x7f038c101410 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0384005cc0 tx=0x7f0384003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f03837fe640 1 -- 172.21.15.63:0/3343288742 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384004450 con 0x7f038c1082a0 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f03837fe640 1 -- 172.21.15.63:0/3343288742 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0384031c90 con 0x7f038c1082a0 2024-09-16T01:22:15.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c1a6b30 con 0x7f038c1082a0 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f03837fe640 1 -- 172.21.15.63:0/3343288742 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038403b400 con 0x7f038c1082a0 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.418+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c1a70c0 con 0x7f038c1082a0 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.419+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f038c0628c0 con 0x7f038c1082a0 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.420+0000 7f03837fe640 1 -- 172.21.15.63:0/3343288742 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0384004680 con 0x7f038c1082a0 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.421+0000 7f03837fe640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f03780a3350 0x7f03780a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.421+0000 7f038a59c640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f03780a3350 0x7f03780a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.421+0000 7f03837fe640 1 -- 172.21.15.63:0/3343288742 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f038402e030 con 0x7f038c1082a0 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.421+0000 7f03837fe640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] conn(0x7f03780acf80 0x7f03780af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.421+0000 7f03837fe640 1 -- 172.21.15.63:0/3343288742 --> [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f038403de50 con 0x7f03780acf80 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.421+0000 7f03837fe640 1 -- 172.21.15.63:0/3343288742 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f03840f52a0 con 0x7f038c1082a0 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.421+0000 7f0383fff640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] conn(0x7f03780acf80 0x7f03780af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.422+0000 7f038a59c640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f03780a3350 0x7f03780a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f037c005fd0 tx=0x7f037c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.422+0000 7f0383fff640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] conn(0x7f03780acf80 0x7f03780af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.422+0000 7f03837fe640 1 -- 172.21.15.63:0/3343288742 <== osd.0 v2:172.21.15.63:6802/2972213449 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f038403de50 con 0x7f03780acf80 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.436+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 --> [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f038c062cf0 con 0x7f03780acf80 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.436+0000 7f03837fe640 1 -- 172.21.15.63:0/3343288742 <== osd.0 v2:172.21.15.63:6802/2972213449 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f038c062cf0 con 0x7f03780acf80 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] conn(0x7f03780acf80 msgr2=0x7f03780af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f039082e640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] conn(0x7f03780acf80 0x7f03780af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f03780a3350 msgr2=0x7f03780a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f039082e640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f03780a3350 0x7f03780a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f037c005fd0 tx=0x7f037c00b390 comp rx=0 tx=0).stop 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f038c1082a0 msgr2=0x7f038c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f039082e640 1 --2- 172.21.15.63:0/3343288742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f038c1082a0 0x7f038c101410 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0384005cc0 tx=0x7f0384003c20 comp rx=0 tx=0).stop 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f038ad9d640 1 -- 172.21.15.63:0/3343288742 reap_dead start 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 shutdown_connections 2024-09-16T01:22:15.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 >> 172.21.15.63:0/3343288742 conn(0x7f038c0fc7d0 msgr2=0x7f038c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:15.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 shutdown_connections 2024-09-16T01:22:15.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.437+0000 7f039082e640 1 -- 172.21.15.63:0/3343288742 wait complete. 2024-09-16T01:22:16.124 INFO:teuthology.orchestra.run.smithi063.stdout:34359738446 2024-09-16T01:22:16.125 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-16T01:22:16.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.314+0000 7f848259e640 1 -- 172.21.15.63:0/1730638169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f847c103780 msgr2=0x7f847c107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.314+0000 7f848259e640 1 --2- 172.21.15.63:0/1730638169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f847c103780 0x7f847c107bc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8470009930 tx=0x7f847002a420 comp rx=0 tx=0).stop 2024-09-16T01:22:16.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.314+0000 7f848259e640 1 -- 172.21.15.63:0/1730638169 shutdown_connections 2024-09-16T01:22:16.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.314+0000 7f848259e640 1 --2- 172.21.15.63:0/1730638169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c108300 0x7f847c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.314+0000 7f848259e640 1 --2- 172.21.15.63:0/1730638169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f847c103780 0x7f847c107bc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.314+0000 7f848259e640 1 --2- 172.21.15.63:0/1730638169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f847c102dd0 0x7f847c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.314+0000 7f848259e640 1 -- 172.21.15.63:0/1730638169 >> 172.21.15.63:0/1730638169 conn(0x7f847c0fc7d0 msgr2=0x7f847c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:16.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.315+0000 7f848259e640 1 -- 172.21.15.63:0/1730638169 shutdown_connections 2024-09-16T01:22:16.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.315+0000 7f848259e640 1 -- 172.21.15.63:0/1730638169 wait complete. 2024-09-16T01:22:16.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.315+0000 7f848259e640 1 Processor -- start 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.315+0000 7f848259e640 1 -- start start 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f848259e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c102dd0 0x7f847c100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f848259e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f847c103780 0x7f847c100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f848259e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f847c108300 0x7f847c1014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f848259e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f847c112050 con 0x7f847c108300 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f848259e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f847c111ed0 con 0x7f847c103780 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f848259e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f847c1121d0 con 0x7f847c102dd0 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f8480b3b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f847c108300 0x7f847c1014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f8480b3b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f847c108300 0x7f847c1014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33456/0 (socket says 172.21.15.63:33456) 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f8480b3b640 1 -- 172.21.15.63:0/4249030103 learned_addr learned my addr 172.21.15.63:0/4249030103 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f847bfff640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c102dd0 0x7f847c100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f847b7fe640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f847c103780 0x7f847c100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f8480b3b640 1 -- 172.21.15.63:0/4249030103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c102dd0 msgr2=0x7f847c100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f8480b3b640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c102dd0 0x7f847c100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f8480b3b640 1 -- 172.21.15.63:0/4249030103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f847c103780 msgr2=0x7f847c100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f8480b3b640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f847c103780 0x7f847c100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f8480b3b640 1 -- 172.21.15.63:0/4249030103 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847c1a6af0 con 0x7f847c108300 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f847b7fe640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f847c103780 0x7f847c100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.316+0000 7f8480b3b640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f847c108300 0x7f847c1014b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f847400b970 tx=0x7f847400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.317+0000 7f84797fa640 1 -- 172.21.15.63:0/4249030103 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8474019070 con 0x7f847c108300 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.317+0000 7f84797fa640 1 -- 172.21.15.63:0/4249030103 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8474014440 con 0x7f847c108300 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.317+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847c1a6de0 con 0x7f847c108300 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.317+0000 7f84797fa640 1 -- 172.21.15.63:0/4249030103 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84740075d0 con 0x7f847c108300 2024-09-16T01:22:16.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.317+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f847c1a72f0 con 0x7f847c108300 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.318+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f847c0628c0 con 0x7f847c108300 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.319+0000 7f84797fa640 1 -- 172.21.15.63:0/4249030103 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f847401c070 con 0x7f847c108300 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.320+0000 7f84797fa640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f84640a3350 0x7f84640a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.320+0000 7f847bfff640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f84640a3350 0x7f84640a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.320+0000 7f84797fa640 1 -- 172.21.15.63:0/4249030103 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f84740cf630 con 0x7f847c108300 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.320+0000 7f84797fa640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] conn(0x7f84640acf80 0x7f84640af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.320+0000 7f84797fa640 1 -- 172.21.15.63:0/4249030103 --> [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84640afaf0 con 0x7f84640acf80 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.320+0000 7f84797fa640 1 -- 172.21.15.63:0/4249030103 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f84740cfa60 con 0x7f847c108300 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.320+0000 7f847bfff640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f84640a3350 0x7f84640a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f846c009990 tx=0x7f846c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.320+0000 7f847b7fe640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] conn(0x7f84640acf80 0x7f84640af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.321+0000 7f847b7fe640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] conn(0x7f84640acf80 0x7f84640af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:16.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.322+0000 7f84797fa640 1 -- 172.21.15.63:0/4249030103 <== osd.8 v2:172.21.15.192:6816/2030889502 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f84640afaf0 con 0x7f84640acf80 2024-09-16T01:22:16.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.336+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 --> [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f847c062cf0 con 0x7f84640acf80 2024-09-16T01:22:16.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.336+0000 7f84797fa640 1 -- 172.21.15.63:0/4249030103 <== osd.8 v2:172.21.15.192:6816/2030889502 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f847c062cf0 con 0x7f84640acf80 2024-09-16T01:22:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 >> [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] conn(0x7f84640acf80 msgr2=0x7f84640af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f848259e640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] conn(0x7f84640acf80 0x7f84640af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f84640a3350 msgr2=0x7f84640a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f848259e640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f84640a3350 0x7f84640a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f846c009990 tx=0x7f846c009110 comp rx=0 tx=0).stop 2024-09-16T01:22:16.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f847c108300 msgr2=0x7f847c1014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f848259e640 1 --2- 172.21.15.63:0/4249030103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f847c108300 0x7f847c1014b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f847400b970 tx=0x7f847400bd70 comp rx=0 tx=0).stop 2024-09-16T01:22:16.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f8480b3b640 1 -- 172.21.15.63:0/4249030103 reap_dead start 2024-09-16T01:22:16.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 shutdown_connections 2024-09-16T01:22:16.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 >> 172.21.15.63:0/4249030103 conn(0x7f847c0fc7d0 msgr2=0x7f847c105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:16.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 shutdown_connections 2024-09-16T01:22:16.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:16.337+0000 7f848259e640 1 -- 172.21.15.63:0/4249030103 wait complete. 2024-09-16T01:22:16.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.066+0000 7fca956a7640 1 -- 172.21.15.63:0/302004264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca90102e00 msgr2=0x7fca901031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.066+0000 7fca956a7640 1 --2- 172.21.15.63:0/302004264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca90102e00 0x7fca901031e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fca80009900 tx=0x7fca8002a480 comp rx=0 tx=0).stop 2024-09-16T01:22:16.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.066+0000 7fca956a7640 1 -- 172.21.15.63:0/302004264 shutdown_connections 2024-09-16T01:22:16.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.066+0000 7fca956a7640 1 --2- 172.21.15.63:0/302004264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca9010c1a0 0x7fca9010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.066+0000 7fca956a7640 1 --2- 172.21.15.63:0/302004264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90103720 0x7fca9010bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.066+0000 7fca956a7640 1 --2- 172.21.15.63:0/302004264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca90102e00 0x7fca901031e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.066+0000 7fca956a7640 1 -- 172.21.15.63:0/302004264 >> 172.21.15.63:0/302004264 conn(0x7fca900fc7a0 msgr2=0x7fca900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:16.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.066+0000 7fca956a7640 1 -- 172.21.15.63:0/302004264 shutdown_connections 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.066+0000 7fca956a7640 1 -- 172.21.15.63:0/302004264 wait complete. 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.067+0000 7fca956a7640 1 Processor -- start 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.067+0000 7fca956a7640 1 -- start start 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.067+0000 7fca956a7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca90102e00 0x7fca90100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca956a7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90103720 0x7fca90100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca956a7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9010c1a0 0x7fca901014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca956a7640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fca90111e70 con 0x7fca9010c1a0 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca956a7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca90111cf0 con 0x7fca90103720 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca956a7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fca90111ff0 con 0x7fca90102e00 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9010c1a0 0x7fca901014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9010c1a0 0x7fca901014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33418/0 (socket says 172.21.15.63:33418) 2024-09-16T01:22:16.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8f7fe640 1 -- 172.21.15.63:0/3635224318 learned_addr learned my addr 172.21.15.63:0/3635224318 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8effd640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca90102e00 0x7fca90100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8e7fc640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90103720 0x7fca90100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8f7fe640 1 -- 172.21.15.63:0/3635224318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca90102e00 msgr2=0x7fca90100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8f7fe640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca90102e00 0x7fca90100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8f7fe640 1 -- 172.21.15.63:0/3635224318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90103720 msgr2=0x7fca90100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8f7fe640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90103720 0x7fca90100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8f7fe640 1 -- 172.21.15.63:0/3635224318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca901a6830 con 0x7fca9010c1a0 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8e7fc640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca90103720 0x7fca90100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca8f7fe640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9010c1a0 0x7fca901014e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fca8800eaa0 tx=0x7fca8800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca77fff640 1 -- 172.21.15.63:0/3635224318 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8800cdb0 con 0x7fca9010c1a0 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca77fff640 1 -- 172.21.15.63:0/3635224318 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca88005020 con 0x7fca9010c1a0 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca901a6b20 con 0x7fca9010c1a0 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.068+0000 7fca77fff640 1 -- 172.21.15.63:0/3635224318 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca880116d0 con 0x7fca9010c1a0 2024-09-16T01:22:16.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.069+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca901a7010 con 0x7fca9010c1a0 2024-09-16T01:22:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.070+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca900628c0 con 0x7fca9010c1a0 2024-09-16T01:22:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.071+0000 7fca77fff640 1 -- 172.21.15.63:0/3635224318 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fca880051d0 con 0x7fca9010c1a0 2024-09-16T01:22:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.071+0000 7fca77fff640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fca780a32d0 0x7fca780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.072+0000 7fca77fff640 1 -- 172.21.15.63:0/3635224318 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fca880cfce0 con 0x7fca9010c1a0 2024-09-16T01:22:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.072+0000 7fca8effd640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fca780a32d0 0x7fca780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.072+0000 7fca77fff640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] conn(0x7fca780acf00 0x7fca780af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.072+0000 7fca77fff640 1 -- 172.21.15.63:0/3635224318 --> [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca88018ec0 con 0x7fca780acf00 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.072+0000 7fca77fff640 1 -- 172.21.15.63:0/3635224318 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fca880d2380 con 0x7fca9010c1a0 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.072+0000 7fca8e7fc640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] conn(0x7fca780acf00 0x7fca780af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.072+0000 7fca8e7fc640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] conn(0x7fca780acf00 0x7fca780af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.072+0000 7fca8effd640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fca780a32d0 0x7fca780a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fca80000c00 tx=0x7fca80031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.073+0000 7fca77fff640 1 -- 172.21.15.63:0/3635224318 <== osd.3 v2:172.21.15.63:6810/913316325 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca88018ec0 con 0x7fca780acf00 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.103+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 --> [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca90062d40 con 0x7fca780acf00 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.104+0000 7fca77fff640 1 -- 172.21.15.63:0/3635224318 <== osd.3 v2:172.21.15.63:6810/913316325 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca90062d40 con 0x7fca780acf00 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.104+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] conn(0x7fca780acf00 msgr2=0x7fca780af3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.105+0000 7fca956a7640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] conn(0x7fca780acf00 0x7fca780af3a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.105+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fca780a32d0 msgr2=0x7fca780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.105+0000 7fca956a7640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fca780a32d0 0x7fca780a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fca80000c00 tx=0x7fca80031400 comp rx=0 tx=0).stop 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.105+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9010c1a0 msgr2=0x7fca901014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.105+0000 7fca956a7640 1 --2- 172.21.15.63:0/3635224318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca9010c1a0 0x7fca901014e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fca8800eaa0 tx=0x7fca8800ef60 comp rx=0 tx=0).stop 2024-09-16T01:22:16.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.105+0000 7fca8f7fe640 1 -- 172.21.15.63:0/3635224318 reap_dead start 2024-09-16T01:22:16.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.105+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 shutdown_connections 2024-09-16T01:22:16.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.105+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 >> 172.21.15.63:0/3635224318 conn(0x7fca900fc7a0 msgr2=0x7fca900fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:16.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.105+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 shutdown_connections 2024-09-16T01:22:16.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:15.105+0000 7fca956a7640 1 -- 172.21.15.63:0/3635224318 wait complete. 2024-09-16T01:22:17.322 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:17 smithi063 ceph-mon[31070]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T01:22:17.356 INFO:teuthology.orchestra.run.smithi063.stdout:244813135911 2024-09-16T01:22:17.356 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-16T01:22:17.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:17 smithi192 ceph-mon[34775]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T01:22:17.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:17 smithi162 ceph-mon[34539]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-16T01:22:17.798 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:17.920 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:17.920 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:18.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.003+0000 7f3361541640 1 -- 172.21.15.63:0/46270100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f335c102790 msgr2=0x7f335c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.003+0000 7f3361541640 1 --2- 172.21.15.63:0/46270100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f335c102790 0x7f335c1067e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3350009900 tx=0x7f335002a410 comp rx=0 tx=0).stop 2024-09-16T01:22:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.003+0000 7f3361541640 1 -- 172.21.15.63:0/46270100 shutdown_connections 2024-09-16T01:22:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.003+0000 7f3361541640 1 --2- 172.21.15.63:0/46270100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335c106f10 0x7f335c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.003+0000 7f3361541640 1 --2- 172.21.15.63:0/46270100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f335c102790 0x7f335c1067e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.003+0000 7f3361541640 1 --2- 172.21.15.63:0/46270100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f335c101de0 0x7f335c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.003+0000 7f3361541640 1 -- 172.21.15.63:0/46270100 >> 172.21.15.63:0/46270100 conn(0x7f335c0fd8c0 msgr2=0x7f335c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.003+0000 7f3361541640 1 -- 172.21.15.63:0/46270100 shutdown_connections 2024-09-16T01:22:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.003+0000 7f3361541640 1 -- 172.21.15.63:0/46270100 wait complete. 2024-09-16T01:22:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.004+0000 7f3361541640 1 Processor -- start 2024-09-16T01:22:18.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.004+0000 7f3361541640 1 -- start start 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.004+0000 7f3361541640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f335c101de0 0x7f335c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.004+0000 7f3361541640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f335c102790 0x7f335c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.004+0000 7f3361541640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335c106f10 0x7f335c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.004+0000 7f3361541640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f335c111e20 con 0x7f335c102790 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.004+0000 7f3361541640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f335c111ca0 con 0x7f335c106f10 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.004+0000 7f3361541640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f335c111fa0 con 0x7f335c101de0 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f335c102790 0x7f335c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f335c102790 0x7f335c198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33466/0 (socket says 172.21.15.63:33466) 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335a7fc640 1 -- 172.21.15.63:0/2138093176 learned_addr learned my addr 172.21.15.63:0/2138093176 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335affd640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f335c101de0 0x7f335c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:18.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335b7fe640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335c106f10 0x7f335c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335a7fc640 1 -- 172.21.15.63:0/2138093176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f335c101de0 msgr2=0x7f335c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335a7fc640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f335c101de0 0x7f335c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335a7fc640 1 -- 172.21.15.63:0/2138093176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335c106f10 msgr2=0x7f335c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335a7fc640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335c106f10 0x7f335c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335a7fc640 1 -- 172.21.15.63:0/2138093176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c19d2f0 con 0x7f335c102790 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f335a7fc640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f335c102790 0x7f335c198880 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3350005940 tx=0x7f3350004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f3343fff640 1 -- 172.21.15.63:0/2138093176 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335003f030 con 0x7f335c102790 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f3343fff640 1 -- 172.21.15.63:0/2138093176 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3350003aa0 con 0x7f335c102790 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f3361541640 1 -- 172.21.15.63:0/2138093176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335c19d580 con 0x7f335c102790 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f3343fff640 1 -- 172.21.15.63:0/2138093176 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3350035070 con 0x7f335c102790 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.005+0000 7f3361541640 1 -- 172.21.15.63:0/2138093176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f335c1a4ec0 con 0x7f335c102790 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.006+0000 7f3361541640 1 -- 172.21.15.63:0/2138093176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335c1032c0 con 0x7f335c102790 2024-09-16T01:22:18.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.007+0000 7f3343fff640 1 -- 172.21.15.63:0/2138093176 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3350042030 con 0x7f335c102790 2024-09-16T01:22:18.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.008+0000 7f3343fff640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f33440a32d0 0x7f33440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:18.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.008+0000 7f335affd640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f33440a32d0 0x7f33440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:18.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.008+0000 7f3343fff640 1 -- 172.21.15.63:0/2138093176 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f33500f0300 con 0x7f335c102790 2024-09-16T01:22:18.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.009+0000 7f335affd640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f33440a32d0 0x7f33440a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f334c005fd0 tx=0x7f334c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:18.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.013+0000 7f3343fff640 1 -- 172.21.15.63:0/2138093176 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33500bcec0 con 0x7f335c102790 2024-09-16T01:22:18.083 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.208+0000 7f3361541640 1 -- 172.21.15.63:0/2138093176 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f335c10a150 con 0x7f335c102790 2024-09-16T01:22:18.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.209+0000 7f3343fff640 1 -- 172.21.15.63:0/2138093176 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f33500bc7c0 con 0x7f335c102790 2024-09-16T01:22:18.210 INFO:teuthology.orchestra.run.smithi063.stdout:77309411397 2024-09-16T01:22:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 -- 172.21.15.63:0/2138093176 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f33440a32d0 msgr2=0x7f33440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f33440a32d0 0x7f33440a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f334c005fd0 tx=0x7f334c005850 comp rx=0 tx=0).stop 2024-09-16T01:22:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 -- 172.21.15.63:0/2138093176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f335c102790 msgr2=0x7f335c198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f335c102790 0x7f335c198880 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3350005940 tx=0x7f3350004270 comp rx=0 tx=0).stop 2024-09-16T01:22:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 -- 172.21.15.63:0/2138093176 shutdown_connections 2024-09-16T01:22:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f33440a32d0 0x7f33440a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f335c106f10 0x7f335c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f335c102790 0x7f335c198880 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 --2- 172.21.15.63:0/2138093176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f335c101de0 0x7f335c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 -- 172.21.15.63:0/2138093176 >> 172.21.15.63:0/2138093176 conn(0x7f335c0fd8c0 msgr2=0x7f335c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 -- 172.21.15.63:0/2138093176 shutdown_connections 2024-09-16T01:22:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.211+0000 7f3361541640 1 -- 172.21.15.63:0/2138093176 wait complete. 2024-09-16T01:22:18.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.916+0000 7fc5538a1640 1 -- 172.21.15.63:0/578122680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102790 msgr2=0x7fc54c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.916+0000 7fc5538a1640 1 --2- 172.21.15.63:0/578122680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102790 0x7fc54c1067e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc548009ca0 tx=0x7fc54802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.916+0000 7fc5538a1640 1 -- 172.21.15.63:0/578122680 shutdown_connections 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.916+0000 7fc5538a1640 1 --2- 172.21.15.63:0/578122680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54c106f10 0x7fc54c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.916+0000 7fc5538a1640 1 --2- 172.21.15.63:0/578122680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102790 0x7fc54c1067e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.916+0000 7fc5538a1640 1 --2- 172.21.15.63:0/578122680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc54c101de0 0x7fc54c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.916+0000 7fc5538a1640 1 -- 172.21.15.63:0/578122680 >> 172.21.15.63:0/578122680 conn(0x7fc54c0fd8c0 msgr2=0x7fc54c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.916+0000 7fc5538a1640 1 -- 172.21.15.63:0/578122680 shutdown_connections 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.916+0000 7fc5538a1640 1 -- 172.21.15.63:0/578122680 wait complete. 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc5538a1640 1 Processor -- start 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc5538a1640 1 -- start start 2024-09-16T01:22:18.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc5538a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54c101de0 0x7fc54c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc5538a1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102790 0x7fc54c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc5538a1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc54c106f10 0x7fc54c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc5538a1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c111e40 con 0x7fc54c102790 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc5538a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c111cc0 con 0x7fc54c101de0 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc5538a1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c111fc0 con 0x7fc54c106f10 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc550e3c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102790 0x7fc54c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc550e3c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102790 0x7fc54c1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46704/0 (socket says 172.21.15.63:46704) 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc550e3c640 1 -- 172.21.15.63:0/668257362 learned_addr learned my addr 172.21.15.63:0/668257362 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc55163d640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54c101de0 0x7fc54c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc551e3e640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc54c106f10 0x7fc54c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:18.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc550e3c640 1 -- 172.21.15.63:0/668257362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc54c106f10 msgr2=0x7fc54c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc550e3c640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc54c106f10 0x7fc54c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc550e3c640 1 -- 172.21.15.63:0/668257362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54c101de0 msgr2=0x7fc54c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc550e3c640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54c101de0 0x7fc54c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc550e3c640 1 -- 172.21.15.63:0/668257362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c19d410 con 0x7fc54c102790 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc551e3e640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc54c106f10 0x7fc54c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.917+0000 7fc55163d640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54c101de0 0x7fc54c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.918+0000 7fc550e3c640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102790 0x7fc54c1989a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc54802ade0 tx=0x7fc548032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.918+0000 7fc53e7fc640 1 -- 172.21.15.63:0/668257362 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548003cf0 con 0x7fc54c102790 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.918+0000 7fc5538a1640 1 -- 172.21.15.63:0/668257362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c19d6a0 con 0x7fc54c102790 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.918+0000 7fc53e7fc640 1 -- 172.21.15.63:0/668257362 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc5480044f0 con 0x7fc54c102790 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.918+0000 7fc53e7fc640 1 -- 172.21.15.63:0/668257362 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548030bd0 con 0x7fc54c102790 2024-09-16T01:22:18.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.918+0000 7fc5538a1640 1 -- 172.21.15.63:0/668257362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54c1a4fe0 con 0x7fc54c102790 2024-09-16T01:22:18.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.919+0000 7fc5538a1640 1 -- 172.21.15.63:0/668257362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54c1021c0 con 0x7fc54c102790 2024-09-16T01:22:18.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.920+0000 7fc53e7fc640 1 -- 172.21.15.63:0/668257362 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc548030d70 con 0x7fc54c102790 2024-09-16T01:22:18.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.921+0000 7fc53e7fc640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc5380a32d0 0x7fc5380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:18.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.921+0000 7fc55163d640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc5380a32d0 0x7fc5380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:18.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.921+0000 7fc53e7fc640 1 -- 172.21.15.63:0/668257362 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc5480f10a0 con 0x7fc54c102790 2024-09-16T01:22:18.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.921+0000 7fc55163d640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc5380a32d0 0x7fc5380a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc540009d60 tx=0x7fc540009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:18.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:18.924+0000 7fc53e7fc640 1 -- 172.21.15.63:0/668257362 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5480bdd70 con 0x7fc54c102790 2024-09-16T01:22:19.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:19 smithi063 ceph-mon[31070]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-16T01:22:19.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:19 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2138093176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T01:22:19.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.110+0000 7fc5538a1640 1 -- 172.21.15.63:0/668257362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc54c1997c0 con 0x7fc54c102790 2024-09-16T01:22:19.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.111+0000 7fc53e7fc640 1 -- 172.21.15.63:0/668257362 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc54c1997c0 con 0x7fc54c102790 2024-09-16T01:22:19.112 INFO:teuthology.orchestra.run.smithi063.stdout:274877906978 2024-09-16T01:22:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 -- 172.21.15.63:0/668257362 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc5380a32d0 msgr2=0x7fc5380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc5380a32d0 0x7fc5380a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc540009d60 tx=0x7fc540009110 comp rx=0 tx=0).stop 2024-09-16T01:22:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 -- 172.21.15.63:0/668257362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102790 msgr2=0x7fc54c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102790 0x7fc54c1989a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc54802ade0 tx=0x7fc548032ff0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 -- 172.21.15.63:0/668257362 shutdown_connections 2024-09-16T01:22:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc5380a32d0 0x7fc5380a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc54c106f10 0x7fc54c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc54c102790 0x7fc54c1989a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 --2- 172.21.15.63:0/668257362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc54c101de0 0x7fc54c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 -- 172.21.15.63:0/668257362 >> 172.21.15.63:0/668257362 conn(0x7fc54c0fd8c0 msgr2=0x7fc54c0fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 -- 172.21.15.63:0/668257362 shutdown_connections 2024-09-16T01:22:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.113+0000 7fc5538a1640 1 -- 172.21.15.63:0/668257362 wait complete. 2024-09-16T01:22:19.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:19 smithi192 ceph-mon[34775]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-16T01:22:19.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:19 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2138093176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T01:22:19.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:19 smithi162 ceph-mon[34539]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-16T01:22:19.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:19 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2138093176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T01:22:19.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.512+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/2083228910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c84106a80 msgr2=0x7f6c84106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.512+0000 7f6c8b1ef640 1 --2- 172.21.15.63:0/2083228910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c84106a80 0x7f6c84106e60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009930 tx=0x7f6c7802a420 comp rx=0 tx=0).stop 2024-09-16T01:22:19.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.512+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/2083228910 shutdown_connections 2024-09-16T01:22:19.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.512+0000 7f6c8b1ef640 1 --2- 172.21.15.63:0/2083228910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c84101420 0x7f6c8410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.512+0000 7f6c8b1ef640 1 --2- 172.21.15.63:0/2083228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84100a80 0x7f6c84100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.512+0000 7f6c8b1ef640 1 --2- 172.21.15.63:0/2083228910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c84106a80 0x7f6c84106e60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.512+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/2083228910 >> 172.21.15.63:0/2083228910 conn(0x7f6c840fc7a0 msgr2=0x7f6c840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.512+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/2083228910 shutdown_connections 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.512+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/2083228910 wait complete. 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8b1ef640 1 Processor -- start 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8b1ef640 1 -- start start 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8b1ef640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c84100a80 0x7f6c84199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8b1ef640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84101420 0x7f6c841997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8b1ef640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c84106a80 0x7f6c841a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8b1ef640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84110d30 con 0x7f6c84106a80 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8b1ef640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84110bb0 con 0x7f6c84101420 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8b1ef640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84110eb0 con 0x7f6c84100a80 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8978c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c84106a80 0x7f6c841a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:19.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8978c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c84106a80 0x7f6c841a42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46728/0 (socket says 172.21.15.63:46728) 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8978c640 1 -- 172.21.15.63:0/409105645 learned_addr learned my addr 172.21.15.63:0/409105645 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c88f8b640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c84100a80 0x7f6c84199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c83fff640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84101420 0x7f6c841997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8978c640 1 -- 172.21.15.63:0/409105645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c84100a80 msgr2=0x7f6c84199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8978c640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c84100a80 0x7f6c84199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8978c640 1 -- 172.21.15.63:0/409105645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84101420 msgr2=0x7f6c841997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8978c640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84101420 0x7f6c841997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.513+0000 7f6c8978c640 1 -- 172.21.15.63:0/409105645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c841a4820 con 0x7f6c84106a80 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.514+0000 7f6c8978c640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c84106a80 0x7f6c841a42e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00eaa0 tx=0x7f6c7c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.514+0000 7f6c81ffb640 1 -- 172.21.15.63:0/409105645 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00cdb0 con 0x7f6c84106a80 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.514+0000 7f6c81ffb640 1 -- 172.21.15.63:0/409105645 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c7c005020 con 0x7f6c84106a80 2024-09-16T01:22:19.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.514+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/409105645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c841a49f0 con 0x7f6c84106a80 2024-09-16T01:22:19.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.514+0000 7f6c81ffb640 1 -- 172.21.15.63:0/409105645 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0116d0 con 0x7f6c84106a80 2024-09-16T01:22:19.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.514+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/409105645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c841a4eb0 con 0x7f6c84106a80 2024-09-16T01:22:19.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.515+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/409105645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c84100ee0 con 0x7f6c84106a80 2024-09-16T01:22:19.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.516+0000 7f6c81ffb640 1 -- 172.21.15.63:0/409105645 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6c7c0051d0 con 0x7f6c84106a80 2024-09-16T01:22:19.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.517+0000 7f6c81ffb640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6c740a32d0 0x7f6c740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:19.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.517+0000 7f6c81ffb640 1 -- 172.21.15.63:0/409105645 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6c7c0cfba0 con 0x7f6c84106a80 2024-09-16T01:22:19.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.517+0000 7f6c88f8b640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6c740a32d0 0x7f6c740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:19.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.517+0000 7f6c88f8b640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6c740a32d0 0x7f6c740a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009900 tx=0x7f6c78000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:19.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.521+0000 7f6c81ffb640 1 -- 172.21.15.63:0/409105645 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c7c016030 con 0x7f6c84106a80 2024-09-16T01:22:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.700+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/409105645 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f6c84108ff0 con 0x7f6c84106a80 2024-09-16T01:22:19.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.700+0000 7f6c81ffb640 1 -- 172.21.15.63:0/409105645 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6c7c09c110 con 0x7f6c84106a80 2024-09-16T01:22:19.702 INFO:teuthology.orchestra.run.smithi063.stdout:296352743452 2024-09-16T01:22:19.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/409105645 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6c740a32d0 msgr2=0x7f6c740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6c740a32d0 0x7f6c740a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009900 tx=0x7f6c78000bc0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/409105645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c84106a80 msgr2=0x7f6c841a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c84106a80 0x7f6c841a42e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00eaa0 tx=0x7f6c7c00ef60 comp rx=0 tx=0).stop 2024-09-16T01:22:19.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/409105645 shutdown_connections 2024-09-16T01:22:19.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6c740a32d0 0x7f6c740a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c84106a80 0x7f6c841a42e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c84101420 0x7f6c841997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 --2- 172.21.15.63:0/409105645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c84100a80 0x7f6c84199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/409105645 >> 172.21.15.63:0/409105645 conn(0x7f6c840fc7a0 msgr2=0x7f6c840fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:19.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/409105645 shutdown_connections 2024-09-16T01:22:19.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.704+0000 7f6c8b1ef640 1 -- 172.21.15.63:0/409105645 wait complete. 2024-09-16T01:22:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.728+0000 7fba1c2fd640 1 -- 172.21.15.63:0/2108898878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba1410c180 msgr2=0x7fba1410e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.728+0000 7fba1c2fd640 1 --2- 172.21.15.63:0/2108898878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba1410c180 0x7fba1410e620 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009ca0 tx=0x7fba0c02a950 comp rx=0 tx=0).stop 2024-09-16T01:22:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.728+0000 7fba1c2fd640 1 -- 172.21.15.63:0/2108898878 shutdown_connections 2024-09-16T01:22:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.728+0000 7fba1c2fd640 1 --2- 172.21.15.63:0/2108898878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba1410c180 0x7fba1410e620 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.728+0000 7fba1c2fd640 1 --2- 172.21.15.63:0/2108898878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba14103670 0x7fba1410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.728+0000 7fba1c2fd640 1 --2- 172.21.15.63:0/2108898878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba14102d50 0x7fba14103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.728+0000 7fba1c2fd640 1 -- 172.21.15.63:0/2108898878 >> 172.21.15.63:0/2108898878 conn(0x7fba140fc7d0 msgr2=0x7fba140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.728+0000 7fba1c2fd640 1 -- 172.21.15.63:0/2108898878 shutdown_connections 2024-09-16T01:22:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.728+0000 7fba1c2fd640 1 -- 172.21.15.63:0/2108898878 wait complete. 2024-09-16T01:22:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1c2fd640 1 Processor -- start 2024-09-16T01:22:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1c2fd640 1 -- start start 2024-09-16T01:22:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1c2fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba14102d50 0x7fba141009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1c2fd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba14103670 0x7fba14100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1c2fd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1410c180 0x7fba14101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1c2fd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fba14111e30 con 0x7fba14103670 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1c2fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba14111cb0 con 0x7fba14102d50 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1c2fd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fba14111fb0 con 0x7fba1410c180 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba19898640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba14103670 0x7fba14100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba19898640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba14103670 0x7fba14100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46756/0 (socket says 172.21.15.63:46756) 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba19898640 1 -- 172.21.15.63:0/1356953793 learned_addr learned my addr 172.21.15.63:0/1356953793 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1a099640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba14102d50 0x7fba141009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1a89a640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1410c180 0x7fba14101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba19898640 1 -- 172.21.15.63:0/1356953793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1410c180 msgr2=0x7fba14101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba19898640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1410c180 0x7fba14101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba19898640 1 -- 172.21.15.63:0/1356953793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba14102d50 msgr2=0x7fba141009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba19898640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba14102d50 0x7fba141009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba19898640 1 -- 172.21.15.63:0/1356953793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba141a67f0 con 0x7fba14103670 2024-09-16T01:22:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.729+0000 7fba1a099640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba14102d50 0x7fba141009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.730+0000 7fba19898640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba14103670 0x7fba14100ef0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fba0400e9f0 tx=0x7fba0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.730+0000 7fba0b7fe640 1 -- 172.21.15.63:0/1356953793 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0400cd80 con 0x7fba14103670 2024-09-16T01:22:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.730+0000 7fba0b7fe640 1 -- 172.21.15.63:0/1356953793 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba040035f0 con 0x7fba14103670 2024-09-16T01:22:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.730+0000 7fba0b7fe640 1 -- 172.21.15.63:0/1356953793 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04010690 con 0x7fba14103670 2024-09-16T01:22:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.730+0000 7fba1c2fd640 1 -- 172.21.15.63:0/1356953793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba141a6ae0 con 0x7fba14103670 2024-09-16T01:22:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.730+0000 7fba1c2fd640 1 -- 172.21.15.63:0/1356953793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141a6fd0 con 0x7fba14103670 2024-09-16T01:22:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.731+0000 7fba1c2fd640 1 -- 172.21.15.63:0/1356953793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba14103130 con 0x7fba14103670 2024-09-16T01:22:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.732+0000 7fba0b7fe640 1 -- 172.21.15.63:0/1356953793 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fba040037a0 con 0x7fba14103670 2024-09-16T01:22:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.733+0000 7fba0b7fe640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba000a32d0 0x7fba000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.733+0000 7fba1a099640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba000a32d0 0x7fba000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.733+0000 7fba0b7fe640 1 -- 172.21.15.63:0/1356953793 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fba040cfdd0 con 0x7fba14103670 2024-09-16T01:22:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.734+0000 7fba1a099640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba000a32d0 0x7fba000a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fba100058c0 tx=0x7fba10005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.740+0000 7fba0b7fe640 1 -- 172.21.15.63:0/1356953793 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba0409c990 con 0x7fba14103670 2024-09-16T01:22:19.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.918+0000 7fba1c2fd640 1 -- 172.21.15.63:0/1356953793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fba14107220 con 0x7fba14103670 2024-09-16T01:22:19.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.918+0000 7fba0b7fe640 1 -- 172.21.15.63:0/1356953793 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fba0409c290 con 0x7fba14103670 2024-09-16T01:22:19.919 INFO:teuthology.orchestra.run.smithi063.stdout:163208757300 2024-09-16T01:22:19.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 -- 172.21.15.63:0/1356953793 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba000a32d0 msgr2=0x7fba000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba000a32d0 0x7fba000a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fba100058c0 tx=0x7fba10005850 comp rx=0 tx=0).stop 2024-09-16T01:22:19.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 -- 172.21.15.63:0/1356953793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba14103670 msgr2=0x7fba14100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:19.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba14103670 0x7fba14100ef0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fba0400e9f0 tx=0x7fba0400eeb0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 -- 172.21.15.63:0/1356953793 shutdown_connections 2024-09-16T01:22:19.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fba000a32d0 0x7fba000a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1410c180 0x7fba14101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba14103670 0x7fba14100ef0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 --2- 172.21.15.63:0/1356953793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba14102d50 0x7fba141009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:19.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 -- 172.21.15.63:0/1356953793 >> 172.21.15.63:0/1356953793 conn(0x7fba140fc7d0 msgr2=0x7fba140fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:19.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 -- 172.21.15.63:0/1356953793 shutdown_connections 2024-09-16T01:22:19.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:19.920+0000 7fba1c2fd640 1 -- 172.21.15.63:0/1356953793 wait complete. 2024-09-16T01:22:20.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:20 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/668257362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-16T01:22:20.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:20 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/409105645' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-16T01:22:20.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:20 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1356953793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T01:22:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:20 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/668257362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-16T01:22:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:20 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/409105645' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-16T01:22:20.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:20 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1356953793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T01:22:20.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:20 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/668257362' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-16T01:22:20.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:20 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/409105645' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-16T01:22:20.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:20 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1356953793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T01:22:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:214748364842 2024-09-16T01:22:20.552 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-16T01:22:21.011 INFO:teuthology.orchestra.run.smithi063.stdout:107374182462 2024-09-16T01:22:21.011 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-16T01:22:21.234 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:21 smithi063 ceph-mon[31070]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:21.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:21 smithi192 ceph-mon[34775]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:21.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:21 smithi162 ceph-mon[34539]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.445+0000 7fd17b937640 1 -- 172.21.15.63:0/1619729497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd174105ad0 msgr2=0x7fd174105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.445+0000 7fd17b937640 1 --2- 172.21.15.63:0/1619729497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd174105ad0 0x7fd174105eb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd170009900 tx=0x7fd17002a410 comp rx=0 tx=0).stop 2024-09-16T01:22:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.445+0000 7fd17b937640 1 -- 172.21.15.63:0/1619729497 shutdown_connections 2024-09-16T01:22:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.445+0000 7fd17b937640 1 --2- 172.21.15.63:0/1619729497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd174101ba0 0x7fd17410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.445+0000 7fd17b937640 1 --2- 172.21.15.63:0/1619729497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd174101200 0x7fd174101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.445+0000 7fd17b937640 1 --2- 172.21.15.63:0/1619729497 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd174105ad0 0x7fd174105eb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.445+0000 7fd17b937640 1 -- 172.21.15.63:0/1619729497 >> 172.21.15.63:0/1619729497 conn(0x7fd174077210 msgr2=0x7fd1740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:21.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.445+0000 7fd17b937640 1 -- 172.21.15.63:0/1619729497 shutdown_connections 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.445+0000 7fd17b937640 1 -- 172.21.15.63:0/1619729497 wait complete. 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd17b937640 1 Processor -- start 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd17b937640 1 -- start start 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd17b937640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd174101200 0x7fd174197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd17b937640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd174101ba0 0x7fd174197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd17b937640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd174105ad0 0x7fd17419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd17b937640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd174110da0 con 0x7fd174101ba0 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd17b937640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd174110c20 con 0x7fd174105ad0 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd17b937640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd174110f20 con 0x7fd174101200 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd178ed2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd174101ba0 0x7fd174197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd178ed2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd174101ba0 0x7fd174197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46778/0 (socket says 172.21.15.63:46778) 2024-09-16T01:22:21.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd178ed2640 1 -- 172.21.15.63:0/2637830073 learned_addr learned my addr 172.21.15.63:0/2637830073 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd1796d3640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd174101200 0x7fd174197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd179ed4640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd174105ad0 0x7fd17419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd178ed2640 1 -- 172.21.15.63:0/2637830073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd174101200 msgr2=0x7fd174197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd178ed2640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd174101200 0x7fd174197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd178ed2640 1 -- 172.21.15.63:0/2637830073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd174105ad0 msgr2=0x7fd17419bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd178ed2640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd174105ad0 0x7fd17419bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd178ed2640 1 -- 172.21.15.63:0/2637830073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17419c1c0 con 0x7fd174101ba0 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.446+0000 7fd179ed4640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd174105ad0 0x7fd17419bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.447+0000 7fd178ed2640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd174101ba0 0x7fd174197750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd16800d950 tx=0x7fd16800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.447+0000 7fd1667fc640 1 -- 172.21.15.63:0/2637830073 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168017070 con 0x7fd174101ba0 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.447+0000 7fd17b937640 1 -- 172.21.15.63:0/2637830073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17419c4b0 con 0x7fd174101ba0 2024-09-16T01:22:21.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.447+0000 7fd1667fc640 1 -- 172.21.15.63:0/2637830073 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd168009c30 con 0x7fd174101ba0 2024-09-16T01:22:21.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.447+0000 7fd1667fc640 1 -- 172.21.15.63:0/2637830073 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16800f620 con 0x7fd174101ba0 2024-09-16T01:22:21.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.447+0000 7fd17b937640 1 -- 172.21.15.63:0/2637830073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1741a3d90 con 0x7fd174101ba0 2024-09-16T01:22:21.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.448+0000 7fd17b937640 1 -- 172.21.15.63:0/2637830073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd174101660 con 0x7fd174101ba0 2024-09-16T01:22:21.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.449+0000 7fd1667fc640 1 -- 172.21.15.63:0/2637830073 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd1680109a0 con 0x7fd174101ba0 2024-09-16T01:22:21.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.450+0000 7fd1667fc640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1600a32d0 0x7fd1600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.450+0000 7fd1796d3640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1600a32d0 0x7fd1600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.450+0000 7fd1667fc640 1 -- 172.21.15.63:0/2637830073 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd1680cf6f0 con 0x7fd174101ba0 2024-09-16T01:22:21.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.450+0000 7fd1796d3640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1600a32d0 0x7fd1600a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd170009230 tx=0x7fd1700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:21.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.454+0000 7fd1667fc640 1 -- 172.21.15.63:0/2637830073 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd168009de0 con 0x7fd174101ba0 2024-09-16T01:22:21.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.632+0000 7fd17b937640 1 -- 172.21.15.63:0/2637830073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd174108a80 con 0x7fd174101ba0 2024-09-16T01:22:21.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.632+0000 7fd1667fc640 1 -- 172.21.15.63:0/2637830073 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd16809c2b0 con 0x7fd174101ba0 2024-09-16T01:22:21.633 INFO:teuthology.orchestra.run.smithi063.stdout:193273528369 2024-09-16T01:22:21.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 -- 172.21.15.63:0/2637830073 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1600a32d0 msgr2=0x7fd1600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1600a32d0 0x7fd1600a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd170009230 tx=0x7fd1700058d0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 -- 172.21.15.63:0/2637830073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd174101ba0 msgr2=0x7fd174197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd174101ba0 0x7fd174197750 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd16800d950 tx=0x7fd16800de10 comp rx=0 tx=0).stop 2024-09-16T01:22:21.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 -- 172.21.15.63:0/2637830073 shutdown_connections 2024-09-16T01:22:21.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd1600a32d0 0x7fd1600a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd174105ad0 0x7fd17419bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd174101ba0 0x7fd174197750 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 --2- 172.21.15.63:0/2637830073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd174101200 0x7fd174197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 -- 172.21.15.63:0/2637830073 >> 172.21.15.63:0/2637830073 conn(0x7fd174077210 msgr2=0x7fd174104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:21.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 -- 172.21.15.63:0/2637830073 shutdown_connections 2024-09-16T01:22:21.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:21.634+0000 7fd17b937640 1 -- 172.21.15.63:0/2637830073 wait complete. 2024-09-16T01:22:22.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:22 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2637830073' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-16T01:22:22.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:22 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2637830073' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-16T01:22:22.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:22 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2637830073' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-16T01:22:22.471 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411397 for osd.2 2024-09-16T01:22:22.471 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:23.138 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:23.138 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:23.138 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:23.160 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906976 got 274877906978 for osd.9 2024-09-16T01:22:23.160 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:23.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:23 smithi063 ceph-mon[31070]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-16T01:22:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:23 smithi192 ceph-mon[34775]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-16T01:22:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:23 smithi162 ceph-mon[34539]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-16T01:22:23.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.893+0000 7f73cfd96640 1 -- 172.21.15.63:0/2688888732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c81082a0 msgr2=0x7f73c810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.893+0000 7f73cfd96640 1 --2- 172.21.15.63:0/2688888732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c81082a0 0x7f73c810ec40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009ca0 tx=0x7f73c002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.893+0000 7f73cfd96640 1 -- 172.21.15.63:0/2688888732 shutdown_connections 2024-09-16T01:22:23.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.893+0000 7f73cfd96640 1 --2- 172.21.15.63:0/2688888732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c81082a0 0x7f73c810ec40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.893+0000 7f73cfd96640 1 --2- 172.21.15.63:0/2688888732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73c81036e0 0x7f73c8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.893+0000 7f73cfd96640 1 --2- 172.21.15.63:0/2688888732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8102d30 0x7f73c8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.893+0000 7f73cfd96640 1 -- 172.21.15.63:0/2688888732 >> 172.21.15.63:0/2688888732 conn(0x7f73c80fc7d0 msgr2=0x7f73c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:23.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.893+0000 7f73cfd96640 1 -- 172.21.15.63:0/2688888732 shutdown_connections 2024-09-16T01:22:23.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.893+0000 7f73cfd96640 1 -- 172.21.15.63:0/2688888732 wait complete. 2024-09-16T01:22:23.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73cfd96640 1 Processor -- start 2024-09-16T01:22:23.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73cfd96640 1 -- start start 2024-09-16T01:22:23.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73cfd96640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8102d30 0x7f73c819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73cfd96640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73c81036e0 0x7f73c819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73cfd96640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c81082a0 0x7f73c819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73cfd96640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8114140 con 0x7f73c81082a0 2024-09-16T01:22:23.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73cfd96640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8113fc0 con 0x7f73c8102d30 2024-09-16T01:22:23.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73cfd96640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81142c0 con 0x7f73c81036e0 2024-09-16T01:22:23.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73ce333640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c81082a0 0x7f73c819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73cdb32640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8102d30 0x7f73c819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73ce333640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c81082a0 0x7f73c819ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46792/0 (socket says 172.21.15.63:46792) 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73ce333640 1 -- 172.21.15.63:0/1384293256 learned_addr learned my addr 172.21.15.63:0/1384293256 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.894+0000 7f73cd331640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73c81036e0 0x7f73c819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73cdb32640 1 -- 172.21.15.63:0/1384293256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73c81036e0 msgr2=0x7f73c819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73cdb32640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73c81036e0 0x7f73c819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73cdb32640 1 -- 172.21.15.63:0/1384293256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c81082a0 msgr2=0x7f73c819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73cdb32640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c81082a0 0x7f73c819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73cdb32640 1 -- 172.21.15.63:0/1384293256 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c819f5f0 con 0x7f73c8102d30 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73ce333640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c81082a0 0x7f73c819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73cd331640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73c81036e0 0x7f73c819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73cdb32640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8102d30 0x7f73c819a640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f73c400d6d0 tx=0x7f73c400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73beffd640 1 -- 172.21.15.63:0/1384293256 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4017070 con 0x7f73c8102d30 2024-09-16T01:22:23.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73beffd640 1 -- 172.21.15.63:0/1384293256 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73c4009820 con 0x7f73c8102d30 2024-09-16T01:22:23.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73cfd96640 1 -- 172.21.15.63:0/1384293256 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c819f8e0 con 0x7f73c8102d30 2024-09-16T01:22:23.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73beffd640 1 -- 172.21.15.63:0/1384293256 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4004c40 con 0x7f73c8102d30 2024-09-16T01:22:23.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.895+0000 7f73cfd96640 1 -- 172.21.15.63:0/1384293256 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c81a71c0 con 0x7f73c8102d30 2024-09-16T01:22:23.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.896+0000 7f73cfd96640 1 -- 172.21.15.63:0/1384293256 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c8103110 con 0x7f73c8102d30 2024-09-16T01:22:23.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.898+0000 7f73beffd640 1 -- 172.21.15.63:0/1384293256 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f73c40099d0 con 0x7f73c8102d30 2024-09-16T01:22:23.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.898+0000 7f73beffd640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f73b40a32d0 0x7f73b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.898+0000 7f73cd331640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f73b40a32d0 0x7f73b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.898+0000 7f73beffd640 1 -- 172.21.15.63:0/1384293256 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f73c40cf590 con 0x7f73c8102d30 2024-09-16T01:22:23.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.899+0000 7f73cd331640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f73b40a32d0 0x7f73b40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73c80fedf0 tx=0x7f73b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:23.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:23.902+0000 7f73beffd640 1 -- 172.21.15.63:0/1384293256 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73c409bb00 con 0x7f73c8102d30 2024-09-16T01:22:24.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.082+0000 7f73cfd96640 1 -- 172.21.15.63:0/1384293256 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f73c810a2b0 con 0x7f73c8102d30 2024-09-16T01:22:24.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.084+0000 7f73beffd640 1 -- 172.21.15.63:0/1384293256 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f73c409fe00 con 0x7f73c8102d30 2024-09-16T01:22:24.086 INFO:teuthology.orchestra.run.smithi063.stdout:34359738448 2024-09-16T01:22:24.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 -- 172.21.15.63:0/1384293256 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f73b40a32d0 msgr2=0x7f73b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f73b40a32d0 0x7f73b40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73c80fedf0 tx=0x7f73b8005f90 comp rx=0 tx=0).stop 2024-09-16T01:22:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 -- 172.21.15.63:0/1384293256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8102d30 msgr2=0x7f73c819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8102d30 0x7f73c819a640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f73c400d6d0 tx=0x7f73c400db90 comp rx=0 tx=0).stop 2024-09-16T01:22:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 -- 172.21.15.63:0/1384293256 shutdown_connections 2024-09-16T01:22:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f73b40a32d0 0x7f73b40a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73c81082a0 0x7f73c819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73c81036e0 0x7f73c819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 --2- 172.21.15.63:0/1384293256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73c8102d30 0x7f73c819a640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 -- 172.21.15.63:0/1384293256 >> 172.21.15.63:0/1384293256 conn(0x7f73c80fc7d0 msgr2=0x7f73c8105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 -- 172.21.15.63:0/1384293256 shutdown_connections 2024-09-16T01:22:24.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.087+0000 7f73cfd96640 1 -- 172.21.15.63:0/1384293256 wait complete. 2024-09-16T01:22:24.355 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:24 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:22:24.382 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528366 got 193273528369 for osd.6 2024-09-16T01:22:24.383 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:24.415 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:24 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:22:24.420 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:24 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/298919240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e4108290 msgr2=0x7ff0e410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 --2- 172.21.15.63:0/298919240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e4108290 0x7ff0e410ec30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009cd0 tx=0x7ff0dc02a8e0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/298919240 shutdown_connections 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 --2- 172.21.15.63:0/298919240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e4108290 0x7ff0e410ec30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 --2- 172.21.15.63:0/298919240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0e4103740 0x7ff0e4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 --2- 172.21.15.63:0/298919240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4102d90 0x7ff0e4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/298919240 >> 172.21.15.63:0/298919240 conn(0x7ff0e40fc7d0 msgr2=0x7ff0e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/298919240 shutdown_connections 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/298919240 wait complete. 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 Processor -- start 2024-09-16T01:22:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.571+0000 7ff0ea5c8640 1 -- start start 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0ea5c8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e4102d90 0x7ff0e4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0ea5c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4103740 0x7ff0e41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0ea5c8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0e4108290 0x7ff0e419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0ea5c8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e4111f40 con 0x7ff0e4102d90 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0ea5c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e4111dc0 con 0x7ff0e4103740 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0ea5c8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e41120c0 con 0x7ff0e4108290 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e4102d90 0x7ff0e4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e4102d90 0x7ff0e4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46804/0 (socket says 172.21.15.63:46804) 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e3fff640 1 -- 172.21.15.63:0/2398444025 learned_addr learned my addr 172.21.15.63:0/2398444025 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e8b65640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0e4108290 0x7ff0e419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e37fe640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4103740 0x7ff0e41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e3fff640 1 -- 172.21.15.63:0/2398444025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0e4108290 msgr2=0x7ff0e419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e3fff640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0e4108290 0x7ff0e419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e3fff640 1 -- 172.21.15.63:0/2398444025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4103740 msgr2=0x7ff0e41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e3fff640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4103740 0x7ff0e41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e3fff640 1 -- 172.21.15.63:0/2398444025 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e419d410 con 0x7ff0e4102d90 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e37fe640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4103740 0x7ff0e41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e3fff640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e4102d90 0x7ff0e4198460 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400d950 tx=0x7ff0d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e17fa640 1 -- 172.21.15.63:0/2398444025 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4017070 con 0x7ff0e4102d90 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e17fa640 1 -- 172.21.15.63:0/2398444025 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff0d4009c30 con 0x7ff0e4102d90 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/2398444025 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e419d700 con 0x7ff0e4102d90 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.572+0000 7ff0e17fa640 1 -- 172.21.15.63:0/2398444025 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400f620 con 0x7ff0e4102d90 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.573+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/2398444025 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e41a4fe0 con 0x7ff0e4102d90 2024-09-16T01:22:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.574+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/2398444025 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e4103170 con 0x7ff0e4102d90 2024-09-16T01:22:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.575+0000 7ff0e17fa640 1 -- 172.21.15.63:0/2398444025 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff0d40109a0 con 0x7ff0e4102d90 2024-09-16T01:22:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.575+0000 7ff0e17fa640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff0cc0a32d0 0x7ff0cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.576+0000 7ff0e37fe640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff0cc0a32d0 0x7ff0cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.576+0000 7ff0e17fa640 1 -- 172.21.15.63:0/2398444025 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff0d40cf6f0 con 0x7ff0e4102d90 2024-09-16T01:22:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.576+0000 7ff0e37fe640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff0cc0a32d0 0x7ff0cc0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40feea0 tx=0x7ff0d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.580+0000 7ff0e17fa640 1 -- 172.21.15.63:0/2398444025 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0d4009de0 con 0x7ff0e4102d90 2024-09-16T01:22:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.765+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/2398444025 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff0e410a2a0 con 0x7ff0e4102d90 2024-09-16T01:22:24.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.766+0000 7ff0e17fa640 1 -- 172.21.15.63:0/2398444025 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff0d409c2b0 con 0x7ff0e4102d90 2024-09-16T01:22:24.768 INFO:teuthology.orchestra.run.smithi063.stdout:141733920828 2024-09-16T01:22:24.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/2398444025 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff0cc0a32d0 msgr2=0x7ff0cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff0cc0a32d0 0x7ff0cc0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40feea0 tx=0x7ff0d8005f90 comp rx=0 tx=0).stop 2024-09-16T01:22:24.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/2398444025 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e4102d90 msgr2=0x7ff0e4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e4102d90 0x7ff0e4198460 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400d950 tx=0x7ff0d400de10 comp rx=0 tx=0).stop 2024-09-16T01:22:24.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/2398444025 shutdown_connections 2024-09-16T01:22:24.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff0cc0a32d0 0x7ff0cc0a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0e4108290 0x7ff0e419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4103740 0x7ff0e41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 --2- 172.21.15.63:0/2398444025 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0e4102d90 0x7ff0e4198460 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/2398444025 >> 172.21.15.63:0/2398444025 conn(0x7ff0e40fc7d0 msgr2=0x7ff0e4105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/2398444025 shutdown_connections 2024-09-16T01:22:24.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:24.768+0000 7ff0ea5c8640 1 -- 172.21.15.63:0/2398444025 wait complete. 2024-09-16T01:22:25.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:25 smithi063 ceph-mon[31070]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:25.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:25 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1384293256' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T01:22:25.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:25 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2398444025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T01:22:25.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:25 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:25 smithi192 ceph-mon[34775]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:25.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:25 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1384293256' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T01:22:25.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:25 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2398444025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T01:22:25.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:25 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:25 smithi162 ceph-mon[34539]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:25.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:25 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1384293256' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T01:22:25.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:25 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2398444025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T01:22:25.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:25 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:25.533 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920824 got 141733920828 for osd.4 2024-09-16T01:22:25.533 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:26.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.025+0000 7fc6e8e71640 1 -- 172.21.15.63:0/3754543460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6e4102d30 msgr2=0x7fc6e4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.025+0000 7fc6e8e71640 1 --2- 172.21.15.63:0/3754543460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6e4102d30 0x7fc6e4103110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009930 tx=0x7fc6d402a420 comp rx=0 tx=0).stop 2024-09-16T01:22:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.025+0000 7fc6e8e71640 1 -- 172.21.15.63:0/3754543460 shutdown_connections 2024-09-16T01:22:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.025+0000 7fc6e8e71640 1 --2- 172.21.15.63:0/3754543460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e41082a0 0x7fc6e410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.025+0000 7fc6e8e71640 1 --2- 172.21.15.63:0/3754543460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e41036e0 0x7fc6e4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.025+0000 7fc6e8e71640 1 --2- 172.21.15.63:0/3754543460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6e4102d30 0x7fc6e4103110 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.025+0000 7fc6e8e71640 1 -- 172.21.15.63:0/3754543460 >> 172.21.15.63:0/3754543460 conn(0x7fc6e40fc7d0 msgr2=0x7fc6e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.026+0000 7fc6e8e71640 1 -- 172.21.15.63:0/3754543460 shutdown_connections 2024-09-16T01:22:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.026+0000 7fc6e8e71640 1 -- 172.21.15.63:0/3754543460 wait complete. 2024-09-16T01:22:26.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e8e71640 1 Processor -- start 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e8e71640 1 -- start start 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e8e71640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6e4102d30 0x7fc6e4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e8e71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e41036e0 0x7fc6e4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e8e71640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e41082a0 0x7fc6e4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e8e71640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e4111f50 con 0x7fc6e4102d30 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e8e71640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e4111dd0 con 0x7fc6e41036e0 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e8e71640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e41120d0 con 0x7fc6e41082a0 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6e4102d30 0x7fc6e4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6e4102d30 0x7fc6e4100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46844/0 (socket says 172.21.15.63:46844) 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e259c640 1 -- 172.21.15.63:0/1645259292 learned_addr learned my addr 172.21.15.63:0/1645259292 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:26.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e2d9d640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e41082a0 0x7fc6e4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e1d9b640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e41036e0 0x7fc6e4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e259c640 1 -- 172.21.15.63:0/1645259292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e41082a0 msgr2=0x7fc6e4101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e259c640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e41082a0 0x7fc6e4101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e259c640 1 -- 172.21.15.63:0/1645259292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e41036e0 msgr2=0x7fc6e4100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e259c640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e41036e0 0x7fc6e4100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.027+0000 7fc6e259c640 1 -- 172.21.15.63:0/1645259292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e41a69d0 con 0x7fc6e4102d30 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.028+0000 7fc6e259c640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6e4102d30 0x7fc6e4100990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4005940 tx=0x7fc6d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.028+0000 7fc6d37fe640 1 -- 172.21.15.63:0/1645259292 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d403f030 con 0x7fc6e4102d30 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.028+0000 7fc6e8e71640 1 -- 172.21.15.63:0/1645259292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e41a6c60 con 0x7fc6e4102d30 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.028+0000 7fc6d37fe640 1 -- 172.21.15.63:0/1645259292 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc6d40318a0 con 0x7fc6e4102d30 2024-09-16T01:22:26.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.028+0000 7fc6d37fe640 1 -- 172.21.15.63:0/1645259292 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4035070 con 0x7fc6e4102d30 2024-09-16T01:22:26.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.028+0000 7fc6e8e71640 1 -- 172.21.15.63:0/1645259292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e41a7190 con 0x7fc6e4102d30 2024-09-16T01:22:26.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.029+0000 7fc6e8e71640 1 -- 172.21.15.63:0/1645259292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e4103110 con 0x7fc6e4102d30 2024-09-16T01:22:26.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.030+0000 7fc6d37fe640 1 -- 172.21.15.63:0/1645259292 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc6d4042030 con 0x7fc6e4102d30 2024-09-16T01:22:26.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.031+0000 7fc6d37fe640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc6cc0a32d0 0x7fc6cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.031+0000 7fc6d37fe640 1 -- 172.21.15.63:0/1645259292 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc6d40f0470 con 0x7fc6e4102d30 2024-09-16T01:22:26.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.031+0000 7fc6e1d9b640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc6cc0a32d0 0x7fc6cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.032+0000 7fc6e1d9b640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc6cc0a32d0 0x7fc6cc0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4102420 tx=0x7fc6d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.034+0000 7fc6d37fe640 1 -- 172.21.15.63:0/1645259292 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6d40bd030 con 0x7fc6e4102d30 2024-09-16T01:22:26.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.217+0000 7fc6e8e71640 1 -- 172.21.15.63:0/1645259292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fc6e410a2b0 con 0x7fc6e4102d30 2024-09-16T01:22:26.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.217+0000 7fc6d37fe640 1 -- 172.21.15.63:0/1645259292 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc6d40bc930 con 0x7fc6e4102d30 2024-09-16T01:22:26.220 INFO:teuthology.orchestra.run.smithi063.stdout:326417514521 2024-09-16T01:22:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 -- 172.21.15.63:0/1645259292 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc6cc0a32d0 msgr2=0x7fc6cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc6cc0a32d0 0x7fc6cc0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4102420 tx=0x7fc6d8005f90 comp rx=0 tx=0).stop 2024-09-16T01:22:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 -- 172.21.15.63:0/1645259292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6e4102d30 msgr2=0x7fc6e4100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6e4102d30 0x7fc6e4100990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4005940 tx=0x7fc6d40042f0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 -- 172.21.15.63:0/1645259292 shutdown_connections 2024-09-16T01:22:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc6cc0a32d0 0x7fc6cc0a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6e41082a0 0x7fc6e4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e41036e0 0x7fc6e4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 --2- 172.21.15.63:0/1645259292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6e4102d30 0x7fc6e4100990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 -- 172.21.15.63:0/1645259292 >> 172.21.15.63:0/1645259292 conn(0x7fc6e40fc7d0 msgr2=0x7fc6e4105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:26.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 -- 172.21.15.63:0/1645259292 shutdown_connections 2024-09-16T01:22:26.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.220+0000 7fc6e8e71640 1 -- 172.21.15.63:0/1645259292 wait complete. 2024-09-16T01:22:26.509 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743450 got 296352743452 for osd.10 2024-09-16T01:22:26.509 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:26.932 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738448 for osd.0 2024-09-16T01:22:26.932 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:27.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:27 smithi063 ceph-mon[31070]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:27.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:27 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3254801483' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-16T01:22:27.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:27 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1645259292' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-16T01:22:27.414 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757299 got 163208757300 for osd.5 2024-09-16T01:22:27.415 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:27.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:27 smithi192 ceph-mon[34775]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:27.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:27 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3254801483' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-16T01:22:27.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:27 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1645259292' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-16T01:22:27.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:27 smithi162 ceph-mon[34539]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:27.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:27 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3254801483' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-16T01:22:27.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:27 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1645259292' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-16T01:22:28.158 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514518 got 326417514521 for osd.11 2024-09-16T01:22:28.159 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:28.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.915+0000 7f6b3c157640 1 -- 172.21.15.63:0/2036538380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b34100a80 msgr2=0x7f6b34100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:28.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.915+0000 7f6b3c157640 1 --2- 172.21.15.63:0/2036538380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b34100a80 0x7f6b34100ee0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009930 tx=0x7f6b2802a420 comp rx=0 tx=0).stop 2024-09-16T01:22:28.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.915+0000 7f6b3c157640 1 -- 172.21.15.63:0/2036538380 shutdown_connections 2024-09-16T01:22:28.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.915+0000 7f6b3c157640 1 --2- 172.21.15.63:0/2036538380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b34101420 0x7f6b3410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.915+0000 7f6b3c157640 1 --2- 172.21.15.63:0/2036538380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b34100a80 0x7f6b34100ee0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.915+0000 7f6b3c157640 1 --2- 172.21.15.63:0/2036538380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b34106a80 0x7f6b34106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.915+0000 7f6b3c157640 1 -- 172.21.15.63:0/2036538380 >> 172.21.15.63:0/2036538380 conn(0x7f6b340fc7a0 msgr2=0x7f6b340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:28.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.915+0000 7f6b3c157640 1 -- 172.21.15.63:0/2036538380 shutdown_connections 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.915+0000 7f6b3c157640 1 -- 172.21.15.63:0/2036538380 wait complete. 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.916+0000 7f6b3c157640 1 Processor -- start 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.916+0000 7f6b3c157640 1 -- start start 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.916+0000 7f6b3c157640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b34100a80 0x7f6b34199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.916+0000 7f6b3c157640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b34101420 0x7f6b341996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.916+0000 7f6b3c157640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b34106a80 0x7f6b341a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.916+0000 7f6b3c157640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6b34110d80 con 0x7f6b34101420 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.916+0000 7f6b3c157640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6b34110c00 con 0x7f6b34100a80 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.916+0000 7f6b3c157640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b34110f00 con 0x7f6b34106a80 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.916+0000 7f6b396f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b34101420 0x7f6b341996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b396f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b34101420 0x7f6b341996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46818/0 (socket says 172.21.15.63:46818) 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b396f2640 1 -- 172.21.15.63:0/3254801483 learned_addr learned my addr 172.21.15.63:0/3254801483 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:28.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b3a6f4640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b34106a80 0x7f6b341a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b39ef3640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b34100a80 0x7f6b34199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b396f2640 1 -- 172.21.15.63:0/3254801483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b34106a80 msgr2=0x7f6b341a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b396f2640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b34106a80 0x7f6b341a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b396f2640 1 -- 172.21.15.63:0/3254801483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b34100a80 msgr2=0x7f6b34199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b396f2640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b34100a80 0x7f6b34199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b396f2640 1 -- 172.21.15.63:0/3254801483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b341a4750 con 0x7f6b34101420 2024-09-16T01:22:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b396f2640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b34101420 0x7f6b341996d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005ab0 tx=0x7f6b28003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:28.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b26ffd640 1 -- 172.21.15.63:0/3254801483 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2803f070 con 0x7f6b34101420 2024-09-16T01:22:28.270 INFO:teuthology.orchestra.run.smithi063.stdout:244813135912 2024-09-16T01:22:28.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b26ffd640 1 -- 172.21.15.63:0/3254801483 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b28031d60 con 0x7f6b34101420 2024-09-16T01:22:28.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b3c157640 1 -- 172.21.15.63:0/3254801483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b341a4920 con 0x7f6b34101420 2024-09-16T01:22:28.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b26ffd640 1 -- 172.21.15.63:0/3254801483 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28035030 con 0x7f6b34101420 2024-09-16T01:22:28.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.917+0000 7f6b3c157640 1 -- 172.21.15.63:0/3254801483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b341a4dd0 con 0x7f6b34101420 2024-09-16T01:22:28.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.918+0000 7f6b3c157640 1 -- 172.21.15.63:0/3254801483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b34100ee0 con 0x7f6b34101420 2024-09-16T01:22:28.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.919+0000 7f6b26ffd640 1 -- 172.21.15.63:0/3254801483 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6b28042070 con 0x7f6b34101420 2024-09-16T01:22:28.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.920+0000 7f6b26ffd640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6b200a32d0 0x7f6b200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:28.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.920+0000 7f6b39ef3640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6b200a32d0 0x7f6b200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:28.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.920+0000 7f6b26ffd640 1 -- 172.21.15.63:0/3254801483 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6b280f0970 con 0x7f6b34101420 2024-09-16T01:22:28.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.921+0000 7f6b39ef3640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6b200a32d0 0x7f6b200a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6b30005d90 tx=0x7f6b30005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:25.923+0000 7f6b26ffd640 1 -- 172.21.15.63:0/3254801483 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b280bd530 con 0x7f6b34101420 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.108+0000 7f6b3c157640 1 -- 172.21.15.63:0/3254801483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f6b3402d7c0 con 0x7f6b34101420 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.108+0000 7f6b26ffd640 1 -- 172.21.15.63:0/3254801483 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6b280bce30 con 0x7f6b34101420 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 -- 172.21.15.63:0/3254801483 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6b200a32d0 msgr2=0x7f6b200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6b200a32d0 0x7f6b200a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6b30005d90 tx=0x7f6b30005d20 comp rx=0 tx=0).stop 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 -- 172.21.15.63:0/3254801483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b34101420 msgr2=0x7f6b341996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b34101420 0x7f6b341996d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005ab0 tx=0x7f6b28003cd0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 -- 172.21.15.63:0/3254801483 shutdown_connections 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6b200a32d0 0x7f6b200a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b34106a80 0x7f6b341a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b34101420 0x7f6b341996d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 --2- 172.21.15.63:0/3254801483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b34100a80 0x7f6b34199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 -- 172.21.15.63:0/3254801483 >> 172.21.15.63:0/3254801483 conn(0x7f6b340fc7a0 msgr2=0x7f6b340fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:28.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 -- 172.21.15.63:0/3254801483 shutdown_connections 2024-09-16T01:22:28.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:26.111+0000 7f6b3c157640 1 -- 172.21.15.63:0/3254801483 wait complete. 2024-09-16T01:22:28.587 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:28.588 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:29.051 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135911 got 244813135912 for osd.8 2024-09-16T01:22:29.051 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:29.063 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:29.293 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:29 smithi063 ceph-mon[31070]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:29.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:29 smithi192 ceph-mon[34775]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:29.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:29 smithi162 ceph-mon[34539]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.531+0000 7f250e676640 1 -- 172.21.15.63:0/3559790852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2508106f10 msgr2=0x7f250810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.531+0000 7f250e676640 1 --2- 172.21.15.63:0/3559790852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2508106f10 0x7f250810ea90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2500009ca0 tx=0x7f250002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.531+0000 7f250e676640 1 -- 172.21.15.63:0/3559790852 shutdown_connections 2024-09-16T01:22:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.531+0000 7f250e676640 1 --2- 172.21.15.63:0/3559790852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2508106f10 0x7f250810ea90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.531+0000 7f250e676640 1 --2- 172.21.15.63:0/3559790852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2508102790 0x7f25081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.531+0000 7f250e676640 1 --2- 172.21.15.63:0/3559790852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508101de0 0x7f25081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.531+0000 7f250e676640 1 -- 172.21.15.63:0/3559790852 >> 172.21.15.63:0/3559790852 conn(0x7f25080fd8c0 msgr2=0x7f25080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.531+0000 7f250e676640 1 -- 172.21.15.63:0/3559790852 shutdown_connections 2024-09-16T01:22:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.531+0000 7f250e676640 1 -- 172.21.15.63:0/3559790852 wait complete. 2024-09-16T01:22:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.531+0000 7f250e676640 1 Processor -- start 2024-09-16T01:22:29.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f250e676640 1 -- start start 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f250e676640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2508101de0 0x7f2508198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f250e676640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2508102790 0x7f2508198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f250e676640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508106f10 0x7f250819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f250e676640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2508111e40 con 0x7f2508101de0 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f250e676640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2508111cc0 con 0x7f2508106f10 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f250e676640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2508111fc0 con 0x7f2508102790 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f2507fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2508101de0 0x7f2508198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f2507fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2508101de0 0x7f2508198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60056/0 (socket says 172.21.15.63:60056) 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f2507fff640 1 -- 172.21.15.63:0/549286554 learned_addr learned my addr 172.21.15.63:0/549286554 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f250cc13640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508106f10 0x7f250819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:29.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.532+0000 7f25077fe640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2508102790 0x7f2508198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f2507fff640 1 -- 172.21.15.63:0/549286554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2508102790 msgr2=0x7f2508198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f2507fff640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2508102790 0x7f2508198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f2507fff640 1 -- 172.21.15.63:0/549286554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508106f10 msgr2=0x7f250819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f2507fff640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508106f10 0x7f250819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f2507fff640 1 -- 172.21.15.63:0/549286554 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250819d2b0 con 0x7f2508101de0 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f250cc13640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508106f10 0x7f250819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f2507fff640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2508101de0 0x7f2508198300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c920 tx=0x7f24f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f25057fa640 1 -- 172.21.15.63:0/549286554 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8007c70 con 0x7f2508101de0 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f25057fa640 1 -- 172.21.15.63:0/549286554 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f24f8007e10 con 0x7f2508101de0 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f250e676640 1 -- 172.21.15.63:0/549286554 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250819d5a0 con 0x7f2508101de0 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f25057fa640 1 -- 172.21.15.63:0/549286554 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8018820 con 0x7f2508101de0 2024-09-16T01:22:29.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.533+0000 7f250e676640 1 -- 172.21.15.63:0/549286554 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25081a4e80 con 0x7f2508101de0 2024-09-16T01:22:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.534+0000 7f250e676640 1 -- 172.21.15.63:0/549286554 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25081021c0 con 0x7f2508101de0 2024-09-16T01:22:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.535+0000 7f25057fa640 1 -- 172.21.15.63:0/549286554 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f24f80189c0 con 0x7f2508101de0 2024-09-16T01:22:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.536+0000 7f25057fa640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f24f00a3350 0x7f24f00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.536+0000 7f25077fe640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f24f00a3350 0x7f24f00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.536+0000 7f25057fa640 1 -- 172.21.15.63:0/549286554 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f24f80cfc20 con 0x7f2508101de0 2024-09-16T01:22:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.537+0000 7f25077fe640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f24f00a3350 0x7f24f00a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f25080fdce0 tx=0x7f24fc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.540+0000 7f25057fa640 1 -- 172.21.15.63:0/549286554 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24f8014030 con 0x7f2508101de0 2024-09-16T01:22:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.720+0000 7f250e676640 1 -- 172.21.15.63:0/549286554 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f250810a0f0 con 0x7f2508101de0 2024-09-16T01:22:29.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.720+0000 7f25057fa640 1 -- 172.21.15.63:0/549286554 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f24f800de20 con 0x7f2508101de0 2024-09-16T01:22:29.791 INFO:teuthology.orchestra.run.smithi063.stdout:107374182465 2024-09-16T01:22:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 -- 172.21.15.63:0/549286554 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f24f00a3350 msgr2=0x7f24f00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f24f00a3350 0x7f24f00a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f25080fdce0 tx=0x7f24fc008040 comp rx=0 tx=0).stop 2024-09-16T01:22:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 -- 172.21.15.63:0/549286554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2508101de0 msgr2=0x7f2508198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2508101de0 0x7f2508198300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f24f800c920 tx=0x7f24f800cde0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 -- 172.21.15.63:0/549286554 shutdown_connections 2024-09-16T01:22:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f24f00a3350 0x7f24f00a5810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508106f10 0x7f250819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2508102790 0x7f2508198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 --2- 172.21.15.63:0/549286554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2508101de0 0x7f2508198300 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 -- 172.21.15.63:0/549286554 >> 172.21.15.63:0/549286554 conn(0x7f25080fd8c0 msgr2=0x7f25080fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 -- 172.21.15.63:0/549286554 shutdown_connections 2024-09-16T01:22:29.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:29.722+0000 7f250e676640 1 -- 172.21.15.63:0/549286554 wait complete. 2024-09-16T01:22:30.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:30 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/549286554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T01:22:30.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:30 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/549286554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T01:22:30.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:30 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/549286554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T01:22:30.478 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182462 got 107374182465 for osd.3 2024-09-16T01:22:30.479 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:30.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.907+0000 7f37c4f13640 1 -- 172.21.15.63:0/3151573878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c0106f10 msgr2=0x7f37c010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.907+0000 7f37c4f13640 1 --2- 172.21.15.63:0/3151573878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c0106f10 0x7f37c010ea90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009ca0 tx=0x7f37b802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.907+0000 7f37c4f13640 1 -- 172.21.15.63:0/3151573878 shutdown_connections 2024-09-16T01:22:30.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.907+0000 7f37c4f13640 1 --2- 172.21.15.63:0/3151573878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c0106f10 0x7f37c010ea90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.907+0000 7f37c4f13640 1 --2- 172.21.15.63:0/3151573878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c0102790 0x7f37c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.907+0000 7f37c4f13640 1 --2- 172.21.15.63:0/3151573878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c0101de0 0x7f37c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.907+0000 7f37c4f13640 1 -- 172.21.15.63:0/3151573878 >> 172.21.15.63:0/3151573878 conn(0x7f37c00fd8c0 msgr2=0x7f37c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.907+0000 7f37c4f13640 1 -- 172.21.15.63:0/3151573878 shutdown_connections 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.907+0000 7f37c4f13640 1 -- 172.21.15.63:0/3151573878 wait complete. 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37c4f13640 1 Processor -- start 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37c4f13640 1 -- start start 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37c4f13640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c0101de0 0x7f37c0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37c4f13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c0102790 0x7f37c01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37c4f13640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c0106f10 0x7f37c019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37c4f13640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0111ec0 con 0x7f37c0101de0 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37c4f13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0111d40 con 0x7f37c0102790 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37c4f13640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0112040 con 0x7f37c0106f10 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37be59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c0101de0 0x7f37c0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37be59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c0101de0 0x7f37c0198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60074/0 (socket says 172.21.15.63:60074) 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37be59c640 1 -- 172.21.15.63:0/2901997492 learned_addr learned my addr 172.21.15.63:0/2901997492 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.908+0000 7f37bdd9b640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c0102790 0x7f37c01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37bed9d640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c0106f10 0x7f37c019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37be59c640 1 -- 172.21.15.63:0/2901997492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c0106f10 msgr2=0x7f37c019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37be59c640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c0106f10 0x7f37c019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37be59c640 1 -- 172.21.15.63:0/2901997492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c0102790 msgr2=0x7f37c01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37be59c640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c0102790 0x7f37c01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37be59c640 1 -- 172.21.15.63:0/2901997492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c019d430 con 0x7f37c0101de0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37be59c640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c0101de0 0x7f37c0198480 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f37b000b4a0 tx=0x7f37b000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37af7fe640 1 -- 172.21.15.63:0/2901997492 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0015020 con 0x7f37c0101de0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37af7fe640 1 -- 172.21.15.63:0/2901997492 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f37b0011ce0 con 0x7f37c0101de0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37c4f13640 1 -- 172.21.15.63:0/2901997492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c019d720 con 0x7f37c0101de0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37af7fe640 1 -- 172.21.15.63:0/2901997492 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0010dc0 con 0x7f37c0101de0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.909+0000 7f37c4f13640 1 -- 172.21.15.63:0/2901997492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c01a5000 con 0x7f37c0101de0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.910+0000 7f37c4f13640 1 -- 172.21.15.63:0/2901997492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c01021c0 con 0x7f37c0101de0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.911+0000 7f37af7fe640 1 -- 172.21.15.63:0/2901997492 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f37b0018020 con 0x7f37c0101de0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.912+0000 7f37af7fe640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f37a80a32d0 0x7f37a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.912+0000 7f37bdd9b640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f37a80a32d0 0x7f37a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.912+0000 7f37af7fe640 1 -- 172.21.15.63:0/2901997492 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f37b00cf260 con 0x7f37c0101de0 2024-09-16T01:22:30.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.913+0000 7f37bdd9b640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f37a80a32d0 0x7f37a80a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f37c00ffe50 tx=0x7f37b4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:30.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:30.917+0000 7f37af7fe640 1 -- 172.21.15.63:0/2901997492 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37b001f020 con 0x7f37c0101de0 2024-09-16T01:22:31.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.095+0000 7f37c4f13640 1 -- 172.21.15.63:0/2901997492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f37c010a150 con 0x7f37c0101de0 2024-09-16T01:22:31.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.095+0000 7f37af7fe640 1 -- 172.21.15.63:0/2901997492 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37b009bf30 con 0x7f37c0101de0 2024-09-16T01:22:31.098 INFO:teuthology.orchestra.run.smithi063.stdout:55834574923 2024-09-16T01:22:31.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 -- 172.21.15.63:0/2901997492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f37a80a32d0 msgr2=0x7f37a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f37a80a32d0 0x7f37a80a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f37c00ffe50 tx=0x7f37b4009110 comp rx=0 tx=0).stop 2024-09-16T01:22:31.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 -- 172.21.15.63:0/2901997492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c0101de0 msgr2=0x7f37c0198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c0101de0 0x7f37c0198480 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f37b000b4a0 tx=0x7f37b000b8a0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 -- 172.21.15.63:0/2901997492 shutdown_connections 2024-09-16T01:22:31.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f37a80a32d0 0x7f37a80a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37c0106f10 0x7f37c019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37c0102790 0x7f37c01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 --2- 172.21.15.63:0/2901997492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c0101de0 0x7f37c0198480 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 -- 172.21.15.63:0/2901997492 >> 172.21.15.63:0/2901997492 conn(0x7f37c00fd8c0 msgr2=0x7f37c00fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:31.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 -- 172.21.15.63:0/2901997492 shutdown_connections 2024-09-16T01:22:31.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.098+0000 7f37c4f13640 1 -- 172.21.15.63:0/2901997492 wait complete. 2024-09-16T01:22:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.233+0000 7f5bdf5da640 1 -- 172.21.15.63:0/2979396883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd810c170 msgr2=0x7f5bd810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.233+0000 7f5bdf5da640 1 --2- 172.21.15.63:0/2979396883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd810c170 0x7f5bd810e610 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009ca0 tx=0x7f5bd002a950 comp rx=0 tx=0).stop 2024-09-16T01:22:31.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.233+0000 7f5bdf5da640 1 -- 172.21.15.63:0/2979396883 shutdown_connections 2024-09-16T01:22:31.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.233+0000 7f5bdf5da640 1 --2- 172.21.15.63:0/2979396883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd810c170 0x7f5bd810e610 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.233+0000 7f5bdf5da640 1 --2- 172.21.15.63:0/2979396883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bd8103660 0x7f5bd810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.233+0000 7f5bdf5da640 1 --2- 172.21.15.63:0/2979396883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd8102d40 0x7f5bd8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.233+0000 7f5bdf5da640 1 -- 172.21.15.63:0/2979396883 >> 172.21.15.63:0/2979396883 conn(0x7f5bd80fc7a0 msgr2=0x7f5bd80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:31.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.233+0000 7f5bdf5da640 1 -- 172.21.15.63:0/2979396883 shutdown_connections 2024-09-16T01:22:31.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.233+0000 7f5bdf5da640 1 -- 172.21.15.63:0/2979396883 wait complete. 2024-09-16T01:22:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.233+0000 7f5bdf5da640 1 Processor -- start 2024-09-16T01:22:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bdf5da640 1 -- start start 2024-09-16T01:22:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bdf5da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd8102d40 0x7f5bd819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bdf5da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bd8103660 0x7f5bd819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bdf5da640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd810c170 0x7f5bd819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bdf5da640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd8111e80 con 0x7f5bd810c170 2024-09-16T01:22:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bdf5da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd8111d00 con 0x7f5bd8102d40 2024-09-16T01:22:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bdf5da640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd8112000 con 0x7f5bd8103660 2024-09-16T01:22:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bddb77640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd810c170 0x7f5bd819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bddb77640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd810c170 0x7f5bd819ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60096/0 (socket says 172.21.15.63:60096) 2024-09-16T01:22:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bddb77640 1 -- 172.21.15.63:0/938139957 learned_addr learned my addr 172.21.15.63:0/938139957 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bdd376640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd8102d40 0x7f5bd819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bdcb75640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bd8103660 0x7f5bd819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bddb77640 1 -- 172.21.15.63:0/938139957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bd8103660 msgr2=0x7f5bd819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bddb77640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bd8103660 0x7f5bd819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bddb77640 1 -- 172.21.15.63:0/938139957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd8102d40 msgr2=0x7f5bd819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bddb77640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd8102d40 0x7f5bd819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bddb77640 1 -- 172.21.15.63:0/938139957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd819f570 con 0x7f5bd810c170 2024-09-16T01:22:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.234+0000 7f5bddb77640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd810c170 0x7f5bd819ee90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5bd002ae70 tx=0x7f5bd002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.235+0000 7f5bca7fc640 1 -- 172.21.15.63:0/938139957 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0034040 con 0x7f5bd810c170 2024-09-16T01:22:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.235+0000 7f5bdf5da640 1 -- 172.21.15.63:0/938139957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd819f800 con 0x7f5bd810c170 2024-09-16T01:22:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.235+0000 7f5bca7fc640 1 -- 172.21.15.63:0/938139957 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bd00308f0 con 0x7f5bd810c170 2024-09-16T01:22:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.235+0000 7f5bca7fc640 1 -- 172.21.15.63:0/938139957 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0004750 con 0x7f5bd810c170 2024-09-16T01:22:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.235+0000 7f5bdf5da640 1 -- 172.21.15.63:0/938139957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd81a7140 con 0x7f5bd810c170 2024-09-16T01:22:31.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.236+0000 7f5bdf5da640 1 -- 172.21.15.63:0/938139957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd8103120 con 0x7f5bd810c170 2024-09-16T01:22:31.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.238+0000 7f5bca7fc640 1 -- 172.21.15.63:0/938139957 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5bd0037020 con 0x7f5bd810c170 2024-09-16T01:22:31.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.238+0000 7f5bca7fc640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5bc40a32d0 0x7f5bc40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.238+0000 7f5bdd376640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5bc40a32d0 0x7f5bc40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.238+0000 7f5bca7fc640 1 -- 172.21.15.63:0/938139957 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5bd00f09b0 con 0x7f5bd810c170 2024-09-16T01:22:31.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.239+0000 7f5bdd376640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5bc40a32d0 0x7f5bc40a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009990 tx=0x7f5bcc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.242+0000 7f5bca7fc640 1 -- 172.21.15.63:0/938139957 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5bd00bd710 con 0x7f5bd810c170 2024-09-16T01:22:31.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:31 smithi063 ceph-mon[31070]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:31.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:31 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2901997492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T01:22:31.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:31 smithi192 ceph-mon[34775]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:31.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:31 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2901997492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T01:22:31.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.429+0000 7f5bdf5da640 1 -- 172.21.15.63:0/938139957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5bd81a7370 con 0x7f5bd810c170 2024-09-16T01:22:31.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.429+0000 7f5bca7fc640 1 -- 172.21.15.63:0/938139957 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5bd00bd010 con 0x7f5bd810c170 2024-09-16T01:22:31.432 INFO:teuthology.orchestra.run.smithi063.stdout:214748364844 2024-09-16T01:22:31.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:31 smithi162 ceph-mon[34539]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:31.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:31 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2901997492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T01:22:31.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 -- 172.21.15.63:0/938139957 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5bc40a32d0 msgr2=0x7f5bc40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5bc40a32d0 0x7f5bc40a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc009990 tx=0x7f5bcc009110 comp rx=0 tx=0).stop 2024-09-16T01:22:31.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 -- 172.21.15.63:0/938139957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd810c170 msgr2=0x7f5bd819ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd810c170 0x7f5bd819ee90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5bd002ae70 tx=0x7f5bd002f5d0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 -- 172.21.15.63:0/938139957 shutdown_connections 2024-09-16T01:22:31.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5bc40a32d0 0x7f5bc40a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd810c170 0x7f5bd819ee90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5bd8103660 0x7f5bd819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 --2- 172.21.15.63:0/938139957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bd8102d40 0x7f5bd819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 -- 172.21.15.63:0/938139957 >> 172.21.15.63:0/938139957 conn(0x7f5bd80fc7a0 msgr2=0x7f5bd8101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:31.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 -- 172.21.15.63:0/938139957 shutdown_connections 2024-09-16T01:22:31.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:31.432+0000 7f5bdf5da640 1 -- 172.21.15.63:0/938139957 wait complete. 2024-09-16T01:22:31.971 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574923 for osd.1 2024-09-16T01:22:31.971 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:32.321 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:32 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/938139957' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-16T01:22:32.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:32 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/938139957' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-16T01:22:32.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:32 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/938139957' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-16T01:22:32.654 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364842 got 214748364844 for osd.7 2024-09-16T01:22:32.654 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:32.655 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T01:22:32.655 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:22:33.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:33 smithi063 ceph-mon[31070]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:33.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:33 smithi192 ceph-mon[34775]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:33.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:33 smithi162 ceph-mon[34539]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:33.460 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 -- 172.21.15.63:0/3272775967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbec0102ef0 msgr2=0x7fbec010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 --2- 172.21.15.63:0/3272775967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbec0102ef0 0x7fbec010da40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009ca0 tx=0x7fbeb802a950 comp rx=0 tx=0).stop 2024-09-16T01:22:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 -- 172.21.15.63:0/3272775967 shutdown_connections 2024-09-16T01:22:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 --2- 172.21.15.63:0/3272775967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbec0102ef0 0x7fbec010da40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 --2- 172.21.15.63:0/3272775967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec0102570 0x7fbec01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 --2- 172.21.15.63:0/3272775967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec0100e20 0x7fbec0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 -- 172.21.15.63:0/3272775967 >> 172.21.15.63:0/3272775967 conn(0x7fbec00fc7d0 msgr2=0x7fbec00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 -- 172.21.15.63:0/3272775967 shutdown_connections 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 -- 172.21.15.63:0/3272775967 wait complete. 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 Processor -- start 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.944+0000 7fbec69b4640 1 -- start start 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbec69b4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbec0100e20 0x7fbec01993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbec69b4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec0102570 0x7fbec0199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbec69b4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec0102ef0 0x7fbec01a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbec69b4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbec0110f20 con 0x7fbec0100e20 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbec69b4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbec0110da0 con 0x7fbec0102570 2024-09-16T01:22:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbec69b4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbec01110a0 con 0x7fbec0102ef0 2024-09-16T01:22:33.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbec0100e20 0x7fbec01993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbec0100e20 0x7fbec01993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60116/0 (socket says 172.21.15.63:60116) 2024-09-16T01:22:33.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebffff640 1 -- 172.21.15.63:0/1604365894 learned_addr learned my addr 172.21.15.63:0/1604365894 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:33.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbec4f51640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec0102ef0 0x7fbec01a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebf7fe640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec0102570 0x7fbec0199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebffff640 1 -- 172.21.15.63:0/1604365894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec0102ef0 msgr2=0x7fbec01a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebffff640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec0102ef0 0x7fbec01a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebffff640 1 -- 172.21.15.63:0/1604365894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec0102570 msgr2=0x7fbec0199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebffff640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec0102570 0x7fbec0199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebffff640 1 -- 172.21.15.63:0/1604365894 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec01a4990 con 0x7fbec0100e20 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebf7fe640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec0102570 0x7fbec0199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.945+0000 7fbebffff640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbec0100e20 0x7fbec01993d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000b4a0 tx=0x7fbeb000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.946+0000 7fbebd7fa640 1 -- 172.21.15.63:0/1604365894 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0014070 con 0x7fbec0100e20 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.946+0000 7fbec69b4640 1 -- 172.21.15.63:0/1604365894 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec01a4b60 con 0x7fbec0100e20 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.946+0000 7fbebd7fa640 1 -- 172.21.15.63:0/1604365894 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbeb0010ac0 con 0x7fbec0100e20 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.946+0000 7fbebd7fa640 1 -- 172.21.15.63:0/1604365894 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0017c30 con 0x7fbec0100e20 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.946+0000 7fbec69b4640 1 -- 172.21.15.63:0/1604365894 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec01a5020 con 0x7fbec0100e20 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.947+0000 7fbec69b4640 1 -- 172.21.15.63:0/1604365894 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec0101280 con 0x7fbec0100e20 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.948+0000 7fbebd7fa640 1 -- 172.21.15.63:0/1604365894 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbeb0017070 con 0x7fbec0100e20 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.948+0000 7fbebd7fa640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbeac0a32d0 0x7fbeac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.949+0000 7fbebd7fa640 1 -- 172.21.15.63:0/1604365894 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbeb00cedf0 con 0x7fbec0100e20 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.949+0000 7fbebf7fe640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbeac0a32d0 0x7fbeac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.949+0000 7fbebf7fe640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbeac0a32d0 0x7fbeac0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbea8006fd0 tx=0x7fbea8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:33.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:33.953+0000 7fbebd7fa640 1 -- 172.21.15.63:0/1604365894 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbeb009bac0 con 0x7fbec0100e20 2024-09-16T01:22:34.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.142+0000 7fbec69b4640 1 -- 172.21.15.63:0/1604365894 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbec0062630 con 0x7fbeac0a32d0 2024-09-16T01:22:34.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.149+0000 7fbebd7fa640 1 -- 172.21.15.63:0/1604365894 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258959 (secure 0 0 0) 0x7fbec0062630 con 0x7fbeac0a32d0 2024-09-16T01:22:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:34.156 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-16T01:22:34.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.152+0000 7fbec69b4640 1 -- 172.21.15.63:0/1604365894 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbeac0a32d0 msgr2=0x7fbeac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.152+0000 7fbec69b4640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbeac0a32d0 0x7fbeac0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbea8006fd0 tx=0x7fbea8008040 comp rx=0 tx=0).stop 2024-09-16T01:22:34.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.152+0000 7fbec69b4640 1 -- 172.21.15.63:0/1604365894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbec0100e20 msgr2=0x7fbec01993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.152+0000 7fbec69b4640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbec0100e20 0x7fbec01993d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000b4a0 tx=0x7fbeb000b960 comp rx=0 tx=0).stop 2024-09-16T01:22:34.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.152+0000 7fbec69b4640 1 -- 172.21.15.63:0/1604365894 shutdown_connections 2024-09-16T01:22:34.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.152+0000 7fbec69b4640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbeac0a32d0 0x7fbeac0a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.152+0000 7fbec69b4640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec0102ef0 0x7fbec01a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.153+0000 7fbec69b4640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec0102570 0x7fbec0199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.153+0000 7fbec69b4640 1 --2- 172.21.15.63:0/1604365894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbec0100e20 0x7fbec01993d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.153+0000 7fbec69b4640 1 -- 172.21.15.63:0/1604365894 >> 172.21.15.63:0/1604365894 conn(0x7fbec00fc7d0 msgr2=0x7fbec00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:34.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.153+0000 7fbec69b4640 1 -- 172.21.15.63:0/1604365894 shutdown_connections 2024-09-16T01:22:34.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:34.153+0000 7fbec69b4640 1 -- 172.21.15.63:0/1604365894 wait complete. 2024-09-16T01:22:34.911 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-16T01:22:33.194950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":472,"num_read_kb":350,"num_write":345,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360400,"kb_used_data":11136,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581424,"statfs":{"total":1151940427776,"available":1151571378176,"internally_reserved":0,"allocated":11403264,"data_stored":7252590,"data_compressed":177609,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003265"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090037+0000","last_change":"2024-09-16T01:21:28.051261+0000","last_active":"2024-09-16T01:21:39.090037+0000","last_peered":"2024-09-16T01:21:39.090037+0000","last_clean":"2024-09-16T01:21:39.090037+0000","last_became_active":"2024-09-16T01:21:28.049073+0000","last_became_peered":"2024-09-16T01:21:28.049073+0000","last_unstale":"2024-09-16T01:21:39.090037+0000","last_undegraded":"2024-09-16T01:21:39.090037+0000","last_fullsized":"2024-09-16T01:21:39.090037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:06.863766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093652+0000","last_change":"2024-09-16T01:21:28.049457+0000","last_active":"2024-09-16T01:21:39.093652+0000","last_peered":"2024-09-16T01:21:39.093652+0000","last_clean":"2024-09-16T01:21:39.093652+0000","last_became_active":"2024-09-16T01:21:28.048707+0000","last_became_peered":"2024-09-16T01:21:28.048707+0000","last_unstale":"2024-09-16T01:21:39.093652+0000","last_undegraded":"2024-09-16T01:21:39.093652+0000","last_fullsized":"2024-09-16T01:21:39.093652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:56.346506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093456+0000","last_change":"2024-09-16T01:21:28.052931+0000","last_active":"2024-09-16T01:21:39.093456+0000","last_peered":"2024-09-16T01:21:39.093456+0000","last_clean":"2024-09-16T01:21:39.093456+0000","last_became_active":"2024-09-16T01:21:28.052501+0000","last_became_peered":"2024-09-16T01:21:28.052501+0000","last_unstale":"2024-09-16T01:21:39.093456+0000","last_undegraded":"2024-09-16T01:21:39.093456+0000","last_fullsized":"2024-09-16T01:21:39.093456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:45:23.351452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.096667+0000","last_change":"2024-09-16T01:21:39.096279+0000","last_active":"2024-09-16T01:21:39.096667+0000","last_peered":"2024-09-16T01:21:39.096667+0000","last_clean":"2024-09-16T01:21:39.096667+0000","last_became_active":"2024-09-16T01:21:39.095886+0000","last_became_peered":"2024-09-16T01:21:39.095886+0000","last_unstale":"2024-09-16T01:21:39.096667+0000","last_undegraded":"2024-09-16T01:21:39.096667+0000","last_fullsized":"2024-09-16T01:21:39.096667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:56.530007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093192+0000","last_change":"2024-09-16T01:21:28.043473+0000","last_active":"2024-09-16T01:21:39.093192+0000","last_peered":"2024-09-16T01:21:39.093192+0000","last_clean":"2024-09-16T01:21:39.093192+0000","last_became_active":"2024-09-16T01:21:28.043127+0000","last_became_peered":"2024-09-16T01:21:28.043127+0000","last_unstale":"2024-09-16T01:21:39.093192+0000","last_undegraded":"2024-09-16T01:21:39.093192+0000","last_fullsized":"2024-09-16T01:21:39.093192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.714834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090192+0000","last_change":"2024-09-16T01:21:28.047210+0000","last_active":"2024-09-16T01:21:39.090192+0000","last_peered":"2024-09-16T01:21:39.090192+0000","last_clean":"2024-09-16T01:21:39.090192+0000","last_became_active":"2024-09-16T01:21:28.046872+0000","last_became_peered":"2024-09-16T01:21:28.046872+0000","last_unstale":"2024-09-16T01:21:39.090192+0000","last_undegraded":"2024-09-16T01:21:39.090192+0000","last_fullsized":"2024-09-16T01:21:39.090192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:22.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088806+0000","last_change":"2024-09-16T01:21:28.052212+0000","last_active":"2024-09-16T01:21:39.088806+0000","last_peered":"2024-09-16T01:21:39.088806+0000","last_clean":"2024-09-16T01:21:39.088806+0000","last_became_active":"2024-09-16T01:21:28.050307+0000","last_became_peered":"2024-09-16T01:21:28.050307+0000","last_unstale":"2024-09-16T01:21:39.088806+0000","last_undegraded":"2024-09-16T01:21:39.088806+0000","last_fullsized":"2024-09-16T01:21:39.088806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:21.869103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089494+0000","last_change":"2024-09-16T01:21:28.047980+0000","last_active":"2024-09-16T01:21:39.089494+0000","last_peered":"2024-09-16T01:21:39.089494+0000","last_clean":"2024-09-16T01:21:39.089494+0000","last_became_active":"2024-09-16T01:21:28.047671+0000","last_became_peered":"2024-09-16T01:21:28.047671+0000","last_unstale":"2024-09-16T01:21:39.089494+0000","last_undegraded":"2024-09-16T01:21:39.089494+0000","last_fullsized":"2024-09-16T01:21:39.089494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:30.501419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093245+0000","last_change":"2024-09-16T01:21:28.052468+0000","last_active":"2024-09-16T01:21:39.093245+0000","last_peered":"2024-09-16T01:21:39.093245+0000","last_clean":"2024-09-16T01:21:39.093245+0000","last_became_active":"2024-09-16T01:21:28.052156+0000","last_became_peered":"2024-09-16T01:21:28.052156+0000","last_unstale":"2024-09-16T01:21:39.093245+0000","last_undegraded":"2024-09-16T01:21:39.093245+0000","last_fullsized":"2024-09-16T01:21:39.093245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:44.631498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090981+0000","last_change":"2024-09-16T01:21:28.048278+0000","last_active":"2024-09-16T01:21:39.090981+0000","last_peered":"2024-09-16T01:21:39.090981+0000","last_clean":"2024-09-16T01:21:39.090981+0000","last_became_active":"2024-09-16T01:21:28.047892+0000","last_became_peered":"2024-09-16T01:21:28.047892+0000","last_unstale":"2024-09-16T01:21:39.090981+0000","last_undegraded":"2024-09-16T01:21:39.090981+0000","last_fullsized":"2024-09-16T01:21:39.090981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.949956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089369+0000","last_change":"2024-09-16T01:21:28.052814+0000","last_active":"2024-09-16T01:21:39.089369+0000","last_peered":"2024-09-16T01:21:39.089369+0000","last_clean":"2024-09-16T01:21:39.089369+0000","last_became_active":"2024-09-16T01:21:28.052440+0000","last_became_peered":"2024-09-16T01:21:28.052440+0000","last_unstale":"2024-09-16T01:21:39.089369+0000","last_undegraded":"2024-09-16T01:21:39.089369+0000","last_fullsized":"2024-09-16T01:21:39.089369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:47.470646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106734+0000","last_change":"2024-09-16T01:21:28.053917+0000","last_active":"2024-09-16T01:21:39.106734+0000","last_peered":"2024-09-16T01:21:39.106734+0000","last_clean":"2024-09-16T01:21:39.106734+0000","last_became_active":"2024-09-16T01:21:28.052625+0000","last_became_peered":"2024-09-16T01:21:28.052625+0000","last_unstale":"2024-09-16T01:21:39.106734+0000","last_undegraded":"2024-09-16T01:21:39.106734+0000","last_fullsized":"2024-09-16T01:21:39.106734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:32.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087092+0000","last_change":"2024-09-16T01:21:28.046588+0000","last_active":"2024-09-16T01:21:39.087092+0000","last_peered":"2024-09-16T01:21:39.087092+0000","last_clean":"2024-09-16T01:21:39.087092+0000","last_became_active":"2024-09-16T01:21:28.046268+0000","last_became_peered":"2024-09-16T01:21:28.046268+0000","last_unstale":"2024-09-16T01:21:39.087092+0000","last_undegraded":"2024-09-16T01:21:39.087092+0000","last_fullsized":"2024-09-16T01:21:39.087092+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:49.659707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093475+0000","last_change":"2024-09-16T01:21:28.051946+0000","last_active":"2024-09-16T01:21:39.093475+0000","last_peered":"2024-09-16T01:21:39.093475+0000","last_clean":"2024-09-16T01:21:39.093475+0000","last_became_active":"2024-09-16T01:21:28.051615+0000","last_became_peered":"2024-09-16T01:21:28.051615+0000","last_unstale":"2024-09-16T01:21:39.093475+0000","last_undegraded":"2024-09-16T01:21:39.093475+0000","last_fullsized":"2024-09-16T01:21:39.093475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.462830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093253+0000","last_change":"2024-09-16T01:21:28.047382+0000","last_active":"2024-09-16T01:21:39.093253+0000","last_peered":"2024-09-16T01:21:39.093253+0000","last_clean":"2024-09-16T01:21:39.093253+0000","last_became_active":"2024-09-16T01:21:28.045361+0000","last_became_peered":"2024-09-16T01:21:28.045361+0000","last_unstale":"2024-09-16T01:21:39.093253+0000","last_undegraded":"2024-09-16T01:21:39.093253+0000","last_fullsized":"2024-09-16T01:21:39.093253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:26.099519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091996+0000","last_change":"2024-09-16T01:21:28.054028+0000","last_active":"2024-09-16T01:21:39.091996+0000","last_peered":"2024-09-16T01:21:39.091996+0000","last_clean":"2024-09-16T01:21:39.091996+0000","last_became_active":"2024-09-16T01:21:28.052698+0000","last_became_peered":"2024-09-16T01:21:28.052698+0000","last_unstale":"2024-09-16T01:21:39.091996+0000","last_undegraded":"2024-09-16T01:21:39.091996+0000","last_fullsized":"2024-09-16T01:21:39.091996+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:01.745424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090073+0000","last_change":"2024-09-16T01:21:28.049032+0000","last_active":"2024-09-16T01:21:39.090073+0000","last_peered":"2024-09-16T01:21:39.090073+0000","last_clean":"2024-09-16T01:21:39.090073+0000","last_became_active":"2024-09-16T01:21:28.048357+0000","last_became_peered":"2024-09-16T01:21:28.048357+0000","last_unstale":"2024-09-16T01:21:39.090073+0000","last_undegraded":"2024-09-16T01:21:39.090073+0000","last_fullsized":"2024-09-16T01:21:39.090073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:17.963329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089030+0000","last_change":"2024-09-16T01:21:28.051126+0000","last_active":"2024-09-16T01:21:39.089030+0000","last_peered":"2024-09-16T01:21:39.089030+0000","last_clean":"2024-09-16T01:21:39.089030+0000","last_became_active":"2024-09-16T01:21:28.050789+0000","last_became_peered":"2024-09-16T01:21:28.050789+0000","last_unstale":"2024-09-16T01:21:39.089030+0000","last_undegraded":"2024-09-16T01:21:39.089030+0000","last_fullsized":"2024-09-16T01:21:39.089030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:35.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090443+0000","last_change":"2024-09-16T01:21:28.045569+0000","last_active":"2024-09-16T01:21:39.090443+0000","last_peered":"2024-09-16T01:21:39.090443+0000","last_clean":"2024-09-16T01:21:39.090443+0000","last_became_active":"2024-09-16T01:21:28.044496+0000","last_became_peered":"2024-09-16T01:21:28.044496+0000","last_unstale":"2024-09-16T01:21:39.090443+0000","last_undegraded":"2024-09-16T01:21:39.090443+0000","last_fullsized":"2024-09-16T01:21:39.090443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:10.665322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089790+0000","last_change":"2024-09-16T01:21:28.047522+0000","last_active":"2024-09-16T01:21:39.089790+0000","last_peered":"2024-09-16T01:21:39.089790+0000","last_clean":"2024-09-16T01:21:39.089790+0000","last_became_active":"2024-09-16T01:21:28.047192+0000","last_became_peered":"2024-09-16T01:21:28.047192+0000","last_unstale":"2024-09-16T01:21:39.089790+0000","last_undegraded":"2024-09-16T01:21:39.089790+0000","last_fullsized":"2024-09-16T01:21:39.089790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.044980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087099+0000","last_change":"2024-09-16T01:21:28.043184+0000","last_active":"2024-09-16T01:21:39.087099+0000","last_peered":"2024-09-16T01:21:39.087099+0000","last_clean":"2024-09-16T01:21:39.087099+0000","last_became_active":"2024-09-16T01:21:28.042787+0000","last_became_peered":"2024-09-16T01:21:28.042787+0000","last_unstale":"2024-09-16T01:21:39.087099+0000","last_undegraded":"2024-09-16T01:21:39.087099+0000","last_fullsized":"2024-09-16T01:21:39.087099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:00.633731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092704+0000","last_change":"2024-09-16T01:21:28.050141+0000","last_active":"2024-09-16T01:21:39.092704+0000","last_peered":"2024-09-16T01:21:39.092704+0000","last_clean":"2024-09-16T01:21:39.092704+0000","last_became_active":"2024-09-16T01:21:28.049843+0000","last_became_peered":"2024-09-16T01:21:28.049843+0000","last_unstale":"2024-09-16T01:21:39.092704+0000","last_undegraded":"2024-09-16T01:21:39.092704+0000","last_fullsized":"2024-09-16T01:21:39.092704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:39.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089783+0000","last_change":"2024-09-16T01:21:28.044260+0000","last_active":"2024-09-16T01:21:39.089783+0000","last_peered":"2024-09-16T01:21:39.089783+0000","last_clean":"2024-09-16T01:21:39.089783+0000","last_became_active":"2024-09-16T01:21:28.043959+0000","last_became_peered":"2024-09-16T01:21:28.043959+0000","last_unstale":"2024-09-16T01:21:39.089783+0000","last_undegraded":"2024-09-16T01:21:39.089783+0000","last_fullsized":"2024-09-16T01:21:39.089783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087679+0000","last_change":"2024-09-16T01:21:28.044143+0000","last_active":"2024-09-16T01:21:39.087679+0000","last_peered":"2024-09-16T01:21:39.087679+0000","last_clean":"2024-09-16T01:21:39.087679+0000","last_became_active":"2024-09-16T01:21:28.043767+0000","last_became_peered":"2024-09-16T01:21:28.043767+0000","last_unstale":"2024-09-16T01:21:39.087679+0000","last_undegraded":"2024-09-16T01:21:39.087679+0000","last_fullsized":"2024-09-16T01:21:39.087679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:25.269737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089450+0000","last_change":"2024-09-16T01:21:28.047663+0000","last_active":"2024-09-16T01:21:39.089450+0000","last_peered":"2024-09-16T01:21:39.089450+0000","last_clean":"2024-09-16T01:21:39.089450+0000","last_became_active":"2024-09-16T01:21:28.047044+0000","last_became_peered":"2024-09-16T01:21:28.047044+0000","last_unstale":"2024-09-16T01:21:39.089450+0000","last_undegraded":"2024-09-16T01:21:39.089450+0000","last_fullsized":"2024-09-16T01:21:39.089450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:44.539096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091431+0000","last_change":"2024-09-16T01:21:28.052740+0000","last_active":"2024-09-16T01:21:39.091431+0000","last_peered":"2024-09-16T01:21:39.091431+0000","last_clean":"2024-09-16T01:21:39.091431+0000","last_became_active":"2024-09-16T01:21:28.052396+0000","last_became_peered":"2024-09-16T01:21:28.052396+0000","last_unstale":"2024-09-16T01:21:39.091431+0000","last_undegraded":"2024-09-16T01:21:39.091431+0000","last_fullsized":"2024-09-16T01:21:39.091431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:49.021594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089633+0000","last_change":"2024-09-16T01:21:28.050867+0000","last_active":"2024-09-16T01:21:39.089633+0000","last_peered":"2024-09-16T01:21:39.089633+0000","last_clean":"2024-09-16T01:21:39.089633+0000","last_became_active":"2024-09-16T01:21:28.050412+0000","last_became_peered":"2024-09-16T01:21:28.050412+0000","last_unstale":"2024-09-16T01:21:39.089633+0000","last_undegraded":"2024-09-16T01:21:39.089633+0000","last_fullsized":"2024-09-16T01:21:39.089633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.286864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087224+0000","last_change":"2024-09-16T01:21:28.037593+0000","last_active":"2024-09-16T01:21:39.087224+0000","last_peered":"2024-09-16T01:21:39.087224+0000","last_clean":"2024-09-16T01:21:39.087224+0000","last_became_active":"2024-09-16T01:21:28.037268+0000","last_became_peered":"2024-09-16T01:21:28.037268+0000","last_unstale":"2024-09-16T01:21:39.087224+0000","last_undegraded":"2024-09-16T01:21:39.087224+0000","last_fullsized":"2024-09-16T01:21:39.087224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:09.625480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093471+0000","last_change":"2024-09-16T01:21:28.044744+0000","last_active":"2024-09-16T01:21:39.093471+0000","last_peered":"2024-09-16T01:21:39.093471+0000","last_clean":"2024-09-16T01:21:39.093471+0000","last_became_active":"2024-09-16T01:21:28.044440+0000","last_became_peered":"2024-09-16T01:21:28.044440+0000","last_unstale":"2024-09-16T01:21:39.093471+0000","last_undegraded":"2024-09-16T01:21:39.093471+0000","last_fullsized":"2024-09-16T01:21:39.093471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:20.404778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090655+0000","last_change":"2024-09-16T01:21:28.044498+0000","last_active":"2024-09-16T01:21:39.090655+0000","last_peered":"2024-09-16T01:21:39.090655+0000","last_clean":"2024-09-16T01:21:39.090655+0000","last_became_active":"2024-09-16T01:21:28.044028+0000","last_became_peered":"2024-09-16T01:21:28.044028+0000","last_unstale":"2024-09-16T01:21:39.090655+0000","last_undegraded":"2024-09-16T01:21:39.090655+0000","last_fullsized":"2024-09-16T01:21:39.090655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:46.134484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090743+0000","last_change":"2024-09-16T01:21:28.047796+0000","last_active":"2024-09-16T01:21:39.090743+0000","last_peered":"2024-09-16T01:21:39.090743+0000","last_clean":"2024-09-16T01:21:39.090743+0000","last_became_active":"2024-09-16T01:21:28.046289+0000","last_became_peered":"2024-09-16T01:21:28.046289+0000","last_unstale":"2024-09-16T01:21:39.090743+0000","last_undegraded":"2024-09-16T01:21:39.090743+0000","last_fullsized":"2024-09-16T01:21:39.090743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:53.709261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089792+0000","last_change":"2024-09-16T01:21:28.050767+0000","last_active":"2024-09-16T01:21:39.089792+0000","last_peered":"2024-09-16T01:21:39.089792+0000","last_clean":"2024-09-16T01:21:39.089792+0000","last_became_active":"2024-09-16T01:21:28.050430+0000","last_became_peered":"2024-09-16T01:21:28.050430+0000","last_unstale":"2024-09-16T01:21:39.089792+0000","last_undegraded":"2024-09-16T01:21:39.089792+0000","last_fullsized":"2024-09-16T01:21:39.089792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:37.436612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092925+0000","last_change":"2024-09-16T01:21:28.045374+0000","last_active":"2024-09-16T01:21:39.092925+0000","last_peered":"2024-09-16T01:21:39.092925+0000","last_clean":"2024-09-16T01:21:39.092925+0000","last_became_active":"2024-09-16T01:21:28.045072+0000","last_became_peered":"2024-09-16T01:21:28.045072+0000","last_unstale":"2024-09-16T01:21:39.092925+0000","last_undegraded":"2024-09-16T01:21:39.092925+0000","last_fullsized":"2024-09-16T01:21:39.092925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:10.579680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":83,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:22:28.169539+0000","last_change":"2024-09-16T01:21:25.922017+0000","last_active":"2024-09-16T01:22:28.169539+0000","last_peered":"2024-09-16T01:22:28.169539+0000","last_clean":"2024-09-16T01:22:28.169539+0000","last_became_active":"2024-09-16T01:21:25.921580+0000","last_became_peered":"2024-09-16T01:21:25.921580+0000","last_unstale":"2024-09-16T01:22:28.169539+0000","last_undegraded":"2024-09-16T01:22:28.169539+0000","last_fullsized":"2024-09-16T01:22:28.169539+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.745844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094811+0000","last_change":"2024-09-16T01:21:39.094811+0000","last_active":"2024-09-16T01:21:39.094811+0000","last_peered":"2024-09-16T01:21:39.094811+0000","last_clean":"2024-09-16T01:21:39.094811+0000","last_became_active":"2024-09-16T01:21:39.094399+0000","last_became_peered":"2024-09-16T01:21:39.094399+0000","last_unstale":"2024-09-16T01:21:39.094811+0000","last_undegraded":"2024-09-16T01:21:39.094811+0000","last_fullsized":"2024-09-16T01:21:39.094811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:48.363791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.110226+0000","last_change":"2024-09-16T01:21:39.110226+0000","last_active":"2024-09-16T01:21:39.110226+0000","last_peered":"2024-09-16T01:21:39.110226+0000","last_clean":"2024-09-16T01:21:39.110226+0000","last_became_active":"2024-09-16T01:21:39.107676+0000","last_became_peered":"2024-09-16T01:21:39.107676+0000","last_unstale":"2024-09-16T01:21:39.110226+0000","last_undegraded":"2024-09-16T01:21:39.110226+0000","last_fullsized":"2024-09-16T01:21:39.110226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:57:14.854181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086856+0000","last_change":"2024-09-16T01:21:25.924434+0000","last_active":"2024-09-16T01:21:39.086856+0000","last_peered":"2024-09-16T01:21:39.086856+0000","last_clean":"2024-09-16T01:21:39.086856+0000","last_became_active":"2024-09-16T01:21:25.924092+0000","last_became_peered":"2024-09-16T01:21:25.924092+0000","last_unstale":"2024-09-16T01:21:39.086856+0000","last_undegraded":"2024-09-16T01:21:39.086856+0000","last_fullsized":"2024-09-16T01:21:39.086856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:20.956985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089603+0000","last_change":"2024-09-16T01:21:28.037273+0000","last_active":"2024-09-16T01:21:39.089603+0000","last_peered":"2024-09-16T01:21:39.089603+0000","last_clean":"2024-09-16T01:21:39.089603+0000","last_became_active":"2024-09-16T01:21:28.036958+0000","last_became_peered":"2024-09-16T01:21:28.036958+0000","last_unstale":"2024-09-16T01:21:39.089603+0000","last_undegraded":"2024-09-16T01:21:39.089603+0000","last_fullsized":"2024-09-16T01:21:39.089603+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:53.376640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088161+0000","last_change":"2024-09-16T01:21:25.923208+0000","last_active":"2024-09-16T01:21:39.088161+0000","last_peered":"2024-09-16T01:21:39.088161+0000","last_clean":"2024-09-16T01:21:39.088161+0000","last_became_active":"2024-09-16T01:21:25.922882+0000","last_became_peered":"2024-09-16T01:21:25.922882+0000","last_unstale":"2024-09-16T01:21:39.088161+0000","last_undegraded":"2024-09-16T01:21:39.088161+0000","last_fullsized":"2024-09-16T01:21:39.088161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:44.359615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088715+0000","last_change":"2024-09-16T01:21:28.035901+0000","last_active":"2024-09-16T01:21:39.088715+0000","last_peered":"2024-09-16T01:21:39.088715+0000","last_clean":"2024-09-16T01:21:39.088715+0000","last_became_active":"2024-09-16T01:21:28.035568+0000","last_became_peered":"2024-09-16T01:21:28.035568+0000","last_unstale":"2024-09-16T01:21:39.088715+0000","last_undegraded":"2024-09-16T01:21:39.088715+0000","last_fullsized":"2024-09-16T01:21:39.088715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:42.270380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":78,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:22:29.170224+0000","last_change":"2024-09-16T01:21:25.923692+0000","last_active":"2024-09-16T01:22:29.170224+0000","last_peered":"2024-09-16T01:22:29.170224+0000","last_clean":"2024-09-16T01:22:29.170224+0000","last_became_active":"2024-09-16T01:21:25.923325+0000","last_became_peered":"2024-09-16T01:21:25.923325+0000","last_unstale":"2024-09-16T01:22:29.170224+0000","last_undegraded":"2024-09-16T01:22:29.170224+0000","last_fullsized":"2024-09-16T01:22:29.170224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:55.075655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093337+0000","last_change":"2024-09-16T01:21:28.054697+0000","last_active":"2024-09-16T01:21:39.093337+0000","last_peered":"2024-09-16T01:21:39.093337+0000","last_clean":"2024-09-16T01:21:39.093337+0000","last_became_active":"2024-09-16T01:21:28.054416+0000","last_became_peered":"2024-09-16T01:21:28.054416+0000","last_unstale":"2024-09-16T01:21:39.093337+0000","last_undegraded":"2024-09-16T01:21:39.093337+0000","last_fullsized":"2024-09-16T01:21:39.093337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:42.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089652+0000","last_change":"2024-09-16T01:21:25.920939+0000","last_active":"2024-09-16T01:21:39.089652+0000","last_peered":"2024-09-16T01:21:39.089652+0000","last_clean":"2024-09-16T01:21:39.089652+0000","last_became_active":"2024-09-16T01:21:25.920574+0000","last_became_peered":"2024-09-16T01:21:25.920574+0000","last_unstale":"2024-09-16T01:21:39.089652+0000","last_undegraded":"2024-09-16T01:21:39.089652+0000","last_fullsized":"2024-09-16T01:21:39.089652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:15.640800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093972+0000","last_change":"2024-09-16T01:21:28.048981+0000","last_active":"2024-09-16T01:21:39.093972+0000","last_peered":"2024-09-16T01:21:39.093972+0000","last_clean":"2024-09-16T01:21:39.093972+0000","last_became_active":"2024-09-16T01:21:28.048675+0000","last_became_peered":"2024-09-16T01:21:28.048675+0000","last_unstale":"2024-09-16T01:21:39.093972+0000","last_undegraded":"2024-09-16T01:21:39.093972+0000","last_fullsized":"2024-09-16T01:21:39.093972+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:30.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088725+0000","last_change":"2024-09-16T01:21:26.660117+0000","last_active":"2024-09-16T01:21:39.088725+0000","last_peered":"2024-09-16T01:21:39.088725+0000","last_clean":"2024-09-16T01:21:39.088725+0000","last_became_active":"2024-09-16T01:21:26.659743+0000","last_became_peered":"2024-09-16T01:21:26.659743+0000","last_unstale":"2024-09-16T01:21:39.088725+0000","last_undegraded":"2024-09-16T01:21:39.088725+0000","last_fullsized":"2024-09-16T01:21:39.088725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:10.220612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092331+0000","last_change":"2024-09-16T01:21:28.051057+0000","last_active":"2024-09-16T01:21:39.092331+0000","last_peered":"2024-09-16T01:21:39.092331+0000","last_clean":"2024-09-16T01:21:39.092331+0000","last_became_active":"2024-09-16T01:21:28.050756+0000","last_became_peered":"2024-09-16T01:21:28.050756+0000","last_unstale":"2024-09-16T01:21:39.092331+0000","last_undegraded":"2024-09-16T01:21:39.092331+0000","last_fullsized":"2024-09-16T01:21:39.092331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:16.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'28","reported_seq":165,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:22:30.171494+0000","last_change":"2024-09-16T01:21:25.927384+0000","last_active":"2024-09-16T01:22:30.171494+0000","last_peered":"2024-09-16T01:22:30.171494+0000","last_clean":"2024-09-16T01:22:30.171494+0000","last_became_active":"2024-09-16T01:21:25.927017+0000","last_became_peered":"2024-09-16T01:21:25.927017+0000","last_unstale":"2024-09-16T01:22:30.171494+0000","last_undegraded":"2024-09-16T01:22:30.171494+0000","last_fullsized":"2024-09-16T01:22:30.171494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:03.267625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093543+0000","last_change":"2024-09-16T01:21:28.049410+0000","last_active":"2024-09-16T01:21:39.093543+0000","last_peered":"2024-09-16T01:21:39.093543+0000","last_clean":"2024-09-16T01:21:39.093543+0000","last_became_active":"2024-09-16T01:21:28.049058+0000","last_became_peered":"2024-09-16T01:21:28.049058+0000","last_unstale":"2024-09-16T01:21:39.093543+0000","last_undegraded":"2024-09-16T01:21:39.093543+0000","last_fullsized":"2024-09-16T01:21:39.093543+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091098+0000","last_change":"2024-09-16T01:21:25.922040+0000","last_active":"2024-09-16T01:21:39.091098+0000","last_peered":"2024-09-16T01:21:39.091098+0000","last_clean":"2024-09-16T01:21:39.091098+0000","last_became_active":"2024-09-16T01:21:25.921487+0000","last_became_peered":"2024-09-16T01:21:25.921487+0000","last_unstale":"2024-09-16T01:21:39.091098+0000","last_undegraded":"2024-09-16T01:21:39.091098+0000","last_fullsized":"2024-09-16T01:21:39.091098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:15.361010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086957+0000","last_change":"2024-09-16T01:21:28.043344+0000","last_active":"2024-09-16T01:21:39.086957+0000","last_peered":"2024-09-16T01:21:39.086957+0000","last_clean":"2024-09-16T01:21:39.086957+0000","last_became_active":"2024-09-16T01:21:28.042495+0000","last_became_peered":"2024-09-16T01:21:28.042495+0000","last_unstale":"2024-09-16T01:21:39.086957+0000","last_undegraded":"2024-09-16T01:21:39.086957+0000","last_fullsized":"2024-09-16T01:21:39.086957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:28.957975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087280+0000","last_change":"2024-09-16T01:21:25.924144+0000","last_active":"2024-09-16T01:21:39.087280+0000","last_peered":"2024-09-16T01:21:39.087280+0000","last_clean":"2024-09-16T01:21:39.087280+0000","last_became_active":"2024-09-16T01:21:25.923761+0000","last_became_peered":"2024-09-16T01:21:25.923761+0000","last_unstale":"2024-09-16T01:21:39.087280+0000","last_undegraded":"2024-09-16T01:21:39.087280+0000","last_fullsized":"2024-09-16T01:21:39.087280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.651575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088985+0000","last_change":"2024-09-16T01:21:28.049329+0000","last_active":"2024-09-16T01:21:39.088985+0000","last_peered":"2024-09-16T01:21:39.088985+0000","last_clean":"2024-09-16T01:21:39.088985+0000","last_became_active":"2024-09-16T01:21:28.048976+0000","last_became_peered":"2024-09-16T01:21:28.048976+0000","last_unstale":"2024-09-16T01:21:39.088985+0000","last_undegraded":"2024-09-16T01:21:39.088985+0000","last_fullsized":"2024-09-16T01:21:39.088985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:11.564388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":82,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:22:29.170724+0000","last_change":"2024-09-16T01:21:25.923608+0000","last_active":"2024-09-16T01:22:29.170724+0000","last_peered":"2024-09-16T01:22:29.170724+0000","last_clean":"2024-09-16T01:22:29.170724+0000","last_became_active":"2024-09-16T01:21:25.923284+0000","last_became_peered":"2024-09-16T01:21:25.923284+0000","last_unstale":"2024-09-16T01:22:29.170724+0000","last_undegraded":"2024-09-16T01:22:29.170724+0000","last_fullsized":"2024-09-16T01:22:29.170724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:41.195014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091872+0000","last_change":"2024-09-16T01:21:39.091872+0000","last_active":"2024-09-16T01:21:39.091872+0000","last_peered":"2024-09-16T01:21:39.091872+0000","last_clean":"2024-09-16T01:21:39.091872+0000","last_became_active":"2024-09-16T01:21:39.091480+0000","last_became_peered":"2024-09-16T01:21:39.091480+0000","last_unstale":"2024-09-16T01:21:39.091872+0000","last_undegraded":"2024-09-16T01:21:39.091872+0000","last_fullsized":"2024-09-16T01:21:39.091872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:23.606447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092805+0000","last_change":"2024-09-16T01:21:26.661446+0000","last_active":"2024-09-16T01:21:39.092805+0000","last_peered":"2024-09-16T01:21:39.092805+0000","last_clean":"2024-09-16T01:21:39.092805+0000","last_became_active":"2024-09-16T01:21:26.661047+0000","last_became_peered":"2024-09-16T01:21:26.661047+0000","last_unstale":"2024-09-16T01:21:39.092805+0000","last_undegraded":"2024-09-16T01:21:39.092805+0000","last_fullsized":"2024-09-16T01:21:39.092805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:22.983581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087298+0000","last_change":"2024-09-16T01:21:28.054663+0000","last_active":"2024-09-16T01:21:39.087298+0000","last_peered":"2024-09-16T01:21:39.087298+0000","last_clean":"2024-09-16T01:21:39.087298+0000","last_became_active":"2024-09-16T01:21:28.054350+0000","last_became_peered":"2024-09-16T01:21:28.054350+0000","last_unstale":"2024-09-16T01:21:39.087298+0000","last_undegraded":"2024-09-16T01:21:39.087298+0000","last_fullsized":"2024-09-16T01:21:39.087298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:22.963709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094004+0000","last_change":"2024-09-16T01:21:25.921910+0000","last_active":"2024-09-16T01:21:39.094004+0000","last_peered":"2024-09-16T01:21:39.094004+0000","last_clean":"2024-09-16T01:21:39.094004+0000","last_became_active":"2024-09-16T01:21:25.921578+0000","last_became_peered":"2024-09-16T01:21:25.921578+0000","last_unstale":"2024-09-16T01:21:39.094004+0000","last_undegraded":"2024-09-16T01:21:39.094004+0000","last_fullsized":"2024-09-16T01:21:39.094004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:20.210397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089644+0000","last_change":"2024-09-16T01:21:28.049953+0000","last_active":"2024-09-16T01:21:39.089644+0000","last_peered":"2024-09-16T01:21:39.089644+0000","last_clean":"2024-09-16T01:21:39.089644+0000","last_became_active":"2024-09-16T01:21:28.049450+0000","last_became_peered":"2024-09-16T01:21:28.049450+0000","last_unstale":"2024-09-16T01:21:39.089644+0000","last_undegraded":"2024-09-16T01:21:39.089644+0000","last_fullsized":"2024-09-16T01:21:39.089644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:49.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.098150+0000","last_change":"2024-09-16T01:21:39.098150+0000","last_active":"2024-09-16T01:21:39.098150+0000","last_peered":"2024-09-16T01:21:39.098150+0000","last_clean":"2024-09-16T01:21:39.098150+0000","last_became_active":"2024-09-16T01:21:39.094297+0000","last_became_peered":"2024-09-16T01:21:39.094297+0000","last_unstale":"2024-09-16T01:21:39.098150+0000","last_undegraded":"2024-09-16T01:21:39.098150+0000","last_fullsized":"2024-09-16T01:21:39.098150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:30:25.297230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091018+0000","last_change":"2024-09-16T01:21:28.053920+0000","last_active":"2024-09-16T01:21:39.091018+0000","last_peered":"2024-09-16T01:21:39.091018+0000","last_clean":"2024-09-16T01:21:39.091018+0000","last_became_active":"2024-09-16T01:21:28.053397+0000","last_became_peered":"2024-09-16T01:21:28.053397+0000","last_unstale":"2024-09-16T01:21:39.091018+0000","last_undegraded":"2024-09-16T01:21:39.091018+0000","last_fullsized":"2024-09-16T01:21:39.091018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:27.079374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088854+0000","last_change":"2024-09-16T01:21:25.920527+0000","last_active":"2024-09-16T01:21:39.088854+0000","last_peered":"2024-09-16T01:21:39.088854+0000","last_clean":"2024-09-16T01:21:39.088854+0000","last_became_active":"2024-09-16T01:21:25.920162+0000","last_became_peered":"2024-09-16T01:21:25.920162+0000","last_unstale":"2024-09-16T01:21:39.088854+0000","last_undegraded":"2024-09-16T01:21:39.088854+0000","last_fullsized":"2024-09-16T01:21:39.088854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:31.995141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089348+0000","last_change":"2024-09-16T01:21:28.050068+0000","last_active":"2024-09-16T01:21:39.089348+0000","last_peered":"2024-09-16T01:21:39.089348+0000","last_clean":"2024-09-16T01:21:39.089348+0000","last_became_active":"2024-09-16T01:21:28.049678+0000","last_became_peered":"2024-09-16T01:21:28.049678+0000","last_unstale":"2024-09-16T01:21:39.089348+0000","last_undegraded":"2024-09-16T01:21:39.089348+0000","last_fullsized":"2024-09-16T01:21:39.089348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:57.870550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091065+0000","last_change":"2024-09-16T01:21:26.663670+0000","last_active":"2024-09-16T01:21:39.091065+0000","last_peered":"2024-09-16T01:21:39.091065+0000","last_clean":"2024-09-16T01:21:39.091065+0000","last_became_active":"2024-09-16T01:21:26.663173+0000","last_became_peered":"2024-09-16T01:21:26.663173+0000","last_unstale":"2024-09-16T01:21:39.091065+0000","last_undegraded":"2024-09-16T01:21:39.091065+0000","last_fullsized":"2024-09-16T01:21:39.091065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:01.747039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089528+0000","last_change":"2024-09-16T01:21:28.053354+0000","last_active":"2024-09-16T01:21:39.089528+0000","last_peered":"2024-09-16T01:21:39.089528+0000","last_clean":"2024-09-16T01:21:39.089528+0000","last_became_active":"2024-09-16T01:21:28.052985+0000","last_became_peered":"2024-09-16T01:21:28.052985+0000","last_unstale":"2024-09-16T01:21:39.089528+0000","last_undegraded":"2024-09-16T01:21:39.089528+0000","last_fullsized":"2024-09-16T01:21:39.089528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:09.360220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":337,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:20:14.084036+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:20:14.083552+0000","last_became_peered":"2024-09-16T01:20:14.083552+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_clean_scrub_stamp":"2024-09-16T01:16:51.922126+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:37.598878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106614+0000","last_change":"2024-09-16T01:21:25.923170+0000","last_active":"2024-09-16T01:21:39.106614+0000","last_peered":"2024-09-16T01:21:39.106614+0000","last_clean":"2024-09-16T01:21:39.106614+0000","last_became_active":"2024-09-16T01:21:25.922555+0000","last_became_peered":"2024-09-16T01:21:25.922555+0000","last_unstale":"2024-09-16T01:21:39.106614+0000","last_undegraded":"2024-09-16T01:21:39.106614+0000","last_fullsized":"2024-09-16T01:21:39.106614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:14.948264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094536+0000","last_change":"2024-09-16T01:21:39.093752+0000","last_active":"2024-09-16T01:21:39.094536+0000","last_peered":"2024-09-16T01:21:39.094536+0000","last_clean":"2024-09-16T01:21:39.094536+0000","last_became_active":"2024-09-16T01:21:39.093394+0000","last_became_peered":"2024-09-16T01:21:39.093394+0000","last_unstale":"2024-09-16T01:21:39.094536+0000","last_undegraded":"2024-09-16T01:21:39.094536+0000","last_fullsized":"2024-09-16T01:21:39.094536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:32.703408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:21:25.925009+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:21:25.924661+0000","last_became_peered":"2024-09-16T01:21:25.924661+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.703241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086849+0000","last_change":"2024-09-16T01:21:28.045745+0000","last_active":"2024-09-16T01:21:39.086849+0000","last_peered":"2024-09-16T01:21:39.086849+0000","last_clean":"2024-09-16T01:21:39.086849+0000","last_became_active":"2024-09-16T01:21:28.045398+0000","last_became_peered":"2024-09-16T01:21:28.045398+0000","last_unstale":"2024-09-16T01:21:39.086849+0000","last_undegraded":"2024-09-16T01:21:39.086849+0000","last_fullsized":"2024-09-16T01:21:39.086849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:17.422858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":79,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:22:29.170150+0000","last_change":"2024-09-16T01:21:26.660859+0000","last_active":"2024-09-16T01:22:29.170150+0000","last_peered":"2024-09-16T01:22:29.170150+0000","last_clean":"2024-09-16T01:22:29.170150+0000","last_became_active":"2024-09-16T01:21:26.660515+0000","last_became_peered":"2024-09-16T01:21:26.660515+0000","last_unstale":"2024-09-16T01:22:29.170150+0000","last_undegraded":"2024-09-16T01:22:29.170150+0000","last_fullsized":"2024-09-16T01:22:29.170150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:57.301546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092617+0000","last_change":"2024-09-16T01:21:39.092617+0000","last_active":"2024-09-16T01:21:39.092617+0000","last_peered":"2024-09-16T01:21:39.092617+0000","last_clean":"2024-09-16T01:21:39.092617+0000","last_became_active":"2024-09-16T01:21:39.092212+0000","last_became_peered":"2024-09-16T01:21:39.092212+0000","last_unstale":"2024-09-16T01:21:39.092617+0000","last_undegraded":"2024-09-16T01:21:39.092617+0000","last_fullsized":"2024-09-16T01:21:39.092617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.894975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089151+0000","last_change":"2024-09-16T01:21:25.924485+0000","last_active":"2024-09-16T01:21:39.089151+0000","last_peered":"2024-09-16T01:21:39.089151+0000","last_clean":"2024-09-16T01:21:39.089151+0000","last_became_active":"2024-09-16T01:21:25.924075+0000","last_became_peered":"2024-09-16T01:21:25.924075+0000","last_unstale":"2024-09-16T01:21:39.089151+0000","last_undegraded":"2024-09-16T01:21:39.089151+0000","last_fullsized":"2024-09-16T01:21:39.089151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:13.034668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090273+0000","last_change":"2024-09-16T01:21:28.048152+0000","last_active":"2024-09-16T01:21:39.090273+0000","last_peered":"2024-09-16T01:21:39.090273+0000","last_clean":"2024-09-16T01:21:39.090273+0000","last_became_active":"2024-09-16T01:21:28.047818+0000","last_became_peered":"2024-09-16T01:21:28.047818+0000","last_unstale":"2024-09-16T01:21:39.090273+0000","last_undegraded":"2024-09-16T01:21:39.090273+0000","last_fullsized":"2024-09-16T01:21:39.090273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:19.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089286+0000","last_change":"2024-09-16T01:21:26.660336+0000","last_active":"2024-09-16T01:21:39.089286+0000","last_peered":"2024-09-16T01:21:39.089286+0000","last_clean":"2024-09-16T01:21:39.089286+0000","last_became_active":"2024-09-16T01:21:26.660005+0000","last_became_peered":"2024-09-16T01:21:26.660005+0000","last_unstale":"2024-09-16T01:21:39.089286+0000","last_undegraded":"2024-09-16T01:21:39.089286+0000","last_fullsized":"2024-09-16T01:21:39.089286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:37.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090412+0000","last_change":"2024-09-16T01:21:28.043112+0000","last_active":"2024-09-16T01:21:39.090412+0000","last_peered":"2024-09-16T01:21:39.090412+0000","last_clean":"2024-09-16T01:21:39.090412+0000","last_became_active":"2024-09-16T01:21:28.042752+0000","last_became_peered":"2024-09-16T01:21:28.042752+0000","last_unstale":"2024-09-16T01:21:39.090412+0000","last_undegraded":"2024-09-16T01:21:39.090412+0000","last_fullsized":"2024-09-16T01:21:39.090412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:57.379826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093748+0000","last_change":"2024-09-16T01:21:26.661003+0000","last_active":"2024-09-16T01:21:39.093748+0000","last_peered":"2024-09-16T01:21:39.093748+0000","last_clean":"2024-09-16T01:21:39.093748+0000","last_became_active":"2024-09-16T01:21:26.660407+0000","last_became_peered":"2024-09-16T01:21:26.660407+0000","last_unstale":"2024-09-16T01:21:39.093748+0000","last_undegraded":"2024-09-16T01:21:39.093748+0000","last_fullsized":"2024-09-16T01:21:39.093748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:52.229473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087273+0000","last_change":"2024-09-16T01:21:28.046938+0000","last_active":"2024-09-16T01:21:39.087273+0000","last_peered":"2024-09-16T01:21:39.087273+0000","last_clean":"2024-09-16T01:21:39.087273+0000","last_became_active":"2024-09-16T01:21:28.046620+0000","last_became_peered":"2024-09-16T01:21:28.046620+0000","last_unstale":"2024-09-16T01:21:39.087273+0000","last_undegraded":"2024-09-16T01:21:39.087273+0000","last_fullsized":"2024-09-16T01:21:39.087273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:04.845341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'10","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:52.037484+0000","last_change":"2024-09-16T01:21:25.915315+0000","last_active":"2024-09-16T01:21:52.037484+0000","last_peered":"2024-09-16T01:21:52.037484+0000","last_clean":"2024-09-16T01:21:52.037484+0000","last_became_active":"2024-09-16T01:21:25.915001+0000","last_became_peered":"2024-09-16T01:21:25.915001+0000","last_unstale":"2024-09-16T01:21:52.037484+0000","last_undegraded":"2024-09-16T01:21:52.037484+0000","last_fullsized":"2024-09-16T01:21:52.037484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:30.163050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089535+0000","last_change":"2024-09-16T01:21:28.047157+0000","last_active":"2024-09-16T01:21:39.089535+0000","last_peered":"2024-09-16T01:21:39.089535+0000","last_clean":"2024-09-16T01:21:39.089535+0000","last_became_active":"2024-09-16T01:21:28.046583+0000","last_became_peered":"2024-09-16T01:21:28.046583+0000","last_unstale":"2024-09-16T01:21:39.089535+0000","last_undegraded":"2024-09-16T01:21:39.089535+0000","last_fullsized":"2024-09-16T01:21:39.089535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:47.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106885+0000","last_change":"2024-09-16T01:21:26.663047+0000","last_active":"2024-09-16T01:21:39.106885+0000","last_peered":"2024-09-16T01:21:39.106885+0000","last_clean":"2024-09-16T01:21:39.106885+0000","last_became_active":"2024-09-16T01:21:26.662627+0000","last_became_peered":"2024-09-16T01:21:26.662627+0000","last_unstale":"2024-09-16T01:21:39.106885+0000","last_undegraded":"2024-09-16T01:21:39.106885+0000","last_fullsized":"2024-09-16T01:21:39.106885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:59.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093738+0000","last_change":"2024-09-16T01:21:28.046954+0000","last_active":"2024-09-16T01:21:39.093738+0000","last_peered":"2024-09-16T01:21:39.093738+0000","last_clean":"2024-09-16T01:21:39.093738+0000","last_became_active":"2024-09-16T01:21:28.046550+0000","last_became_peered":"2024-09-16T01:21:28.046550+0000","last_unstale":"2024-09-16T01:21:39.093738+0000","last_undegraded":"2024-09-16T01:21:39.093738+0000","last_fullsized":"2024-09-16T01:21:39.093738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:30.880672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.100910+0000","last_change":"2024-09-16T01:21:39.100910+0000","last_active":"2024-09-16T01:21:39.100910+0000","last_peered":"2024-09-16T01:21:39.100910+0000","last_clean":"2024-09-16T01:21:39.100910+0000","last_became_active":"2024-09-16T01:21:39.095257+0000","last_became_peered":"2024-09-16T01:21:39.095257+0000","last_unstale":"2024-09-16T01:21:39.100910+0000","last_undegraded":"2024-09-16T01:21:39.100910+0000","last_fullsized":"2024-09-16T01:21:39.100910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:17.957295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092774+0000","last_change":"2024-09-16T01:21:28.052061+0000","last_active":"2024-09-16T01:21:39.092774+0000","last_peered":"2024-09-16T01:21:39.092774+0000","last_clean":"2024-09-16T01:21:39.092774+0000","last_became_active":"2024-09-16T01:21:28.051705+0000","last_became_peered":"2024-09-16T01:21:28.051705+0000","last_unstale":"2024-09-16T01:21:39.092774+0000","last_undegraded":"2024-09-16T01:21:39.092774+0000","last_fullsized":"2024-09-16T01:21:39.092774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:05.546846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090258+0000","last_change":"2024-09-16T01:21:25.921635+0000","last_active":"2024-09-16T01:21:39.090258+0000","last_peered":"2024-09-16T01:21:39.090258+0000","last_clean":"2024-09-16T01:21:39.090258+0000","last_became_active":"2024-09-16T01:21:25.921281+0000","last_became_peered":"2024-09-16T01:21:25.921281+0000","last_unstale":"2024-09-16T01:21:39.090258+0000","last_undegraded":"2024-09-16T01:21:39.090258+0000","last_fullsized":"2024-09-16T01:21:39.090258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:02.933803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089886+0000","last_change":"2024-09-16T01:21:28.043636+0000","last_active":"2024-09-16T01:21:39.089886+0000","last_peered":"2024-09-16T01:21:39.089886+0000","last_clean":"2024-09-16T01:21:39.089886+0000","last_became_active":"2024-09-16T01:21:28.043273+0000","last_became_peered":"2024-09-16T01:21:28.043273+0000","last_unstale":"2024-09-16T01:21:39.089886+0000","last_undegraded":"2024-09-16T01:21:39.089886+0000","last_fullsized":"2024-09-16T01:21:39.089886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:05.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090771+0000","last_change":"2024-09-16T01:21:25.917934+0000","last_active":"2024-09-16T01:21:39.090771+0000","last_peered":"2024-09-16T01:21:39.090771+0000","last_clean":"2024-09-16T01:21:39.090771+0000","last_became_active":"2024-09-16T01:21:25.917545+0000","last_became_peered":"2024-09-16T01:21:25.917545+0000","last_unstale":"2024-09-16T01:21:39.090771+0000","last_undegraded":"2024-09-16T01:21:39.090771+0000","last_fullsized":"2024-09-16T01:21:39.090771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:07.119546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089851+0000","last_change":"2024-09-16T01:21:28.043270+0000","last_active":"2024-09-16T01:21:39.089851+0000","last_peered":"2024-09-16T01:21:39.089851+0000","last_clean":"2024-09-16T01:21:39.089851+0000","last_became_active":"2024-09-16T01:21:28.042957+0000","last_became_peered":"2024-09-16T01:21:28.042957+0000","last_unstale":"2024-09-16T01:21:39.089851+0000","last_undegraded":"2024-09-16T01:21:39.089851+0000","last_fullsized":"2024-09-16T01:21:39.089851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:11.052387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093263+0000","last_change":"2024-09-16T01:21:25.923224+0000","last_active":"2024-09-16T01:21:39.093263+0000","last_peered":"2024-09-16T01:21:39.093263+0000","last_clean":"2024-09-16T01:21:39.093263+0000","last_became_active":"2024-09-16T01:21:25.922873+0000","last_became_peered":"2024-09-16T01:21:25.922873+0000","last_unstale":"2024-09-16T01:21:39.093263+0000","last_undegraded":"2024-09-16T01:21:39.093263+0000","last_fullsized":"2024-09-16T01:21:39.093263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:14.747752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088910+0000","last_change":"2024-09-16T01:21:28.054706+0000","last_active":"2024-09-16T01:21:39.088910+0000","last_peered":"2024-09-16T01:21:39.088910+0000","last_clean":"2024-09-16T01:21:39.088910+0000","last_became_active":"2024-09-16T01:21:28.054382+0000","last_became_peered":"2024-09-16T01:21:28.054382+0000","last_unstale":"2024-09-16T01:21:39.088910+0000","last_undegraded":"2024-09-16T01:21:39.088910+0000","last_fullsized":"2024-09-16T01:21:39.088910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.908252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088713+0000","last_change":"2024-09-16T01:21:28.051807+0000","last_active":"2024-09-16T01:21:39.088713+0000","last_peered":"2024-09-16T01:21:39.088713+0000","last_clean":"2024-09-16T01:21:39.088713+0000","last_became_active":"2024-09-16T01:21:28.051474+0000","last_became_peered":"2024-09-16T01:21:28.051474+0000","last_unstale":"2024-09-16T01:21:39.088713+0000","last_undegraded":"2024-09-16T01:21:39.088713+0000","last_fullsized":"2024-09-16T01:21:39.088713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:48.006691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.101161+0000","last_change":"2024-09-16T01:21:39.100723+0000","last_active":"2024-09-16T01:21:39.101161+0000","last_peered":"2024-09-16T01:21:39.101161+0000","last_clean":"2024-09-16T01:21:39.101161+0000","last_became_active":"2024-09-16T01:21:39.094895+0000","last_became_peered":"2024-09-16T01:21:39.094895+0000","last_unstale":"2024-09-16T01:21:39.101161+0000","last_undegraded":"2024-09-16T01:21:39.101161+0000","last_fullsized":"2024-09-16T01:21:39.101161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.663815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092318+0000","last_change":"2024-09-16T01:21:28.055506+0000","last_active":"2024-09-16T01:21:39.092318+0000","last_peered":"2024-09-16T01:21:39.092318+0000","last_clean":"2024-09-16T01:21:39.092318+0000","last_became_active":"2024-09-16T01:21:28.055167+0000","last_became_peered":"2024-09-16T01:21:28.055167+0000","last_unstale":"2024-09-16T01:21:39.092318+0000","last_undegraded":"2024-09-16T01:21:39.092318+0000","last_fullsized":"2024-09-16T01:21:39.092318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:38.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093642+0000","last_change":"2024-09-16T01:21:25.920611+0000","last_active":"2024-09-16T01:21:39.093642+0000","last_peered":"2024-09-16T01:21:39.093642+0000","last_clean":"2024-09-16T01:21:39.093642+0000","last_became_active":"2024-09-16T01:21:25.920255+0000","last_became_peered":"2024-09-16T01:21:25.920255+0000","last_unstale":"2024-09-16T01:21:39.093642+0000","last_undegraded":"2024-09-16T01:21:39.093642+0000","last_fullsized":"2024-09-16T01:21:39.093642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:17.268621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093932+0000","last_change":"2024-09-16T01:21:28.054009+0000","last_active":"2024-09-16T01:21:39.093932+0000","last_peered":"2024-09-16T01:21:39.093932+0000","last_clean":"2024-09-16T01:21:39.093932+0000","last_became_active":"2024-09-16T01:21:28.053631+0000","last_became_peered":"2024-09-16T01:21:28.053631+0000","last_unstale":"2024-09-16T01:21:39.093932+0000","last_undegraded":"2024-09-16T01:21:39.093932+0000","last_fullsized":"2024-09-16T01:21:39.093932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:28.298398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090095+0000","last_change":"2024-09-16T01:21:26.659753+0000","last_active":"2024-09-16T01:21:39.090095+0000","last_peered":"2024-09-16T01:21:39.090095+0000","last_clean":"2024-09-16T01:21:39.090095+0000","last_became_active":"2024-09-16T01:21:26.659343+0000","last_became_peered":"2024-09-16T01:21:26.659343+0000","last_unstale":"2024-09-16T01:21:39.090095+0000","last_undegraded":"2024-09-16T01:21:39.090095+0000","last_fullsized":"2024-09-16T01:21:39.090095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:47.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089898+0000","last_change":"2024-09-16T01:21:28.050748+0000","last_active":"2024-09-16T01:21:39.089898+0000","last_peered":"2024-09-16T01:21:39.089898+0000","last_clean":"2024-09-16T01:21:39.089898+0000","last_became_active":"2024-09-16T01:21:28.050457+0000","last_became_peered":"2024-09-16T01:21:28.050457+0000","last_unstale":"2024-09-16T01:21:39.089898+0000","last_undegraded":"2024-09-16T01:21:39.089898+0000","last_fullsized":"2024-09-16T01:21:39.089898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:21.552080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089346+0000","last_change":"2024-09-16T01:21:25.924505+0000","last_active":"2024-09-16T01:21:39.089346+0000","last_peered":"2024-09-16T01:21:39.089346+0000","last_clean":"2024-09-16T01:21:39.089346+0000","last_became_active":"2024-09-16T01:21:25.924076+0000","last_became_peered":"2024-09-16T01:21:25.924076+0000","last_unstale":"2024-09-16T01:21:39.089346+0000","last_undegraded":"2024-09-16T01:21:39.089346+0000","last_fullsized":"2024-09-16T01:21:39.089346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:00.630772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":346,"num_read_kb":241,"num_write":162,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282677,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":441274,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1092912,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441510,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135914,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441430,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364845,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1033755,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":440899,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757303,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1033046,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920830,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":441729,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":441210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":502199,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":500456,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":929792,"data_stored":442170,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:22:34.916 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T01:22:35.190 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:35.312 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:35 smithi063 ceph-mon[31070]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:35.313 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:35.313 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:35 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:35.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:35 smithi192 ceph-mon[34775]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:35.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:35.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:35 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:35.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:35 smithi162 ceph-mon[34539]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:35.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:35.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:35 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:35.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.717+0000 7f2e1900b640 1 -- 172.21.15.63:0/2435212481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e14103780 msgr2=0x7f2e14107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.717+0000 7f2e1900b640 1 --2- 172.21.15.63:0/2435212481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e14103780 0x7f2e14107bc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009930 tx=0x7f2dfc02a420 comp rx=0 tx=0).stop 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.718+0000 7f2e1900b640 1 -- 172.21.15.63:0/2435212481 shutdown_connections 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.718+0000 7f2e1900b640 1 --2- 172.21.15.63:0/2435212481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e14108300 0x7f2e1410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.718+0000 7f2e1900b640 1 --2- 172.21.15.63:0/2435212481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e14103780 0x7f2e14107bc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.718+0000 7f2e1900b640 1 --2- 172.21.15.63:0/2435212481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e14102dd0 0x7f2e141031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.718+0000 7f2e1900b640 1 -- 172.21.15.63:0/2435212481 >> 172.21.15.63:0/2435212481 conn(0x7f2e140fc7d0 msgr2=0x7f2e140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.718+0000 7f2e1900b640 1 -- 172.21.15.63:0/2435212481 shutdown_connections 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.718+0000 7f2e1900b640 1 -- 172.21.15.63:0/2435212481 wait complete. 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.718+0000 7f2e1900b640 1 Processor -- start 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1900b640 1 -- start start 2024-09-16T01:22:35.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1900b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e14102dd0 0x7f2e14198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1900b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e14103780 0x7f2e14198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1900b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e14108300 0x7f2e1419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1900b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2e14111f00 con 0x7f2e14108300 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1900b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e14111d80 con 0x7f2e14102dd0 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1900b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2e14112080 con 0x7f2e14103780 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e14108300 0x7f2e1419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e14108300 0x7f2e1419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60146/0 (socket says 172.21.15.63:60146) 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1359e640 1 -- 172.21.15.63:0/2260345228 learned_addr learned my addr 172.21.15.63:0/2260345228 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e12d9d640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e14102dd0 0x7f2e14198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1259c640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e14103780 0x7f2e14198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1359e640 1 -- 172.21.15.63:0/2260345228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e14103780 msgr2=0x7f2e14198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1359e640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e14103780 0x7f2e14198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1359e640 1 -- 172.21.15.63:0/2260345228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e14102dd0 msgr2=0x7f2e14198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1359e640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e14102dd0 0x7f2e14198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1359e640 1 -- 172.21.15.63:0/2260345228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1419d4b0 con 0x7f2e14108300 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.719+0000 7f2e1359e640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e14108300 0x7f2e1419cdd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00eaa0 tx=0x7f2e0c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.720+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2260345228 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00cdb0 con 0x7f2e14108300 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.720+0000 7f2e1900b640 1 -- 172.21.15.63:0/2260345228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1419d7a0 con 0x7f2e14108300 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.720+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2260345228 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e0c005020 con 0x7f2e14108300 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.720+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2260345228 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0116d0 con 0x7f2e14108300 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.720+0000 7f2e1900b640 1 -- 172.21.15.63:0/2260345228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e141a5080 con 0x7f2e14108300 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.721+0000 7f2e1900b640 1 -- 172.21.15.63:0/2260345228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e141031b0 con 0x7f2e14108300 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.723+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2260345228 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2e0c0051d0 con 0x7f2e14108300 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.724+0000 7f2e0bfff640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e000a32d0 0x7f2e000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.724+0000 7f2e12d9d640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e000a32d0 0x7f2e000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.724+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2260345228 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f2e0c0cff20 con 0x7f2e14108300 2024-09-16T01:22:35.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.724+0000 7f2e12d9d640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e000a32d0 0x7f2e000a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400bbe0 tx=0x7f2e0400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:35.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.727+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2260345228 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e0c016030 con 0x7f2e14108300 2024-09-16T01:22:35.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.899+0000 7f2e1900b640 1 -- 172.21.15.63:0/2260345228 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e14062630 con 0x7f2e000a32d0 2024-09-16T01:22:35.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.906+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2260345228 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258959 (secure 0 0 0) 0x7f2e14062630 con 0x7f2e000a32d0 2024-09-16T01:22:35.910 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-16T01:22:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 -- 172.21.15.63:0/2260345228 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e000a32d0 msgr2=0x7f2e000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e000a32d0 0x7f2e000a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400bbe0 tx=0x7f2e0400b390 comp rx=0 tx=0).stop 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 -- 172.21.15.63:0/2260345228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e14108300 msgr2=0x7f2e1419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e14108300 0x7f2e1419cdd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00eaa0 tx=0x7f2e0c00ef60 comp rx=0 tx=0).stop 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 -- 172.21.15.63:0/2260345228 shutdown_connections 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e000a32d0 0x7f2e000a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e14108300 0x7f2e1419cdd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e14103780 0x7f2e14198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 --2- 172.21.15.63:0/2260345228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e14102dd0 0x7f2e14198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 -- 172.21.15.63:0/2260345228 >> 172.21.15.63:0/2260345228 conn(0x7f2e140fc7d0 msgr2=0x7f2e14105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 -- 172.21.15.63:0/2260345228 shutdown_connections 2024-09-16T01:22:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:35.909+0000 7f2e1900b640 1 -- 172.21.15.63:0/2260345228 wait complete. 2024-09-16T01:22:36.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:36 smithi063 ceph-mon[31070]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:22:36.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:22:36.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:22:36.336 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:36 smithi192 ceph-mon[34775]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:22:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:22:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:22:36.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:36.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:36 smithi162 ceph-mon[34539]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:22:36.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:22:36.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:22:36.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:22:36.645 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-16T01:22:35.195356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654762,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":477,"num_read_kb":350,"num_write":345,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360400,"kb_used_data":11136,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581424,"statfs":{"total":1151940427776,"available":1151571378176,"internally_reserved":0,"allocated":11403264,"data_stored":7252590,"data_compressed":177609,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003016"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090037+0000","last_change":"2024-09-16T01:21:28.051261+0000","last_active":"2024-09-16T01:21:39.090037+0000","last_peered":"2024-09-16T01:21:39.090037+0000","last_clean":"2024-09-16T01:21:39.090037+0000","last_became_active":"2024-09-16T01:21:28.049073+0000","last_became_peered":"2024-09-16T01:21:28.049073+0000","last_unstale":"2024-09-16T01:21:39.090037+0000","last_undegraded":"2024-09-16T01:21:39.090037+0000","last_fullsized":"2024-09-16T01:21:39.090037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:06.863766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093652+0000","last_change":"2024-09-16T01:21:28.049457+0000","last_active":"2024-09-16T01:21:39.093652+0000","last_peered":"2024-09-16T01:21:39.093652+0000","last_clean":"2024-09-16T01:21:39.093652+0000","last_became_active":"2024-09-16T01:21:28.048707+0000","last_became_peered":"2024-09-16T01:21:28.048707+0000","last_unstale":"2024-09-16T01:21:39.093652+0000","last_undegraded":"2024-09-16T01:21:39.093652+0000","last_fullsized":"2024-09-16T01:21:39.093652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:56.346506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093456+0000","last_change":"2024-09-16T01:21:28.052931+0000","last_active":"2024-09-16T01:21:39.093456+0000","last_peered":"2024-09-16T01:21:39.093456+0000","last_clean":"2024-09-16T01:21:39.093456+0000","last_became_active":"2024-09-16T01:21:28.052501+0000","last_became_peered":"2024-09-16T01:21:28.052501+0000","last_unstale":"2024-09-16T01:21:39.093456+0000","last_undegraded":"2024-09-16T01:21:39.093456+0000","last_fullsized":"2024-09-16T01:21:39.093456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:45:23.351452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.096667+0000","last_change":"2024-09-16T01:21:39.096279+0000","last_active":"2024-09-16T01:21:39.096667+0000","last_peered":"2024-09-16T01:21:39.096667+0000","last_clean":"2024-09-16T01:21:39.096667+0000","last_became_active":"2024-09-16T01:21:39.095886+0000","last_became_peered":"2024-09-16T01:21:39.095886+0000","last_unstale":"2024-09-16T01:21:39.096667+0000","last_undegraded":"2024-09-16T01:21:39.096667+0000","last_fullsized":"2024-09-16T01:21:39.096667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:56.530007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093192+0000","last_change":"2024-09-16T01:21:28.043473+0000","last_active":"2024-09-16T01:21:39.093192+0000","last_peered":"2024-09-16T01:21:39.093192+0000","last_clean":"2024-09-16T01:21:39.093192+0000","last_became_active":"2024-09-16T01:21:28.043127+0000","last_became_peered":"2024-09-16T01:21:28.043127+0000","last_unstale":"2024-09-16T01:21:39.093192+0000","last_undegraded":"2024-09-16T01:21:39.093192+0000","last_fullsized":"2024-09-16T01:21:39.093192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.714834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090192+0000","last_change":"2024-09-16T01:21:28.047210+0000","last_active":"2024-09-16T01:21:39.090192+0000","last_peered":"2024-09-16T01:21:39.090192+0000","last_clean":"2024-09-16T01:21:39.090192+0000","last_became_active":"2024-09-16T01:21:28.046872+0000","last_became_peered":"2024-09-16T01:21:28.046872+0000","last_unstale":"2024-09-16T01:21:39.090192+0000","last_undegraded":"2024-09-16T01:21:39.090192+0000","last_fullsized":"2024-09-16T01:21:39.090192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:22.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088806+0000","last_change":"2024-09-16T01:21:28.052212+0000","last_active":"2024-09-16T01:21:39.088806+0000","last_peered":"2024-09-16T01:21:39.088806+0000","last_clean":"2024-09-16T01:21:39.088806+0000","last_became_active":"2024-09-16T01:21:28.050307+0000","last_became_peered":"2024-09-16T01:21:28.050307+0000","last_unstale":"2024-09-16T01:21:39.088806+0000","last_undegraded":"2024-09-16T01:21:39.088806+0000","last_fullsized":"2024-09-16T01:21:39.088806+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:21.869103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089494+0000","last_change":"2024-09-16T01:21:28.047980+0000","last_active":"2024-09-16T01:21:39.089494+0000","last_peered":"2024-09-16T01:21:39.089494+0000","last_clean":"2024-09-16T01:21:39.089494+0000","last_became_active":"2024-09-16T01:21:28.047671+0000","last_became_peered":"2024-09-16T01:21:28.047671+0000","last_unstale":"2024-09-16T01:21:39.089494+0000","last_undegraded":"2024-09-16T01:21:39.089494+0000","last_fullsized":"2024-09-16T01:21:39.089494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:30.501419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093245+0000","last_change":"2024-09-16T01:21:28.052468+0000","last_active":"2024-09-16T01:21:39.093245+0000","last_peered":"2024-09-16T01:21:39.093245+0000","last_clean":"2024-09-16T01:21:39.093245+0000","last_became_active":"2024-09-16T01:21:28.052156+0000","last_became_peered":"2024-09-16T01:21:28.052156+0000","last_unstale":"2024-09-16T01:21:39.093245+0000","last_undegraded":"2024-09-16T01:21:39.093245+0000","last_fullsized":"2024-09-16T01:21:39.093245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:44.631498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090981+0000","last_change":"2024-09-16T01:21:28.048278+0000","last_active":"2024-09-16T01:21:39.090981+0000","last_peered":"2024-09-16T01:21:39.090981+0000","last_clean":"2024-09-16T01:21:39.090981+0000","last_became_active":"2024-09-16T01:21:28.047892+0000","last_became_peered":"2024-09-16T01:21:28.047892+0000","last_unstale":"2024-09-16T01:21:39.090981+0000","last_undegraded":"2024-09-16T01:21:39.090981+0000","last_fullsized":"2024-09-16T01:21:39.090981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.949956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089369+0000","last_change":"2024-09-16T01:21:28.052814+0000","last_active":"2024-09-16T01:21:39.089369+0000","last_peered":"2024-09-16T01:21:39.089369+0000","last_clean":"2024-09-16T01:21:39.089369+0000","last_became_active":"2024-09-16T01:21:28.052440+0000","last_became_peered":"2024-09-16T01:21:28.052440+0000","last_unstale":"2024-09-16T01:21:39.089369+0000","last_undegraded":"2024-09-16T01:21:39.089369+0000","last_fullsized":"2024-09-16T01:21:39.089369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:47.470646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106734+0000","last_change":"2024-09-16T01:21:28.053917+0000","last_active":"2024-09-16T01:21:39.106734+0000","last_peered":"2024-09-16T01:21:39.106734+0000","last_clean":"2024-09-16T01:21:39.106734+0000","last_became_active":"2024-09-16T01:21:28.052625+0000","last_became_peered":"2024-09-16T01:21:28.052625+0000","last_unstale":"2024-09-16T01:21:39.106734+0000","last_undegraded":"2024-09-16T01:21:39.106734+0000","last_fullsized":"2024-09-16T01:21:39.106734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:32.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087092+0000","last_change":"2024-09-16T01:21:28.046588+0000","last_active":"2024-09-16T01:21:39.087092+0000","last_peered":"2024-09-16T01:21:39.087092+0000","last_clean":"2024-09-16T01:21:39.087092+0000","last_became_active":"2024-09-16T01:21:28.046268+0000","last_became_peered":"2024-09-16T01:21:28.046268+0000","last_unstale":"2024-09-16T01:21:39.087092+0000","last_undegraded":"2024-09-16T01:21:39.087092+0000","last_fullsized":"2024-09-16T01:21:39.087092+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:49.659707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093475+0000","last_change":"2024-09-16T01:21:28.051946+0000","last_active":"2024-09-16T01:21:39.093475+0000","last_peered":"2024-09-16T01:21:39.093475+0000","last_clean":"2024-09-16T01:21:39.093475+0000","last_became_active":"2024-09-16T01:21:28.051615+0000","last_became_peered":"2024-09-16T01:21:28.051615+0000","last_unstale":"2024-09-16T01:21:39.093475+0000","last_undegraded":"2024-09-16T01:21:39.093475+0000","last_fullsized":"2024-09-16T01:21:39.093475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.462830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093253+0000","last_change":"2024-09-16T01:21:28.047382+0000","last_active":"2024-09-16T01:21:39.093253+0000","last_peered":"2024-09-16T01:21:39.093253+0000","last_clean":"2024-09-16T01:21:39.093253+0000","last_became_active":"2024-09-16T01:21:28.045361+0000","last_became_peered":"2024-09-16T01:21:28.045361+0000","last_unstale":"2024-09-16T01:21:39.093253+0000","last_undegraded":"2024-09-16T01:21:39.093253+0000","last_fullsized":"2024-09-16T01:21:39.093253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:26.099519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091996+0000","last_change":"2024-09-16T01:21:28.054028+0000","last_active":"2024-09-16T01:21:39.091996+0000","last_peered":"2024-09-16T01:21:39.091996+0000","last_clean":"2024-09-16T01:21:39.091996+0000","last_became_active":"2024-09-16T01:21:28.052698+0000","last_became_peered":"2024-09-16T01:21:28.052698+0000","last_unstale":"2024-09-16T01:21:39.091996+0000","last_undegraded":"2024-09-16T01:21:39.091996+0000","last_fullsized":"2024-09-16T01:21:39.091996+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:01.745424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090073+0000","last_change":"2024-09-16T01:21:28.049032+0000","last_active":"2024-09-16T01:21:39.090073+0000","last_peered":"2024-09-16T01:21:39.090073+0000","last_clean":"2024-09-16T01:21:39.090073+0000","last_became_active":"2024-09-16T01:21:28.048357+0000","last_became_peered":"2024-09-16T01:21:28.048357+0000","last_unstale":"2024-09-16T01:21:39.090073+0000","last_undegraded":"2024-09-16T01:21:39.090073+0000","last_fullsized":"2024-09-16T01:21:39.090073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:17.963329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089030+0000","last_change":"2024-09-16T01:21:28.051126+0000","last_active":"2024-09-16T01:21:39.089030+0000","last_peered":"2024-09-16T01:21:39.089030+0000","last_clean":"2024-09-16T01:21:39.089030+0000","last_became_active":"2024-09-16T01:21:28.050789+0000","last_became_peered":"2024-09-16T01:21:28.050789+0000","last_unstale":"2024-09-16T01:21:39.089030+0000","last_undegraded":"2024-09-16T01:21:39.089030+0000","last_fullsized":"2024-09-16T01:21:39.089030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:35.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090443+0000","last_change":"2024-09-16T01:21:28.045569+0000","last_active":"2024-09-16T01:21:39.090443+0000","last_peered":"2024-09-16T01:21:39.090443+0000","last_clean":"2024-09-16T01:21:39.090443+0000","last_became_active":"2024-09-16T01:21:28.044496+0000","last_became_peered":"2024-09-16T01:21:28.044496+0000","last_unstale":"2024-09-16T01:21:39.090443+0000","last_undegraded":"2024-09-16T01:21:39.090443+0000","last_fullsized":"2024-09-16T01:21:39.090443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:10.665322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089790+0000","last_change":"2024-09-16T01:21:28.047522+0000","last_active":"2024-09-16T01:21:39.089790+0000","last_peered":"2024-09-16T01:21:39.089790+0000","last_clean":"2024-09-16T01:21:39.089790+0000","last_became_active":"2024-09-16T01:21:28.047192+0000","last_became_peered":"2024-09-16T01:21:28.047192+0000","last_unstale":"2024-09-16T01:21:39.089790+0000","last_undegraded":"2024-09-16T01:21:39.089790+0000","last_fullsized":"2024-09-16T01:21:39.089790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.044980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087099+0000","last_change":"2024-09-16T01:21:28.043184+0000","last_active":"2024-09-16T01:21:39.087099+0000","last_peered":"2024-09-16T01:21:39.087099+0000","last_clean":"2024-09-16T01:21:39.087099+0000","last_became_active":"2024-09-16T01:21:28.042787+0000","last_became_peered":"2024-09-16T01:21:28.042787+0000","last_unstale":"2024-09-16T01:21:39.087099+0000","last_undegraded":"2024-09-16T01:21:39.087099+0000","last_fullsized":"2024-09-16T01:21:39.087099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:00.633731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092704+0000","last_change":"2024-09-16T01:21:28.050141+0000","last_active":"2024-09-16T01:21:39.092704+0000","last_peered":"2024-09-16T01:21:39.092704+0000","last_clean":"2024-09-16T01:21:39.092704+0000","last_became_active":"2024-09-16T01:21:28.049843+0000","last_became_peered":"2024-09-16T01:21:28.049843+0000","last_unstale":"2024-09-16T01:21:39.092704+0000","last_undegraded":"2024-09-16T01:21:39.092704+0000","last_fullsized":"2024-09-16T01:21:39.092704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:39.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089783+0000","last_change":"2024-09-16T01:21:28.044260+0000","last_active":"2024-09-16T01:21:39.089783+0000","last_peered":"2024-09-16T01:21:39.089783+0000","last_clean":"2024-09-16T01:21:39.089783+0000","last_became_active":"2024-09-16T01:21:28.043959+0000","last_became_peered":"2024-09-16T01:21:28.043959+0000","last_unstale":"2024-09-16T01:21:39.089783+0000","last_undegraded":"2024-09-16T01:21:39.089783+0000","last_fullsized":"2024-09-16T01:21:39.089783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087679+0000","last_change":"2024-09-16T01:21:28.044143+0000","last_active":"2024-09-16T01:21:39.087679+0000","last_peered":"2024-09-16T01:21:39.087679+0000","last_clean":"2024-09-16T01:21:39.087679+0000","last_became_active":"2024-09-16T01:21:28.043767+0000","last_became_peered":"2024-09-16T01:21:28.043767+0000","last_unstale":"2024-09-16T01:21:39.087679+0000","last_undegraded":"2024-09-16T01:21:39.087679+0000","last_fullsized":"2024-09-16T01:21:39.087679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:25.269737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089450+0000","last_change":"2024-09-16T01:21:28.047663+0000","last_active":"2024-09-16T01:21:39.089450+0000","last_peered":"2024-09-16T01:21:39.089450+0000","last_clean":"2024-09-16T01:21:39.089450+0000","last_became_active":"2024-09-16T01:21:28.047044+0000","last_became_peered":"2024-09-16T01:21:28.047044+0000","last_unstale":"2024-09-16T01:21:39.089450+0000","last_undegraded":"2024-09-16T01:21:39.089450+0000","last_fullsized":"2024-09-16T01:21:39.089450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:44.539096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091431+0000","last_change":"2024-09-16T01:21:28.052740+0000","last_active":"2024-09-16T01:21:39.091431+0000","last_peered":"2024-09-16T01:21:39.091431+0000","last_clean":"2024-09-16T01:21:39.091431+0000","last_became_active":"2024-09-16T01:21:28.052396+0000","last_became_peered":"2024-09-16T01:21:28.052396+0000","last_unstale":"2024-09-16T01:21:39.091431+0000","last_undegraded":"2024-09-16T01:21:39.091431+0000","last_fullsized":"2024-09-16T01:21:39.091431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:49.021594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089633+0000","last_change":"2024-09-16T01:21:28.050867+0000","last_active":"2024-09-16T01:21:39.089633+0000","last_peered":"2024-09-16T01:21:39.089633+0000","last_clean":"2024-09-16T01:21:39.089633+0000","last_became_active":"2024-09-16T01:21:28.050412+0000","last_became_peered":"2024-09-16T01:21:28.050412+0000","last_unstale":"2024-09-16T01:21:39.089633+0000","last_undegraded":"2024-09-16T01:21:39.089633+0000","last_fullsized":"2024-09-16T01:21:39.089633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.286864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087224+0000","last_change":"2024-09-16T01:21:28.037593+0000","last_active":"2024-09-16T01:21:39.087224+0000","last_peered":"2024-09-16T01:21:39.087224+0000","last_clean":"2024-09-16T01:21:39.087224+0000","last_became_active":"2024-09-16T01:21:28.037268+0000","last_became_peered":"2024-09-16T01:21:28.037268+0000","last_unstale":"2024-09-16T01:21:39.087224+0000","last_undegraded":"2024-09-16T01:21:39.087224+0000","last_fullsized":"2024-09-16T01:21:39.087224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:09.625480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093471+0000","last_change":"2024-09-16T01:21:28.044744+0000","last_active":"2024-09-16T01:21:39.093471+0000","last_peered":"2024-09-16T01:21:39.093471+0000","last_clean":"2024-09-16T01:21:39.093471+0000","last_became_active":"2024-09-16T01:21:28.044440+0000","last_became_peered":"2024-09-16T01:21:28.044440+0000","last_unstale":"2024-09-16T01:21:39.093471+0000","last_undegraded":"2024-09-16T01:21:39.093471+0000","last_fullsized":"2024-09-16T01:21:39.093471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:20.404778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090655+0000","last_change":"2024-09-16T01:21:28.044498+0000","last_active":"2024-09-16T01:21:39.090655+0000","last_peered":"2024-09-16T01:21:39.090655+0000","last_clean":"2024-09-16T01:21:39.090655+0000","last_became_active":"2024-09-16T01:21:28.044028+0000","last_became_peered":"2024-09-16T01:21:28.044028+0000","last_unstale":"2024-09-16T01:21:39.090655+0000","last_undegraded":"2024-09-16T01:21:39.090655+0000","last_fullsized":"2024-09-16T01:21:39.090655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:46.134484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090743+0000","last_change":"2024-09-16T01:21:28.047796+0000","last_active":"2024-09-16T01:21:39.090743+0000","last_peered":"2024-09-16T01:21:39.090743+0000","last_clean":"2024-09-16T01:21:39.090743+0000","last_became_active":"2024-09-16T01:21:28.046289+0000","last_became_peered":"2024-09-16T01:21:28.046289+0000","last_unstale":"2024-09-16T01:21:39.090743+0000","last_undegraded":"2024-09-16T01:21:39.090743+0000","last_fullsized":"2024-09-16T01:21:39.090743+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:53.709261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089792+0000","last_change":"2024-09-16T01:21:28.050767+0000","last_active":"2024-09-16T01:21:39.089792+0000","last_peered":"2024-09-16T01:21:39.089792+0000","last_clean":"2024-09-16T01:21:39.089792+0000","last_became_active":"2024-09-16T01:21:28.050430+0000","last_became_peered":"2024-09-16T01:21:28.050430+0000","last_unstale":"2024-09-16T01:21:39.089792+0000","last_undegraded":"2024-09-16T01:21:39.089792+0000","last_fullsized":"2024-09-16T01:21:39.089792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:37.436612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092925+0000","last_change":"2024-09-16T01:21:28.045374+0000","last_active":"2024-09-16T01:21:39.092925+0000","last_peered":"2024-09-16T01:21:39.092925+0000","last_clean":"2024-09-16T01:21:39.092925+0000","last_became_active":"2024-09-16T01:21:28.045072+0000","last_became_peered":"2024-09-16T01:21:28.045072+0000","last_unstale":"2024-09-16T01:21:39.092925+0000","last_undegraded":"2024-09-16T01:21:39.092925+0000","last_fullsized":"2024-09-16T01:21:39.092925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:10.579680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":88,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:22:33.176283+0000","last_change":"2024-09-16T01:21:25.922017+0000","last_active":"2024-09-16T01:22:33.176283+0000","last_peered":"2024-09-16T01:22:33.176283+0000","last_clean":"2024-09-16T01:22:33.176283+0000","last_became_active":"2024-09-16T01:21:25.921580+0000","last_became_peered":"2024-09-16T01:21:25.921580+0000","last_unstale":"2024-09-16T01:22:33.176283+0000","last_undegraded":"2024-09-16T01:22:33.176283+0000","last_fullsized":"2024-09-16T01:22:33.176283+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.745844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094811+0000","last_change":"2024-09-16T01:21:39.094811+0000","last_active":"2024-09-16T01:21:39.094811+0000","last_peered":"2024-09-16T01:21:39.094811+0000","last_clean":"2024-09-16T01:21:39.094811+0000","last_became_active":"2024-09-16T01:21:39.094399+0000","last_became_peered":"2024-09-16T01:21:39.094399+0000","last_unstale":"2024-09-16T01:21:39.094811+0000","last_undegraded":"2024-09-16T01:21:39.094811+0000","last_fullsized":"2024-09-16T01:21:39.094811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:48.363791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.110226+0000","last_change":"2024-09-16T01:21:39.110226+0000","last_active":"2024-09-16T01:21:39.110226+0000","last_peered":"2024-09-16T01:21:39.110226+0000","last_clean":"2024-09-16T01:21:39.110226+0000","last_became_active":"2024-09-16T01:21:39.107676+0000","last_became_peered":"2024-09-16T01:21:39.107676+0000","last_unstale":"2024-09-16T01:21:39.110226+0000","last_undegraded":"2024-09-16T01:21:39.110226+0000","last_fullsized":"2024-09-16T01:21:39.110226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:57:14.854181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086856+0000","last_change":"2024-09-16T01:21:25.924434+0000","last_active":"2024-09-16T01:21:39.086856+0000","last_peered":"2024-09-16T01:21:39.086856+0000","last_clean":"2024-09-16T01:21:39.086856+0000","last_became_active":"2024-09-16T01:21:25.924092+0000","last_became_peered":"2024-09-16T01:21:25.924092+0000","last_unstale":"2024-09-16T01:21:39.086856+0000","last_undegraded":"2024-09-16T01:21:39.086856+0000","last_fullsized":"2024-09-16T01:21:39.086856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:20.956985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089603+0000","last_change":"2024-09-16T01:21:28.037273+0000","last_active":"2024-09-16T01:21:39.089603+0000","last_peered":"2024-09-16T01:21:39.089603+0000","last_clean":"2024-09-16T01:21:39.089603+0000","last_became_active":"2024-09-16T01:21:28.036958+0000","last_became_peered":"2024-09-16T01:21:28.036958+0000","last_unstale":"2024-09-16T01:21:39.089603+0000","last_undegraded":"2024-09-16T01:21:39.089603+0000","last_fullsized":"2024-09-16T01:21:39.089603+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:53.376640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088161+0000","last_change":"2024-09-16T01:21:25.923208+0000","last_active":"2024-09-16T01:21:39.088161+0000","last_peered":"2024-09-16T01:21:39.088161+0000","last_clean":"2024-09-16T01:21:39.088161+0000","last_became_active":"2024-09-16T01:21:25.922882+0000","last_became_peered":"2024-09-16T01:21:25.922882+0000","last_unstale":"2024-09-16T01:21:39.088161+0000","last_undegraded":"2024-09-16T01:21:39.088161+0000","last_fullsized":"2024-09-16T01:21:39.088161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:44.359615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088715+0000","last_change":"2024-09-16T01:21:28.035901+0000","last_active":"2024-09-16T01:21:39.088715+0000","last_peered":"2024-09-16T01:21:39.088715+0000","last_clean":"2024-09-16T01:21:39.088715+0000","last_became_active":"2024-09-16T01:21:28.035568+0000","last_became_peered":"2024-09-16T01:21:28.035568+0000","last_unstale":"2024-09-16T01:21:39.088715+0000","last_undegraded":"2024-09-16T01:21:39.088715+0000","last_fullsized":"2024-09-16T01:21:39.088715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:42.270380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'3","reported_seq":78,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:22:29.170224+0000","last_change":"2024-09-16T01:21:25.923692+0000","last_active":"2024-09-16T01:22:29.170224+0000","last_peered":"2024-09-16T01:22:29.170224+0000","last_clean":"2024-09-16T01:22:29.170224+0000","last_became_active":"2024-09-16T01:21:25.923325+0000","last_became_peered":"2024-09-16T01:21:25.923325+0000","last_unstale":"2024-09-16T01:22:29.170224+0000","last_undegraded":"2024-09-16T01:22:29.170224+0000","last_fullsized":"2024-09-16T01:22:29.170224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:55.075655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093337+0000","last_change":"2024-09-16T01:21:28.054697+0000","last_active":"2024-09-16T01:21:39.093337+0000","last_peered":"2024-09-16T01:21:39.093337+0000","last_clean":"2024-09-16T01:21:39.093337+0000","last_became_active":"2024-09-16T01:21:28.054416+0000","last_became_peered":"2024-09-16T01:21:28.054416+0000","last_unstale":"2024-09-16T01:21:39.093337+0000","last_undegraded":"2024-09-16T01:21:39.093337+0000","last_fullsized":"2024-09-16T01:21:39.093337+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:42.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089652+0000","last_change":"2024-09-16T01:21:25.920939+0000","last_active":"2024-09-16T01:21:39.089652+0000","last_peered":"2024-09-16T01:21:39.089652+0000","last_clean":"2024-09-16T01:21:39.089652+0000","last_became_active":"2024-09-16T01:21:25.920574+0000","last_became_peered":"2024-09-16T01:21:25.920574+0000","last_unstale":"2024-09-16T01:21:39.089652+0000","last_undegraded":"2024-09-16T01:21:39.089652+0000","last_fullsized":"2024-09-16T01:21:39.089652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:15.640800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093972+0000","last_change":"2024-09-16T01:21:28.048981+0000","last_active":"2024-09-16T01:21:39.093972+0000","last_peered":"2024-09-16T01:21:39.093972+0000","last_clean":"2024-09-16T01:21:39.093972+0000","last_became_active":"2024-09-16T01:21:28.048675+0000","last_became_peered":"2024-09-16T01:21:28.048675+0000","last_unstale":"2024-09-16T01:21:39.093972+0000","last_undegraded":"2024-09-16T01:21:39.093972+0000","last_fullsized":"2024-09-16T01:21:39.093972+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:30.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088725+0000","last_change":"2024-09-16T01:21:26.660117+0000","last_active":"2024-09-16T01:21:39.088725+0000","last_peered":"2024-09-16T01:21:39.088725+0000","last_clean":"2024-09-16T01:21:39.088725+0000","last_became_active":"2024-09-16T01:21:26.659743+0000","last_became_peered":"2024-09-16T01:21:26.659743+0000","last_unstale":"2024-09-16T01:21:39.088725+0000","last_undegraded":"2024-09-16T01:21:39.088725+0000","last_fullsized":"2024-09-16T01:21:39.088725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:10.220612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092331+0000","last_change":"2024-09-16T01:21:28.051057+0000","last_active":"2024-09-16T01:21:39.092331+0000","last_peered":"2024-09-16T01:21:39.092331+0000","last_clean":"2024-09-16T01:21:39.092331+0000","last_became_active":"2024-09-16T01:21:28.050756+0000","last_became_peered":"2024-09-16T01:21:28.050756+0000","last_unstale":"2024-09-16T01:21:39.092331+0000","last_undegraded":"2024-09-16T01:21:39.092331+0000","last_fullsized":"2024-09-16T01:21:39.092331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:16.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'28","reported_seq":165,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:22:30.171494+0000","last_change":"2024-09-16T01:21:25.927384+0000","last_active":"2024-09-16T01:22:30.171494+0000","last_peered":"2024-09-16T01:22:30.171494+0000","last_clean":"2024-09-16T01:22:30.171494+0000","last_became_active":"2024-09-16T01:21:25.927017+0000","last_became_peered":"2024-09-16T01:21:25.927017+0000","last_unstale":"2024-09-16T01:22:30.171494+0000","last_undegraded":"2024-09-16T01:22:30.171494+0000","last_fullsized":"2024-09-16T01:22:30.171494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:03.267625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":115,"num_read_kb":115,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093543+0000","last_change":"2024-09-16T01:21:28.049410+0000","last_active":"2024-09-16T01:21:39.093543+0000","last_peered":"2024-09-16T01:21:39.093543+0000","last_clean":"2024-09-16T01:21:39.093543+0000","last_became_active":"2024-09-16T01:21:28.049058+0000","last_became_peered":"2024-09-16T01:21:28.049058+0000","last_unstale":"2024-09-16T01:21:39.093543+0000","last_undegraded":"2024-09-16T01:21:39.093543+0000","last_fullsized":"2024-09-16T01:21:39.093543+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091098+0000","last_change":"2024-09-16T01:21:25.922040+0000","last_active":"2024-09-16T01:21:39.091098+0000","last_peered":"2024-09-16T01:21:39.091098+0000","last_clean":"2024-09-16T01:21:39.091098+0000","last_became_active":"2024-09-16T01:21:25.921487+0000","last_became_peered":"2024-09-16T01:21:25.921487+0000","last_unstale":"2024-09-16T01:21:39.091098+0000","last_undegraded":"2024-09-16T01:21:39.091098+0000","last_fullsized":"2024-09-16T01:21:39.091098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:15.361010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086957+0000","last_change":"2024-09-16T01:21:28.043344+0000","last_active":"2024-09-16T01:21:39.086957+0000","last_peered":"2024-09-16T01:21:39.086957+0000","last_clean":"2024-09-16T01:21:39.086957+0000","last_became_active":"2024-09-16T01:21:28.042495+0000","last_became_peered":"2024-09-16T01:21:28.042495+0000","last_unstale":"2024-09-16T01:21:39.086957+0000","last_undegraded":"2024-09-16T01:21:39.086957+0000","last_fullsized":"2024-09-16T01:21:39.086957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:28.957975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087280+0000","last_change":"2024-09-16T01:21:25.924144+0000","last_active":"2024-09-16T01:21:39.087280+0000","last_peered":"2024-09-16T01:21:39.087280+0000","last_clean":"2024-09-16T01:21:39.087280+0000","last_became_active":"2024-09-16T01:21:25.923761+0000","last_became_peered":"2024-09-16T01:21:25.923761+0000","last_unstale":"2024-09-16T01:21:39.087280+0000","last_undegraded":"2024-09-16T01:21:39.087280+0000","last_fullsized":"2024-09-16T01:21:39.087280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.651575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088985+0000","last_change":"2024-09-16T01:21:28.049329+0000","last_active":"2024-09-16T01:21:39.088985+0000","last_peered":"2024-09-16T01:21:39.088985+0000","last_clean":"2024-09-16T01:21:39.088985+0000","last_became_active":"2024-09-16T01:21:28.048976+0000","last_became_peered":"2024-09-16T01:21:28.048976+0000","last_unstale":"2024-09-16T01:21:39.088985+0000","last_undegraded":"2024-09-16T01:21:39.088985+0000","last_fullsized":"2024-09-16T01:21:39.088985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:11.564388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":82,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:22:29.170724+0000","last_change":"2024-09-16T01:21:25.923608+0000","last_active":"2024-09-16T01:22:29.170724+0000","last_peered":"2024-09-16T01:22:29.170724+0000","last_clean":"2024-09-16T01:22:29.170724+0000","last_became_active":"2024-09-16T01:21:25.923284+0000","last_became_peered":"2024-09-16T01:21:25.923284+0000","last_unstale":"2024-09-16T01:22:29.170724+0000","last_undegraded":"2024-09-16T01:22:29.170724+0000","last_fullsized":"2024-09-16T01:22:29.170724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:41.195014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091872+0000","last_change":"2024-09-16T01:21:39.091872+0000","last_active":"2024-09-16T01:21:39.091872+0000","last_peered":"2024-09-16T01:21:39.091872+0000","last_clean":"2024-09-16T01:21:39.091872+0000","last_became_active":"2024-09-16T01:21:39.091480+0000","last_became_peered":"2024-09-16T01:21:39.091480+0000","last_unstale":"2024-09-16T01:21:39.091872+0000","last_undegraded":"2024-09-16T01:21:39.091872+0000","last_fullsized":"2024-09-16T01:21:39.091872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:23.606447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092805+0000","last_change":"2024-09-16T01:21:26.661446+0000","last_active":"2024-09-16T01:21:39.092805+0000","last_peered":"2024-09-16T01:21:39.092805+0000","last_clean":"2024-09-16T01:21:39.092805+0000","last_became_active":"2024-09-16T01:21:26.661047+0000","last_became_peered":"2024-09-16T01:21:26.661047+0000","last_unstale":"2024-09-16T01:21:39.092805+0000","last_undegraded":"2024-09-16T01:21:39.092805+0000","last_fullsized":"2024-09-16T01:21:39.092805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:22.983581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087298+0000","last_change":"2024-09-16T01:21:28.054663+0000","last_active":"2024-09-16T01:21:39.087298+0000","last_peered":"2024-09-16T01:21:39.087298+0000","last_clean":"2024-09-16T01:21:39.087298+0000","last_became_active":"2024-09-16T01:21:28.054350+0000","last_became_peered":"2024-09-16T01:21:28.054350+0000","last_unstale":"2024-09-16T01:21:39.087298+0000","last_undegraded":"2024-09-16T01:21:39.087298+0000","last_fullsized":"2024-09-16T01:21:39.087298+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:22.963709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094004+0000","last_change":"2024-09-16T01:21:25.921910+0000","last_active":"2024-09-16T01:21:39.094004+0000","last_peered":"2024-09-16T01:21:39.094004+0000","last_clean":"2024-09-16T01:21:39.094004+0000","last_became_active":"2024-09-16T01:21:25.921578+0000","last_became_peered":"2024-09-16T01:21:25.921578+0000","last_unstale":"2024-09-16T01:21:39.094004+0000","last_undegraded":"2024-09-16T01:21:39.094004+0000","last_fullsized":"2024-09-16T01:21:39.094004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:20.210397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089644+0000","last_change":"2024-09-16T01:21:28.049953+0000","last_active":"2024-09-16T01:21:39.089644+0000","last_peered":"2024-09-16T01:21:39.089644+0000","last_clean":"2024-09-16T01:21:39.089644+0000","last_became_active":"2024-09-16T01:21:28.049450+0000","last_became_peered":"2024-09-16T01:21:28.049450+0000","last_unstale":"2024-09-16T01:21:39.089644+0000","last_undegraded":"2024-09-16T01:21:39.089644+0000","last_fullsized":"2024-09-16T01:21:39.089644+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:49.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.098150+0000","last_change":"2024-09-16T01:21:39.098150+0000","last_active":"2024-09-16T01:21:39.098150+0000","last_peered":"2024-09-16T01:21:39.098150+0000","last_clean":"2024-09-16T01:21:39.098150+0000","last_became_active":"2024-09-16T01:21:39.094297+0000","last_became_peered":"2024-09-16T01:21:39.094297+0000","last_unstale":"2024-09-16T01:21:39.098150+0000","last_undegraded":"2024-09-16T01:21:39.098150+0000","last_fullsized":"2024-09-16T01:21:39.098150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:30:25.297230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091018+0000","last_change":"2024-09-16T01:21:28.053920+0000","last_active":"2024-09-16T01:21:39.091018+0000","last_peered":"2024-09-16T01:21:39.091018+0000","last_clean":"2024-09-16T01:21:39.091018+0000","last_became_active":"2024-09-16T01:21:28.053397+0000","last_became_peered":"2024-09-16T01:21:28.053397+0000","last_unstale":"2024-09-16T01:21:39.091018+0000","last_undegraded":"2024-09-16T01:21:39.091018+0000","last_fullsized":"2024-09-16T01:21:39.091018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:27.079374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088854+0000","last_change":"2024-09-16T01:21:25.920527+0000","last_active":"2024-09-16T01:21:39.088854+0000","last_peered":"2024-09-16T01:21:39.088854+0000","last_clean":"2024-09-16T01:21:39.088854+0000","last_became_active":"2024-09-16T01:21:25.920162+0000","last_became_peered":"2024-09-16T01:21:25.920162+0000","last_unstale":"2024-09-16T01:21:39.088854+0000","last_undegraded":"2024-09-16T01:21:39.088854+0000","last_fullsized":"2024-09-16T01:21:39.088854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:31.995141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089348+0000","last_change":"2024-09-16T01:21:28.050068+0000","last_active":"2024-09-16T01:21:39.089348+0000","last_peered":"2024-09-16T01:21:39.089348+0000","last_clean":"2024-09-16T01:21:39.089348+0000","last_became_active":"2024-09-16T01:21:28.049678+0000","last_became_peered":"2024-09-16T01:21:28.049678+0000","last_unstale":"2024-09-16T01:21:39.089348+0000","last_undegraded":"2024-09-16T01:21:39.089348+0000","last_fullsized":"2024-09-16T01:21:39.089348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:57.870550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091065+0000","last_change":"2024-09-16T01:21:26.663670+0000","last_active":"2024-09-16T01:21:39.091065+0000","last_peered":"2024-09-16T01:21:39.091065+0000","last_clean":"2024-09-16T01:21:39.091065+0000","last_became_active":"2024-09-16T01:21:26.663173+0000","last_became_peered":"2024-09-16T01:21:26.663173+0000","last_unstale":"2024-09-16T01:21:39.091065+0000","last_undegraded":"2024-09-16T01:21:39.091065+0000","last_fullsized":"2024-09-16T01:21:39.091065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:01.747039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089528+0000","last_change":"2024-09-16T01:21:28.053354+0000","last_active":"2024-09-16T01:21:39.089528+0000","last_peered":"2024-09-16T01:21:39.089528+0000","last_clean":"2024-09-16T01:21:39.089528+0000","last_became_active":"2024-09-16T01:21:28.052985+0000","last_became_peered":"2024-09-16T01:21:28.052985+0000","last_unstale":"2024-09-16T01:21:39.089528+0000","last_undegraded":"2024-09-16T01:21:39.089528+0000","last_fullsized":"2024-09-16T01:21:39.089528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:09.360220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":337,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:20:14.084036+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:20:14.083552+0000","last_became_peered":"2024-09-16T01:20:14.083552+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_clean_scrub_stamp":"2024-09-16T01:16:51.922126+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:37.598878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106614+0000","last_change":"2024-09-16T01:21:25.923170+0000","last_active":"2024-09-16T01:21:39.106614+0000","last_peered":"2024-09-16T01:21:39.106614+0000","last_clean":"2024-09-16T01:21:39.106614+0000","last_became_active":"2024-09-16T01:21:25.922555+0000","last_became_peered":"2024-09-16T01:21:25.922555+0000","last_unstale":"2024-09-16T01:21:39.106614+0000","last_undegraded":"2024-09-16T01:21:39.106614+0000","last_fullsized":"2024-09-16T01:21:39.106614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:14.948264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094536+0000","last_change":"2024-09-16T01:21:39.093752+0000","last_active":"2024-09-16T01:21:39.094536+0000","last_peered":"2024-09-16T01:21:39.094536+0000","last_clean":"2024-09-16T01:21:39.094536+0000","last_became_active":"2024-09-16T01:21:39.093394+0000","last_became_peered":"2024-09-16T01:21:39.093394+0000","last_unstale":"2024-09-16T01:21:39.094536+0000","last_undegraded":"2024-09-16T01:21:39.094536+0000","last_fullsized":"2024-09-16T01:21:39.094536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:32.703408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:21:25.925009+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:21:25.924661+0000","last_became_peered":"2024-09-16T01:21:25.924661+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.703241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086849+0000","last_change":"2024-09-16T01:21:28.045745+0000","last_active":"2024-09-16T01:21:39.086849+0000","last_peered":"2024-09-16T01:21:39.086849+0000","last_clean":"2024-09-16T01:21:39.086849+0000","last_became_active":"2024-09-16T01:21:28.045398+0000","last_became_peered":"2024-09-16T01:21:28.045398+0000","last_unstale":"2024-09-16T01:21:39.086849+0000","last_undegraded":"2024-09-16T01:21:39.086849+0000","last_fullsized":"2024-09-16T01:21:39.086849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:17.422858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":79,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:22:29.170150+0000","last_change":"2024-09-16T01:21:26.660859+0000","last_active":"2024-09-16T01:22:29.170150+0000","last_peered":"2024-09-16T01:22:29.170150+0000","last_clean":"2024-09-16T01:22:29.170150+0000","last_became_active":"2024-09-16T01:21:26.660515+0000","last_became_peered":"2024-09-16T01:21:26.660515+0000","last_unstale":"2024-09-16T01:22:29.170150+0000","last_undegraded":"2024-09-16T01:22:29.170150+0000","last_fullsized":"2024-09-16T01:22:29.170150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:57.301546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092617+0000","last_change":"2024-09-16T01:21:39.092617+0000","last_active":"2024-09-16T01:21:39.092617+0000","last_peered":"2024-09-16T01:21:39.092617+0000","last_clean":"2024-09-16T01:21:39.092617+0000","last_became_active":"2024-09-16T01:21:39.092212+0000","last_became_peered":"2024-09-16T01:21:39.092212+0000","last_unstale":"2024-09-16T01:21:39.092617+0000","last_undegraded":"2024-09-16T01:21:39.092617+0000","last_fullsized":"2024-09-16T01:21:39.092617+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.894975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089151+0000","last_change":"2024-09-16T01:21:25.924485+0000","last_active":"2024-09-16T01:21:39.089151+0000","last_peered":"2024-09-16T01:21:39.089151+0000","last_clean":"2024-09-16T01:21:39.089151+0000","last_became_active":"2024-09-16T01:21:25.924075+0000","last_became_peered":"2024-09-16T01:21:25.924075+0000","last_unstale":"2024-09-16T01:21:39.089151+0000","last_undegraded":"2024-09-16T01:21:39.089151+0000","last_fullsized":"2024-09-16T01:21:39.089151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:13.034668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090273+0000","last_change":"2024-09-16T01:21:28.048152+0000","last_active":"2024-09-16T01:21:39.090273+0000","last_peered":"2024-09-16T01:21:39.090273+0000","last_clean":"2024-09-16T01:21:39.090273+0000","last_became_active":"2024-09-16T01:21:28.047818+0000","last_became_peered":"2024-09-16T01:21:28.047818+0000","last_unstale":"2024-09-16T01:21:39.090273+0000","last_undegraded":"2024-09-16T01:21:39.090273+0000","last_fullsized":"2024-09-16T01:21:39.090273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:19.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089286+0000","last_change":"2024-09-16T01:21:26.660336+0000","last_active":"2024-09-16T01:21:39.089286+0000","last_peered":"2024-09-16T01:21:39.089286+0000","last_clean":"2024-09-16T01:21:39.089286+0000","last_became_active":"2024-09-16T01:21:26.660005+0000","last_became_peered":"2024-09-16T01:21:26.660005+0000","last_unstale":"2024-09-16T01:21:39.089286+0000","last_undegraded":"2024-09-16T01:21:39.089286+0000","last_fullsized":"2024-09-16T01:21:39.089286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:37.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090412+0000","last_change":"2024-09-16T01:21:28.043112+0000","last_active":"2024-09-16T01:21:39.090412+0000","last_peered":"2024-09-16T01:21:39.090412+0000","last_clean":"2024-09-16T01:21:39.090412+0000","last_became_active":"2024-09-16T01:21:28.042752+0000","last_became_peered":"2024-09-16T01:21:28.042752+0000","last_unstale":"2024-09-16T01:21:39.090412+0000","last_undegraded":"2024-09-16T01:21:39.090412+0000","last_fullsized":"2024-09-16T01:21:39.090412+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:57.379826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093748+0000","last_change":"2024-09-16T01:21:26.661003+0000","last_active":"2024-09-16T01:21:39.093748+0000","last_peered":"2024-09-16T01:21:39.093748+0000","last_clean":"2024-09-16T01:21:39.093748+0000","last_became_active":"2024-09-16T01:21:26.660407+0000","last_became_peered":"2024-09-16T01:21:26.660407+0000","last_unstale":"2024-09-16T01:21:39.093748+0000","last_undegraded":"2024-09-16T01:21:39.093748+0000","last_fullsized":"2024-09-16T01:21:39.093748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:52.229473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087273+0000","last_change":"2024-09-16T01:21:28.046938+0000","last_active":"2024-09-16T01:21:39.087273+0000","last_peered":"2024-09-16T01:21:39.087273+0000","last_clean":"2024-09-16T01:21:39.087273+0000","last_became_active":"2024-09-16T01:21:28.046620+0000","last_became_peered":"2024-09-16T01:21:28.046620+0000","last_unstale":"2024-09-16T01:21:39.087273+0000","last_undegraded":"2024-09-16T01:21:39.087273+0000","last_fullsized":"2024-09-16T01:21:39.087273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:04.845341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'10","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:52.037484+0000","last_change":"2024-09-16T01:21:25.915315+0000","last_active":"2024-09-16T01:21:52.037484+0000","last_peered":"2024-09-16T01:21:52.037484+0000","last_clean":"2024-09-16T01:21:52.037484+0000","last_became_active":"2024-09-16T01:21:25.915001+0000","last_became_peered":"2024-09-16T01:21:25.915001+0000","last_unstale":"2024-09-16T01:21:52.037484+0000","last_undegraded":"2024-09-16T01:21:52.037484+0000","last_fullsized":"2024-09-16T01:21:52.037484+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:30.163050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089535+0000","last_change":"2024-09-16T01:21:28.047157+0000","last_active":"2024-09-16T01:21:39.089535+0000","last_peered":"2024-09-16T01:21:39.089535+0000","last_clean":"2024-09-16T01:21:39.089535+0000","last_became_active":"2024-09-16T01:21:28.046583+0000","last_became_peered":"2024-09-16T01:21:28.046583+0000","last_unstale":"2024-09-16T01:21:39.089535+0000","last_undegraded":"2024-09-16T01:21:39.089535+0000","last_fullsized":"2024-09-16T01:21:39.089535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:47.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106885+0000","last_change":"2024-09-16T01:21:26.663047+0000","last_active":"2024-09-16T01:21:39.106885+0000","last_peered":"2024-09-16T01:21:39.106885+0000","last_clean":"2024-09-16T01:21:39.106885+0000","last_became_active":"2024-09-16T01:21:26.662627+0000","last_became_peered":"2024-09-16T01:21:26.662627+0000","last_unstale":"2024-09-16T01:21:39.106885+0000","last_undegraded":"2024-09-16T01:21:39.106885+0000","last_fullsized":"2024-09-16T01:21:39.106885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:59.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093738+0000","last_change":"2024-09-16T01:21:28.046954+0000","last_active":"2024-09-16T01:21:39.093738+0000","last_peered":"2024-09-16T01:21:39.093738+0000","last_clean":"2024-09-16T01:21:39.093738+0000","last_became_active":"2024-09-16T01:21:28.046550+0000","last_became_peered":"2024-09-16T01:21:28.046550+0000","last_unstale":"2024-09-16T01:21:39.093738+0000","last_undegraded":"2024-09-16T01:21:39.093738+0000","last_fullsized":"2024-09-16T01:21:39.093738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:30.880672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.100910+0000","last_change":"2024-09-16T01:21:39.100910+0000","last_active":"2024-09-16T01:21:39.100910+0000","last_peered":"2024-09-16T01:21:39.100910+0000","last_clean":"2024-09-16T01:21:39.100910+0000","last_became_active":"2024-09-16T01:21:39.095257+0000","last_became_peered":"2024-09-16T01:21:39.095257+0000","last_unstale":"2024-09-16T01:21:39.100910+0000","last_undegraded":"2024-09-16T01:21:39.100910+0000","last_fullsized":"2024-09-16T01:21:39.100910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:17.957295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092774+0000","last_change":"2024-09-16T01:21:28.052061+0000","last_active":"2024-09-16T01:21:39.092774+0000","last_peered":"2024-09-16T01:21:39.092774+0000","last_clean":"2024-09-16T01:21:39.092774+0000","last_became_active":"2024-09-16T01:21:28.051705+0000","last_became_peered":"2024-09-16T01:21:28.051705+0000","last_unstale":"2024-09-16T01:21:39.092774+0000","last_undegraded":"2024-09-16T01:21:39.092774+0000","last_fullsized":"2024-09-16T01:21:39.092774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:05.546846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090258+0000","last_change":"2024-09-16T01:21:25.921635+0000","last_active":"2024-09-16T01:21:39.090258+0000","last_peered":"2024-09-16T01:21:39.090258+0000","last_clean":"2024-09-16T01:21:39.090258+0000","last_became_active":"2024-09-16T01:21:25.921281+0000","last_became_peered":"2024-09-16T01:21:25.921281+0000","last_unstale":"2024-09-16T01:21:39.090258+0000","last_undegraded":"2024-09-16T01:21:39.090258+0000","last_fullsized":"2024-09-16T01:21:39.090258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:02.933803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089886+0000","last_change":"2024-09-16T01:21:28.043636+0000","last_active":"2024-09-16T01:21:39.089886+0000","last_peered":"2024-09-16T01:21:39.089886+0000","last_clean":"2024-09-16T01:21:39.089886+0000","last_became_active":"2024-09-16T01:21:28.043273+0000","last_became_peered":"2024-09-16T01:21:28.043273+0000","last_unstale":"2024-09-16T01:21:39.089886+0000","last_undegraded":"2024-09-16T01:21:39.089886+0000","last_fullsized":"2024-09-16T01:21:39.089886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:05.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090771+0000","last_change":"2024-09-16T01:21:25.917934+0000","last_active":"2024-09-16T01:21:39.090771+0000","last_peered":"2024-09-16T01:21:39.090771+0000","last_clean":"2024-09-16T01:21:39.090771+0000","last_became_active":"2024-09-16T01:21:25.917545+0000","last_became_peered":"2024-09-16T01:21:25.917545+0000","last_unstale":"2024-09-16T01:21:39.090771+0000","last_undegraded":"2024-09-16T01:21:39.090771+0000","last_fullsized":"2024-09-16T01:21:39.090771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:07.119546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089851+0000","last_change":"2024-09-16T01:21:28.043270+0000","last_active":"2024-09-16T01:21:39.089851+0000","last_peered":"2024-09-16T01:21:39.089851+0000","last_clean":"2024-09-16T01:21:39.089851+0000","last_became_active":"2024-09-16T01:21:28.042957+0000","last_became_peered":"2024-09-16T01:21:28.042957+0000","last_unstale":"2024-09-16T01:21:39.089851+0000","last_undegraded":"2024-09-16T01:21:39.089851+0000","last_fullsized":"2024-09-16T01:21:39.089851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:11.052387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093263+0000","last_change":"2024-09-16T01:21:25.923224+0000","last_active":"2024-09-16T01:21:39.093263+0000","last_peered":"2024-09-16T01:21:39.093263+0000","last_clean":"2024-09-16T01:21:39.093263+0000","last_became_active":"2024-09-16T01:21:25.922873+0000","last_became_peered":"2024-09-16T01:21:25.922873+0000","last_unstale":"2024-09-16T01:21:39.093263+0000","last_undegraded":"2024-09-16T01:21:39.093263+0000","last_fullsized":"2024-09-16T01:21:39.093263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:14.747752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088910+0000","last_change":"2024-09-16T01:21:28.054706+0000","last_active":"2024-09-16T01:21:39.088910+0000","last_peered":"2024-09-16T01:21:39.088910+0000","last_clean":"2024-09-16T01:21:39.088910+0000","last_became_active":"2024-09-16T01:21:28.054382+0000","last_became_peered":"2024-09-16T01:21:28.054382+0000","last_unstale":"2024-09-16T01:21:39.088910+0000","last_undegraded":"2024-09-16T01:21:39.088910+0000","last_fullsized":"2024-09-16T01:21:39.088910+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.908252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088713+0000","last_change":"2024-09-16T01:21:28.051807+0000","last_active":"2024-09-16T01:21:39.088713+0000","last_peered":"2024-09-16T01:21:39.088713+0000","last_clean":"2024-09-16T01:21:39.088713+0000","last_became_active":"2024-09-16T01:21:28.051474+0000","last_became_peered":"2024-09-16T01:21:28.051474+0000","last_unstale":"2024-09-16T01:21:39.088713+0000","last_undegraded":"2024-09-16T01:21:39.088713+0000","last_fullsized":"2024-09-16T01:21:39.088713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:48.006691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.101161+0000","last_change":"2024-09-16T01:21:39.100723+0000","last_active":"2024-09-16T01:21:39.101161+0000","last_peered":"2024-09-16T01:21:39.101161+0000","last_clean":"2024-09-16T01:21:39.101161+0000","last_became_active":"2024-09-16T01:21:39.094895+0000","last_became_peered":"2024-09-16T01:21:39.094895+0000","last_unstale":"2024-09-16T01:21:39.101161+0000","last_undegraded":"2024-09-16T01:21:39.101161+0000","last_fullsized":"2024-09-16T01:21:39.101161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.663815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092318+0000","last_change":"2024-09-16T01:21:28.055506+0000","last_active":"2024-09-16T01:21:39.092318+0000","last_peered":"2024-09-16T01:21:39.092318+0000","last_clean":"2024-09-16T01:21:39.092318+0000","last_became_active":"2024-09-16T01:21:28.055167+0000","last_became_peered":"2024-09-16T01:21:28.055167+0000","last_unstale":"2024-09-16T01:21:39.092318+0000","last_undegraded":"2024-09-16T01:21:39.092318+0000","last_fullsized":"2024-09-16T01:21:39.092318+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:38.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093642+0000","last_change":"2024-09-16T01:21:25.920611+0000","last_active":"2024-09-16T01:21:39.093642+0000","last_peered":"2024-09-16T01:21:39.093642+0000","last_clean":"2024-09-16T01:21:39.093642+0000","last_became_active":"2024-09-16T01:21:25.920255+0000","last_became_peered":"2024-09-16T01:21:25.920255+0000","last_unstale":"2024-09-16T01:21:39.093642+0000","last_undegraded":"2024-09-16T01:21:39.093642+0000","last_fullsized":"2024-09-16T01:21:39.093642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:17.268621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093932+0000","last_change":"2024-09-16T01:21:28.054009+0000","last_active":"2024-09-16T01:21:39.093932+0000","last_peered":"2024-09-16T01:21:39.093932+0000","last_clean":"2024-09-16T01:21:39.093932+0000","last_became_active":"2024-09-16T01:21:28.053631+0000","last_became_peered":"2024-09-16T01:21:28.053631+0000","last_unstale":"2024-09-16T01:21:39.093932+0000","last_undegraded":"2024-09-16T01:21:39.093932+0000","last_fullsized":"2024-09-16T01:21:39.093932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:28.298398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090095+0000","last_change":"2024-09-16T01:21:26.659753+0000","last_active":"2024-09-16T01:21:39.090095+0000","last_peered":"2024-09-16T01:21:39.090095+0000","last_clean":"2024-09-16T01:21:39.090095+0000","last_became_active":"2024-09-16T01:21:26.659343+0000","last_became_peered":"2024-09-16T01:21:26.659343+0000","last_unstale":"2024-09-16T01:21:39.090095+0000","last_undegraded":"2024-09-16T01:21:39.090095+0000","last_fullsized":"2024-09-16T01:21:39.090095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:47.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089898+0000","last_change":"2024-09-16T01:21:28.050748+0000","last_active":"2024-09-16T01:21:39.089898+0000","last_peered":"2024-09-16T01:21:39.089898+0000","last_clean":"2024-09-16T01:21:39.089898+0000","last_became_active":"2024-09-16T01:21:28.050457+0000","last_became_peered":"2024-09-16T01:21:28.050457+0000","last_unstale":"2024-09-16T01:21:39.089898+0000","last_undegraded":"2024-09-16T01:21:39.089898+0000","last_fullsized":"2024-09-16T01:21:39.089898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:21.552080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089346+0000","last_change":"2024-09-16T01:21:25.924505+0000","last_active":"2024-09-16T01:21:39.089346+0000","last_peered":"2024-09-16T01:21:39.089346+0000","last_clean":"2024-09-16T01:21:39.089346+0000","last_became_active":"2024-09-16T01:21:25.924076+0000","last_became_peered":"2024-09-16T01:21:25.924076+0000","last_unstale":"2024-09-16T01:21:39.089346+0000","last_undegraded":"2024-09-16T01:21:39.089346+0000","last_fullsized":"2024-09-16T01:21:39.089346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:00.630772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64160,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":351,"num_read_kb":241,"num_write":162,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282677,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514523,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":441274,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1092912,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906981,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441510,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135914,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441430,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364846,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1033755,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528372,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":440899,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757304,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1033046,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920830,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":441729,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":441210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":502199,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":500456,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":929792,"data_stored":442170,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:22:36.649 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T01:22:36.649 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T01:22:36.649 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-16T01:22:36.649 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-16T01:22:36.908 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:37.294 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:37 smithi063 ceph-mon[31070]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:37.295 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:37 smithi063 ceph-mon[31070]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:22:37.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.372+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/243209775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ec100500 msgr2=0x7fd7ec1008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.372+0000 7fd7f3bbe640 1 --2- 172.21.15.63:0/243209775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ec100500 0x7fd7ec1008e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009900 tx=0x7fd7e802a410 comp rx=0 tx=0).stop 2024-09-16T01:22:37.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.372+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/243209775 shutdown_connections 2024-09-16T01:22:37.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.372+0000 7fd7f3bbe640 1 --2- 172.21.15.63:0/243209775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec106f70 0x7fd7ec10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.372+0000 7fd7f3bbe640 1 --2- 172.21.15.63:0/243209775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7ec100eb0 0x7fd7ec106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.372+0000 7fd7f3bbe640 1 --2- 172.21.15.63:0/243209775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ec100500 0x7fd7ec1008e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.372+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/243209775 >> 172.21.15.63:0/243209775 conn(0x7fd7ec0fc5c0 msgr2=0x7fd7ec0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:37.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.372+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/243209775 shutdown_connections 2024-09-16T01:22:37.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.372+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/243209775 wait complete. 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.373+0000 7fd7f3bbe640 1 Processor -- start 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.373+0000 7fd7f3bbe640 1 -- start start 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f3bbe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ec100500 0x7fd7ec1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f3bbe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec100eb0 0x7fd7ec198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f3bbe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7ec106f70 0x7fd7ec19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f3bbe640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec111e40 con 0x7fd7ec100500 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f3bbe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec111cc0 con 0x7fd7ec100eb0 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f3bbe640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec111fc0 con 0x7fd7ec106f70 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f195a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ec100500 0x7fd7ec1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f195a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ec100500 0x7fd7ec1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60170/0 (socket says 172.21.15.63:60170) 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f195a640 1 -- 172.21.15.63:0/1592964372 learned_addr learned my addr 172.21.15.63:0/1592964372 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:37.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f1159640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec100eb0 0x7fd7ec198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f195a640 1 -- 172.21.15.63:0/1592964372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7ec106f70 msgr2=0x7fd7ec19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f195a640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7ec106f70 0x7fd7ec19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f195a640 1 -- 172.21.15.63:0/1592964372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec100eb0 msgr2=0x7fd7ec198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f195a640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec100eb0 0x7fd7ec198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f195a640 1 -- 172.21.15.63:0/1592964372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ec19d390 con 0x7fd7ec100500 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f195a640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ec100500 0x7fd7ec1983e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8004270 tx=0x7fd7e80042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7e2ffd640 1 -- 172.21.15.63:0/1592964372 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e803f030 con 0x7fd7ec100500 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7e2ffd640 1 -- 172.21.15.63:0/1592964372 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7e80044c0 con 0x7fd7ec100500 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/1592964372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ec19d620 con 0x7fd7ec100500 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.374+0000 7fd7e2ffd640 1 -- 172.21.15.63:0/1592964372 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8035070 con 0x7fd7ec100500 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.375+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/1592964372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ec1a4f60 con 0x7fd7ec100500 2024-09-16T01:22:37.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.376+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/1592964372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ec06a4a0 con 0x7fd7ec100500 2024-09-16T01:22:37.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.377+0000 7fd7e2ffd640 1 -- 172.21.15.63:0/1592964372 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd7e8042030 con 0x7fd7ec100500 2024-09-16T01:22:37.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.377+0000 7fd7e2ffd640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd7d80a32d0 0x7fd7d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:37.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.377+0000 7fd7f1159640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd7d80a32d0 0x7fd7d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:37.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.377+0000 7fd7e2ffd640 1 -- 172.21.15.63:0/1592964372 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd7e80efce0 con 0x7fd7ec100500 2024-09-16T01:22:37.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.378+0000 7fd7f1159640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd7d80a32d0 0x7fd7d80a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc005fd0 tx=0x7fd7dc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:37.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.382+0000 7fd7e2ffd640 1 -- 172.21.15.63:0/1592964372 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7e80bc8a0 con 0x7fd7ec100500 2024-09-16T01:22:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:37 smithi192 ceph-mon[34775]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:37 smithi192 ceph-mon[34775]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:22:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:37 smithi162 ceph-mon[34539]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:37 smithi162 ceph-mon[34539]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:22:37.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.596+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/1592964372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd7ec10a0e0 con 0x7fd7ec100500 2024-09-16T01:22:37.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.596+0000 7fd7e2ffd640 1 -- 172.21.15.63:0/1592964372 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd7e80bc1a0 con 0x7fd7ec100500 2024-09-16T01:22:37.599 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:37.599 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T01:22:37.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/1592964372 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd7d80a32d0 msgr2=0x7fd7d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd7d80a32d0 0x7fd7d80a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc005fd0 tx=0x7fd7dc005850 comp rx=0 tx=0).stop 2024-09-16T01:22:37.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/1592964372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ec100500 msgr2=0x7fd7ec1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ec100500 0x7fd7ec1983e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8004270 tx=0x7fd7e80042a0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/1592964372 shutdown_connections 2024-09-16T01:22:37.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd7d80a32d0 0x7fd7d80a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7ec106f70 0x7fd7ec19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7ec100eb0 0x7fd7ec198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 --2- 172.21.15.63:0/1592964372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7ec100500 0x7fd7ec1983e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/1592964372 >> 172.21.15.63:0/1592964372 conn(0x7fd7ec0fc5c0 msgr2=0x7fd7ec105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:37.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/1592964372 shutdown_connections 2024-09-16T01:22:37.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:37.600+0000 7fd7f3bbe640 1 -- 172.21.15.63:0/1592964372 wait complete. 2024-09-16T01:22:38.291 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:38 smithi063 ceph-mon[31070]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:38.291 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:38 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1592964372' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T01:22:38.320 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-16T01:22:38.321 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:22:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:38 smithi192 ceph-mon[34775]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:38 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1592964372' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T01:22:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:38 smithi162 ceph-mon[34539]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:38 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1592964372' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T01:22:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:39.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.091+0000 7f6e55228640 1 -- 172.21.15.63:0/2987067026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e50106f30 msgr2=0x7f6e5010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.091+0000 7f6e55228640 1 --2- 172.21.15.63:0/2987067026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e50106f30 0x7f6e5010eab0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009900 tx=0x7f6e4802a410 comp rx=0 tx=0).stop 2024-09-16T01:22:39.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.091+0000 7f6e55228640 1 -- 172.21.15.63:0/2987067026 shutdown_connections 2024-09-16T01:22:39.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.091+0000 7f6e55228640 1 --2- 172.21.15.63:0/2987067026 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e50106f30 0x7f6e5010eab0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.091+0000 7f6e55228640 1 --2- 172.21.15.63:0/2987067026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e50100cc0 0x7f6e50106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.091+0000 7f6e55228640 1 --2- 172.21.15.63:0/2987067026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e50100310 0x7f6e501006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.091+0000 7f6e55228640 1 -- 172.21.15.63:0/2987067026 >> 172.21.15.63:0/2987067026 conn(0x7f6e50077210 msgr2=0x7f6e500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.091+0000 7f6e55228640 1 -- 172.21.15.63:0/2987067026 shutdown_connections 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.091+0000 7f6e55228640 1 -- 172.21.15.63:0/2987067026 wait complete. 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.092+0000 7f6e55228640 1 Processor -- start 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.092+0000 7f6e55228640 1 -- start start 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e55228640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e50100310 0x7f6e50198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e55228640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e50100cc0 0x7f6e50198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e55228640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e50106f30 0x7f6e5019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e55228640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6e50111e40 con 0x7f6e50106f30 2024-09-16T01:22:39.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e55228640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6e50111cc0 con 0x7f6e50100cc0 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e55228640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6e50111fc0 con 0x7f6e50100310 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e50106f30 0x7f6e5019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e50106f30 0x7f6e5019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57438/0 (socket says 172.21.15.63:57438) 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4f59e640 1 -- 172.21.15.63:0/2287623635 learned_addr learned my addr 172.21.15.63:0/2287623635 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4ed9d640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e50100310 0x7f6e50198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4e59c640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e50100cc0 0x7f6e50198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4f59e640 1 -- 172.21.15.63:0/2287623635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e50100310 msgr2=0x7f6e50198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4f59e640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e50100310 0x7f6e50198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4f59e640 1 -- 172.21.15.63:0/2287623635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e50100cc0 msgr2=0x7f6e50198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4f59e640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e50100cc0 0x7f6e50198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4f59e640 1 -- 172.21.15.63:0/2287623635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5019d2d0 con 0x7f6e50106f30 2024-09-16T01:22:39.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4e59c640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e50100cc0 0x7f6e50198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4ed9d640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e50100310 0x7f6e50198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e4f59e640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e50106f30 0x7f6e5019cbf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009230 tx=0x7f6e48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e47fff640 1 -- 172.21.15.63:0/2287623635 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4803f030 con 0x7f6e50106f30 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e55228640 1 -- 172.21.15.63:0/2287623635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5019d560 con 0x7f6e50106f30 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e47fff640 1 -- 172.21.15.63:0/2287623635 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e48003aa0 con 0x7f6e50106f30 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e47fff640 1 -- 172.21.15.63:0/2287623635 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e48035070 con 0x7f6e50106f30 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.093+0000 7f6e55228640 1 -- 172.21.15.63:0/2287623635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e501a4ea0 con 0x7f6e50106f30 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.094+0000 7f6e55228640 1 -- 172.21.15.63:0/2287623635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e501033d0 con 0x7f6e50106f30 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.096+0000 7f6e47fff640 1 -- 172.21.15.63:0/2287623635 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6e48042030 con 0x7f6e50106f30 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.097+0000 7f6e47fff640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6e3c0a32d0 0x7f6e3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.097+0000 7f6e4ed9d640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6e3c0a32d0 0x7f6e3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.097+0000 7f6e47fff640 1 -- 172.21.15.63:0/2287623635 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6e480f06d0 con 0x7f6e50106f30 2024-09-16T01:22:39.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.097+0000 7f6e4ed9d640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6e3c0a32d0 0x7f6e3c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6e40005fd0 tx=0x7f6e40009970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:39.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.099+0000 7f6e47fff640 1 -- 172.21.15.63:0/2287623635 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e480bd290 con 0x7f6e50106f30 2024-09-16T01:22:39.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.312+0000 7f6e55228640 1 -- 172.21.15.63:0/2287623635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e5010a170 con 0x7f6e50106f30 2024-09-16T01:22:39.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.313+0000 7f6e47fff640 1 -- 172.21.15.63:0/2287623635 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11909 (secure 0 0 0) 0x7f6e480bcb90 con 0x7f6e50106f30 2024-09-16T01:22:39.316 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:39.316 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":24,"btime":"2024-09-16T01:21:40:093564+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:21:39.762667+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24445,24460,24467]},"id":1}]} 2024-09-16T01:22:39.316 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 24 2024-09-16T01:22:39.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 -- 172.21.15.63:0/2287623635 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6e3c0a32d0 msgr2=0x7f6e3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6e3c0a32d0 0x7f6e3c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6e40005fd0 tx=0x7f6e40009970 comp rx=0 tx=0).stop 2024-09-16T01:22:39.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 -- 172.21.15.63:0/2287623635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e50106f30 msgr2=0x7f6e5019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e50106f30 0x7f6e5019cbf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e48009230 tx=0x7f6e48004270 comp rx=0 tx=0).stop 2024-09-16T01:22:39.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 -- 172.21.15.63:0/2287623635 shutdown_connections 2024-09-16T01:22:39.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6e3c0a32d0 0x7f6e3c0a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6e50106f30 0x7f6e5019cbf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e50100cc0 0x7f6e50198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 --2- 172.21.15.63:0/2287623635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e50100310 0x7f6e50198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 -- 172.21.15.63:0/2287623635 >> 172.21.15.63:0/2287623635 conn(0x7f6e50077210 msgr2=0x7f6e501057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:39.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 -- 172.21.15.63:0/2287623635 shutdown_connections 2024-09-16T01:22:39.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:39.316+0000 7f6e55228640 1 -- 172.21.15.63:0/2287623635 wait complete. 2024-09-16T01:22:40.052 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:22:40.314 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:40.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:40 smithi063 ceph-mon[31070]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:40.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:40 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2287623635' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:22:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:40 smithi192 ceph-mon[34775]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:40 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2287623635' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:22:40.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:40 smithi162 ceph-mon[34539]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:40.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:40 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2287623635' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:22:40.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.781+0000 7f182ea17640 1 -- 172.21.15.63:0/2942778463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1828102ef0 msgr2=0x7f182810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.781+0000 7f182ea17640 1 --2- 172.21.15.63:0/2942778463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1828102ef0 0x7f182810da40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1820009ca0 tx=0x7f182002a950 comp rx=0 tx=0).stop 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.781+0000 7f182ea17640 1 -- 172.21.15.63:0/2942778463 shutdown_connections 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.781+0000 7f182ea17640 1 --2- 172.21.15.63:0/2942778463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1828102ef0 0x7f182810da40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.781+0000 7f182ea17640 1 --2- 172.21.15.63:0/2942778463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1828102570 0x7f18281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.781+0000 7f182ea17640 1 --2- 172.21.15.63:0/2942778463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1828100e20 0x7f1828101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.781+0000 7f182ea17640 1 -- 172.21.15.63:0/2942778463 >> 172.21.15.63:0/2942778463 conn(0x7f18280fc7d0 msgr2=0x7f18280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.781+0000 7f182ea17640 1 -- 172.21.15.63:0/2942778463 shutdown_connections 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.781+0000 7f182ea17640 1 -- 172.21.15.63:0/2942778463 wait complete. 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.781+0000 7f182ea17640 1 Processor -- start 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182ea17640 1 -- start start 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182ea17640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1828100e20 0x7f1828198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182ea17640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1828102570 0x7f1828198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182ea17640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1828102ef0 0x7f182819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182ea17640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1828110e50 con 0x7f1828102ef0 2024-09-16T01:22:40.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182ea17640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1828110cd0 con 0x7f1828102570 2024-09-16T01:22:40.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182ea17640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1828110fd0 con 0x7f1828100e20 2024-09-16T01:22:40.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182cfb4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1828102ef0 0x7f182819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182cfb4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1828102ef0 0x7f182819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57452/0 (socket says 172.21.15.63:57452) 2024-09-16T01:22:40.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182cfb4640 1 -- 172.21.15.63:0/750845831 learned_addr learned my addr 172.21.15.63:0/750845831 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:40.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f1827fff640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1828100e20 0x7f1828198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f18277fe640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1828102570 0x7f1828198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182cfb4640 1 -- 172.21.15.63:0/750845831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1828100e20 msgr2=0x7f1828198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182cfb4640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1828100e20 0x7f1828198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182cfb4640 1 -- 172.21.15.63:0/750845831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1828102570 msgr2=0x7f1828198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182cfb4640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1828102570 0x7f1828198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f182cfb4640 1 -- 172.21.15.63:0/750845831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182819d3b0 con 0x7f1828102ef0 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.782+0000 7f1827fff640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1828100e20 0x7f1828198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.783+0000 7f182cfb4640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1828102ef0 0x7f182819ccd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1820006010 tx=0x7f182002f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.783+0000 7f18257fa640 1 -- 172.21.15.63:0/750845831 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820034040 con 0x7f1828102ef0 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.783+0000 7f182ea17640 1 -- 172.21.15.63:0/750845831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182819d640 con 0x7f1828102ef0 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.783+0000 7f18257fa640 1 -- 172.21.15.63:0/750845831 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1820003e00 con 0x7f1828102ef0 2024-09-16T01:22:40.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.783+0000 7f18257fa640 1 -- 172.21.15.63:0/750845831 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820045480 con 0x7f1828102ef0 2024-09-16T01:22:40.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.783+0000 7f182ea17640 1 -- 172.21.15.63:0/750845831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18281a4f80 con 0x7f1828102ef0 2024-09-16T01:22:40.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.784+0000 7f182ea17640 1 -- 172.21.15.63:0/750845831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18281021b0 con 0x7f1828102ef0 2024-09-16T01:22:40.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.785+0000 7f18257fa640 1 -- 172.21.15.63:0/750845831 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1820037020 con 0x7f1828102ef0 2024-09-16T01:22:40.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.786+0000 7f18257fa640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f18100a32d0 0x7f18100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.786+0000 7f1827fff640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f18100a32d0 0x7f18100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.786+0000 7f18257fa640 1 -- 172.21.15.63:0/750845831 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f18200f0b20 con 0x7f1828102ef0 2024-09-16T01:22:40.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.786+0000 7f1827fff640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f18100a32d0 0x7f18100a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1818009930 tx=0x7f1818008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:40.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:40.790+0000 7f18257fa640 1 -- 172.21.15.63:0/750845831 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18200bd7f0 con 0x7f1828102ef0 2024-09-16T01:22:41.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.001+0000 7f182ea17640 1 -- 172.21.15.63:0/750845831 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f182810a0a0 con 0x7f1828102ef0 2024-09-16T01:22:41.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.002+0000 7f18257fa640 1 -- 172.21.15.63:0/750845831 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11909 (secure 0 0 0) 0x7f18200bd0f0 con 0x7f1828102ef0 2024-09-16T01:22:41.004 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:41.005 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":24,"btime":"2024-09-16T01:21:40:093564+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:21:39.762667+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24445,24460,24467]},"id":1}]} 2024-09-16T01:22:41.005 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 24 2024-09-16T01:22:41.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.004+0000 7f182ea17640 1 -- 172.21.15.63:0/750845831 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f18100a32d0 msgr2=0x7f18100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.004+0000 7f182ea17640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f18100a32d0 0x7f18100a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1818009930 tx=0x7f1818008040 comp rx=0 tx=0).stop 2024-09-16T01:22:41.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.004+0000 7f182ea17640 1 -- 172.21.15.63:0/750845831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1828102ef0 msgr2=0x7f182819ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.004+0000 7f182ea17640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1828102ef0 0x7f182819ccd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1820006010 tx=0x7f182002f710 comp rx=0 tx=0).stop 2024-09-16T01:22:41.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.005+0000 7f182ea17640 1 -- 172.21.15.63:0/750845831 shutdown_connections 2024-09-16T01:22:41.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.005+0000 7f182ea17640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f18100a32d0 0x7f18100a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.005+0000 7f182ea17640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1828102ef0 0x7f182819ccd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.005+0000 7f182ea17640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1828102570 0x7f1828198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.005+0000 7f182ea17640 1 --2- 172.21.15.63:0/750845831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1828100e20 0x7f1828198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.005+0000 7f182ea17640 1 -- 172.21.15.63:0/750845831 >> 172.21.15.63:0/750845831 conn(0x7f18280fc7d0 msgr2=0x7f182806a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:41.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.005+0000 7f182ea17640 1 -- 172.21.15.63:0/750845831 shutdown_connections 2024-09-16T01:22:41.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:41.005+0000 7f182ea17640 1 -- 172.21.15.63:0/750845831 wait complete. 2024-09-16T01:22:41.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:41 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/750845831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:22:41.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:41 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/750845831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:22:41.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:41 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/750845831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:22:41.735 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:22:41.992 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:42.409 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:42 smithi063 ceph-mon[31070]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 -- 172.21.15.63:0/2173073799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc80106a80 msgr2=0x7fbc80106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 --2- 172.21.15.63:0/2173073799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc80106a80 0x7fbc80106e60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009930 tx=0x7fbc6802a420 comp rx=0 tx=0).stop 2024-09-16T01:22:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 -- 172.21.15.63:0/2173073799 shutdown_connections 2024-09-16T01:22:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 --2- 172.21.15.63:0/2173073799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc80101420 0x7fbc8010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 --2- 172.21.15.63:0/2173073799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc80100a80 0x7fbc80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 --2- 172.21.15.63:0/2173073799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc80106a80 0x7fbc80106e60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 -- 172.21.15.63:0/2173073799 >> 172.21.15.63:0/2173073799 conn(0x7fbc800fc7a0 msgr2=0x7fbc800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 -- 172.21.15.63:0/2173073799 shutdown_connections 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 -- 172.21.15.63:0/2173073799 wait complete. 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 Processor -- start 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.489+0000 7fbc86d14640 1 -- start start 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc86d14640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc80100a80 0x7fbc801971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc86d14640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc80101420 0x7fbc801976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc86d14640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc80106a80 0x7fbc80197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc86d14640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbc80110e20 con 0x7fbc80101420 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc86d14640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc80110ca0 con 0x7fbc80106a80 2024-09-16T01:22:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc86d14640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbc80110fa0 con 0x7fbc80100a80 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc7ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc80101420 0x7fbc801976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc7ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc80101420 0x7fbc801976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57480/0 (socket says 172.21.15.63:57480) 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc7ffff640 1 -- 172.21.15.63:0/3726574194 learned_addr learned my addr 172.21.15.63:0/3726574194 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc84ab0640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc80100a80 0x7fbc801971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc7ffff640 1 -- 172.21.15.63:0/3726574194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc80100a80 msgr2=0x7fbc801971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc7ffff640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc80100a80 0x7fbc801971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc7ffff640 1 -- 172.21.15.63:0/3726574194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc80106a80 msgr2=0x7fbc80197c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc852b1640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc80106a80 0x7fbc80197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc7ffff640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc80106a80 0x7fbc80197c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc7ffff640 1 -- 172.21.15.63:0/3726574194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc801a6a10 con 0x7fbc80101420 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc852b1640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc80106a80 0x7fbc80197c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:42.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc7ffff640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc80101420 0x7fbc801976e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000ba50 tx=0x7fbc7000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:42.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.490+0000 7fbc7dffb640 1 -- 172.21.15.63:0/3726574194 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc70019070 con 0x7fbc80101420 2024-09-16T01:22:42.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.491+0000 7fbc7dffb640 1 -- 172.21.15.63:0/3726574194 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc7000cbe0 con 0x7fbc80101420 2024-09-16T01:22:42.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.491+0000 7fbc86d14640 1 -- 172.21.15.63:0/3726574194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc801a6d00 con 0x7fbc80101420 2024-09-16T01:22:42.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.491+0000 7fbc7dffb640 1 -- 172.21.15.63:0/3726574194 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc700075d0 con 0x7fbc80101420 2024-09-16T01:22:42.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.491+0000 7fbc86d14640 1 -- 172.21.15.63:0/3726574194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc801a71e0 con 0x7fbc80101420 2024-09-16T01:22:42.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.492+0000 7fbc86d14640 1 -- 172.21.15.63:0/3726574194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc80100f60 con 0x7fbc80101420 2024-09-16T01:22:42.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.493+0000 7fbc7dffb640 1 -- 172.21.15.63:0/3726574194 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbc7001c070 con 0x7fbc80101420 2024-09-16T01:22:42.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.493+0000 7fbc7dffb640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbc6c0a32d0 0x7fbc6c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.494+0000 7fbc84ab0640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbc6c0a32d0 0x7fbc6c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.494+0000 7fbc7dffb640 1 -- 172.21.15.63:0/3726574194 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbc700cef40 con 0x7fbc80101420 2024-09-16T01:22:42.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.494+0000 7fbc84ab0640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbc6c0a32d0 0x7fbc6c0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc68031440 tx=0x7fbc68005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:42.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.498+0000 7fbc7dffb640 1 -- 172.21.15.63:0/3726574194 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc7009b5c0 con 0x7fbc80101420 2024-09-16T01:22:42.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:42 smithi192 ceph-mon[34775]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:42.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.674+0000 7fbc86d14640 1 -- 172.21.15.63:0/3726574194 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc8002d7c0 con 0x7fbc80101420 2024-09-16T01:22:42.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.676+0000 7fbc7dffb640 1 -- 172.21.15.63:0/3726574194 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22710 (secure 0 0 0) 0x7fbc7009f8c0 con 0x7fbc80101420 2024-09-16T01:22:42.678 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:42.678 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:39.083854+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:42.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 -- 172.21.15.63:0/3726574194 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbc6c0a32d0 msgr2=0x7fbc6c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbc6c0a32d0 0x7fbc6c0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc68031440 tx=0x7fbc68005a20 comp rx=0 tx=0).stop 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 -- 172.21.15.63:0/3726574194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc80101420 msgr2=0x7fbc801976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc80101420 0x7fbc801976e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000ba50 tx=0x7fbc7000bf10 comp rx=0 tx=0).stop 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 -- 172.21.15.63:0/3726574194 shutdown_connections 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbc6c0a32d0 0x7fbc6c0a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc80106a80 0x7fbc80197c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbc80101420 0x7fbc801976e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 --2- 172.21.15.63:0/3726574194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc80100a80 0x7fbc801971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 -- 172.21.15.63:0/3726574194 >> 172.21.15.63:0/3726574194 conn(0x7fbc800fc7a0 msgr2=0x7fbc800fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 -- 172.21.15.63:0/3726574194 shutdown_connections 2024-09-16T01:22:42.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:42.678+0000 7fbc86d14640 1 -- 172.21.15.63:0/3726574194 wait complete. 2024-09-16T01:22:42.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:42 smithi162 ceph-mon[34539]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:43.355 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:43 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3726574194' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:22:43.386 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:22:43.643 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:43.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:43 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3726574194' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:22:43.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:43 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3726574194' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:22:44.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.131+0000 7fe46defd640 1 -- 172.21.15.63:0/4195106272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46810c180 msgr2=0x7fe46810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:44.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.131+0000 7fe46defd640 1 --2- 172.21.15.63:0/4195106272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46810c180 0x7fe46810e610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe460009ca0 tx=0x7fe46002a950 comp rx=0 tx=0).stop 2024-09-16T01:22:44.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.131+0000 7fe46defd640 1 -- 172.21.15.63:0/4195106272 shutdown_connections 2024-09-16T01:22:44.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.131+0000 7fe46defd640 1 --2- 172.21.15.63:0/4195106272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46810c180 0x7fe46810e610 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:44.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.131+0000 7fe46defd640 1 --2- 172.21.15.63:0/4195106272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe468103700 0x7fe46810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:44.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.131+0000 7fe46defd640 1 --2- 172.21.15.63:0/4195106272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe468102de0 0x7fe4681031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:44.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.131+0000 7fe46defd640 1 -- 172.21.15.63:0/4195106272 >> 172.21.15.63:0/4195106272 conn(0x7fe4680fc7a0 msgr2=0x7fe4680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:44.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.131+0000 7fe46defd640 1 -- 172.21.15.63:0/4195106272 shutdown_connections 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.131+0000 7fe46defd640 1 -- 172.21.15.63:0/4195106272 wait complete. 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe46defd640 1 Processor -- start 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe46defd640 1 -- start start 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe46defd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe468102de0 0x7fe4681983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe46defd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe468103700 0x7fe4681988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe46defd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46810c180 0x7fe46819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe46defd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe468111e60 con 0x7fe46810c180 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe46defd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe468111ce0 con 0x7fe468103700 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe46defd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe468111fe0 con 0x7fe468102de0 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe467fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46810c180 0x7fe46819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:44.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe467fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46810c180 0x7fe46819cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57500/0 (socket says 172.21.15.63:57500) 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe467fff640 1 -- 172.21.15.63:0/4215263166 learned_addr learned my addr 172.21.15.63:0/4215263166 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe466ffd640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe468103700 0x7fe4681988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.132+0000 7fe4677fe640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe468102de0 0x7fe4681983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe467fff640 1 -- 172.21.15.63:0/4215263166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe468102de0 msgr2=0x7fe4681983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe467fff640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe468102de0 0x7fe4681983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe467fff640 1 -- 172.21.15.63:0/4215263166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe468103700 msgr2=0x7fe4681988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe467fff640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe468103700 0x7fe4681988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe467fff640 1 -- 172.21.15.63:0/4215263166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46819d350 con 0x7fe46810c180 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe4677fe640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe468102de0 0x7fe4681983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe467fff640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46810c180 0x7fe46819cc70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe460006010 tx=0x7fe46002f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe464ff9640 1 -- 172.21.15.63:0/4215263166 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe460034040 con 0x7fe46810c180 2024-09-16T01:22:44.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe46defd640 1 -- 172.21.15.63:0/4215263166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46819d5e0 con 0x7fe46810c180 2024-09-16T01:22:44.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe464ff9640 1 -- 172.21.15.63:0/4215263166 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe460003e00 con 0x7fe46810c180 2024-09-16T01:22:44.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe464ff9640 1 -- 172.21.15.63:0/4215263166 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe460045480 con 0x7fe46810c180 2024-09-16T01:22:44.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.133+0000 7fe46defd640 1 -- 172.21.15.63:0/4215263166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4681a4f20 con 0x7fe46810c180 2024-09-16T01:22:44.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.134+0000 7fe46defd640 1 -- 172.21.15.63:0/4215263166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe46806afd0 con 0x7fe46810c180 2024-09-16T01:22:44.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.135+0000 7fe464ff9640 1 -- 172.21.15.63:0/4215263166 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe460037020 con 0x7fe46810c180 2024-09-16T01:22:44.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.136+0000 7fe464ff9640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe4500a32d0 0x7fe4500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:44.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.136+0000 7fe4677fe640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe4500a32d0 0x7fe4500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:44.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.136+0000 7fe464ff9640 1 -- 172.21.15.63:0/4215263166 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe4600f0ab0 con 0x7fe46810c180 2024-09-16T01:22:44.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.136+0000 7fe4677fe640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe4500a32d0 0x7fe4500a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe458009930 tx=0x7fe458008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:44.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.140+0000 7fe464ff9640 1 -- 172.21.15.63:0/4215263166 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe4600bd810 con 0x7fe46810c180 2024-09-16T01:22:44.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.350+0000 7fe46defd640 1 -- 172.21.15.63:0/4215263166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe468107240 con 0x7fe46810c180 2024-09-16T01:22:44.352 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:44 smithi063 ceph-mon[31070]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:44.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.351+0000 7fe464ff9640 1 -- 172.21.15.63:0/4215263166 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11909 (secure 0 0 0) 0x7fe4600bd110 con 0x7fe46810c180 2024-09-16T01:22:44.353 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:44.353 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":24,"btime":"2024-09-16T01:21:40:093564+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:21:39.762667+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24445,24460,24467]},"id":1}]} 2024-09-16T01:22:44.353 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 24 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.353+0000 7fe46defd640 1 -- 172.21.15.63:0/4215263166 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe4500a32d0 msgr2=0x7fe4500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.353+0000 7fe46defd640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe4500a32d0 0x7fe4500a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe458009930 tx=0x7fe458008040 comp rx=0 tx=0).stop 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.353+0000 7fe46defd640 1 -- 172.21.15.63:0/4215263166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46810c180 msgr2=0x7fe46819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.353+0000 7fe46defd640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46810c180 0x7fe46819cc70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe460006010 tx=0x7fe46002f640 comp rx=0 tx=0).stop 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.353+0000 7fe46defd640 1 -- 172.21.15.63:0/4215263166 shutdown_connections 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.353+0000 7fe46defd640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe4500a32d0 0x7fe4500a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.353+0000 7fe46defd640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46810c180 0x7fe46819cc70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.353+0000 7fe46defd640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe468103700 0x7fe4681988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.353+0000 7fe46defd640 1 --2- 172.21.15.63:0/4215263166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe468102de0 0x7fe4681983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.353+0000 7fe46defd640 1 -- 172.21.15.63:0/4215263166 >> 172.21.15.63:0/4215263166 conn(0x7fe4680fc7a0 msgr2=0x7fe4680fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.354+0000 7fe46defd640 1 -- 172.21.15.63:0/4215263166 shutdown_connections 2024-09-16T01:22:44.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:44.354+0000 7fe46defd640 1 -- 172.21.15.63:0/4215263166 wait complete. 2024-09-16T01:22:44.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:44 smithi192 ceph-mon[34775]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:44.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:44 smithi162 ceph-mon[34539]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:45.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-16T01:21:28.777744+0000', 'modified': '2024-09-16T01:21:39.762667+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24467, 'mds_1': 24460, 'mds_2': 24445}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24419': {'gid': 24419, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/1954173887', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 1954173887}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 1954173887}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6835/383563245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 383563245}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 383563245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6837/1959030818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 1959030818}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 1959030818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.192:6837/3521040095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 3521040095}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 3521040095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.192:6839/82939697', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 82939697}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 82939697}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.162:6839/2919019351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 2919019351}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 2919019351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24467, 'qdb_cluster': [24445, 24460, 24467]} 2024-09-16T01:22:45.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-16T01:22:45.084 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-16T01:22:45.342 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:45.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:45 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/4215263166' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:22:45.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:45 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/4215263166' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:22:45.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:45 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/4215263166' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:22:45.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.825+0000 7f8397556640 1 -- 172.21.15.63:0/1819500898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8390102db0 msgr2=0x7f8390103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.825+0000 7f8397556640 1 --2- 172.21.15.63:0/1819500898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8390102db0 0x7f8390103190 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f838c009930 tx=0x7f838c02a440 comp rx=0 tx=0).stop 2024-09-16T01:22:45.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.825+0000 7f8397556640 1 -- 172.21.15.63:0/1819500898 shutdown_connections 2024-09-16T01:22:45.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.825+0000 7f8397556640 1 --2- 172.21.15.63:0/1819500898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83901082e0 0x7f839010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.825+0000 7f8397556640 1 --2- 172.21.15.63:0/1819500898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8390103760 0x7f8390107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.825+0000 7f8397556640 1 --2- 172.21.15.63:0/1819500898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8390102db0 0x7f8390103190 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.825+0000 7f8397556640 1 -- 172.21.15.63:0/1819500898 >> 172.21.15.63:0/1819500898 conn(0x7f83900fc7d0 msgr2=0x7f83900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:45.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.825+0000 7f8397556640 1 -- 172.21.15.63:0/1819500898 shutdown_connections 2024-09-16T01:22:45.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.825+0000 7f8397556640 1 -- 172.21.15.63:0/1819500898 wait complete. 2024-09-16T01:22:45.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.825+0000 7f8397556640 1 Processor -- start 2024-09-16T01:22:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f8397556640 1 -- start start 2024-09-16T01:22:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f8397556640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8390102db0 0x7f83901985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f8397556640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8390103760 0x7f8390198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f8397556640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83901082e0 0x7f839019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f8397556640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8390112020 con 0x7f8390102db0 2024-09-16T01:22:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f8397556640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8390111ea0 con 0x7f83901082e0 2024-09-16T01:22:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f8397556640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f83901121a0 con 0x7f8390103760 2024-09-16T01:22:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f83952f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8390102db0 0x7f83901985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f83952f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8390102db0 0x7f83901985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57524/0 (socket says 172.21.15.63:57524) 2024-09-16T01:22:45.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f83952f2640 1 -- 172.21.15.63:0/1575845751 learned_addr learned my addr 172.21.15.63:0/1575845751 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f8394af1640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8390103760 0x7f8390198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f83952f2640 1 -- 172.21.15.63:0/1575845751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8390103760 msgr2=0x7f8390198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f8395af3640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83901082e0 0x7f839019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f83952f2640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8390103760 0x7f8390198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f83952f2640 1 -- 172.21.15.63:0/1575845751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83901082e0 msgr2=0x7f839019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f83952f2640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83901082e0 0x7f839019ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f83952f2640 1 -- 172.21.15.63:0/1575845751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839019d590 con 0x7f8390102db0 2024-09-16T01:22:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f8395af3640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83901082e0 0x7f839019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.826+0000 7f83952f2640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8390102db0 0x7f83901985e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f838c009a50 tx=0x7f838c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:45.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.827+0000 7f83867fc640 1 -- 172.21.15.63:0/1575845751 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c03f030 con 0x7f8390102db0 2024-09-16T01:22:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.827+0000 7f8397556640 1 -- 172.21.15.63:0/1575845751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839019d820 con 0x7f8390102db0 2024-09-16T01:22:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.827+0000 7f83867fc640 1 -- 172.21.15.63:0/1575845751 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f838c0035f0 con 0x7f8390102db0 2024-09-16T01:22:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.827+0000 7f83867fc640 1 -- 172.21.15.63:0/1575845751 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c035070 con 0x7f8390102db0 2024-09-16T01:22:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.827+0000 7f8397556640 1 -- 172.21.15.63:0/1575845751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83901a5160 con 0x7f8390102db0 2024-09-16T01:22:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f83867fc640 1 -- 172.21.15.63:0/1575845751 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f838c0037a0 con 0x7f8390102db0 2024-09-16T01:22:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f839992f740 1 Processor -- start 2024-09-16T01:22:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f839992f740 1 -- start start 2024-09-16T01:22:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f839992f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f839992f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1e82f0 0x55ceab1f2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f839992f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1f2bb0 0x55ceab1f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f839992f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ceab14e090 con 0x55ceab1e79d0 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f839992f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ceab0f5a70 con 0x55ceab1e82f0 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f839992f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ceab14a050 con 0x55ceab1f2bb0 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f8395af3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f8395af3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1e7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57536/0 (socket says 172.21.15.63:57536) 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f8395af3640 1 -- 172.21.15.63:0/3182387201 learned_addr learned my addr 172.21.15.63:0/3182387201 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.830+0000 7f83952f2640 1 --2- 172.21.15.63:0/3182387201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1e82f0 0x55ceab1f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f8394af1640 1 --2- 172.21.15.63:0/3182387201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1f2bb0 0x55ceab1f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f8395af3640 1 -- 172.21.15.63:0/3182387201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1f2bb0 msgr2=0x55ceab1f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f8395af3640 1 --2- 172.21.15.63:0/3182387201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1f2bb0 0x55ceab1f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f8395af3640 1 -- 172.21.15.63:0/3182387201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1e82f0 msgr2=0x55ceab1f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f83867fc640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f837c0a32d0 0x7f837c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f8395af3640 1 --2- 172.21.15.63:0/3182387201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1e82f0 0x55ceab1f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f8395af3640 1 -- 172.21.15.63:0/3182387201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceab102130 con 0x55ceab1e79d0 2024-09-16T01:22:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f83867fc640 1 -- 172.21.15.63:0/1575845751 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f838c0f0720 con 0x7f8390102db0 2024-09-16T01:22:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f8395af3640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f837c0a32d0 0x7f837c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f8395af3640 1 --2- 172.21.15.63:0/3182387201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1e7db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8388007f30 tx=0x7f838800c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d093d763f1f7d558 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f837b7fe640 1 -- 172.21.15.63:0/3182387201 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838800f970 con 0x55ceab1e79d0 2024-09-16T01:22:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f837b7fe640 1 -- 172.21.15.63:0/3182387201 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8388014030 con 0x55ceab1e79d0 2024-09-16T01:22:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.831+0000 7f837b7fe640 1 -- 172.21.15.63:0/3182387201 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388019860 con 0x55ceab1e79d0 2024-09-16T01:22:45.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 -- 172.21.15.63:0/3182387201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 msgr2=0x55ceab1e7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f8395af3640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f837c0a32d0 0x7f837c0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8388018000 tx=0x7f8388019ac0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 --2- 172.21.15.63:0/3182387201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1e7db0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8388007f30 tx=0x7f838800c750 comp rx=0 tx=0).stop 2024-09-16T01:22:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 -- 172.21.15.63:0/3182387201 shutdown_connections 2024-09-16T01:22:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 --2- 172.21.15.63:0/3182387201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1f2bb0 0x55ceab1f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 --2- 172.21.15.63:0/3182387201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1e82f0 0x55ceab1f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 --2- 172.21.15.63:0/3182387201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1e7db0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 -- 172.21.15.63:0/3182387201 >> 172.21.15.63:0/3182387201 conn(0x55ceab1e3f60 msgr2=0x55ceab1e4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 -- 172.21.15.63:0/3182387201 shutdown_connections 2024-09-16T01:22:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 -- 172.21.15.63:0/3182387201 wait complete. 2024-09-16T01:22:45.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 -- start start 2024-09-16T01:22:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.832+0000 7f839992f740 1 Processor -- start 2024-09-16T01:22:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f839992f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f839992f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e82f0 0x55ceab1ef760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f839992f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab1efca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f839992f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ceab1f5780 con 0x55ceab1e79d0 2024-09-16T01:22:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f839992f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ceab108f20 con 0x55ceab1f2bb0 2024-09-16T01:22:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f839992f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ceab1f5900 con 0x55ceab1e82f0 2024-09-16T01:22:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f839992f740 10 client.0 _ll_register_callbacks cb 0x55ceab0d2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:22:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f83952f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f83952f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1f23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57552/0 (socket says 172.21.15.63:57552) 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f83952f2640 1 -- 172.21.15.63:0/1680363991 learned_addr learned my addr 172.21.15.63:0/1680363991 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f83952f2640 1 -- 172.21.15.63:0/1680363991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e82f0 msgr2=0x55ceab1ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f83952f2640 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e82f0 0x55ceab1ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f83952f2640 1 -- 172.21.15.63:0/1680363991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 msgr2=0x55ceab1efca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f83952f2640 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab1efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f83952f2640 1 -- 172.21.15.63:0/1680363991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceaaebf2b0 con 0x55ceab1e79d0 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f83952f2640 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1f23c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f838c009900 tx=0x7f838c0bc7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0549b0fc3d0c4b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f8378ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.833+0000 7f8378ff9640 1 -- 172.21.15.63:0/1680363991 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c049040 con 0x55ceab1e79d0 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f8378ff9640 1 -- 172.21.15.63:0/1680363991 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f838c0b9250 con 0x55ceab1e79d0 2024-09-16T01:22:45.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f839992f740 1 -- 172.21.15.63:0/1680363991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8388014030 con 0x55ceab1e79d0 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f8378ff9640 1 -- 172.21.15.63:0/1680363991 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f838c0bcbe0 con 0x55ceab1e79d0 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f839992f740 10 client.14964 fetch_fsmap learned FSMap version 24 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f839992f740 1 -- 172.21.15.63:0/1680363991 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ceab201040 con 0x55ceab1e79d0 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f8378ff9640 1 -- 172.21.15.63:0/1680363991 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8388014030 con 0x55ceab1e79d0 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f8378ff9640 1 -- 172.21.15.63:0/1680363991 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f838c0f0b90 con 0x55ceab1e79d0 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f839992f740 10 client.14964 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f839992f740 10 client.14964 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f839992f740 20 client.14964 populate_metadata read hostname 'smithi063' 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f839992f740 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ceab203870 0x55ceab204c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f839992f740 4 client.14964 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:22:45.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f839992f740 1 -- 172.21.15.63:0/1680363991 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ceab15b600 con 0x55ceab203870 2024-09-16T01:22:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.834+0000 7f8394af1640 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ceab203870 0x55ceab204c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.835+0000 7f8394af1640 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ceab203870 0x55ceab204c60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b92283342d2095c5 server_cookie=cc90335cebfad234 in_seq=0 out_seq=0 2024-09-16T01:22:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.835+0000 7f8378ff9640 10 client.14964 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:22:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f8378ff9640 1 -- 172.21.15.63:0/1680363991 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ceab15b600 con 0x55ceab203870 2024-09-16T01:22:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f8378ff9640 10 client.14964 handle_command_reply: tid=0 2024-09-16T01:22:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 client.14964 shutdown 2024-09-16T01:22:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 -- 172.21.15.63:0/1680363991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 msgr2=0x55ceab1f23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1f23c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f838c009900 tx=0x7f838c0bc7e0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 -- 172.21.15.63:0/1680363991 shutdown_connections 2024-09-16T01:22:45.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ceab203870 0x55ceab204c60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab1efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e82f0 0x55ceab1ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f8378ff9640 0 client.14964 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:22:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 --2- 172.21.15.63:0/1680363991 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab1f23c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 -- 172.21.15.63:0/1680363991 >> 172.21.15.63:0/1680363991 conn(0x55ceab1e3f60 msgr2=0x55ceab1e9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 -- 172.21.15.63:0/1680363991 shutdown_connections 2024-09-16T01:22:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 1 -- 172.21.15.63:0/1680363991 wait complete. 2024-09-16T01:22:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.836+0000 7f839992f740 20 client.14964 trim_cache size 0 max 16384 2024-09-16T01:22:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f839992f740 1 Processor -- start 2024-09-16T01:22:45.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f839992f740 1 -- start start 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f839992f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e79d0 0x55ceab1ef020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f839992f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e82f0 0x55ceab202390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f839992f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab2028d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f839992f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ceab203020 con 0x55ceab1e82f0 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f839992f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ceab2036f0 con 0x55ceab1f2bb0 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f839992f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ceab203d40 con 0x55ceab1e79d0 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f8394af1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e82f0 0x55ceab202390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f8394af1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e82f0 0x55ceab202390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57568/0 (socket says 172.21.15.63:57568) 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.854+0000 7f8394af1640 1 -- 172.21.15.63:0/1434778923 learned_addr learned my addr 172.21.15.63:0/1434778923 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f8395af3640 1 --2- 172.21.15.63:0/1434778923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab2028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f83952f2640 1 --2- 172.21.15.63:0/1434778923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e79d0 0x55ceab1ef020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f8394af1640 1 -- 172.21.15.63:0/1434778923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e79d0 msgr2=0x55ceab1ef020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f8394af1640 1 --2- 172.21.15.63:0/1434778923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e79d0 0x55ceab1ef020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f8394af1640 1 -- 172.21.15.63:0/1434778923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 msgr2=0x55ceab2028d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f8394af1640 1 --2- 172.21.15.63:0/1434778923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab2028d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f8394af1640 1 -- 172.21.15.63:0/1434778923 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ceab1f2730 con 0x55ceab1e82f0 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f8394af1640 1 --2- 172.21.15.63:0/1434778923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e82f0 0x55ceab202390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f83900fee50 tx=0x7f838000bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09117df492c0e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f837affd640 1 -- 172.21.15.63:0/1434778923 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838000bd80 con 0x55ceab1e82f0 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f837affd640 1 -- 172.21.15.63:0/1434778923 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8380022070 con 0x55ceab1e82f0 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.855+0000 7f837affd640 1 -- 172.21.15.63:0/1434778923 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838001dbb0 con 0x55ceab1e82f0 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 -- 172.21.15.63:0/1434778923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e82f0 msgr2=0x55ceab202390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 --2- 172.21.15.63:0/1434778923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e82f0 0x55ceab202390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f83900fee50 tx=0x7f838000bb30 comp rx=0 tx=0).stop 2024-09-16T01:22:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 -- 172.21.15.63:0/1434778923 shutdown_connections 2024-09-16T01:22:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 --2- 172.21.15.63:0/1434778923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab2028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 --2- 172.21.15.63:0/1434778923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e82f0 0x55ceab202390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 --2- 172.21.15.63:0/1434778923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e79d0 0x55ceab1ef020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 -- 172.21.15.63:0/1434778923 >> 172.21.15.63:0/1434778923 conn(0x55ceab1e3f60 msgr2=0x55ceab1ee030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 -- 172.21.15.63:0/1434778923 shutdown_connections 2024-09-16T01:22:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 -- 172.21.15.63:0/1434778923 wait complete. 2024-09-16T01:22:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 -- start start 2024-09-16T01:22:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.856+0000 7f839992f740 1 Processor -- start 2024-09-16T01:22:45.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f839992f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab207f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f839992f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e82f0 0x55ceab208490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f839992f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab26bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f839992f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ceab204ae0 con 0x55ceab1e79d0 2024-09-16T01:22:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f839992f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ceab204410 con 0x55ceab1f2bb0 2024-09-16T01:22:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f839992f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ceab2051b0 con 0x55ceab1e82f0 2024-09-16T01:22:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f839992f740 10 client.0 _ll_register_callbacks cb 0x7f838c0f4040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:22:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f83952f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab207f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f83952f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab207f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57582/0 (socket says 172.21.15.63:57582) 2024-09-16T01:22:45.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f83952f2640 1 -- 172.21.15.63:0/1270472532 learned_addr learned my addr 172.21.15.63:0/1270472532 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f8394af1640 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e82f0 0x55ceab208490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f8395af3640 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab26bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f83952f2640 1 -- 172.21.15.63:0/1270472532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e82f0 msgr2=0x55ceab208490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f83952f2640 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e82f0 0x55ceab208490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f83952f2640 1 -- 172.21.15.63:0/1270472532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 msgr2=0x55ceab26bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f83952f2640 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab26bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f83952f2640 1 -- 172.21.15.63:0/1270472532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ceab208d40 con 0x55ceab1e79d0 2024-09-16T01:22:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f83952f2640 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab207f50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f838c0ee650 tx=0x7f838c0bc9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873c22e35d3e94e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f8378ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:22:45.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f8378ff9640 1 -- 172.21.15.63:0/1270472532 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c049070 con 0x55ceab1e79d0 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f8378ff9640 1 -- 172.21.15.63:0/1270472532 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f838c0a71c0 con 0x55ceab1e79d0 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.857+0000 7f839992f740 1 -- 172.21.15.63:0/1270472532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8380022070 con 0x55ceab1e79d0 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f8378ff9640 1 -- 172.21.15.63:0/1270472532 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f838c0a73c0 con 0x55ceab1e79d0 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f839992f740 10 client.14970 fetch_fsmap learned FSMap version 24 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f839992f740 1 -- 172.21.15.63:0/1270472532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ceab26d510 con 0x55ceab1e79d0 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f8378ff9640 1 -- 172.21.15.63:0/1270472532 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8380022070 con 0x55ceab1e79d0 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f8378ff9640 1 -- 172.21.15.63:0/1270472532 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f838c0bc030 con 0x55ceab1e79d0 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f839992f740 10 client.14970 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f839992f740 10 client.14970 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f839992f740 20 client.14970 populate_metadata read hostname 'smithi063' 2024-09-16T01:22:45.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f839992f740 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ceab271ef0 0x55ceab270c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f839992f740 4 client.14970 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f839992f740 1 -- 172.21.15.63:0/1270472532 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "status"}) -- 0x55ceab155b10 con 0x55ceab271ef0 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.858+0000 7f8394af1640 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ceab271ef0 0x55ceab270c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f8394af1640 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ceab271ef0 0x55ceab270c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11842354ae46c78b server_cookie=de6116fbf6d70d70 in_seq=0 out_seq=0 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f8378ff9640 10 client.14970 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f8378ff9640 1 -- 172.21.15.63:0/1270472532 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ceab155b10 con 0x55ceab271ef0 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f8378ff9640 10 client.14970 handle_command_reply: tid=0 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 client.14970 shutdown 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 -- 172.21.15.63:0/1270472532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 msgr2=0x55ceab207f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab207f50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f838c0ee650 tx=0x7f838c0bc9b0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 -- 172.21.15.63:0/1270472532 shutdown_connections 2024-09-16T01:22:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ceab271ef0 0x55ceab270c00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ceab1f2bb0 0x55ceab26bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ceab1e82f0 0x55ceab208490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f8378ff9640 0 client.14970 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:22:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 --2- 172.21.15.63:0/1270472532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ceab1e79d0 0x55ceab207f50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 -- 172.21.15.63:0/1270472532 >> 172.21.15.63:0/1270472532 conn(0x55ceab1e3f60 msgr2=0x55ceab202390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 -- 172.21.15.63:0/1270472532 shutdown_connections 2024-09-16T01:22:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 1 -- 172.21.15.63:0/1270472532 wait complete. 2024-09-16T01:22:45.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.859+0000 7f839992f740 20 client.14970 trim_cache size 0 max 16384 2024-09-16T01:22:45.882 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:22:45.882 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "c42394ec-73c8-11ef-bceb-c7b262605968", 2024-09-16T01:22:45.882 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 2, 2024-09-16T01:22:45.882 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24445, 2024-09-16T01:22:45.882 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-16T01:22:45.882 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-16T01:22:45.882 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-16T01:22:45.882 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 68.779810682000004, 2024-09-16T01:22:45.883 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 24, 2024-09-16T01:22:45.883 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 84, 2024-09-16T01:22:45.883 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 84, 2024-09-16T01:22:45.883 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 101.951909654 2024-09-16T01:22:45.883 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:22:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 -- 172.21.15.63:0/1575845751 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f837c0a32d0 msgr2=0x7f837c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f837c0a32d0 0x7f837c0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8388018000 tx=0x7f8388019ac0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 -- 172.21.15.63:0/1575845751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8390102db0 msgr2=0x7f83901985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8390102db0 0x7f83901985e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f838c009a50 tx=0x7f838c004270 comp rx=0 tx=0).stop 2024-09-16T01:22:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 -- 172.21.15.63:0/1575845751 shutdown_connections 2024-09-16T01:22:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f837c0a32d0 0x7f837c0a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83901082e0 0x7f839019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8390103760 0x7f8390198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 --2- 172.21.15.63:0/1575845751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8390102db0 0x7f83901985e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 -- 172.21.15.63:0/1575845751 >> 172.21.15.63:0/1575845751 conn(0x7f83900fc7d0 msgr2=0x7f8390105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:45.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 -- 172.21.15.63:0/1575845751 shutdown_connections 2024-09-16T01:22:45.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:45.860+0000 7f8397556640 1 -- 172.21.15.63:0/1575845751 wait complete. 2024-09-16T01:22:46.571 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:46 smithi063 ceph-mon[31070]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:46.598 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-16T01:22:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:46 smithi192 ceph-mon[34775]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:46.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:46 smithi162 ceph-mon[34539]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:46.860 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.325+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2370029358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbce8102790 msgr2=0x7fbce81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.325+0000 7fbcee1dc640 1 --2- 172.21.15.63:0/2370029358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbce8102790 0x7fbce81067e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009900 tx=0x7fbcdc02a410 comp rx=0 tx=0).stop 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.325+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2370029358 shutdown_connections 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.325+0000 7fbcee1dc640 1 --2- 172.21.15.63:0/2370029358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8106f10 0x7fbce810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.325+0000 7fbcee1dc640 1 --2- 172.21.15.63:0/2370029358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbce8102790 0x7fbce81067e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.325+0000 7fbcee1dc640 1 --2- 172.21.15.63:0/2370029358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce8101de0 0x7fbce81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.325+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2370029358 >> 172.21.15.63:0/2370029358 conn(0x7fbce80fd8c0 msgr2=0x7fbce80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.325+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2370029358 shutdown_connections 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.325+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2370029358 wait complete. 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbcee1dc640 1 Processor -- start 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbcee1dc640 1 -- start start 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbcee1dc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8101de0 0x7fbce8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbcee1dc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbce8102790 0x7fbce8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbcee1dc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce8106f10 0x7fbce819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbcee1dc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbce8111e40 con 0x7fbce8102790 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbcee1dc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbce8111cc0 con 0x7fbce8106f10 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbcee1dc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbce8111fc0 con 0x7fbce8101de0 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbce6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbce8102790 0x7fbce8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbce6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbce8102790 0x7fbce8198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57596/0 (socket says 172.21.15.63:57596) 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.326+0000 7fbce6ffd640 1 -- 172.21.15.63:0/2854430795 learned_addr learned my addr 172.21.15.63:0/2854430795 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce77fe640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8101de0 0x7fbce8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce7fff640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce8106f10 0x7fbce819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce6ffd640 1 -- 172.21.15.63:0/2854430795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8101de0 msgr2=0x7fbce8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8101de0 0x7fbce8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce6ffd640 1 -- 172.21.15.63:0/2854430795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce8106f10 msgr2=0x7fbce819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce8106f10 0x7fbce819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce6ffd640 1 -- 172.21.15.63:0/2854430795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce819d3f0 con 0x7fbce8102790 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce7fff640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce8106f10 0x7fbce819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbce8102790 0x7fbce8198980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc005940 tx=0x7fbcdc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce4ff9640 1 -- 172.21.15.63:0/2854430795 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc03f030 con 0x7fbce8102790 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce4ff9640 1 -- 172.21.15.63:0/2854430795 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcdc003aa0 con 0x7fbce8102790 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2854430795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce819d680 con 0x7fbce8102790 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbce4ff9640 1 -- 172.21.15.63:0/2854430795 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc035070 con 0x7fbce8102790 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.327+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2854430795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce81a4fc0 con 0x7fbce8102790 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.329+0000 7fbce4ff9640 1 -- 172.21.15.63:0/2854430795 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbcdc042030 con 0x7fbce8102790 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbcf05b5740 1 Processor -- start 2024-09-16T01:22:47.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbcf05b5740 1 -- start start 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37fccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37fd7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce37fd9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ce37f33090 con 0x55ce37fcc9d0 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce37edaa70 con 0x55ce37fcd2f0 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ce37f2f050 con 0x55ce37fd7bb0 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37fccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbce4ff9640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbcd00a32d0 0x7fbcd00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37fccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57602/0 (socket says 172.21.15.63:57602) 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbce7fff640 1 -- 172.21.15.63:0/3085486197 learned_addr learned my addr 172.21.15.63:0/3085486197 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.330+0000 7fbce77fe640 1 --2- 172.21.15.63:0/3085486197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37fd7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbce7fff640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbcd00a32d0 0x7fbcd00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbce4ff9640 1 -- 172.21.15.63:0/2854430795 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbcdc0f0280 con 0x7fbce8102790 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/3085486197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce37fd9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbce7fff640 1 -- 172.21.15.63:0/3085486197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 msgr2=0x55ce37fd9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbce7fff640 1 --2- 172.21.15.63:0/3085486197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce37fd9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbce7fff640 1 -- 172.21.15.63:0/3085486197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 msgr2=0x55ce37fd7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbce7fff640 1 --2- 172.21.15.63:0/3085486197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37fd7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbce7fff640 1 -- 172.21.15.63:0/3085486197 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce37ee7130 con 0x55ce37fcc9d0 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbce7fff640 1 --2- 172.21.15.63:0/3085486197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37fccdb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbce0013950 tx=0x7fbce0013e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d39676db2874a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbccdffb640 1 -- 172.21.15.63:0/3085486197 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0013420 con 0x55ce37fcc9d0 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbccdffb640 1 -- 172.21.15.63:0/3085486197 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbce0011c40 con 0x55ce37fcc9d0 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.331+0000 7fbccdffb640 1 -- 172.21.15.63:0/3085486197 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce001d660 con 0x55ce37fcc9d0 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3085486197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 msgr2=0x55ce37fccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/3085486197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37fccdb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbce0013950 tx=0x7fbce0013e10 comp rx=0 tx=0).stop 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbce7fff640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbcd00a32d0 0x7fbcd00a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbce0020000 tx=0x7fbce001f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3085486197 shutdown_connections 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/3085486197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce37fd9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/3085486197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37fd7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/3085486197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37fccdb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3085486197 >> 172.21.15.63:0/3085486197 conn(0x55ce37fc8f60 msgr2=0x55ce37fc9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3085486197 shutdown_connections 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3085486197 wait complete. 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.332+0000 7fbcf05b5740 1 -- start start 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbcf05b5740 1 Processor -- start 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcc9d0 0x55ce37fd7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcd2f0 0x55ce37fd47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce37fd4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ce37fdeb90 con 0x55ce37fcd2f0 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce37eedf20 con 0x55ce37fcc9d0 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ce37fded10 con 0x55ce37fd7bb0 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbcf05b5740 10 client.0 _ll_register_callbacks cb 0x55ce37eb7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcd2f0 0x55ce37fd47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcd2f0 0x55ce37fd47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57614/0 (socket says 172.21.15.63:57614) 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce6ffd640 1 -- 172.21.15.63:0/2541623467 learned_addr learned my addr 172.21.15.63:0/2541623467 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce7fff640 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce37fd4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce77fe640 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcc9d0 0x55ce37fd7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce6ffd640 1 -- 172.21.15.63:0/2541623467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 msgr2=0x55ce37fd4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce37fd4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce6ffd640 1 -- 172.21.15.63:0/2541623467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcc9d0 msgr2=0x55ce37fd7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcc9d0 0x55ce37fd7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce6ffd640 1 -- 172.21.15.63:0/2541623467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce37ca42b0 con 0x55ce37fcd2f0 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce7fff640 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce37fd4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce77fe640 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcc9d0 0x55ce37fd7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcd2f0 0x55ce37fd47b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc006010 tx=0x7fbcdc0bc120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcc7ad14bf62a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.333+0000 7fbcc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/2541623467 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc049040 con 0x55ce37fcd2f0 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/2541623467 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbcdc0b8d70 con 0x55ce37fcd2f0 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcf05b5740 1 -- 172.21.15.63:0/2541623467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbce0011c40 con 0x55ce37fcd2f0 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/2541623467 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbcdc0c0ab0 con 0x55ce37fcd2f0 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcf05b5740 10 client.14982 fetch_fsmap learned FSMap version 24 2024-09-16T01:22:47.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcf05b5740 1 -- 172.21.15.63:0/2541623467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ce37fea4b0 con 0x55ce37fcd2f0 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/2541623467 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbce0011c40 con 0x55ce37fcd2f0 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/2541623467 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbcdc0bc960 con 0x55ce37fcd2f0 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcf05b5740 10 client.14982 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcf05b5740 10 client.14982 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcf05b5740 20 client.14982 populate_metadata read hostname 'smithi063' 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55ce37fecb40 0x55ce37fedfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcf05b5740 4 client.14982 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.334+0000 7fbcf05b5740 1 -- 172.21.15.63:0/2541623467 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce37f40600 con 0x55ce37fecb40 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.335+0000 7fbce77fe640 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55ce37fecb40 0x55ce37fedfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.335+0000 7fbce77fe640 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55ce37fecb40 0x55ce37fedfb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fff76c5799fa3222 server_cookie=cdfe665a39ed07cd in_seq=0 out_seq=0 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.335+0000 7fbcc6ffd640 10 client.14982 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/2541623467 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce37f40600 con 0x55ce37fecb40 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcc6ffd640 10 client.14982 handle_command_reply: tid=0 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 client.14982 shutdown 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 -- 172.21.15.63:0/2541623467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcd2f0 msgr2=0x55ce37fd47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcd2f0 0x55ce37fd47b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc006010 tx=0x7fbcdc0bc120 comp rx=0 tx=0).stop 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 -- 172.21.15.63:0/2541623467 shutdown_connections 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55ce37fecb40 0x55ce37fedfb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce37fd4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcd2f0 0x55ce37fd47b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/2541623467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcc9d0 0x55ce37fd7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcc6ffd640 0 client.14982 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 -- 172.21.15.63:0/2541623467 >> 172.21.15.63:0/2541623467 conn(0x55ce37fc8f60 msgr2=0x55ce37fcec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 -- 172.21.15.63:0/2541623467 shutdown_connections 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 1 -- 172.21.15.63:0/2541623467 wait complete. 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.336+0000 7fbcf05b5740 20 client.14982 trim_cache size 0 max 16384 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbcf05b5740 1 Processor -- start 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbcf05b5740 1 -- start start 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fcc9d0 0x55ce37fedfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37feb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fd7bb0 0x55ce37febd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ce37fec2f0 con 0x55ce37fd7bb0 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce37fec9c0 con 0x55ce37fcd2f0 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ce37fed090 con 0x55ce37fcc9d0 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fd7bb0 0x55ce37febd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fd7bb0 0x55ce37febd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57628/0 (socket says 172.21.15.63:57628) 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbce7fff640 1 -- 172.21.15.63:0/364603559 learned_addr learned my addr 172.21.15.63:0/364603559 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/364603559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37feb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbce7fff640 1 -- 172.21.15.63:0/364603559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fcc9d0 msgr2=0x55ce37fedfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbce7fff640 1 --2- 172.21.15.63:0/364603559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fcc9d0 0x55ce37fedfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbce7fff640 1 -- 172.21.15.63:0/364603559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 msgr2=0x55ce37feb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbce7fff640 1 --2- 172.21.15.63:0/364603559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37feb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbce7fff640 1 -- 172.21.15.63:0/364603559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce37fda300 con 0x55ce37fd7bb0 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.354+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/364603559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37feb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbce7fff640 1 --2- 172.21.15.63:0/364603559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fd7bb0 0x55ce37febd40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbce00093e0 tx=0x7fbce000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8128f7694eec2c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbccd7fa640 1 -- 172.21.15.63:0/364603559 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce002c040 con 0x55ce37fd7bb0 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbccd7fa640 1 -- 172.21.15.63:0/364603559 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbce001dcf0 con 0x55ce37fd7bb0 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbccd7fa640 1 -- 172.21.15.63:0/364603559 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0011c40 con 0x55ce37fd7bb0 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbcf05b5740 1 -- 172.21.15.63:0/364603559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fd7bb0 msgr2=0x55ce37febd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/364603559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fd7bb0 0x55ce37febd40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbce00093e0 tx=0x7fbce000f000 comp rx=0 tx=0).stop 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbcf05b5740 1 -- 172.21.15.63:0/364603559 shutdown_connections 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/364603559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fd7bb0 0x55ce37febd40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/364603559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37feb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/364603559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fcc9d0 0x55ce37fedfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.355+0000 7fbcf05b5740 1 -- 172.21.15.63:0/364603559 >> 172.21.15.63:0/364603559 conn(0x55ce37fc8f60 msgr2=0x55ce37fc3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 1 -- 172.21.15.63:0/364603559 shutdown_connections 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 1 -- 172.21.15.63:0/364603559 wait complete. 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 1 -- start start 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 1 Processor -- start 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37ff16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37ff1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce38055240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ce37fede30 con 0x55ce37fcc9d0 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce37fed760 con 0x55ce37fcd2f0 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ce37fee500 con 0x55ce37fd7bb0 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbce77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37ff16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbcf05b5740 10 client.0 _ll_register_callbacks cb 0x7fbcdc0b8a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbce77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37ff16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57638/0 (socket says 172.21.15.63:57638) 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.356+0000 7fbce77fe640 1 -- 172.21.15.63:0/3970228304 learned_addr learned my addr 172.21.15.63:0/3970228304 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37ff1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbce7fff640 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce38055240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbce77fe640 1 -- 172.21.15.63:0/3970228304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 msgr2=0x55ce38055240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbce77fe640 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce38055240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbce77fe640 1 -- 172.21.15.63:0/3970228304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 msgr2=0x55ce37ff1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbce77fe640 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37ff1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbce77fe640 1 -- 172.21.15.63:0/3970228304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce38055780 con 0x55ce37fcc9d0 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbce7fff640 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce38055240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbce77fe640 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37ff16a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8006e10 tx=0x7fbcd8017810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b48fb4f9bce52c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbcc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/3970228304 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd801d310 con 0x55ce37fcc9d0 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/3970228304 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbcd800f040 con 0x55ce37fcc9d0 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3970228304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbce001dcf0 con 0x55ce37fcc9d0 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/3970228304 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbcd802d050 con 0x55ce37fcc9d0 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbcf05b5740 10 client.14988 fetch_fsmap learned FSMap version 24 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.357+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3970228304 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ce38056a80 con 0x55ce37fcc9d0 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.358+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/3970228304 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbce001dcf0 con 0x55ce37fcc9d0 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.358+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/3970228304 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbcd8025680 con 0x55ce37fcc9d0 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.358+0000 7fbcf05b5740 10 client.14988 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:22:47.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.358+0000 7fbcf05b5740 10 client.14988 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.358+0000 7fbcf05b5740 20 client.14988 populate_metadata read hostname 'smithi063' 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.358+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55ce3805b610 0x55ce3805a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.358+0000 7fbcf05b5740 4 client.14988 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.358+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3970228304 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "status"}) -- 0x55ce37f3ab10 con 0x55ce3805b610 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.358+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55ce3805b610 0x55ce3805a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbce6ffd640 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55ce3805b610 0x55ce3805a320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72e790ed361b2b43 server_cookie=f2fbff29b06dc9df in_seq=0 out_seq=0 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcc6ffd640 10 client.14988 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcc6ffd640 1 -- 172.21.15.63:0/3970228304 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ce37f3ab10 con 0x55ce3805b610 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcc6ffd640 10 client.14988 handle_command_reply: tid=0 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 client.14988 shutdown 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3970228304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 msgr2=0x55ce37ff16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37ff16a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8006e10 tx=0x7fbcd8017810 comp rx=0 tx=0).stop 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3970228304 shutdown_connections 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55ce3805b610 0x55ce3805a320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce37fd7bb0 0x55ce38055240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcc6ffd640 0 client.14988 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce37fcd2f0 0x55ce37ff1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 --2- 172.21.15.63:0/3970228304 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ce37fcc9d0 0x55ce37ff16a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3970228304 >> 172.21.15.63:0/3970228304 conn(0x55ce37fc8f60 msgr2=0x55ce37fd4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3970228304 shutdown_connections 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 1 -- 172.21.15.63:0/3970228304 wait complete. 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.359+0000 7fbcf05b5740 20 client.14988 trim_cache size 0 max 16384 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "c42394ec-73c8-11ef-bceb-c7b262605968", 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 1, 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24460, 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 71.285445187999997, 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 24, 2024-09-16T01:22:47.382 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 84, 2024-09-16T01:22:47.382 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 84, 2024-09-16T01:22:47.382 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 98.196427077999999 2024-09-16T01:22:47.382 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:22:47.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2854430795 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbcd00a32d0 msgr2=0x7fbcd00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbcd00a32d0 0x7fbcd00a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbce0020000 tx=0x7fbce001f000 comp rx=0 tx=0).stop 2024-09-16T01:22:47.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2854430795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbce8102790 msgr2=0x7fbce8198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbce8102790 0x7fbce8198980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc005940 tx=0x7fbcdc004270 comp rx=0 tx=0).stop 2024-09-16T01:22:47.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2854430795 shutdown_connections 2024-09-16T01:22:47.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fbcd00a32d0 0x7fbcd00a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce8106f10 0x7fbce819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbce8102790 0x7fbce8198980 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 --2- 172.21.15.63:0/2854430795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce8101de0 0x7fbce8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2854430795 >> 172.21.15.63:0/2854430795 conn(0x7fbce80fd8c0 msgr2=0x7fbce80fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2854430795 shutdown_connections 2024-09-16T01:22:47.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:47.360+0000 7fbcee1dc640 1 -- 172.21.15.63:0/2854430795 wait complete. 2024-09-16T01:22:48.104 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-16T01:22:48.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:48 smithi063 ceph-mon[31070]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:48.367 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:48.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:48 smithi192 ceph-mon[34775]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:48.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:48 smithi162 ceph-mon[34539]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:48.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.821+0000 7f9e838c6640 1 -- 172.21.15.63:0/2427966658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c106f20 msgr2=0x7f9e7c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.821+0000 7f9e838c6640 1 --2- 172.21.15.63:0/2427966658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c106f20 0x7f9e7c10eaa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009ca0 tx=0x7f9e6c02a8c0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.821+0000 7f9e838c6640 1 -- 172.21.15.63:0/2427966658 shutdown_connections 2024-09-16T01:22:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.821+0000 7f9e838c6640 1 --2- 172.21.15.63:0/2427966658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c106f20 0x7f9e7c10eaa0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.821+0000 7f9e838c6640 1 --2- 172.21.15.63:0/2427966658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e7c1027a0 0x7f9e7c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.821+0000 7f9e838c6640 1 --2- 172.21.15.63:0/2427966658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7c101df0 0x7f9e7c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.821+0000 7f9e838c6640 1 -- 172.21.15.63:0/2427966658 >> 172.21.15.63:0/2427966658 conn(0x7f9e7c0fd8f0 msgr2=0x7f9e7c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.822+0000 7f9e838c6640 1 -- 172.21.15.63:0/2427966658 shutdown_connections 2024-09-16T01:22:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.822+0000 7f9e838c6640 1 -- 172.21.15.63:0/2427966658 wait complete. 2024-09-16T01:22:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.822+0000 7f9e838c6640 1 Processor -- start 2024-09-16T01:22:48.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.822+0000 7f9e838c6640 1 -- start start 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.822+0000 7f9e838c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7c101df0 0x7f9e7c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.822+0000 7f9e838c6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e7c1027a0 0x7f9e7c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.822+0000 7f9e838c6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c106f20 0x7f9e7c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.822+0000 7f9e838c6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c111ed0 con 0x7f9e7c106f20 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e838c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c111d50 con 0x7f9e7c101df0 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e838c6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c112050 con 0x7f9e7c1027a0 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81e63640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c106f20 0x7f9e7c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81e63640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c106f20 0x7f9e7c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42834/0 (socket says 172.21.15.63:42834) 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81e63640 1 -- 172.21.15.63:0/828235932 learned_addr learned my addr 172.21.15.63:0/828235932 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e80e61640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e7c1027a0 0x7f9e7c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81662640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7c101df0 0x7f9e7c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81e63640 1 -- 172.21.15.63:0/828235932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e7c1027a0 msgr2=0x7f9e7c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81e63640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e7c1027a0 0x7f9e7c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81e63640 1 -- 172.21.15.63:0/828235932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7c101df0 msgr2=0x7f9e7c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81e63640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7c101df0 0x7f9e7c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81e63640 1 -- 172.21.15.63:0/828235932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c19d3c0 con 0x7f9e7c106f20 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e80e61640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e7c1027a0 0x7f9e7c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81662640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7c101df0 0x7f9e7c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e81e63640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c106f20 0x7f9e7c19cce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009dc0 tx=0x7f9e6c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e7a7fc640 1 -- 172.21.15.63:0/828235932 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c004040 con 0x7f9e7c106f20 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e838c6640 1 -- 172.21.15.63:0/828235932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7c19d650 con 0x7f9e7c106f20 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e7a7fc640 1 -- 172.21.15.63:0/828235932 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e6c004690 con 0x7f9e7c106f20 2024-09-16T01:22:48.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e7a7fc640 1 -- 172.21.15.63:0/828235932 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c030d90 con 0x7f9e7c106f20 2024-09-16T01:22:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.823+0000 7f9e838c6640 1 -- 172.21.15.63:0/828235932 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7c1a4f90 con 0x7f9e7c106f20 2024-09-16T01:22:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.826+0000 7f9e7a7fc640 1 -- 172.21.15.63:0/828235932 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9e6c0305c0 con 0x7f9e7c106f20 2024-09-16T01:22:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.826+0000 7f9e85c9f740 1 Processor -- start 2024-09-16T01:22:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.826+0000 7f9e85c9f740 1 -- start start 2024-09-16T01:22:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.826+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef28c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.826+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef37a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.826+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef3a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.826+0000 7f9e7a7fc640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e640a32d0 0x7f9e640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.826+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ee8f090 con 0x55fa6ef291b0 2024-09-16T01:22:48.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.826+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ee36a70 con 0x55fa6ef28890 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.826+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ee8b050 con 0x55fa6ef37fc0 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e81662640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef37a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e80e61640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e640a32d0 0x7f9e640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e81662640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef37a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42842/0 (socket says 172.21.15.63:42842) 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e81662640 1 -- 172.21.15.63:0/992940672 learned_addr learned my addr 172.21.15.63:0/992940672 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e81e63640 1 --2- 172.21.15.63:0/992940672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef3a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e80e61640 1 --2- 172.21.15.63:0/992940672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef28c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e7a7fc640 1 -- 172.21.15.63:0/828235932 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f9e6c0f1420 con 0x7f9e7c106f20 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e81662640 1 -- 172.21.15.63:0/992940672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 msgr2=0x55fa6ef3a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e81662640 1 --2- 172.21.15.63:0/992940672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef3a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e81662640 1 -- 172.21.15.63:0/992940672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 msgr2=0x55fa6ef28c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e81662640 1 --2- 172.21.15.63:0/992940672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef28c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e81662640 1 -- 172.21.15.63:0/992940672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6ee43130 con 0x55fa6ef291b0 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e80e61640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e640a32d0 0x7f9e640a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000afd0 tx=0x7f9e7000a910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e81662640 1 --2- 172.21.15.63:0/992940672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef37a80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9e74007850 tx=0x7f9e74007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e12cc703018010 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e637fe640 1 -- 172.21.15.63:0/992940672 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7400d950 con 0x55fa6ef291b0 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e637fe640 1 -- 172.21.15.63:0/992940672 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e74018070 con 0x55fa6ef291b0 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.827+0000 7f9e637fe640 1 -- 172.21.15.63:0/992940672 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74013da0 con 0x55fa6ef291b0 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.828+0000 7f9e85c9f740 1 -- 172.21.15.63:0/992940672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 msgr2=0x55fa6ef37a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.828+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/992940672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef37a80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9e74007850 tx=0x7f9e74007d10 comp rx=0 tx=0).stop 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.828+0000 7f9e85c9f740 1 -- 172.21.15.63:0/992940672 shutdown_connections 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.828+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/992940672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef3a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.828+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/992940672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef37a80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.828+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/992940672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef28c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.828+0000 7f9e85c9f740 1 -- 172.21.15.63:0/992940672 >> 172.21.15.63:0/992940672 conn(0x55fa6ef24f60 msgr2=0x55fa6ef25340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.828+0000 7f9e85c9f740 1 -- 172.21.15.63:0/992940672 shutdown_connections 2024-09-16T01:22:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.828+0000 7f9e85c9f740 1 -- 172.21.15.63:0/992940672 wait complete. 2024-09-16T01:22:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e85c9f740 1 -- start start 2024-09-16T01:22:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e85c9f740 1 Processor -- start 2024-09-16T01:22:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef28890 0x55fa6ef37840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef34be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef35120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ef3ab90 con 0x55fa6ef291b0 2024-09-16T01:22:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ee49f20 con 0x55fa6ef37fc0 2024-09-16T01:22:48.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ef3ad10 con 0x55fa6ef28890 2024-09-16T01:22:48.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e85c9f740 10 client.0 _ll_register_callbacks cb 0x55fa6ee13030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:22:48.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e80e61640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef34be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e80e61640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef34be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42844/0 (socket says 172.21.15.63:42844) 2024-09-16T01:22:48.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e80e61640 1 -- 172.21.15.63:0/1832836228 learned_addr learned my addr 172.21.15.63:0/1832836228 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:48.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.829+0000 7f9e81e63640 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef35120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e81662640 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef28890 0x55fa6ef37840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e80e61640 1 -- 172.21.15.63:0/1832836228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef28890 msgr2=0x55fa6ef37840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:48.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e80e61640 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef28890 0x55fa6ef37840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e80e61640 1 -- 172.21.15.63:0/1832836228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef37fc0 msgr2=0x55fa6ef35120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e80e61640 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef35120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e80e61640 1 -- 172.21.15.63:0/1832836228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6ec002b0 con 0x55fa6ef291b0 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e80e61640 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef34be0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000abd0 tx=0x7f9e70006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c876251e67605b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e60ff9640 1 -- 172.21.15.63:0/1832836228 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70024020 con 0x55fa6ef291b0 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e85c9f740 1 -- 172.21.15.63:0/1832836228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e74018070 con 0x55fa6ef291b0 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e60ff9640 1 -- 172.21.15.63:0/1832836228 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f9e70018be0 con 0x55fa6ef291b0 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e60ff9640 1 -- 172.21.15.63:0/1832836228 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e7001c070 con 0x55fa6ef291b0 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e85c9f740 10 client.15000 fetch_fsmap learned FSMap version 24 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e85c9f740 1 -- 172.21.15.63:0/1832836228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fa6ef46570 con 0x55fa6ef291b0 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e60ff9640 1 -- 172.21.15.63:0/1832836228 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e74018070 con 0x55fa6ef291b0 2024-09-16T01:22:48.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e60ff9640 1 -- 172.21.15.63:0/1832836228 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e7001f070 con 0x55fa6ef291b0 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e85c9f740 10 client.15000 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e85c9f740 10 client.15000 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.830+0000 7f9e85c9f740 20 client.15000 populate_metadata read hostname 'smithi063' 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.831+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55fa6ef48be0 0x55fa6ef4a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.831+0000 7f9e85c9f740 4 client.15000 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.831+0000 7f9e85c9f740 1 -- 172.21.15.63:0/1832836228 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa6ee9c600 con 0x55fa6ef48be0 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.831+0000 7f9e81662640 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55fa6ef48be0 0x55fa6ef4a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.831+0000 7f9e60ff9640 10 client.15000 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.831+0000 7f9e81662640 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55fa6ef48be0 0x55fa6ef4a050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e21873f9deb745 server_cookie=325dceb28fe3ce0f in_seq=0 out_seq=0 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e60ff9640 1 -- 172.21.15.63:0/1832836228 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa6ee9c600 con 0x55fa6ef48be0 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e60ff9640 10 client.15000 handle_command_reply: tid=0 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 client.15000 shutdown 2024-09-16T01:22:48.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 -- 172.21.15.63:0/1832836228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 msgr2=0x55fa6ef34be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef34be0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000abd0 tx=0x7f9e70006f90 comp rx=0 tx=0).stop 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 -- 172.21.15.63:0/1832836228 shutdown_connections 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef35120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55fa6ef48be0 0x55fa6ef4a050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef34be0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/1832836228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef28890 0x55fa6ef37840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e60ff9640 0 client.15000 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 -- 172.21.15.63:0/1832836228 >> 172.21.15.63:0/1832836228 conn(0x55fa6ef24f60 msgr2=0x55fa6ef2acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 -- 172.21.15.63:0/1832836228 shutdown_connections 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 1 -- 172.21.15.63:0/1832836228 wait complete. 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.832+0000 7f9e85c9f740 20 client.15000 trim_cache size 0 max 16384 2024-09-16T01:22:48.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e85c9f740 1 Processor -- start 2024-09-16T01:22:48.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e85c9f740 1 -- start start 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef4a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef1fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef334b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ef48390 con 0x55fa6ef291b0 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ef48a60 con 0x55fa6ef28890 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ef49130 con 0x55fa6ef37fc0 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e80e61640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef1fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e80e61640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef1fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42852/0 (socket says 172.21.15.63:42852) 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e80e61640 1 -- 172.21.15.63:0/195700302 learned_addr learned my addr 172.21.15.63:0/195700302 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e80e61640 1 -- 172.21.15.63:0/195700302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 msgr2=0x55fa6ef334b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:48.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e80e61640 1 --2- 172.21.15.63:0/195700302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e80e61640 1 -- 172.21.15.63:0/195700302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 msgr2=0x55fa6ef4a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e80e61640 1 --2- 172.21.15.63:0/195700302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef4a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e80e61640 1 -- 172.21.15.63:0/195700302 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6ef28fe0 con 0x55fa6ef291b0 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.851+0000 7f9e80e61640 1 --2- 172.21.15.63:0/195700302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef1fce0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9e70000c00 tx=0x7f9e7000a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2058e874d8d4d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.852+0000 7f9e62ffd640 1 -- 172.21.15.63:0/195700302 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70039070 con 0x55fa6ef291b0 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.852+0000 7f9e62ffd640 1 -- 172.21.15.63:0/195700302 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e70018820 con 0x55fa6ef291b0 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.852+0000 7f9e62ffd640 1 -- 172.21.15.63:0/195700302 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70024070 con 0x55fa6ef291b0 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.852+0000 7f9e85c9f740 1 -- 172.21.15.63:0/195700302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 msgr2=0x55fa6ef1fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.852+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/195700302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef1fce0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9e70000c00 tx=0x7f9e7000a760 comp rx=0 tx=0).stop 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.852+0000 7f9e85c9f740 1 -- 172.21.15.63:0/195700302 shutdown_connections 2024-09-16T01:22:48.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.852+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/195700302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef334b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.852+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/195700302 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef1fce0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.852+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/195700302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef4a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.852+0000 7f9e85c9f740 1 -- 172.21.15.63:0/195700302 >> 172.21.15.63:0/195700302 conn(0x55fa6ef24f60 msgr2=0x55fa6ef25340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 1 -- 172.21.15.63:0/195700302 shutdown_connections 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 1 -- 172.21.15.63:0/195700302 wait complete. 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 1 -- start start 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 1 Processor -- start 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef31210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef31750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef51310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ef49ed0 con 0x55fa6ef291b0 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ef49800 con 0x55fa6ef28890 2024-09-16T01:22:48.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fa6ef4a5a0 con 0x55fa6ef37fc0 2024-09-16T01:22:48.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.853+0000 7f9e85c9f740 10 client.0 _ll_register_callbacks cb 0x7f9e7000ab20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:22:48.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e80e61640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef31750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e80e61640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef31750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42856/0 (socket says 172.21.15.63:42856) 2024-09-16T01:22:48.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e80e61640 1 -- 172.21.15.63:0/505012269 learned_addr learned my addr 172.21.15.63:0/505012269 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:48.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e81662640 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef31210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e81e63640 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef51310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e80e61640 1 -- 172.21.15.63:0/505012269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 msgr2=0x55fa6ef51310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:48.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e80e61640 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef51310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e80e61640 1 -- 172.21.15.63:0/505012269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 msgr2=0x55fa6ef31210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:48.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e80e61640 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef31210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e80e61640 1 -- 172.21.15.63:0/505012269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6ef51850 con 0x55fa6ef291b0 2024-09-16T01:22:48.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e81662640 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef31210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:48.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e80e61640 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef31750 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9e70015010 tx=0x7f9e70021970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff9e7b27fcea9bb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:48.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e60ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:22:48.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e60ff9640 1 -- 172.21.15.63:0/505012269 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70039030 con 0x55fa6ef291b0 2024-09-16T01:22:48.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e85c9f740 1 -- 172.21.15.63:0/505012269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e70018820 con 0x55fa6ef291b0 2024-09-16T01:22:48.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e60ff9640 1 -- 172.21.15.63:0/505012269 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f9e70021d70 con 0x55fa6ef291b0 2024-09-16T01:22:48.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e60ff9640 1 -- 172.21.15.63:0/505012269 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e70024070 con 0x55fa6ef291b0 2024-09-16T01:22:48.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e85c9f740 10 client.15006 fetch_fsmap learned FSMap version 24 2024-09-16T01:22:48.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.854+0000 7f9e85c9f740 1 -- 172.21.15.63:0/505012269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fa6ef52b50 con 0x55fa6ef291b0 2024-09-16T01:22:48.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.855+0000 7f9e60ff9640 1 -- 172.21.15.63:0/505012269 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9e70018820 con 0x55fa6ef291b0 2024-09-16T01:22:48.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.855+0000 7f9e60ff9640 1 -- 172.21.15.63:0/505012269 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e7001f040 con 0x55fa6ef291b0 2024-09-16T01:22:48.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.855+0000 7f9e85c9f740 10 client.15006 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:22:48.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.855+0000 7f9e85c9f740 10 client.15006 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:22:48.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.855+0000 7f9e85c9f740 20 client.15006 populate_metadata read hostname 'smithi063' 2024-09-16T01:22:48.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.855+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55fa6efb73c0 0x55fa6efb60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.855+0000 7f9e85c9f740 4 client.15006 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:22:48.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.855+0000 7f9e85c9f740 1 -- 172.21.15.63:0/505012269 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "status"}) -- 0x55fa6ee96b10 con 0x55fa6efb73c0 2024-09-16T01:22:48.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.855+0000 7f9e81662640 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55fa6efb73c0 0x55fa6efb60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e81662640 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55fa6efb73c0 0x55fa6efb60d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=885162f78d2d996a server_cookie=7b962d9112bc6793 in_seq=0 out_seq=0 2024-09-16T01:22:48.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e60ff9640 10 client.15006 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:22:48.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e60ff9640 1 -- 172.21.15.63:0/505012269 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fa6ee96b10 con 0x55fa6efb73c0 2024-09-16T01:22:48.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e60ff9640 10 client.15006 handle_command_reply: tid=0 2024-09-16T01:22:48.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 client.15006 shutdown 2024-09-16T01:22:48.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 -- 172.21.15.63:0/505012269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 msgr2=0x55fa6ef31750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef31750 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9e70015010 tx=0x7f9e70021970 comp rx=0 tx=0).stop 2024-09-16T01:22:48.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 -- 172.21.15.63:0/505012269 shutdown_connections 2024-09-16T01:22:48.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fa6ef37fc0 0x55fa6ef51310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55fa6efb73c0 0x55fa6efb60d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55fa6ef291b0 0x55fa6ef31750 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 --2- 172.21.15.63:0/505012269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fa6ef28890 0x55fa6ef31210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 -- 172.21.15.63:0/505012269 >> 172.21.15.63:0/505012269 conn(0x55fa6ef24f60 msgr2=0x55fa6ef1fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:48.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e60ff9640 0 client.15006 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:22:48.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 -- 172.21.15.63:0/505012269 shutdown_connections 2024-09-16T01:22:48.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 1 -- 172.21.15.63:0/505012269 wait complete. 2024-09-16T01:22:48.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.856+0000 7f9e85c9f740 20 client.15006 trim_cache size 0 max 16384 2024-09-16T01:22:48.878 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:22:48.878 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "c42394ec-73c8-11ef-bceb-c7b262605968", 2024-09-16T01:22:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-16T01:22:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24467, 2024-09-16T01:22:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-16T01:22:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-16T01:22:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-16T01:22:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 79.828510991000002, 2024-09-16T01:22:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 24, 2024-09-16T01:22:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 84, 2024-09-16T01:22:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 84, 2024-09-16T01:22:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 90.781653325999997 2024-09-16T01:22:48.880 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:22:48.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 -- 172.21.15.63:0/828235932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e640a32d0 msgr2=0x7f9e640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e640a32d0 0x7f9e640a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000afd0 tx=0x7f9e7000a910 comp rx=0 tx=0).stop 2024-09-16T01:22:48.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 -- 172.21.15.63:0/828235932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c106f20 msgr2=0x7f9e7c19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c106f20 0x7f9e7c19cce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009dc0 tx=0x7f9e6c003ba0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 -- 172.21.15.63:0/828235932 shutdown_connections 2024-09-16T01:22:48.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9e640a32d0 0x7f9e640a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e7c106f20 0x7f9e7c19cce0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e7c1027a0 0x7f9e7c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 --2- 172.21.15.63:0/828235932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7c101df0 0x7f9e7c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 -- 172.21.15.63:0/828235932 >> 172.21.15.63:0/828235932 conn(0x7f9e7c0fd8f0 msgr2=0x7f9e7c0fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:48.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 -- 172.21.15.63:0/828235932 shutdown_connections 2024-09-16T01:22:48.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:48.857+0000 7f9e838c6640 1 -- 172.21.15.63:0/828235932 wait complete. 2024-09-16T01:22:49.585 INFO:tasks.cephadm:Setup complete, yielding 2024-09-16T01:22:49.585 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T01:22:49.596 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi063.front.sepia.ceph.com 2024-09-16T01:22:49.596 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-16T01:22:49.853 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:50.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.384+0000 7fe081c5f640 1 -- 172.21.15.63:0/3551122324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07c1037d0 msgr2=0x7fe07c10a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.384+0000 7fe081c5f640 1 --2- 172.21.15.63:0/3551122324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07c1037d0 0x7fe07c10a060 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe074009ca0 tx=0x7fe07402a8c0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.384+0000 7fe081c5f640 1 -- 172.21.15.63:0/3551122324 shutdown_connections 2024-09-16T01:22:50.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.384+0000 7fe081c5f640 1 --2- 172.21.15.63:0/3551122324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07c1037d0 0x7fe07c10a060 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.384+0000 7fe081c5f640 1 --2- 172.21.15.63:0/3551122324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c102e10 0x7fe07c103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.384+0000 7fe081c5f640 1 --2- 172.21.15.63:0/3551122324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe07c101c10 0x7fe07c102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.384+0000 7fe081c5f640 1 -- 172.21.15.63:0/3551122324 >> 172.21.15.63:0/3551122324 conn(0x7fe07c0fd3c0 msgr2=0x7fe07c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.384+0000 7fe081c5f640 1 -- 172.21.15.63:0/3551122324 shutdown_connections 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.384+0000 7fe081c5f640 1 -- 172.21.15.63:0/3551122324 wait complete. 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.384+0000 7fe081c5f640 1 Processor -- start 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe081c5f640 1 -- start start 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe081c5f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07c101c10 0x7fe07c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe081c5f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe07c102e10 0x7fe07c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe081c5f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c1037d0 0x7fe07c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe081c5f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c10d720 con 0x7fe07c101c10 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe081c5f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c10d5a0 con 0x7fe07c102e10 2024-09-16T01:22:50.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe081c5f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c10d8a0 con 0x7fe07c1037d0 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07c101c10 0x7fe07c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07c101c10 0x7fe07c075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42872/0 (socket says 172.21.15.63:42872) 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07b7fe640 1 -- 172.21.15.63:0/3249527616 learned_addr learned my addr 172.21.15.63:0/3249527616 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07bfff640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c1037d0 0x7fe07c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07affd640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe07c102e10 0x7fe07c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07b7fe640 1 -- 172.21.15.63:0/3249527616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c1037d0 msgr2=0x7fe07c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07b7fe640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c1037d0 0x7fe07c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07b7fe640 1 -- 172.21.15.63:0/3249527616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe07c102e10 msgr2=0x7fe07c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07b7fe640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe07c102e10 0x7fe07c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07b7fe640 1 -- 172.21.15.63:0/3249527616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c0753e0 con 0x7fe07c101c10 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07bfff640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c1037d0 0x7fe07c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:50.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07affd640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe07c102e10 0x7fe07c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.385+0000 7fe07b7fe640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07c101c10 0x7fe07c075f90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00d770 tx=0x7fe06c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.386+0000 7fe078ff9640 1 -- 172.21.15.63:0/3249527616 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c017070 con 0x7fe07c101c10 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.386+0000 7fe078ff9640 1 -- 172.21.15.63:0/3249527616 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe06c009c30 con 0x7fe07c101c10 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.386+0000 7fe081c5f640 1 -- 172.21.15.63:0/3249527616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c1a1f30 con 0x7fe07c101c10 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.386+0000 7fe078ff9640 1 -- 172.21.15.63:0/3249527616 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c003d00 con 0x7fe07c101c10 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.386+0000 7fe081c5f640 1 -- 172.21.15.63:0/3249527616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c1a2320 con 0x7fe07c101c10 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.387+0000 7fe081c5f640 1 -- 172.21.15.63:0/3249527616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c109010 con 0x7fe07c101c10 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.388+0000 7fe078ff9640 1 -- 172.21.15.63:0/3249527616 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe06c003ea0 con 0x7fe07c101c10 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.389+0000 7fe078ff9640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0640a32d0 0x7fe0640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.389+0000 7fe07affd640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0640a32d0 0x7fe0640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.389+0000 7fe078ff9640 1 -- 172.21.15.63:0/3249527616 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe06c0cf850 con 0x7fe07c101c10 2024-09-16T01:22:50.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.389+0000 7fe07affd640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0640a32d0 0x7fe0640a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe07c075d10 tx=0x7fe070005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.393+0000 7fe078ff9640 1 -- 172.21.15.63:0/3249527616 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe06c09c410 con 0x7fe07c101c10 2024-09-16T01:22:50.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.584+0000 7fe081c5f640 1 -- 172.21.15.63:0/3249527616 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fe07c062630 con 0x7fe0640a32d0 2024-09-16T01:22:50.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:50 smithi063 ceph-mon[31070]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:50.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.585+0000 7fe078ff9640 1 -- 172.21.15.63:0/3249527616 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fe07c062630 con 0x7fe0640a32d0 2024-09-16T01:22:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:Backend: cephadm 2024-09-16T01:22:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:Available: Yes 2024-09-16T01:22:50.587 INFO:teuthology.orchestra.run.smithi063.stdout:Paused: No 2024-09-16T01:22:50.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 -- 172.21.15.63:0/3249527616 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0640a32d0 msgr2=0x7fe0640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0640a32d0 0x7fe0640a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe07c075d10 tx=0x7fe070005e50 comp rx=0 tx=0).stop 2024-09-16T01:22:50.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 -- 172.21.15.63:0/3249527616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07c101c10 msgr2=0x7fe07c075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07c101c10 0x7fe07c075f90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00d770 tx=0x7fe06c00dc30 comp rx=0 tx=0).stop 2024-09-16T01:22:50.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 -- 172.21.15.63:0/3249527616 shutdown_connections 2024-09-16T01:22:50.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0640a32d0 0x7fe0640a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c1037d0 0x7fe07c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe07c102e10 0x7fe07c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 --2- 172.21.15.63:0/3249527616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe07c101c10 0x7fe07c075f90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 -- 172.21.15.63:0/3249527616 >> 172.21.15.63:0/3249527616 conn(0x7fe07c0fd3c0 msgr2=0x7fe07c1061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:50.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 -- 172.21.15.63:0/3249527616 shutdown_connections 2024-09-16T01:22:50.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:50.588+0000 7fe081c5f640 1 -- 172.21.15.63:0/3249527616 wait complete. 2024-09-16T01:22:50.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:50 smithi192 ceph-mon[34775]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:50.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:50 smithi162 ceph-mon[34539]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:51.376 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-16T01:22:51.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:51 smithi063 ceph-mon[31070]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:51.638 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:51.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:51 smithi192 ceph-mon[34775]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:51.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:51 smithi162 ceph-mon[34539]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.105+0000 7f6a548ed640 1 -- 172.21.15.63:0/2627038329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50101d10 msgr2=0x7f6a50102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.105+0000 7f6a548ed640 1 --2- 172.21.15.63:0/2627038329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50101d10 0x7f6a50102190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009900 tx=0x7f6a3802a410 comp rx=0 tx=0).stop 2024-09-16T01:22:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.105+0000 7f6a548ed640 1 -- 172.21.15.63:0/2627038329 shutdown_connections 2024-09-16T01:22:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.105+0000 7f6a548ed640 1 --2- 172.21.15.63:0/2627038329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a501026d0 0x7f6a50108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.105+0000 7f6a548ed640 1 --2- 172.21.15.63:0/2627038329 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50101d10 0x7f6a50102190 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.105+0000 7f6a548ed640 1 --2- 172.21.15.63:0/2627038329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a50100b10 0x7f6a50100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.105+0000 7f6a548ed640 1 -- 172.21.15.63:0/2627038329 >> 172.21.15.63:0/2627038329 conn(0x7f6a500fc2a0 msgr2=0x7f6a500fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.105+0000 7f6a548ed640 1 -- 172.21.15.63:0/2627038329 shutdown_connections 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.105+0000 7f6a548ed640 1 -- 172.21.15.63:0/2627038329 wait complete. 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a548ed640 1 Processor -- start 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a548ed640 1 -- start start 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a548ed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50100b10 0x7f6a5006b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a548ed640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a50101d10 0x7f6a5019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a548ed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a501026d0 0x7f6a5019f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a548ed640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5010c6a0 con 0x7f6a50100b10 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a548ed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5010c520 con 0x7f6a501026d0 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a548ed640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5010c820 con 0x7f6a50101d10 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a4e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50100b10 0x7f6a5006b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a4e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50100b10 0x7f6a5006b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42894/0 (socket says 172.21.15.63:42894) 2024-09-16T01:22:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a4e59c640 1 -- 172.21.15.63:0/911117600 learned_addr learned my addr 172.21.15.63:0/911117600 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a47fff640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a50101d10 0x7f6a5019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a4ed9d640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a501026d0 0x7f6a5019f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a4e59c640 1 -- 172.21.15.63:0/911117600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a50101d10 msgr2=0x7f6a5019cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a4e59c640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a50101d10 0x7f6a5019cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a4e59c640 1 -- 172.21.15.63:0/911117600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a501026d0 msgr2=0x7f6a5019f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a4e59c640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a501026d0 0x7f6a5019f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a4e59c640 1 -- 172.21.15.63:0/911117600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5019fab0 con 0x7f6a50100b10 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.106+0000 7f6a4ed9d640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a501026d0 0x7f6a5019f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.107+0000 7f6a4e59c640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50100b10 0x7f6a5006b330 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000d770 tx=0x7f6a4000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.107+0000 7f6a477fe640 1 -- 172.21.15.63:0/911117600 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40017070 con 0x7f6a50100b10 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.107+0000 7f6a548ed640 1 -- 172.21.15.63:0/911117600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5019fda0 con 0x7f6a50100b10 2024-09-16T01:22:52.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.107+0000 7f6a477fe640 1 -- 172.21.15.63:0/911117600 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a40009c30 con 0x7f6a50100b10 2024-09-16T01:22:52.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.107+0000 7f6a477fe640 1 -- 172.21.15.63:0/911117600 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40003d00 con 0x7f6a50100b10 2024-09-16T01:22:52.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.107+0000 7f6a548ed640 1 -- 172.21.15.63:0/911117600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a501a0270 con 0x7f6a50100b10 2024-09-16T01:22:52.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.108+0000 7f6a548ed640 1 -- 172.21.15.63:0/911117600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a50107f50 con 0x7f6a50100b10 2024-09-16T01:22:52.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.109+0000 7f6a477fe640 1 -- 172.21.15.63:0/911117600 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6a40003ea0 con 0x7f6a50100b10 2024-09-16T01:22:52.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.110+0000 7f6a477fe640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6a3c0a32d0 0x7f6a3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:52.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.110+0000 7f6a47fff640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6a3c0a32d0 0x7f6a3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:52.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.110+0000 7f6a477fe640 1 -- 172.21.15.63:0/911117600 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6a400cf8a0 con 0x7f6a50100b10 2024-09-16T01:22:52.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.110+0000 7f6a47fff640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6a3c0a32d0 0x7f6a3c0a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6a5006b0b0 tx=0x7f6a380314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:52.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.114+0000 7f6a477fe640 1 -- 172.21.15.63:0/911117600 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a4009c460 con 0x7f6a50100b10 2024-09-16T01:22:52.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.299+0000 7f6a548ed640 1 -- 172.21.15.63:0/911117600 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6a50062630 con 0x7f6a3c0a32d0 2024-09-16T01:22:52.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.312+0000 7f6a477fe640 1 -- 172.21.15.63:0/911117600 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f6a50062630 con 0x7f6a3c0a32d0 2024-09-16T01:22:52.313 INFO:teuthology.orchestra.run.smithi063.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T01:22:52.313 INFO:teuthology.orchestra.run.smithi063.stdout:mds.a smithi063 running (97s) 17s ago 96s 13.6M - 19.1.1-326-g8921c8ef f1455bd0219c 48e95a2d2755 2024-09-16T01:22:52.313 INFO:teuthology.orchestra.run.smithi063.stdout:mds.b smithi162 running (94s) 27s ago 94s 26.4M - 19.1.1-326-g8921c8ef f1455bd0219c bb65176f48e6 2024-09-16T01:22:52.313 INFO:teuthology.orchestra.run.smithi063.stdout:mds.c smithi192 running (108s) 27s ago 108s 17.5M - 19.1.1-326-g8921c8ef f1455bd0219c 71abd1eea68b 2024-09-16T01:22:52.313 INFO:teuthology.orchestra.run.smithi063.stdout:mds.d smithi063 running (116s) 17s ago 116s 14.5M - 19.1.1-326-g8921c8ef f1455bd0219c 9af031d7390e 2024-09-16T01:22:52.313 INFO:teuthology.orchestra.run.smithi063.stdout:mds.e smithi162 running (113s) 27s ago 113s 19.1M - 19.1.1-326-g8921c8ef f1455bd0219c 086ea1b0f962 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mds.f smithi192 running (111s) 27s ago 110s 16.9M - 19.1.1-326-g8921c8ef f1455bd0219c 2b9e97fb37a8 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mds.g smithi063 running (100s) 17s ago 99s 13.6M - 19.1.1-326-g8921c8ef f1455bd0219c 5b68f36a4849 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mds.h smithi162 running (106s) 27s ago 105s 20.0M - 19.1.1-326-g8921c8ef f1455bd0219c 485d109b5814 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mds.i smithi192 running (103s) 27s ago 103s 18.3M - 19.1.1-326-g8921c8ef f1455bd0219c fbc85ec88b9c 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mds.j smithi063 running (2m) 17s ago 119s 16.0M - 19.1.1-326-g8921c8ef f1455bd0219c 39662097d50c 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mds.k smithi162 running (2m) 27s ago 2m 14.4M - 19.1.1-326-g8921c8ef f1455bd0219c a940b68fa605 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mds.l smithi192 running (2m) 27s ago 2m 14.5M - 19.1.1-326-g8921c8ef f1455bd0219c 408d776c38a2 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.x smithi063 *:9283,8765 running (8m) 17s ago 8m 509M - 19.1.1-326-g8921c8ef f1455bd0219c e4adc27e8257 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.y smithi162 *:8443,8765 running (7m) 27s ago 7m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 2e427d1d05f2 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mgr.z smithi192 *:8443,8765 running (7m) 27s ago 7m 443M - 19.1.1-326-g8921c8ef f1455bd0219c 0846615ad343 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mon.a smithi063 running (8m) 17s ago 9m 53.0M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e7f7588f4968 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mon.b smithi162 running (7m) 27s ago 7m 41.4M 2048M 19.1.1-326-g8921c8ef f1455bd0219c cead7c419158 2024-09-16T01:22:52.314 INFO:teuthology.orchestra.run.smithi063.stdout:mon.c smithi192 running (7m) 27s ago 7m 41.3M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 75f8e12764a2 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 smithi063 running (7m) 17s ago 7m 56.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 428b8e861014 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 smithi162 running (6m) 27s ago 6m 46.9M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 0ea3ae7f008f 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 smithi192 running (6m) 27s ago 6m 47.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 88fa0d109e72 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 smithi063 running (5m) 17s ago 5m 54.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 735979cd4a50 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 smithi162 running (5m) 27s ago 5m 45.5M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 6e0028ff1c8d 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 smithi192 running (4m) 27s ago 4m 43.9M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 1c5e6313dd28 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6 smithi063 running (4m) 17s ago 4m 53.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c a6877ee0ed90 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7 smithi162 running (4m) 27s ago 4m 44.0M 4272M 19.1.1-326-g8921c8ef f1455bd0219c c76ca93da3d2 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8 smithi192 running (3m) 27s ago 3m 42.2M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 15702c0cefc6 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9 smithi063 running (3m) 17s ago 3m 40.9M 4272M 19.1.1-326-g8921c8ef f1455bd0219c c19fea07869a 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10 smithi162 running (2m) 27s ago 2m 54.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c fb5d0268bb8f 2024-09-16T01:22:52.315 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11 smithi192 running (2m) 27s ago 2m 51.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c a94b0cef3c9e 2024-09-16T01:22:52.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 -- 172.21.15.63:0/911117600 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6a3c0a32d0 msgr2=0x7f6a3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6a3c0a32d0 0x7f6a3c0a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6a5006b0b0 tx=0x7f6a380314a0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 -- 172.21.15.63:0/911117600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50100b10 msgr2=0x7f6a5006b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50100b10 0x7f6a5006b330 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000d770 tx=0x7f6a4000dc30 comp rx=0 tx=0).stop 2024-09-16T01:22:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 -- 172.21.15.63:0/911117600 shutdown_connections 2024-09-16T01:22:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6a3c0a32d0 0x7f6a3c0a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a501026d0 0x7f6a5019f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a50101d10 0x7f6a5019cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 --2- 172.21.15.63:0/911117600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a50100b10 0x7f6a5006b330 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 -- 172.21.15.63:0/911117600 >> 172.21.15.63:0/911117600 conn(0x7f6a500fc2a0 msgr2=0x7f6a50105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 -- 172.21.15.63:0/911117600 shutdown_connections 2024-09-16T01:22:52.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:52.314+0000 7f6a548ed640 1 -- 172.21.15.63:0/911117600 wait complete. 2024-09-16T01:22:52.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:52 smithi063 ceph-mon[31070]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:52.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:52 smithi192 ceph-mon[34775]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:52.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:52 smithi162 ceph-mon[34539]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:53.262 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-16T01:22:53.526 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:53.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:53 smithi063 ceph-mon[31070]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:53.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:53 smithi192 ceph-mon[34775]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:53.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:53 smithi162 ceph-mon[34539]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.988+0000 7f0f7726a640 1 -- 172.21.15.63:0/3794505619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f70100b10 msgr2=0x7f0f70100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.988+0000 7f0f7726a640 1 --2- 172.21.15.63:0/3794505619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f70100b10 0x7f0f70100f10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009900 tx=0x7f0f6402a410 comp rx=0 tx=0).stop 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.988+0000 7f0f7726a640 1 -- 172.21.15.63:0/3794505619 shutdown_connections 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.988+0000 7f0f7726a640 1 --2- 172.21.15.63:0/3794505619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f701026d0 0x7f0f70108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.988+0000 7f0f7726a640 1 --2- 172.21.15.63:0/3794505619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f70101d10 0x7f0f70102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.988+0000 7f0f7726a640 1 --2- 172.21.15.63:0/3794505619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f70100b10 0x7f0f70100f10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.988+0000 7f0f7726a640 1 -- 172.21.15.63:0/3794505619 >> 172.21.15.63:0/3794505619 conn(0x7f0f700fc2a0 msgr2=0x7f0f700fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.988+0000 7f0f7726a640 1 -- 172.21.15.63:0/3794505619 shutdown_connections 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.988+0000 7f0f7726a640 1 -- 172.21.15.63:0/3794505619 wait complete. 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.988+0000 7f0f7726a640 1 Processor -- start 2024-09-16T01:22:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f7726a640 1 -- start start 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f7726a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f70100b10 0x7f0f70196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f7726a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f70101d10 0x7f0f701973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f7726a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f701026d0 0x7f0f7019e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f7726a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7010c720 con 0x7f0f701026d0 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f7726a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7010c5a0 con 0x7f0f70101d10 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f7726a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7010c8a0 con 0x7f0f70100b10 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f75807640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f701026d0 0x7f0f7019e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f75807640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f701026d0 0x7f0f7019e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42918/0 (socket says 172.21.15.63:42918) 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f75807640 1 -- 172.21.15.63:0/1081688485 learned_addr learned my addr 172.21.15.63:0/1081688485 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f75006640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f70100b10 0x7f0f70196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f74805640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f70101d10 0x7f0f701973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f75807640 1 -- 172.21.15.63:0/1081688485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f70100b10 msgr2=0x7f0f70196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f75807640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f70100b10 0x7f0f70196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f75807640 1 -- 172.21.15.63:0/1081688485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f70101d10 msgr2=0x7f0f701973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f75807640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f70101d10 0x7f0f701973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f75807640 1 -- 172.21.15.63:0/1081688485 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7019eae0 con 0x7f0f701026d0 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f75807640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f701026d0 0x7f0f7019e470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800b970 tx=0x7f0f6800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.989+0000 7f0f627fc640 1 -- 172.21.15.63:0/1081688485 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68019070 con 0x7f0f701026d0 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.990+0000 7f0f627fc640 1 -- 172.21.15.63:0/1081688485 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f68014440 con 0x7f0f701026d0 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.990+0000 7f0f7726a640 1 -- 172.21.15.63:0/1081688485 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7019edd0 con 0x7f0f701026d0 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.990+0000 7f0f627fc640 1 -- 172.21.15.63:0/1081688485 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f680075d0 con 0x7f0f701026d0 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.990+0000 7f0f7726a640 1 -- 172.21.15.63:0/1081688485 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7019f300 con 0x7f0f701026d0 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.991+0000 7f0f7726a640 1 -- 172.21.15.63:0/1081688485 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f70108040 con 0x7f0f701026d0 2024-09-16T01:22:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.992+0000 7f0f627fc640 1 -- 172.21.15.63:0/1081688485 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0f6801c070 con 0x7f0f701026d0 2024-09-16T01:22:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.992+0000 7f0f627fc640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0f5c0a3380 0x7f0f5c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.992+0000 7f0f75006640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0f5c0a3380 0x7f0f5c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.993+0000 7f0f627fc640 1 -- 172.21.15.63:0/1081688485 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0f680cef30 con 0x7f0f701026d0 2024-09-16T01:22:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.993+0000 7f0f75006640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0f5c0a3380 0x7f0f5c0a5840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f64000c00 tx=0x7f0f640314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:53.997+0000 7f0f627fc640 1 -- 172.21.15.63:0/1081688485 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f6809bc00 con 0x7f0f701026d0 2024-09-16T01:22:54.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.180+0000 7f0f7726a640 1 -- 172.21.15.63:0/1081688485 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0f70062630 con 0x7f0f5c0a3380 2024-09-16T01:22:54.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.186+0000 7f0f627fc640 1 -- 172.21.15.63:0/1081688485 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f0f70062630 con 0x7f0f5c0a3380 2024-09-16T01:22:54.187 INFO:teuthology.orchestra.run.smithi063.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-16T01:22:54.187 INFO:teuthology.orchestra.run.smithi063.stdout:mds.all 12/12 29s ago 2m smithi063=a;smithi063=d;smithi063=g;smithi063=j;smithi162=b;smithi162=e;smithi162=h;smithi162=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-16T01:22:54.187 INFO:teuthology.orchestra.run.smithi063.stdout:mgr 3/3 29s ago 7m smithi063=x;smithi162=y;smithi192=z;count:3 2024-09-16T01:22:54.187 INFO:teuthology.orchestra.run.smithi063.stdout:mon 3/3 29s ago 7m smithi063:172.21.15.63=a;smithi162:172.21.15.162=b;smithi192:172.21.15.192=c;count:3 2024-09-16T01:22:54.187 INFO:teuthology.orchestra.run.smithi063.stdout:osd 12 29s ago - 2024-09-16T01:22:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 -- 172.21.15.63:0/1081688485 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0f5c0a3380 msgr2=0x7f0f5c0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0f5c0a3380 0x7f0f5c0a5840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f64000c00 tx=0x7f0f640314a0 comp rx=0 tx=0).stop 2024-09-16T01:22:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 -- 172.21.15.63:0/1081688485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f701026d0 msgr2=0x7f0f7019e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f701026d0 0x7f0f7019e470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800b970 tx=0x7f0f6800be30 comp rx=0 tx=0).stop 2024-09-16T01:22:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 -- 172.21.15.63:0/1081688485 shutdown_connections 2024-09-16T01:22:54.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0f5c0a3380 0x7f0f5c0a5840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:54.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f701026d0 0x7f0f7019e470 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:54.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f70101d10 0x7f0f701973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:54.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 --2- 172.21.15.63:0/1081688485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f70100b10 0x7f0f70196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:54.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 -- 172.21.15.63:0/1081688485 >> 172.21.15.63:0/1081688485 conn(0x7f0f700fc2a0 msgr2=0x7f0f70105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:54.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 -- 172.21.15.63:0/1081688485 shutdown_connections 2024-09-16T01:22:54.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:54.188+0000 7f0f7726a640 1 -- 172.21.15.63:0/1081688485 wait complete. 2024-09-16T01:22:54.569 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:54 smithi063 ceph-mon[31070]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:54.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:54 smithi192 ceph-mon[34775]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:54.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:54 smithi162 ceph-mon[34539]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:22:54.914 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-16T01:22:55.178 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:55.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:55 smithi063 ceph-mon[31070]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:55.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.622+0000 7f3c720fd640 1 -- 172.21.15.63:0/957350257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c6c104f90 msgr2=0x7f3c6c107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.622+0000 7f3c720fd640 1 --2- 172.21.15.63:0/957350257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c6c104f90 0x7f3c6c107380 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009900 tx=0x7f3c5402a3f0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.622+0000 7f3c720fd640 1 -- 172.21.15.63:0/957350257 shutdown_connections 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.622+0000 7f3c720fd640 1 --2- 172.21.15.63:0/957350257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c6c1078c0 0x7f3c6c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.622+0000 7f3c720fd640 1 --2- 172.21.15.63:0/957350257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c6c104f90 0x7f3c6c107380 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.622+0000 7f3c720fd640 1 --2- 172.21.15.63:0/957350257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6c102660 0x7f3c6c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.622+0000 7f3c720fd640 1 -- 172.21.15.63:0/957350257 >> 172.21.15.63:0/957350257 conn(0x7f3c6c0fc280 msgr2=0x7f3c6c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.622+0000 7f3c720fd640 1 -- 172.21.15.63:0/957350257 shutdown_connections 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.622+0000 7f3c720fd640 1 -- 172.21.15.63:0/957350257 wait complete. 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.623+0000 7f3c720fd640 1 Processor -- start 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.623+0000 7f3c720fd640 1 -- start start 2024-09-16T01:22:55.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.623+0000 7f3c720fd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c6c102660 0x7f3c6c197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.623+0000 7f3c720fd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6c104f90 0x7f3c6c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.623+0000 7f3c720fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c6c1078c0 0x7f3c6c19f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.623+0000 7f3c720fd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c10d740 con 0x7f3c6c102660 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.623+0000 7f3c720fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c10d5c0 con 0x7f3c6c1078c0 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.623+0000 7f3c720fd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c10d8c0 con 0x7f3c6c104f90 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.623+0000 7f3c6b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c6c102660 0x7f3c6c197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c6c102660 0x7f3c6c197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42936/0 (socket says 172.21.15.63:42936) 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6b7fe640 1 -- 172.21.15.63:0/1751290868 learned_addr learned my addr 172.21.15.63:0/1751290868 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6bfff640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c6c1078c0 0x7f3c6c19f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6affd640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6c104f90 0x7f3c6c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:55.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6b7fe640 1 -- 172.21.15.63:0/1751290868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6c104f90 msgr2=0x7f3c6c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6b7fe640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6c104f90 0x7f3c6c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6b7fe640 1 -- 172.21.15.63:0/1751290868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c6c1078c0 msgr2=0x7f3c6c19f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6b7fe640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c6c1078c0 0x7f3c6c19f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6b7fe640 1 -- 172.21.15.63:0/1751290868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c19fa20 con 0x7f3c6c102660 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6bfff640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c6c1078c0 0x7f3c6c19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c6b7fe640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c6c102660 0x7f3c6c197df0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00eab0 tx=0x7f3c5c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c68ff9640 1 -- 172.21.15.63:0/1751290868 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c00ce40 con 0x7f3c6c102660 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c68ff9640 1 -- 172.21.15.63:0/1751290868 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3c5c011920 con 0x7f3c6c102660 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c720fd640 1 -- 172.21.15.63:0/1751290868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6c19fd10 con 0x7f3c6c102660 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c68ff9640 1 -- 172.21.15.63:0/1751290868 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c010a00 con 0x7f3c6c102660 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.624+0000 7f3c720fd640 1 -- 172.21.15.63:0/1751290868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6c1a0170 con 0x7f3c6c102660 2024-09-16T01:22:55.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.625+0000 7f3c720fd640 1 -- 172.21.15.63:0/1751290868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6c0fdd70 con 0x7f3c6c102660 2024-09-16T01:22:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.627+0000 7f3c68ff9640 1 -- 172.21.15.63:0/1751290868 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3c5c011ad0 con 0x7f3c6c102660 2024-09-16T01:22:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.628+0000 7f3c68ff9640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c580a3300 0x7f3c580a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.628+0000 7f3c6affd640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c580a3300 0x7f3c580a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.628+0000 7f3c68ff9640 1 -- 172.21.15.63:0/1751290868 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3c5c0d01b0 con 0x7f3c6c102660 2024-09-16T01:22:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.628+0000 7f3c6affd640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c580a3300 0x7f3c580a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3c54006010 tx=0x7f3c540314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:55.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.632+0000 7f3c68ff9640 1 -- 172.21.15.63:0/1751290868 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3c5c016030 con 0x7f3c6c102660 2024-09-16T01:22:55.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:55 smithi192 ceph-mon[34775]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:55.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:55 smithi162 ceph-mon[34539]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:55.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.812+0000 7f3c720fd640 1 -- 172.21.15.63:0/1751290868 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f3c6c062630 con 0x7f3c580a3300 2024-09-16T01:22:55.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.814+0000 7f3c68ff9640 1 -- 172.21.15.63:0/1751290868 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f3c6c062630 con 0x7f3c580a3300 2024-09-16T01:22:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:HOST ADDR LABELS STATUS 2024-09-16T01:22:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063 172.21.15.63 2024-09-16T01:22:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:smithi162 172.21.15.162 2024-09-16T01:22:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:smithi192 172.21.15.192 2024-09-16T01:22:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:3 hosts in cluster 2024-09-16T01:22:55.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 -- 172.21.15.63:0/1751290868 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c580a3300 msgr2=0x7f3c580a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:55.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c580a3300 0x7f3c580a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3c54006010 tx=0x7f3c540314a0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 -- 172.21.15.63:0/1751290868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c6c102660 msgr2=0x7f3c6c197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:55.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c6c102660 0x7f3c6c197df0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00eab0 tx=0x7f3c5c00ef70 comp rx=0 tx=0).stop 2024-09-16T01:22:55.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 -- 172.21.15.63:0/1751290868 shutdown_connections 2024-09-16T01:22:55.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3c580a3300 0x7f3c580a57c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c6c1078c0 0x7f3c6c19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c6c104f90 0x7f3c6c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 --2- 172.21.15.63:0/1751290868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c6c102660 0x7f3c6c197df0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:55.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 -- 172.21.15.63:0/1751290868 >> 172.21.15.63:0/1751290868 conn(0x7f3c6c0fc280 msgr2=0x7f3c6c102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:55.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 -- 172.21.15.63:0/1751290868 shutdown_connections 2024-09-16T01:22:55.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:55.816+0000 7f3c720fd640 1 -- 172.21.15.63:0/1751290868 wait complete. 2024-09-16T01:22:56.557 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:56 smithi063 ceph-mon[31070]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:56.558 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:56 smithi063 ceph-mon[31070]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:56.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-16T01:22:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:56 smithi192 ceph-mon[34775]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:56 smithi192 ceph-mon[34775]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:56.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:56 smithi162 ceph-mon[34539]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:22:56.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:56 smithi162 ceph-mon[34539]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:56.856 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.308+0000 7f8b76309640 1 -- 172.21.15.63:0/3097609721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b70102e00 msgr2=0x7f8b70103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.308+0000 7f8b76309640 1 --2- 172.21.15.63:0/3097609721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b70102e00 0x7f8b70103280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009900 tx=0x7f8b6402a410 comp rx=0 tx=0).stop 2024-09-16T01:22:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.308+0000 7f8b76309640 1 -- 172.21.15.63:0/3097609721 shutdown_connections 2024-09-16T01:22:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.308+0000 7f8b76309640 1 --2- 172.21.15.63:0/3097609721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b701037c0 0x7f8b7010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.308+0000 7f8b76309640 1 --2- 172.21.15.63:0/3097609721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b70102e00 0x7f8b70103280 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.308+0000 7f8b76309640 1 --2- 172.21.15.63:0/3097609721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b70101c00 0x7f8b70102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.308+0000 7f8b76309640 1 -- 172.21.15.63:0/3097609721 >> 172.21.15.63:0/3097609721 conn(0x7f8b700fd390 msgr2=0x7f8b700ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.308+0000 7f8b76309640 1 -- 172.21.15.63:0/3097609721 shutdown_connections 2024-09-16T01:22:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.308+0000 7f8b76309640 1 -- 172.21.15.63:0/3097609721 wait complete. 2024-09-16T01:22:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b76309640 1 Processor -- start 2024-09-16T01:22:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b76309640 1 -- start start 2024-09-16T01:22:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b76309640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b70101c00 0x7f8b70197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b76309640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b70102e00 0x7f8b70198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b76309640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b701037c0 0x7f8b7019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b76309640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7010d710 con 0x7f8b70101c00 2024-09-16T01:22:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b76309640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7010d590 con 0x7f8b70102e00 2024-09-16T01:22:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b76309640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7010d890 con 0x7f8b701037c0 2024-09-16T01:22:57.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b70101c00 0x7f8b70197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b70101c00 0x7f8b70197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42958/0 (socket says 172.21.15.63:42958) 2024-09-16T01:22:57.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b6ffff640 1 -- 172.21.15.63:0/77868374 learned_addr learned my addr 172.21.15.63:0/77868374 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:57.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.309+0000 7f8b6f7fe640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b70102e00 0x7f8b70198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b748a6640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b701037c0 0x7f8b7019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b6ffff640 1 -- 172.21.15.63:0/77868374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b701037c0 msgr2=0x7f8b7019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b6ffff640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b701037c0 0x7f8b7019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b6ffff640 1 -- 172.21.15.63:0/77868374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b70102e00 msgr2=0x7f8b70198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b6ffff640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b70102e00 0x7f8b70198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b6ffff640 1 -- 172.21.15.63:0/77868374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7019fa20 con 0x7f8b70101c00 2024-09-16T01:22:57.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b6ffff640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b70101c00 0x7f8b70197df0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000c970 tx=0x7f8b6000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:57.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b6d7fa640 1 -- 172.21.15.63:0/77868374 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60004220 con 0x7f8b70101c00 2024-09-16T01:22:57.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b6d7fa640 1 -- 172.21.15.63:0/77868374 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b600043c0 con 0x7f8b70101c00 2024-09-16T01:22:57.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b76309640 1 -- 172.21.15.63:0/77868374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7019fd10 con 0x7f8b70101c00 2024-09-16T01:22:57.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b6d7fa640 1 -- 172.21.15.63:0/77868374 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000f450 con 0x7f8b70101c00 2024-09-16T01:22:57.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.310+0000 7f8b76309640 1 -- 172.21.15.63:0/77868374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b701a0170 con 0x7f8b70101c00 2024-09-16T01:22:57.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.311+0000 7f8b76309640 1 -- 172.21.15.63:0/77868374 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b701090a0 con 0x7f8b70101c00 2024-09-16T01:22:57.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.312+0000 7f8b6d7fa640 1 -- 172.21.15.63:0/77868374 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8b600079b0 con 0x7f8b70101c00 2024-09-16T01:22:57.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.313+0000 7f8b6d7fa640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8b580a3300 0x7f8b580a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.314+0000 7f8b6f7fe640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8b580a3300 0x7f8b580a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.314+0000 7f8b6d7fa640 1 -- 172.21.15.63:0/77868374 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8b600cf830 con 0x7f8b70101c00 2024-09-16T01:22:57.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.314+0000 7f8b6f7fe640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8b580a3300 0x7f8b580a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8b64000c00 tx=0x7f8b64005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:57.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.318+0000 7f8b6d7fa640 1 -- 172.21.15.63:0/77868374 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b60014030 con 0x7f8b70101c00 2024-09-16T01:22:57.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.502+0000 7f8b76309640 1 -- 172.21.15.63:0/77868374 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f8b70062630 con 0x7f8b580a3300 2024-09-16T01:22:57.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.504+0000 7f8b6d7fa640 1 -- 172.21.15.63:0/77868374 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f8b70062630 con 0x7f8b580a3300 2024-09-16T01:22:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-16T01:22:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5344005B400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-16T01:22:57.505 INFO:teuthology.orchestra.run.smithi063.stdout:smithi162 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JU400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-16T01:22:57.506 INFO:teuthology.orchestra.run.smithi063.stdout:smithi192 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500NN400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.506+0000 7f8b76309640 1 -- 172.21.15.63:0/77868374 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8b580a3300 msgr2=0x7f8b580a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.506+0000 7f8b76309640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8b580a3300 0x7f8b580a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8b64000c00 tx=0x7f8b64005e40 comp rx=0 tx=0).stop 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.506+0000 7f8b76309640 1 -- 172.21.15.63:0/77868374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b70101c00 msgr2=0x7f8b70197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.506+0000 7f8b76309640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b70101c00 0x7f8b70197df0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000c970 tx=0x7f8b6000ce30 comp rx=0 tx=0).stop 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.507+0000 7f8b76309640 1 -- 172.21.15.63:0/77868374 shutdown_connections 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.507+0000 7f8b76309640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8b580a3300 0x7f8b580a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.507+0000 7f8b76309640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b701037c0 0x7f8b7019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.507+0000 7f8b76309640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b70102e00 0x7f8b70198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.507+0000 7f8b76309640 1 --2- 172.21.15.63:0/77868374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b70101c00 0x7f8b70197df0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.507+0000 7f8b76309640 1 -- 172.21.15.63:0/77868374 >> 172.21.15.63:0/77868374 conn(0x7f8b700fd390 msgr2=0x7f8b70106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:57.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.507+0000 7f8b76309640 1 -- 172.21.15.63:0/77868374 shutdown_connections 2024-09-16T01:22:57.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:57.507+0000 7f8b76309640 1 -- 172.21.15.63:0/77868374 wait complete. 2024-09-16T01:22:58.191 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T01:22:58.200 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi063.front.sepia.ceph.com 2024-09-16T01:22:58.200 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T01:22:58.458 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:22:58.579 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:58 smithi063 ceph-mon[31070]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:58.580 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:58 smithi063 ceph-mon[31070]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:58.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:58 smithi192 ceph-mon[34775]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:58.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:58 smithi192 ceph-mon[34775]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:58.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:58 smithi162 ceph-mon[34539]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:22:58.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:58 smithi162 ceph-mon[34539]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T01:22:58.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.906+0000 7f49303a0640 1 -- 172.21.15.63:0/2676741361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4928105070 msgr2=0x7f4928107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.906+0000 7f49303a0640 1 --2- 172.21.15.63:0/2676741361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4928105070 0x7f4928107460 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4918009900 tx=0x7f491802a410 comp rx=0 tx=0).stop 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.906+0000 7f49303a0640 1 -- 172.21.15.63:0/2676741361 shutdown_connections 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.906+0000 7f49303a0640 1 --2- 172.21.15.63:0/2676741361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49281079a0 0x7f4928109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.906+0000 7f49303a0640 1 --2- 172.21.15.63:0/2676741361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4928105070 0x7f4928107460 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.906+0000 7f49303a0640 1 --2- 172.21.15.63:0/2676741361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4928102740 0x7f4928104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.906+0000 7f49303a0640 1 -- 172.21.15.63:0/2676741361 >> 172.21.15.63:0/2676741361 conn(0x7f49280fc2a0 msgr2=0x7f49280fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.906+0000 7f49303a0640 1 -- 172.21.15.63:0/2676741361 shutdown_connections 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.906+0000 7f49303a0640 1 -- 172.21.15.63:0/2676741361 wait complete. 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.907+0000 7f49303a0640 1 Processor -- start 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.907+0000 7f49303a0640 1 -- start start 2024-09-16T01:22:58.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.907+0000 7f49303a0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4928102740 0x7f4928197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.907+0000 7f49303a0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4928105070 0x7f49281984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.907+0000 7f49303a0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49281079a0 0x7f492819f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.907+0000 7f49303a0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f492810d820 con 0x7f49281079a0 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.907+0000 7f49303a0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f492810d6a0 con 0x7f4928102740 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.907+0000 7f49303a0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f492810d9a0 con 0x7f4928105070 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e93d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49281079a0 0x7f492819f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e93d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49281079a0 0x7f492819f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59318/0 (socket says 172.21.15.63:59318) 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e93d640 1 -- 172.21.15.63:0/3100779307 learned_addr learned my addr 172.21.15.63:0/3100779307 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492d93b640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4928105070 0x7f49281984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e13c640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4928102740 0x7f4928197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:58.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e93d640 1 -- 172.21.15.63:0/3100779307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4928105070 msgr2=0x7f49281984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e93d640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4928105070 0x7f49281984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e93d640 1 -- 172.21.15.63:0/3100779307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4928102740 msgr2=0x7f4928197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e93d640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4928102740 0x7f4928197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e93d640 1 -- 172.21.15.63:0/3100779307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492819fbc0 con 0x7f49281079a0 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492d93b640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4928105070 0x7f49281984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e13c640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4928102740 0x7f4928197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f492e93d640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49281079a0 0x7f492819f550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f492000b970 tx=0x7f492000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f491f7fe640 1 -- 172.21.15.63:0/3100779307 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920019070 con 0x7f49281079a0 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f491f7fe640 1 -- 172.21.15.63:0/3100779307 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4920014440 con 0x7f49281079a0 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f49303a0640 1 -- 172.21.15.63:0/3100779307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492819feb0 con 0x7f49281079a0 2024-09-16T01:22:58.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f491f7fe640 1 -- 172.21.15.63:0/3100779307 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49200075d0 con 0x7f49281079a0 2024-09-16T01:22:58.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.908+0000 7f49303a0640 1 -- 172.21.15.63:0/3100779307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49281a03e0 con 0x7f49281079a0 2024-09-16T01:22:58.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.909+0000 7f49303a0640 1 -- 172.21.15.63:0/3100779307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49280fdd90 con 0x7f49281079a0 2024-09-16T01:22:58.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.910+0000 7f491f7fe640 1 -- 172.21.15.63:0/3100779307 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f492001c070 con 0x7f49281079a0 2024-09-16T01:22:58.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.911+0000 7f491f7fe640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f49140a3300 0x7f49140a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:58.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.911+0000 7f492e13c640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f49140a3300 0x7f49140a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:58.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.911+0000 7f491f7fe640 1 -- 172.21.15.63:0/3100779307 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f49200cef60 con 0x7f49281079a0 2024-09-16T01:22:58.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.912+0000 7f492e13c640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f49140a3300 0x7f49140a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4924006fd0 tx=0x7f4924008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:58.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:58.915+0000 7f491f7fe640 1 -- 172.21.15.63:0/3100779307 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f492009bc30 con 0x7f49281079a0 2024-09-16T01:22:59.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.126+0000 7f49303a0640 1 -- 172.21.15.63:0/3100779307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f492802d9c0 con 0x7f49281079a0 2024-09-16T01:22:59.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.126+0000 7f491f7fe640 1 -- 172.21.15.63:0/3100779307 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3085 (secure 0 0 0) 0x7f492009b530 con 0x7f49281079a0 2024-09-16T01:22:59.128 INFO:teuthology.orchestra.run.smithi063.stdout:e24 2024-09-16T01:22:59.128 INFO:teuthology.orchestra.run.smithi063.stdout:btime 2024-09-16T01:21:40:093564+0000 2024-09-16T01:22:59.128 INFO:teuthology.orchestra.run.smithi063.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T01:22:59.128 INFO:teuthology.orchestra.run.smithi063.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T01:22:59.128 INFO:teuthology.orchestra.run.smithi063.stdout:legacy client fscid: 1 2024-09-16T01:22:59.128 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:59.128 INFO:teuthology.orchestra.run.smithi063.stdout:Filesystem 'cephfs' (1) 2024-09-16T01:22:59.128 INFO:teuthology.orchestra.run.smithi063.stdout:fs_name cephfs 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 24 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-16T01:21:28.777744+0000 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2024-09-16T01:21:39.762667+0000 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:tableserver 0 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:root 0 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:session_timeout 300 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:session_autoclose 300 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:max_file_size 1099511627776 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:max_xattr_size 65536 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:required_client_features {} 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure 0 2024-09-16T01:22:59.129 INFO:teuthology.orchestra.run.smithi063.stdout:last_failure_osd_epoch 0 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:max_mds 3 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:in 0,1,2 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:up {0=24467,1=24460,2=24445} 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:failed 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:damaged 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:stopped 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:data_pools [3] 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:metadata_pool 2 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:inline_data disabled 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:balancer 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:bal_rank_mask -1 2024-09-16T01:22:59.130 INFO:teuthology.orchestra.run.smithi063.stdout:standby_count_wanted 0 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout:qdb_cluster leader: 24467 members: 24445,24460,24467 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b{0:24467} state up:active seq 4 addr [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.h{0:24443} state up:standby-replay seq 1 addr [v2:172.21.15.162:6836/1959030818,v1:172.21.15.162:6837/1959030818] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.i{1:24460} state up:active seq 8 addr [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.f{1:24439} state up:standby-replay seq 1 addr [v2:172.21.15.192:6834/383563245,v1:172.21.15.192:6835/383563245] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c{2:24445} state up:active seq 10 addr [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.e{2:24419} state up:standby-replay seq 1 addr [v2:172.21.15.162:6834/1954173887,v1:172.21.15.162:6835/1954173887] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout:Standby daemons: 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.63:6834/2088156309,v1:172.21.15.63:6835/2088156309] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.131 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d{-1:14541} state up:standby seq 1 addr [v2:172.21.15.63:6836/888614929,v1:172.21.15.63:6837/888614929] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.132 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.g{-1:14601} state up:standby seq 1 addr [v2:172.21.15.63:6838/37939833,v1:172.21.15.63:6839/37939833] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.132 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a{-1:14607} state up:standby seq 1 addr [v2:172.21.15.63:6840/1202342156,v1:172.21.15.63:6841/1202342156] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.132 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.k{-1:24395} state up:standby seq 1 addr [v2:172.21.15.162:6832/4134893055,v1:172.21.15.162:6833/4134893055] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.132 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.l{-1:24409} state up:standby seq 1 addr [v2:172.21.15.192:6832/3923088697,v1:172.21.15.192:6833/3923088697] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T01:22:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 24 2024-09-16T01:22:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.128+0000 7f49303a0640 1 -- 172.21.15.63:0/3100779307 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f49140a3300 msgr2=0x7f49140a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.128+0000 7f49303a0640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f49140a3300 0x7f49140a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4924006fd0 tx=0x7f4924008040 comp rx=0 tx=0).stop 2024-09-16T01:22:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.128+0000 7f49303a0640 1 -- 172.21.15.63:0/3100779307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49281079a0 msgr2=0x7f492819f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.128+0000 7f49303a0640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49281079a0 0x7f492819f550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f492000b970 tx=0x7f492000be30 comp rx=0 tx=0).stop 2024-09-16T01:22:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.128+0000 7f49303a0640 1 -- 172.21.15.63:0/3100779307 shutdown_connections 2024-09-16T01:22:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.128+0000 7f49303a0640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f49140a3300 0x7f49140a57c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.128+0000 7f49303a0640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f49281079a0 0x7f492819f550 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.128+0000 7f49303a0640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4928105070 0x7f49281984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.128+0000 7f49303a0640 1 --2- 172.21.15.63:0/3100779307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4928102740 0x7f4928197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:59.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.128+0000 7f49303a0640 1 -- 172.21.15.63:0/3100779307 >> 172.21.15.63:0/3100779307 conn(0x7f49280fc2a0 msgr2=0x7f4928103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:59.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.129+0000 7f49303a0640 1 -- 172.21.15.63:0/3100779307 shutdown_connections 2024-09-16T01:22:59.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:22:59.129+0000 7f49303a0640 1 -- 172.21.15.63:0/3100779307 wait complete. 2024-09-16T01:22:59.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:22:59 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3100779307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:22:59.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:22:59 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3100779307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:22:59.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:22:59 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3100779307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T01:22:59.859 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-16T01:23:00.117 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:00.506 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:00 smithi063 ceph-mon[31070]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:00.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.587+0000 7fb3eef87640 1 -- 172.21.15.63:0/3973941718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e8100b10 msgr2=0x7fb3e8100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.587+0000 7fb3eef87640 1 --2- 172.21.15.63:0/3973941718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e8100b10 0x7fb3e8100f10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009900 tx=0x7fb3dc02a410 comp rx=0 tx=0).stop 2024-09-16T01:23:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.587+0000 7fb3eef87640 1 -- 172.21.15.63:0/3973941718 shutdown_connections 2024-09-16T01:23:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.587+0000 7fb3eef87640 1 --2- 172.21.15.63:0/3973941718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3e81026d0 0x7fb3e8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.587+0000 7fb3eef87640 1 --2- 172.21.15.63:0/3973941718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e8101d10 0x7fb3e8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.587+0000 7fb3eef87640 1 --2- 172.21.15.63:0/3973941718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e8100b10 0x7fb3e8100f10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.587+0000 7fb3eef87640 1 -- 172.21.15.63:0/3973941718 >> 172.21.15.63:0/3973941718 conn(0x7fb3e80fc2a0 msgr2=0x7fb3e80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.587+0000 7fb3eef87640 1 -- 172.21.15.63:0/3973941718 shutdown_connections 2024-09-16T01:23:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.587+0000 7fb3eef87640 1 -- 172.21.15.63:0/3973941718 wait complete. 2024-09-16T01:23:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3eef87640 1 Processor -- start 2024-09-16T01:23:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3eef87640 1 -- start start 2024-09-16T01:23:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3eef87640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e8100b10 0x7fb3e8197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3eef87640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3e8101d10 0x7fb3e81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:00.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3eef87640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e81026d0 0x7fb3e819f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3eef87640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e810c640 con 0x7fb3e8100b10 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3eef87640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e810c4c0 con 0x7fb3e8101d10 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3eef87640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e810c7c0 con 0x7fb3e81026d0 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3ecd23640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e8100b10 0x7fb3e8197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3ecd23640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e8100b10 0x7fb3e8197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59332/0 (socket says 172.21.15.63:59332) 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3ecd23640 1 -- 172.21.15.63:0/1508528308 learned_addr learned my addr 172.21.15.63:0/1508528308 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3e7fff640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3e8101d10 0x7fb3e81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3ecd23640 1 -- 172.21.15.63:0/1508528308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e81026d0 msgr2=0x7fb3e819f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3ecd23640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e81026d0 0x7fb3e819f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3ecd23640 1 -- 172.21.15.63:0/1508528308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3e8101d10 msgr2=0x7fb3e81983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3ecd23640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3e8101d10 0x7fb3e81983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:00.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3ecd23640 1 -- 172.21.15.63:0/1508528308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e819faa0 con 0x7fb3e8100b10 2024-09-16T01:23:00.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.588+0000 7fb3e7fff640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3e8101d10 0x7fb3e81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:00.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.589+0000 7fb3ecd23640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e8100b10 0x7fb3e8197e70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0314e0 tx=0x7fb3dc0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:00.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.589+0000 7fb3e5ffb640 1 -- 172.21.15.63:0/1508528308 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc03f030 con 0x7fb3e8100b10 2024-09-16T01:23:00.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.589+0000 7fb3e5ffb640 1 -- 172.21.15.63:0/1508528308 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb3dc003cb0 con 0x7fb3e8100b10 2024-09-16T01:23:00.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.589+0000 7fb3eef87640 1 -- 172.21.15.63:0/1508528308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e819fd30 con 0x7fb3e8100b10 2024-09-16T01:23:00.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.589+0000 7fb3e5ffb640 1 -- 172.21.15.63:0/1508528308 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc035070 con 0x7fb3e8100b10 2024-09-16T01:23:00.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.589+0000 7fb3eef87640 1 -- 172.21.15.63:0/1508528308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e81a01b0 con 0x7fb3e8100b10 2024-09-16T01:23:00.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.590+0000 7fb3eef87640 1 -- 172.21.15.63:0/1508528308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e81a03e0 con 0x7fb3e8100b10 2024-09-16T01:23:00.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.591+0000 7fb3e5ffb640 1 -- 172.21.15.63:0/1508528308 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb3dc042030 con 0x7fb3e8100b10 2024-09-16T01:23:00.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.592+0000 7fb3e5ffb640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb3d80a3380 0x7fb3d80a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:00.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.592+0000 7fb3e7fff640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb3d80a3380 0x7fb3d80a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:00.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.592+0000 7fb3e5ffb640 1 -- 172.21.15.63:0/1508528308 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb3dc0f04f0 con 0x7fb3e8100b10 2024-09-16T01:23:00.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.593+0000 7fb3e7fff640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb3d80a3380 0x7fb3d80a5840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40058c0 tx=0x7fb3d4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:00.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.595+0000 7fb3e5ffb640 1 -- 172.21.15.63:0/1508528308 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3dc0bd1d0 con 0x7fb3e8100b10 2024-09-16T01:23:00.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:00 smithi192 ceph-mon[34775]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:00.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:00 smithi162 ceph-mon[34539]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:00.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.771+0000 7fb3eef87640 1 -- 172.21.15.63:0/1508528308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fb3e81a0770 con 0x7fb3e8100b10 2024-09-16T01:23:00.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.772+0000 7fb3e5ffb640 1 -- 172.21.15.63:0/1508528308 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5288 (secure 0 0 0) 0x7fb3dc0bcad0 con 0x7fb3e8100b10 2024-09-16T01:23:00.773 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 84 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:fsid c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-16T01:13:51.098958+0000 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2024-09-16T01:21:39.083854+0000 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:crush_version 26 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:full_ratio 0.95 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:backfillfull_ratio 0.9 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:nearfull_ratio 0.85 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:require_min_compat_client luminous 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:min_compat_client luminous 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:require_osd_release squid 2024-09-16T01:23:00.774 INFO:teuthology.orchestra.run.smithi063.stdout:stretch_mode_enabled false 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:max_osd 12 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 up in weight 1 up_from 8 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6802/2972213449,v1:172.21.15.63:6803/2972213449] [v2:172.21.15.63:6804/2972213449,v1:172.21.15.63:6805/2972213449] exists,up 39d7f320-babf-4ba5-86c8-9cd4c9ffa030 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6800/94832668,v1:172.21.15.162:6801/94832668] [v2:172.21.15.162:6802/94832668,v1:172.21.15.162:6803/94832668] exists,up 0a7a8f9d-2b87-41ec-8781-b2ece64566ba 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6800/166209023,v1:172.21.15.192:6801/166209023] [v2:172.21.15.192:6802/166209023,v1:172.21.15.192:6803/166209023] exists,up 073915c9-5d6f-40db-9720-fd0bd7e8522b 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6810/913316325,v1:172.21.15.63:6811/913316325] [v2:172.21.15.63:6812/913316325,v1:172.21.15.63:6813/913316325] exists,up d565129a-d24c-4262-a024-993dad3c27e3 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 up in weight 1 up_from 33 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6808/3400523772,v1:172.21.15.162:6809/3400523772] [v2:172.21.15.162:6810/3400523772,v1:172.21.15.162:6811/3400523772] exists,up 1b40f769-2023-43f4-a415-27ba2acf8624 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 up in weight 1 up_from 38 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6808/88086565,v1:172.21.15.192:6809/88086565] [v2:172.21.15.192:6810/88086565,v1:172.21.15.192:6811/88086565] exists,up cae53db9-bbae-4a94-8e71-843209fc8204 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6 up in weight 1 up_from 45 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6818/558859237,v1:172.21.15.63:6819/558859237] [v2:172.21.15.63:6820/558859237,v1:172.21.15.63:6821/558859237] exists,up 46244e9b-0619-42f1-8f8a-815f21ab4e98 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7 up in weight 1 up_from 50 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6816/4217268335,v1:172.21.15.162:6817/4217268335] [v2:172.21.15.162:6818/4217268335,v1:172.21.15.162:6819/4217268335] exists,up 1c588431-8c7a-4d8f-b02b-22e2adabc3d3 2024-09-16T01:23:00.775 INFO:teuthology.orchestra.run.smithi063.stdout:osd.8 up in weight 1 up_from 57 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6816/2030889502,v1:172.21.15.192:6817/2030889502] [v2:172.21.15.192:6818/2030889502,v1:172.21.15.192:6819/2030889502] exists,up 51d7f064-3b9d-4556-bc0d-1275eaef7ea0 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:osd.9 up in weight 1 up_from 64 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6826/2226037893,v1:172.21.15.63:6827/2226037893] [v2:172.21.15.63:6828/2226037893,v1:172.21.15.63:6829/2226037893] exists,up 85070701-b935-4fc2-9add-9c0bcd2896f9 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:osd.10 up in weight 1 up_from 69 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6824/3603743801,v1:172.21.15.162:6825/3603743801] [v2:172.21.15.162:6826/3603743801,v1:172.21.15.162:6827/3603743801] exists,up d7568686-adaf-46b9-8fc6-544ed2265715 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:osd.11 up in weight 1 up_from 76 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6824/508338152,v1:172.21.15.192:6825/508338152] [v2:172.21.15.192:6826/508338152,v1:172.21.15.192:6827/508338152] exists,up c7c12f12-3089-459f-a85d-17699c95a7f5 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 2.8 [2,11] 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 2.e [2,1] 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 2.1a [8,4] 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 2.1c [8,11] 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.0 [4,6] 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.2 [3,9] 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.10 [5,9] 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.1b [4,8] 2024-09-16T01:23:00.776 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.3c [4,9] 2024-09-16T01:23:00.777 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/3391259049 expires 2024-09-17T01:14:37.096309+0000 2024-09-16T01:23:00.777 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/2380375395 expires 2024-09-17T01:14:37.096309+0000 2024-09-16T01:23:00.777 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:6801/1469009490 expires 2024-09-17T01:14:37.096309+0000 2024-09-16T01:23:00.777 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/1539909966 expires 2024-09-17T01:14:37.096309+0000 2024-09-16T01:23:00.777 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/1391657104 expires 2024-09-17T01:14:12.995809+0000 2024-09-16T01:23:00.777 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:6801/843312492 expires 2024-09-17T01:14:12.995809+0000 2024-09-16T01:23:00.777 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:6800/843312492 expires 2024-09-17T01:14:12.995809+0000 2024-09-16T01:23:00.777 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:6800/1469009490 expires 2024-09-17T01:14:37.096309+0000 2024-09-16T01:23:00.777 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/3972146858 expires 2024-09-17T01:14:12.995809+0000 2024-09-16T01:23:00.777 INFO:teuthology.orchestra.run.smithi063.stdout:blocklist 172.21.15.63:0/1773373724 expires 2024-09-17T01:14:12.995809+0000 2024-09-16T01:23:00.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.774+0000 7fb3eef87640 1 -- 172.21.15.63:0/1508528308 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb3d80a3380 msgr2=0x7fb3d80a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:00.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.774+0000 7fb3eef87640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb3d80a3380 0x7fb3d80a5840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40058c0 tx=0x7fb3d4005850 comp rx=0 tx=0).stop 2024-09-16T01:23:00.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.774+0000 7fb3eef87640 1 -- 172.21.15.63:0/1508528308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e8100b10 msgr2=0x7fb3e8197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:00.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.774+0000 7fb3eef87640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e8100b10 0x7fb3e8197e70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0314e0 tx=0x7fb3dc0042e0 comp rx=0 tx=0).stop 2024-09-16T01:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.775+0000 7fb3eef87640 1 -- 172.21.15.63:0/1508528308 shutdown_connections 2024-09-16T01:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.775+0000 7fb3eef87640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb3d80a3380 0x7fb3d80a5840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.775+0000 7fb3eef87640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e81026d0 0x7fb3e819f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.775+0000 7fb3eef87640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3e8101d10 0x7fb3e81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.775+0000 7fb3eef87640 1 --2- 172.21.15.63:0/1508528308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e8100b10 0x7fb3e8197e70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.775+0000 7fb3eef87640 1 -- 172.21.15.63:0/1508528308 >> 172.21.15.63:0/1508528308 conn(0x7fb3e80fc2a0 msgr2=0x7fb3e806a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.775+0000 7fb3eef87640 1 -- 172.21.15.63:0/1508528308 shutdown_connections 2024-09-16T01:23:00.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:00.775+0000 7fb3eef87640 1 -- 172.21.15.63:0/1508528308 wait complete. 2024-09-16T01:23:01.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:01 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1508528308' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-16T01:23:01.621 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-16T01:23:01.634 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:23:01.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:01 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1508528308' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-16T01:23:01.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:01 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1508528308' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-16T01:23:01.897 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:02.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.383+0000 7fe5aa99f640 1 -- 172.21.15.63:0/38510276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5a4102bf0 msgr2=0x7fe5a4102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:02.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.383+0000 7fe5aa99f640 1 --2- 172.21.15.63:0/38510276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5a4102bf0 0x7fe5a4102fd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe598009900 tx=0x7fe59802a480 comp rx=0 tx=0).stop 2024-09-16T01:23:02.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.383+0000 7fe5aa99f640 1 -- 172.21.15.63:0/38510276 shutdown_connections 2024-09-16T01:23:02.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.383+0000 7fe5aa99f640 1 --2- 172.21.15.63:0/38510276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a410bfd0 0x7fe5a410e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.383+0000 7fe5aa99f640 1 --2- 172.21.15.63:0/38510276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5a4103510 0x7fe5a410ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.383+0000 7fe5aa99f640 1 --2- 172.21.15.63:0/38510276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5a4102bf0 0x7fe5a4102fd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.383+0000 7fe5aa99f640 1 -- 172.21.15.63:0/38510276 >> 172.21.15.63:0/38510276 conn(0x7fe5a40fc630 msgr2=0x7fe5a40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.383+0000 7fe5aa99f640 1 -- 172.21.15.63:0/38510276 shutdown_connections 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.383+0000 7fe5aa99f640 1 -- 172.21.15.63:0/38510276 wait complete. 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa99f640 1 Processor -- start 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa99f640 1 -- start start 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa99f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5a4102bf0 0x7fe5a4198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa99f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a4103510 0x7fe5a4198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa99f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5a410bfd0 0x7fe5a419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa99f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a4111c60 con 0x7fe5a410bfd0 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa99f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a4111ae0 con 0x7fe5a4102bf0 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa99f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a4111de0 con 0x7fe5a4103510 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa19e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5a410bfd0 0x7fe5a419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:02.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa19e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5a410bfd0 0x7fe5a419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59342/0 (socket says 172.21.15.63:59342) 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa19e640 1 -- 172.21.15.63:0/1206016135 learned_addr learned my addr 172.21.15.63:0/1206016135 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5a919c640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a4103510 0x7fe5a4198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5a999d640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5a4102bf0 0x7fe5a4198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa19e640 1 -- 172.21.15.63:0/1206016135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a4103510 msgr2=0x7fe5a4198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa19e640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a4103510 0x7fe5a4198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa19e640 1 -- 172.21.15.63:0/1206016135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5a4102bf0 msgr2=0x7fe5a4198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa19e640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5a4102bf0 0x7fe5a4198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.384+0000 7fe5aa19e640 1 -- 172.21.15.63:0/1206016135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a419d0d0 con 0x7fe5a410bfd0 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.385+0000 7fe5aa19e640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5a410bfd0 0x7fe5a419c9f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00eaa0 tx=0x7fe59c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.385+0000 7fe596ffd640 1 -- 172.21.15.63:0/1206016135 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c004d20 con 0x7fe5a410bfd0 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.385+0000 7fe596ffd640 1 -- 172.21.15.63:0/1206016135 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe59c005020 con 0x7fe5a410bfd0 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.385+0000 7fe5aa99f640 1 -- 172.21.15.63:0/1206016135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a419d3c0 con 0x7fe5a410bfd0 2024-09-16T01:23:02.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.385+0000 7fe596ffd640 1 -- 172.21.15.63:0/1206016135 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0116b0 con 0x7fe5a410bfd0 2024-09-16T01:23:02.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.385+0000 7fe5aa99f640 1 -- 172.21.15.63:0/1206016135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a41a4ca0 con 0x7fe5a410bfd0 2024-09-16T01:23:02.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.386+0000 7fe5aa99f640 1 -- 172.21.15.63:0/1206016135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a4102fd0 con 0x7fe5a410bfd0 2024-09-16T01:23:02.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.387+0000 7fe596ffd640 1 -- 172.21.15.63:0/1206016135 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe59c0051d0 con 0x7fe5a410bfd0 2024-09-16T01:23:02.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.388+0000 7fe596ffd640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe5900a32d0 0x7fe5900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:02.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.388+0000 7fe5a999d640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe5900a32d0 0x7fe5900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:02.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.388+0000 7fe596ffd640 1 -- 172.21.15.63:0/1206016135 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe59c0d0010 con 0x7fe5a410bfd0 2024-09-16T01:23:02.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.388+0000 7fe5a999d640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe5900a32d0 0x7fe5900a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe598031440 tx=0x7fe5980095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:02.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.391+0000 7fe596ffd640 1 -- 172.21.15.63:0/1206016135 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe59c016030 con 0x7fe5a410bfd0 2024-09-16T01:23:02.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.603+0000 7fe5aa99f640 1 -- 172.21.15.63:0/1206016135 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5a4199480 con 0x7fe5a410bfd0 2024-09-16T01:23:02.605 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:02 smithi063 ceph-mon[31070]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:02.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.604+0000 7fe596ffd640 1 -- 172.21.15.63:0/1206016135 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11909 (secure 0 0 0) 0x7fe5a4199480 con 0x7fe5a410bfd0 2024-09-16T01:23:02.605 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:23:02.606 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":24,"btime":"2024-09-16T01:21:40:093564+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:21:39.762667+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24445,24460,24467]},"id":1}]} 2024-09-16T01:23:02.606 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 24 2024-09-16T01:23:02.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 -- 172.21.15.63:0/1206016135 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe5900a32d0 msgr2=0x7fe5900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:02.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe5900a32d0 0x7fe5900a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe598031440 tx=0x7fe5980095f0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 -- 172.21.15.63:0/1206016135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5a410bfd0 msgr2=0x7fe5a419c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:02.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5a410bfd0 0x7fe5a419c9f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00eaa0 tx=0x7fe59c00eea0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 -- 172.21.15.63:0/1206016135 shutdown_connections 2024-09-16T01:23:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe5900a32d0 0x7fe5900a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5a410bfd0 0x7fe5a419c9f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a4103510 0x7fe5a4198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 --2- 172.21.15.63:0/1206016135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5a4102bf0 0x7fe5a4198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 -- 172.21.15.63:0/1206016135 >> 172.21.15.63:0/1206016135 conn(0x7fe5a40fc630 msgr2=0x7fe5a40fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 -- 172.21.15.63:0/1206016135 shutdown_connections 2024-09-16T01:23:02.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:02.606+0000 7fe5aa99f640 1 -- 172.21.15.63:0/1206016135 wait complete. 2024-09-16T01:23:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:02 smithi192 ceph-mon[34775]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:02.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:02 smithi162 ceph-mon[34539]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:03.456 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:23:03.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:03 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1206016135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:03.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:03 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1206016135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:03.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:03 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1206016135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:03.717 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:04.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.189+0000 7f4b48fde640 1 -- 172.21.15.63:0/440851946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b44102d30 msgr2=0x7f4b44103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.189+0000 7f4b48fde640 1 --2- 172.21.15.63:0/440851946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b44102d30 0x7f4b44103110 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009930 tx=0x7f4b3402a420 comp rx=0 tx=0).stop 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.189+0000 7f4b48fde640 1 -- 172.21.15.63:0/440851946 shutdown_connections 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.189+0000 7f4b48fde640 1 --2- 172.21.15.63:0/440851946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b441082a0 0x7f4b4410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.189+0000 7f4b48fde640 1 --2- 172.21.15.63:0/440851946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b441036e0 0x7f4b44107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.189+0000 7f4b48fde640 1 --2- 172.21.15.63:0/440851946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b44102d30 0x7f4b44103110 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.189+0000 7f4b48fde640 1 -- 172.21.15.63:0/440851946 >> 172.21.15.63:0/440851946 conn(0x7f4b440fc7d0 msgr2=0x7f4b440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.189+0000 7f4b48fde640 1 -- 172.21.15.63:0/440851946 shutdown_connections 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.189+0000 7f4b48fde640 1 -- 172.21.15.63:0/440851946 wait complete. 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b48fde640 1 Processor -- start 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b48fde640 1 -- start start 2024-09-16T01:23:04.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b48fde640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b44102d30 0x7f4b441984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b48fde640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b441036e0 0x7f4b441989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b48fde640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b441082a0 0x7f4b4419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b48fde640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4b44111fb0 con 0x7f4b44102d30 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b48fde640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b44111e30 con 0x7f4b441082a0 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b48fde640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4b44112130 con 0x7f4b441036e0 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b4259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b44102d30 0x7f4b441984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b4259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b44102d30 0x7f4b441984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59366/0 (socket says 172.21.15.63:59366) 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b4259c640 1 -- 172.21.15.63:0/1878550417 learned_addr learned my addr 172.21.15.63:0/1878550417 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b3bfff640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b441036e0 0x7f4b441989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b42d9d640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b441082a0 0x7f4b4419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b4259c640 1 -- 172.21.15.63:0/1878550417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b441036e0 msgr2=0x7f4b441989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b4259c640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b441036e0 0x7f4b441989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b4259c640 1 -- 172.21.15.63:0/1878550417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b441082a0 msgr2=0x7f4b4419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b4259c640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b441082a0 0x7f4b4419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b4259c640 1 -- 172.21.15.63:0/1878550417 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4419d460 con 0x7f4b44102d30 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.190+0000 7f4b42d9d640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b441082a0 0x7f4b4419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.191+0000 7f4b4259c640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b44102d30 0x7f4b441984b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4b34005940 tx=0x7f4b340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.191+0000 7f4b3b7fe640 1 -- 172.21.15.63:0/1878550417 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3403f030 con 0x7f4b44102d30 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.191+0000 7f4b3b7fe640 1 -- 172.21.15.63:0/1878550417 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4b34003cb0 con 0x7f4b44102d30 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.191+0000 7f4b48fde640 1 -- 172.21.15.63:0/1878550417 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4419d6f0 con 0x7f4b44102d30 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.191+0000 7f4b3b7fe640 1 -- 172.21.15.63:0/1878550417 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34035070 con 0x7f4b44102d30 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.191+0000 7f4b48fde640 1 -- 172.21.15.63:0/1878550417 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b441008c0 con 0x7f4b44102d30 2024-09-16T01:23:04.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.192+0000 7f4b48fde640 1 -- 172.21.15.63:0/1878550417 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b4406a850 con 0x7f4b44102d30 2024-09-16T01:23:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.193+0000 7f4b3b7fe640 1 -- 172.21.15.63:0/1878550417 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4b34042030 con 0x7f4b44102d30 2024-09-16T01:23:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.194+0000 7f4b3b7fe640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4b300a3350 0x7f4b300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.194+0000 7f4b3bfff640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4b300a3350 0x7f4b300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.194+0000 7f4b3b7fe640 1 -- 172.21.15.63:0/1878550417 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4b340f0020 con 0x7f4b44102d30 2024-09-16T01:23:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.194+0000 7f4b3bfff640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4b300a3350 0x7f4b300a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c005e10 tx=0x7f4b2c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:04.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.198+0000 7f4b3b7fe640 1 -- 172.21.15.63:0/1878550417 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b340bcbe0 con 0x7f4b44102d30 2024-09-16T01:23:04.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:04 smithi063 ceph-mon[31070]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:04.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.410+0000 7f4b48fde640 1 -- 172.21.15.63:0/1878550417 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b44199810 con 0x7f4b44102d30 2024-09-16T01:23:04.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.410+0000 7f4b3b7fe640 1 -- 172.21.15.63:0/1878550417 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11909 (secure 0 0 0) 0x7f4b340bc4e0 con 0x7f4b44102d30 2024-09-16T01:23:04.412 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:23:04.412 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":24,"btime":"2024-09-16T01:21:40:093564+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:21:39.762667+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24445,24460,24467]},"id":1}]} 2024-09-16T01:23:04.412 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 24 2024-09-16T01:23:04.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 -- 172.21.15.63:0/1878550417 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4b300a3350 msgr2=0x7f4b300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4b300a3350 0x7f4b300a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c005e10 tx=0x7f4b2c005da0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 -- 172.21.15.63:0/1878550417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b44102d30 msgr2=0x7f4b441984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b44102d30 0x7f4b441984b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4b34005940 tx=0x7f4b340042f0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 -- 172.21.15.63:0/1878550417 shutdown_connections 2024-09-16T01:23:04.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f4b300a3350 0x7f4b300a5810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b441082a0 0x7f4b4419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b441036e0 0x7f4b441989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 --2- 172.21.15.63:0/1878550417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b44102d30 0x7f4b441984b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 -- 172.21.15.63:0/1878550417 >> 172.21.15.63:0/1878550417 conn(0x7f4b440fc7d0 msgr2=0x7f4b44105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 -- 172.21.15.63:0/1878550417 shutdown_connections 2024-09-16T01:23:04.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:04.413+0000 7f4b48fde640 1 -- 172.21.15.63:0/1878550417 wait complete. 2024-09-16T01:23:04.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:04 smithi192 ceph-mon[34775]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:04.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:04 smithi162 ceph-mon[34539]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:05.305 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:23:05.568 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:05.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:05 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1878550417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:05.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:05 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1878550417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:05.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:05 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1878550417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:06.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.092+0000 7f7c93eca640 1 -- 172.21.15.63:0/680180818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c8c1027a0 msgr2=0x7f7c8c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.092+0000 7f7c93eca640 1 --2- 172.21.15.63:0/680180818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c8c1027a0 0x7f7c8c1067f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009900 tx=0x7f7c8002a440 comp rx=0 tx=0).stop 2024-09-16T01:23:06.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.092+0000 7f7c93eca640 1 -- 172.21.15.63:0/680180818 shutdown_connections 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.092+0000 7f7c93eca640 1 --2- 172.21.15.63:0/680180818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c106f20 0x7f7c8c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.092+0000 7f7c93eca640 1 --2- 172.21.15.63:0/680180818 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c8c1027a0 0x7f7c8c1067f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.092+0000 7f7c93eca640 1 --2- 172.21.15.63:0/680180818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8c101df0 0x7f7c8c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.092+0000 7f7c93eca640 1 -- 172.21.15.63:0/680180818 >> 172.21.15.63:0/680180818 conn(0x7f7c8c0fd8f0 msgr2=0x7f7c8c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.092+0000 7f7c93eca640 1 -- 172.21.15.63:0/680180818 shutdown_connections 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.092+0000 7f7c93eca640 1 -- 172.21.15.63:0/680180818 wait complete. 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c93eca640 1 Processor -- start 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c93eca640 1 -- start start 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c93eca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c8c101df0 0x7f7c8c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c93eca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c1027a0 0x7f7c8c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c93eca640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8c106f20 0x7f7c8c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c93eca640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c111f10 con 0x7f7c8c101df0 2024-09-16T01:23:06.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c93eca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c111d90 con 0x7f7c8c1027a0 2024-09-16T01:23:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c93eca640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c112090 con 0x7f7c8c106f20 2024-09-16T01:23:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c91c66640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c8c101df0 0x7f7c8c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c91c66640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c8c101df0 0x7f7c8c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59378/0 (socket says 172.21.15.63:59378) 2024-09-16T01:23:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c91c66640 1 -- 172.21.15.63:0/1866067284 learned_addr learned my addr 172.21.15.63:0/1866067284 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c92467640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8c106f20 0x7f7c8c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c91c66640 1 -- 172.21.15.63:0/1866067284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8c106f20 msgr2=0x7f7c8c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c91c66640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8c106f20 0x7f7c8c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c91c66640 1 -- 172.21.15.63:0/1866067284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c1027a0 msgr2=0x7f7c8c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c91c66640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c1027a0 0x7f7c8c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c91c66640 1 -- 172.21.15.63:0/1866067284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c19d4e0 con 0x7f7c8c101df0 2024-09-16T01:23:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.093+0000 7f7c91c66640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c8c101df0 0x7f7c8c198530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00ba50 tx=0x7f7c7c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.094+0000 7f7c8affd640 1 -- 172.21.15.63:0/1866067284 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c019070 con 0x7f7c8c101df0 2024-09-16T01:23:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.094+0000 7f7c8affd640 1 -- 172.21.15.63:0/1866067284 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7c7c00cc10 con 0x7f7c8c101df0 2024-09-16T01:23:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.094+0000 7f7c93eca640 1 -- 172.21.15.63:0/1866067284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8c19d7d0 con 0x7f7c8c101df0 2024-09-16T01:23:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.094+0000 7f7c8affd640 1 -- 172.21.15.63:0/1866067284 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c0075d0 con 0x7f7c8c101df0 2024-09-16T01:23:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.094+0000 7f7c93eca640 1 -- 172.21.15.63:0/1866067284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c8c1a50b0 con 0x7f7c8c101df0 2024-09-16T01:23:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.095+0000 7f7c93eca640 1 -- 172.21.15.63:0/1866067284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c8c102250 con 0x7f7c8c101df0 2024-09-16T01:23:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.096+0000 7f7c8affd640 1 -- 172.21.15.63:0/1866067284 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7c7c01c070 con 0x7f7c8c101df0 2024-09-16T01:23:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.097+0000 7f7c8affd640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c740a32d0 0x7f7c740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.097+0000 7f7c91465640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c740a32d0 0x7f7c740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.097+0000 7f7c8affd640 1 -- 172.21.15.63:0/1866067284 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7c7c0cf520 con 0x7f7c8c101df0 2024-09-16T01:23:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.098+0000 7f7c91465640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c740a32d0 0x7f7c740a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c800096c0 tx=0x7f7c80031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.100+0000 7f7c8affd640 1 -- 172.21.15.63:0/1866067284 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c7c09c1f0 con 0x7f7c8c101df0 2024-09-16T01:23:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.279+0000 7f7c93eca640 1 -- 172.21.15.63:0/1866067284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c8c199890 con 0x7f7c8c101df0 2024-09-16T01:23:06.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.281+0000 7f7c8affd640 1 -- 172.21.15.63:0/1866067284 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22710 (secure 0 0 0) 0x7f7c8c199890 con 0x7f7c8c101df0 2024-09-16T01:23:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:23:06.283 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:39.083854+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 -- 172.21.15.63:0/1866067284 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c740a32d0 msgr2=0x7f7c740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c740a32d0 0x7f7c740a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c800096c0 tx=0x7f7c80031400 comp rx=0 tx=0).stop 2024-09-16T01:23:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 -- 172.21.15.63:0/1866067284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c8c101df0 msgr2=0x7f7c8c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c8c101df0 0x7f7c8c198530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00ba50 tx=0x7f7c7c00bf10 comp rx=0 tx=0).stop 2024-09-16T01:23:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 -- 172.21.15.63:0/1866067284 shutdown_connections 2024-09-16T01:23:06.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f7c740a32d0 0x7f7c740a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c8c106f20 0x7f7c8c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c1027a0 0x7f7c8c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 --2- 172.21.15.63:0/1866067284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c8c101df0 0x7f7c8c198530 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 -- 172.21.15.63:0/1866067284 >> 172.21.15.63:0/1866067284 conn(0x7f7c8c0fd8f0 msgr2=0x7f7c8c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 -- 172.21.15.63:0/1866067284 shutdown_connections 2024-09-16T01:23:06.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:06.284+0000 7f7c93eca640 1 -- 172.21.15.63:0/1866067284 wait complete. 2024-09-16T01:23:06.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:06 smithi063 ceph-mon[31070]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:23:06.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:06 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1866067284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:23:06.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:06 smithi192 ceph-mon[34775]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:23:06.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:06 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1866067284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:23:06.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:06 smithi162 ceph-mon[34539]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:23:06.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:06 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1866067284' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:23:07.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-16T01:21:28.777744+0000', 'modified': '2024-09-16T01:21:39.762667+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24467, 'mds_1': 24460, 'mds_2': 24445}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24419': {'gid': 24419, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/1954173887', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 1954173887}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 1954173887}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6835/383563245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 383563245}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 383563245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6837/1959030818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 1959030818}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 1959030818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.192:6837/3521040095', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 3521040095}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 3521040095}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.192:6839/82939697', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 82939697}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 82939697}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.162:6839/2919019351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 2919019351}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 2919019351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24467, 'qdb_cluster': [24445, 24460, 24467]} 2024-09-16T01:23:07.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-16T01:23:07.063 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-16T01:23:07.352 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:07.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 -- 172.21.15.63:0/1469128684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc41410c170 msgr2=0x7fc41410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 --2- 172.21.15.63:0/1469128684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc41410c170 0x7fc41410e610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009900 tx=0x7fc40c02a480 comp rx=0 tx=0).stop 2024-09-16T01:23:07.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 -- 172.21.15.63:0/1469128684 shutdown_connections 2024-09-16T01:23:07.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 --2- 172.21.15.63:0/1469128684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc41410c170 0x7fc41410e610 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 --2- 172.21.15.63:0/1469128684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc414103660 0x7fc41410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 --2- 172.21.15.63:0/1469128684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc414102d40 0x7fc414103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 -- 172.21.15.63:0/1469128684 >> 172.21.15.63:0/1469128684 conn(0x7fc4140fc7a0 msgr2=0x7fc4140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 -- 172.21.15.63:0/1469128684 shutdown_connections 2024-09-16T01:23:07.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 -- 172.21.15.63:0/1469128684 wait complete. 2024-09-16T01:23:07.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 Processor -- start 2024-09-16T01:23:07.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.835+0000 7fc419a44640 1 -- start start 2024-09-16T01:23:07.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc419a44640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc414102d40 0x7fc41419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc419a44640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc414103660 0x7fc41419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc419a44640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc41410c170 0x7fc41419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc419a44640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc414101cf0 con 0x7fc414102d40 2024-09-16T01:23:07.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc419a44640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc414101b70 con 0x7fc41410c170 2024-09-16T01:23:07.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc419a44640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc414101e70 con 0x7fc414103660 2024-09-16T01:23:07.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc412ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc414102d40 0x7fc41419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc412ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc414102d40 0x7fc41419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59388/0 (socket says 172.21.15.63:59388) 2024-09-16T01:23:07.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc412ffd640 1 -- 172.21.15.63:0/1673650024 learned_addr learned my addr 172.21.15.63:0/1673650024 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:07.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc4137fe640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc41410c170 0x7fc41419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc4127fc640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc414103660 0x7fc41419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc412ffd640 1 -- 172.21.15.63:0/1673650024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc414103660 msgr2=0x7fc41419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc412ffd640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc414103660 0x7fc41419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc412ffd640 1 -- 172.21.15.63:0/1673650024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc41410c170 msgr2=0x7fc41419edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc412ffd640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc41410c170 0x7fc41419edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc412ffd640 1 -- 172.21.15.63:0/1673650024 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc41419f4a0 con 0x7fc414102d40 2024-09-16T01:23:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.836+0000 7fc412ffd640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc414102d40 0x7fc41419a4f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc40400ea80 tx=0x7fc40400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.837+0000 7fc418a42640 1 -- 172.21.15.63:0/1673650024 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40400ce40 con 0x7fc414102d40 2024-09-16T01:23:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.837+0000 7fc418a42640 1 -- 172.21.15.63:0/1673650024 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc404005020 con 0x7fc414102d40 2024-09-16T01:23:07.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.837+0000 7fc419a44640 1 -- 172.21.15.63:0/1673650024 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc41419f790 con 0x7fc414102d40 2024-09-16T01:23:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.837+0000 7fc418a42640 1 -- 172.21.15.63:0/1673650024 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4040116d0 con 0x7fc414102d40 2024-09-16T01:23:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.837+0000 7fc419a44640 1 -- 172.21.15.63:0/1673650024 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4141a7070 con 0x7fc414102d40 2024-09-16T01:23:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.839+0000 7fc418a42640 1 -- 172.21.15.63:0/1673650024 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc4040051d0 con 0x7fc414102d40 2024-09-16T01:23:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.839+0000 7fc41be1d740 1 Processor -- start 2024-09-16T01:23:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.839+0000 7fc41be1d740 1 -- start start 2024-09-16T01:23:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867089d0 0x55cd86708db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867092f0 0x55cd86713670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd86715fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc41be1d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cd8666f090 con 0x55cd86713bb0 2024-09-16T01:23:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc41be1d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cd86616a70 con 0x55cd867089d0 2024-09-16T01:23:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc41be1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cd8666b050 con 0x55cd867092f0 2024-09-16T01:23:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc418a42640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3fc0a32c0 0x7fc3fc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4127fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd86715fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4127fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd86715fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59392/0 (socket says 172.21.15.63:59392) 2024-09-16T01:23:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4127fc640 1 -- 172.21.15.63:0/641728084 learned_addr learned my addr 172.21.15.63:0/641728084 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4137fe640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3fc0a32c0 0x7fc3fc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc412ffd640 1 --2- 172.21.15.63:0/641728084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867092f0 0x55cd86713670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4137fe640 1 --2- 172.21.15.63:0/641728084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867089d0 0x55cd86708db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4127fc640 1 -- 172.21.15.63:0/641728084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867092f0 msgr2=0x55cd86713670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4127fc640 1 --2- 172.21.15.63:0/641728084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867092f0 0x55cd86713670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4127fc640 1 -- 172.21.15.63:0/641728084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867089d0 msgr2=0x55cd86708db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4127fc640 1 --2- 172.21.15.63:0/641728084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867089d0 0x55cd86708db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4127fc640 1 -- 172.21.15.63:0/641728084 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd86623130 con 0x55cd86713bb0 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc418a42640 1 -- 172.21.15.63:0/1673650024 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc4040cfaf0 con 0x7fc414102d40 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4127fc640 1 --2- 172.21.15.63:0/641728084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd86715fa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc40800bc20 tx=0x7fc4080107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610abf0e0ce10fd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc4137fe640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3fc0a32c0 0x7fc3fc0a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc40c006010 tx=0x7fc40c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.840+0000 7fc3f9ffb640 1 -- 172.21.15.63:0/641728084 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40801c480 con 0x55cd86713bb0 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc3f9ffb640 1 -- 172.21.15.63:0/641728084 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc40801cad0 con 0x55cd86713bb0 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc3f9ffb640 1 -- 172.21.15.63:0/641728084 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408011af0 con 0x55cd86713bb0 2024-09-16T01:23:07.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc41be1d740 1 -- 172.21.15.63:0/641728084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 msgr2=0x55cd86715fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc41be1d740 1 --2- 172.21.15.63:0/641728084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd86715fa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc40800bc20 tx=0x7fc4080107a0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc41be1d740 1 -- 172.21.15.63:0/641728084 shutdown_connections 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc41be1d740 1 --2- 172.21.15.63:0/641728084 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd86715fa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc41be1d740 1 --2- 172.21.15.63:0/641728084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867092f0 0x55cd86713670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc41be1d740 1 --2- 172.21.15.63:0/641728084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867089d0 0x55cd86708db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc41be1d740 1 -- 172.21.15.63:0/641728084 >> 172.21.15.63:0/641728084 conn(0x55cd86704f60 msgr2=0x55cd86705340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc41be1d740 1 -- 172.21.15.63:0/641728084 shutdown_connections 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.841+0000 7fc41be1d740 1 -- 172.21.15.63:0/641728084 wait complete. 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc41be1d740 1 -- start start 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc41be1d740 1 Processor -- start 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd867134c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867092f0 0x55cd86710810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd86713bb0 0x55cd86710d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc41be1d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cd86716780 con 0x55cd867089d0 2024-09-16T01:23:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc41be1d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cd86629f20 con 0x55cd86713bb0 2024-09-16T01:23:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc41be1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cd86716900 con 0x55cd867092f0 2024-09-16T01:23:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc41be1d740 10 client.0 _ll_register_callbacks cb 0x55cd865f3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc412ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd867134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc412ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd867134c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59396/0 (socket says 172.21.15.63:59396) 2024-09-16T01:23:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc412ffd640 1 -- 172.21.15.63:0/4020032377 learned_addr learned my addr 172.21.15.63:0/4020032377 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:07.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc4127fc640 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867092f0 0x55cd86710810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.842+0000 7fc4137fe640 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd86713bb0 0x55cd86710d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc412ffd640 1 -- 172.21.15.63:0/4020032377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867092f0 msgr2=0x55cd86710810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc412ffd640 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867092f0 0x55cd86710810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc412ffd640 1 -- 172.21.15.63:0/4020032377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd86713bb0 msgr2=0x55cd86710d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc412ffd640 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd86713bb0 0x55cd86710d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc412ffd640 1 -- 172.21.15.63:0/4020032377 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd863e02b0 con 0x55cd867089d0 2024-09-16T01:23:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc412ffd640 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd867134c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc4040cd5b0 tx=0x7fc40406aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f72e9efe524707 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc3f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/4020032377 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40406be60 con 0x55cd867089d0 2024-09-16T01:23:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/4020032377 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc4040bc070 con 0x55cd867089d0 2024-09-16T01:23:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc41be1d740 1 -- 172.21.15.63:0/4020032377 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc40801cad0 con 0x55cd867089d0 2024-09-16T01:23:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/4020032377 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc404069020 con 0x55cd867089d0 2024-09-16T01:23:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc41be1d740 10 client.15078 fetch_fsmap learned FSMap version 24 2024-09-16T01:23:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc41be1d740 1 -- 172.21.15.63:0/4020032377 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cd86722100 con 0x55cd867089d0 2024-09-16T01:23:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.843+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/4020032377 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc40801cad0 con 0x55cd867089d0 2024-09-16T01:23:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.844+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/4020032377 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc40400f040 con 0x55cd867089d0 2024-09-16T01:23:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.844+0000 7fc41be1d740 10 client.15078 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.844+0000 7fc41be1d740 10 client.15078 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.844+0000 7fc41be1d740 20 client.15078 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.844+0000 7fc41be1d740 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55cd867246b0 0x55cd86725b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.844+0000 7fc41be1d740 4 client.15078 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.844+0000 7fc41be1d740 1 -- 172.21.15.63:0/4020032377 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd8667c600 con 0x55cd867246b0 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.844+0000 7fc4127fc640 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55cd867246b0 0x55cd86725b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.844+0000 7fc4127fc640 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55cd867246b0 0x55cd86725b20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=94bbde0a20efb0ff server_cookie=434c3a0b75bdf574 in_seq=0 out_seq=0 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.844+0000 7fc3f2ffd640 10 client.15078 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/4020032377 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd8667c600 con 0x55cd867246b0 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc3f2ffd640 10 client.15078 handle_command_reply: tid=0 2024-09-16T01:23:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc41be1d740 1 client.15078 shutdown 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc41be1d740 1 -- 172.21.15.63:0/4020032377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 msgr2=0x55cd867134c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc41be1d740 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd867134c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc4040cd5b0 tx=0x7fc40406aec0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc41be1d740 1 -- 172.21.15.63:0/4020032377 shutdown_connections 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc41be1d740 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55cd867246b0 0x55cd86725b20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc41be1d740 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd86713bb0 0x55cd86710d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc41be1d740 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867092f0 0x55cd86710810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc3f2ffd640 0 client.15078 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc41be1d740 1 --2- 172.21.15.63:0/4020032377 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd867134c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.845+0000 7fc41be1d740 1 -- 172.21.15.63:0/4020032377 >> 172.21.15.63:0/4020032377 conn(0x55cd86704f60 msgr2=0x55cd8670ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.846+0000 7fc41be1d740 1 -- 172.21.15.63:0/4020032377 shutdown_connections 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.846+0000 7fc41be1d740 1 -- 172.21.15.63:0/4020032377 wait complete. 2024-09-16T01:23:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.846+0000 7fc41be1d740 20 client.15078 trim_cache size 0 max 16384 2024-09-16T01:23:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.863+0000 7fc41be1d740 1 Processor -- start 2024-09-16T01:23:07.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.863+0000 7fc41be1d740 1 -- start start 2024-09-16T01:23:07.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867089d0 0x55cd86710110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867092f0 0x55cd8672de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd8672e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc41be1d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cd86723e60 con 0x55cd86713bb0 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc41be1d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cd86724530 con 0x55cd867092f0 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc41be1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cd86724c00 con 0x55cd867089d0 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc4137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd8672e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc4137fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd8672e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59406/0 (socket says 172.21.15.63:59406) 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc4137fe640 1 -- 172.21.15.63:0/313300131 learned_addr learned my addr 172.21.15.63:0/313300131 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc4127fc640 1 --2- 172.21.15.63:0/313300131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867092f0 0x55cd8672de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc412ffd640 1 --2- 172.21.15.63:0/313300131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867089d0 0x55cd86710110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc4137fe640 1 -- 172.21.15.63:0/313300131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867089d0 msgr2=0x55cd86710110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc4137fe640 1 --2- 172.21.15.63:0/313300131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867089d0 0x55cd86710110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc4137fe640 1 -- 172.21.15.63:0/313300131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867092f0 msgr2=0x55cd8672de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc4137fe640 1 --2- 172.21.15.63:0/313300131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867092f0 0x55cd8672de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc4137fe640 1 -- 172.21.15.63:0/313300131 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd86713830 con 0x55cd86713bb0 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc412ffd640 1 --2- 172.21.15.63:0/313300131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867089d0 0x55cd86710110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc4137fe640 1 --2- 172.21.15.63:0/313300131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd8672e340 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009900 tx=0x7fc40c03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b59c4e357cb8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.864+0000 7fc3f97fa640 1 -- 172.21.15.63:0/313300131 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c04f070 con 0x55cd86713bb0 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc3f97fa640 1 -- 172.21.15.63:0/313300131 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc40c004440 con 0x55cd86713bb0 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc3f97fa640 1 -- 172.21.15.63:0/313300131 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40c045040 con 0x55cd86713bb0 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc41be1d740 1 -- 172.21.15.63:0/313300131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 msgr2=0x55cd8672e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc41be1d740 1 --2- 172.21.15.63:0/313300131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd8672e340 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009900 tx=0x7fc40c03c000 comp rx=0 tx=0).stop 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc41be1d740 1 -- 172.21.15.63:0/313300131 shutdown_connections 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc41be1d740 1 --2- 172.21.15.63:0/313300131 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd86713bb0 0x55cd8672e340 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc41be1d740 1 --2- 172.21.15.63:0/313300131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867092f0 0x55cd8672de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc41be1d740 1 --2- 172.21.15.63:0/313300131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd867089d0 0x55cd86710110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc41be1d740 1 -- 172.21.15.63:0/313300131 >> 172.21.15.63:0/313300131 conn(0x55cd86704f60 msgr2=0x55cd867107d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc41be1d740 1 -- 172.21.15.63:0/313300131 shutdown_connections 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.865+0000 7fc41be1d740 1 -- 172.21.15.63:0/313300131 wait complete. 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc41be1d740 1 -- start start 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc41be1d740 1 Processor -- start 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd86728e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867092f0 0x55cd86729370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc41be1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd86713bb0 0x55cd867298f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc41be1d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cd867259a0 con 0x55cd867089d0 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc41be1d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cd867252d0 con 0x55cd867092f0 2024-09-16T01:23:07.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc41be1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cd86726070 con 0x55cd86713bb0 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc41be1d740 10 client.0 _ll_register_callbacks cb 0x7fc40407f040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc412ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd86728e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc412ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd86728e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59422/0 (socket says 172.21.15.63:59422) 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc412ffd640 1 -- 172.21.15.63:0/1872493849 learned_addr learned my addr 172.21.15.63:0/1872493849 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc4127fc640 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867092f0 0x55cd86729370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.866+0000 7fc4137fe640 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd86713bb0 0x55cd867298f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc412ffd640 1 -- 172.21.15.63:0/1872493849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd86713bb0 msgr2=0x55cd867298f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc412ffd640 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd86713bb0 0x55cd867298f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc412ffd640 1 -- 172.21.15.63:0/1872493849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867092f0 msgr2=0x55cd86729370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc412ffd640 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867092f0 0x55cd86729370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc412ffd640 1 -- 172.21.15.63:0/1872493849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd8678d0a0 con 0x55cd867089d0 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc4137fe640 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd86713bb0 0x55cd867298f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc412ffd640 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd86728e30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc40400efd0 tx=0x7fc404005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e65d674262f6513 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc3f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/1872493849 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40401f040 con 0x55cd867089d0 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/1872493849 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc40409b5d0 con 0x55cd867089d0 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc41be1d740 1 -- 172.21.15.63:0/1872493849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc40c004440 con 0x55cd867089d0 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/1872493849 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc40409bf50 con 0x55cd867089d0 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc41be1d740 10 client.15084 fetch_fsmap learned FSMap version 24 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc41be1d740 1 -- 172.21.15.63:0/1872493849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cd8678e310 con 0x55cd867089d0 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/1872493849 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc40c004440 con 0x55cd867089d0 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/1872493849 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc4040a1610 con 0x55cd867089d0 2024-09-16T01:23:07.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc41be1d740 10 client.15084 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:23:07.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc41be1d740 10 client.15084 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:23:07.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.867+0000 7fc41be1d740 20 client.15084 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:07.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.868+0000 7fc41be1d740 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55cd867246b0 0x55cd86791c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.868+0000 7fc41be1d740 4 client.15084 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:23:07.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.868+0000 7fc41be1d740 1 -- 172.21.15.63:0/1872493849 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "status"}) -- 0x55cd86676b10 con 0x55cd867246b0 2024-09-16T01:23:07.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.868+0000 7fc4127fc640 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55cd867246b0 0x55cd86791c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.868+0000 7fc3f2ffd640 10 client.15084 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.868+0000 7fc4127fc640 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55cd867246b0 0x55cd86791c10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d99c5233e57175 server_cookie=51e84d718ccb20d in_seq=0 out_seq=0 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.868+0000 7fc3f2ffd640 1 -- 172.21.15.63:0/1872493849 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55cd86676b10 con 0x55cd867246b0 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.868+0000 7fc3f2ffd640 10 client.15084 handle_command_reply: tid=0 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.868+0000 7fc41be1d740 1 client.15084 shutdown 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 1 -- 172.21.15.63:0/1872493849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 msgr2=0x55cd86728e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd86728e30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc40400efd0 tx=0x7fc404005770 comp rx=0 tx=0).stop 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 1 -- 172.21.15.63:0/1872493849 shutdown_connections 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55cd867246b0 0x55cd86791c10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd86713bb0 0x55cd867298f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cd867092f0 0x55cd86729370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc3f2ffd640 0 client.15084 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:23:07.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 1 --2- 172.21.15.63:0/1872493849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cd867089d0 0x55cd86728e30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 1 -- 172.21.15.63:0/1872493849 >> 172.21.15.63:0/1872493849 conn(0x55cd86704f60 msgr2=0x55cd867037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 1 -- 172.21.15.63:0/1872493849 shutdown_connections 2024-09-16T01:23:07.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 1 -- 172.21.15.63:0/1872493849 wait complete. 2024-09-16T01:23:07.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc41be1d740 20 client.15084 trim_cache size 0 max 16384 2024-09-16T01:23:07.883 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:23:07.883 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "c42394ec-73c8-11ef-bceb-c7b262605968", 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 2, 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24445, 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 90.789360224000006, 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 24, 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 84, 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 84, 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 123.9614574 2024-09-16T01:23:07.884 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:23:07.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc419a44640 1 -- 172.21.15.63:0/1673650024 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3fc0a32c0 msgr2=0x7fc3fc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc419a44640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3fc0a32c0 0x7fc3fc0a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc40c006010 tx=0x7fc40c031400 comp rx=0 tx=0).stop 2024-09-16T01:23:07.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc419a44640 1 -- 172.21.15.63:0/1673650024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc414102d40 msgr2=0x7fc41419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc419a44640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc414102d40 0x7fc41419a4f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc40400ea80 tx=0x7fc40400ef40 comp rx=0 tx=0).stop 2024-09-16T01:23:07.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc419a44640 1 -- 172.21.15.63:0/1673650024 shutdown_connections 2024-09-16T01:23:07.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc419a44640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3fc0a32c0 0x7fc3fc0a5780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc419a44640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc41410c170 0x7fc41419edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc419a44640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc414103660 0x7fc41419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc419a44640 1 --2- 172.21.15.63:0/1673650024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc414102d40 0x7fc41419a4f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.869+0000 7fc419a44640 1 -- 172.21.15.63:0/1673650024 >> 172.21.15.63:0/1673650024 conn(0x7fc4140fc7a0 msgr2=0x7fc41410d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.870+0000 7fc419a44640 1 -- 172.21.15.63:0/1673650024 shutdown_connections 2024-09-16T01:23:07.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:07.870+0000 7fc419a44640 1 -- 172.21.15.63:0/1673650024 wait complete. 2024-09-16T01:23:08.564 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:08 smithi063 ceph-mon[31070]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:08.565 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:08 smithi063 ceph-mon[31070]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-16T01:23:08.592 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-16T01:23:08.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:08 smithi192 ceph-mon[34775]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:08.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:08 smithi192 ceph-mon[34775]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-16T01:23:08.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:08 smithi162 ceph-mon[34539]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:08.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:08 smithi162 ceph-mon[34539]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-16T01:23:08.849 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.366+0000 7fed55c50640 1 -- 172.21.15.63:0/1599811156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed50100e20 msgr2=0x7fed50101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.366+0000 7fed55c50640 1 --2- 172.21.15.63:0/1599811156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed50100e20 0x7fed50101200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fed40009900 tx=0x7fed4002a480 comp rx=0 tx=0).stop 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.366+0000 7fed55c50640 1 -- 172.21.15.63:0/1599811156 shutdown_connections 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.366+0000 7fed55c50640 1 --2- 172.21.15.63:0/1599811156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed50102ef0 0x7fed5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.366+0000 7fed55c50640 1 --2- 172.21.15.63:0/1599811156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed50102570 0x7fed501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.366+0000 7fed55c50640 1 --2- 172.21.15.63:0/1599811156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed50100e20 0x7fed50101200 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.366+0000 7fed55c50640 1 -- 172.21.15.63:0/1599811156 >> 172.21.15.63:0/1599811156 conn(0x7fed500fc7d0 msgr2=0x7fed500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.366+0000 7fed55c50640 1 -- 172.21.15.63:0/1599811156 shutdown_connections 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.366+0000 7fed55c50640 1 -- 172.21.15.63:0/1599811156 wait complete. 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.366+0000 7fed55c50640 1 Processor -- start 2024-09-16T01:23:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed55c50640 1 -- start start 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed55c50640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed50100e20 0x7fed501984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed55c50640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed50102570 0x7fed50198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed55c50640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed50102ef0 0x7fed5019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed55c50640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fed50110e70 con 0x7fed50100e20 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed55c50640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed50110cf0 con 0x7fed50102ef0 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed55c50640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fed50110ff0 con 0x7fed50102570 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed50100e20 0x7fed501984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed50100e20 0x7fed501984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52398/0 (socket says 172.21.15.63:52398) 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4f7fe640 1 -- 172.21.15.63:0/1532814985 learned_addr learned my addr 172.21.15.63:0/1532814985 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4ffff640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed50102ef0 0x7fed5019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4f7fe640 1 -- 172.21.15.63:0/1532814985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed50102570 msgr2=0x7fed50198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4effd640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed50102570 0x7fed50198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed50102570 0x7fed50198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4f7fe640 1 -- 172.21.15.63:0/1532814985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed50102ef0 msgr2=0x7fed5019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed50102ef0 0x7fed5019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4f7fe640 1 -- 172.21.15.63:0/1532814985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5019d470 con 0x7fed50100e20 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.367+0000 7fed4ffff640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed50102ef0 0x7fed5019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.368+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed50100e20 0x7fed501984c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fed40006010 tx=0x7fed400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.368+0000 7fed4cff9640 1 -- 172.21.15.63:0/1532814985 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4003f070 con 0x7fed50100e20 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.368+0000 7fed4cff9640 1 -- 172.21.15.63:0/1532814985 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed40003aa0 con 0x7fed50100e20 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.368+0000 7fed55c50640 1 -- 172.21.15.63:0/1532814985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5019d700 con 0x7fed50100e20 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.368+0000 7fed4cff9640 1 -- 172.21.15.63:0/1532814985 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40035030 con 0x7fed50100e20 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.368+0000 7fed55c50640 1 -- 172.21.15.63:0/1532814985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed501a5040 con 0x7fed50100e20 2024-09-16T01:23:09.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.370+0000 7fed4cff9640 1 -- 172.21.15.63:0/1532814985 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fed40042070 con 0x7fed50100e20 2024-09-16T01:23:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.370+0000 7fed58029740 1 Processor -- start 2024-09-16T01:23:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.370+0000 7fed58029740 1 -- start start 2024-09-16T01:23:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.370+0000 7fed58029740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732be98b0 0x55c732be9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.370+0000 7fed58029740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732bf8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed58029740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732bfb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed58029740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c732b50090 con 0x55c732bf8fc0 2024-09-16T01:23:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed58029740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c732af7a70 con 0x55c732be98b0 2024-09-16T01:23:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed58029740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c732b4c050 con 0x55c732bea1d0 2024-09-16T01:23:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732bfb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732bfb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52414/0 (socket says 172.21.15.63:52414) 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4effd640 1 -- 172.21.15.63:0/165270149 learned_addr learned my addr 172.21.15.63:0/165270149 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4ffff640 1 --2- 172.21.15.63:0/165270149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732be98b0 0x55c732be9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/165270149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732bf8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4cff9640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fed3c0a3240 0x7fed3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4effd640 1 -- 172.21.15.63:0/165270149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 msgr2=0x55c732bf8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4effd640 1 --2- 172.21.15.63:0/165270149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732bf8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4effd640 1 -- 172.21.15.63:0/165270149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732be98b0 msgr2=0x55c732be9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4effd640 1 --2- 172.21.15.63:0/165270149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732be98b0 0x55c732be9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4effd640 1 -- 172.21.15.63:0/165270149 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c732b04130 con 0x55c732bf8fc0 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4ffff640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fed3c0a3240 0x7fed3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4cff9640 1 -- 172.21.15.63:0/1532814985 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fed400f0390 con 0x7fed50100e20 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed4effd640 1 --2- 172.21.15.63:0/165270149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732bfb3b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fed3800a8e0 tx=0x7fed3800ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb439ebc3bdda93 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.371+0000 7fed45ffb640 1 -- 172.21.15.63:0/165270149 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed38015070 con 0x55c732bf8fc0 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed45ffb640 1 -- 172.21.15.63:0/165270149 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed380113f0 con 0x55c732bf8fc0 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed45ffb640 1 -- 172.21.15.63:0/165270149 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed380185c0 con 0x55c732bf8fc0 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed4ffff640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fed3c0a3240 0x7fed3c0a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed48005fd0 tx=0x7fed48004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed58029740 1 -- 172.21.15.63:0/165270149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 msgr2=0x55c732bfb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed58029740 1 --2- 172.21.15.63:0/165270149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732bfb3b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fed3800a8e0 tx=0x7fed3800ada0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed58029740 1 -- 172.21.15.63:0/165270149 shutdown_connections 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed58029740 1 --2- 172.21.15.63:0/165270149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732bfb3b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed58029740 1 --2- 172.21.15.63:0/165270149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732bf8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed58029740 1 --2- 172.21.15.63:0/165270149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732be98b0 0x55c732be9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed58029740 1 -- 172.21.15.63:0/165270149 >> 172.21.15.63:0/165270149 conn(0x55c732be5f60 msgr2=0x55c732be6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:09.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed58029740 1 -- 172.21.15.63:0/165270149 shutdown_connections 2024-09-16T01:23:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.372+0000 7fed58029740 1 -- 172.21.15.63:0/165270149 wait complete. 2024-09-16T01:23:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed58029740 1 -- start start 2024-09-16T01:23:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed58029740 1 Processor -- start 2024-09-16T01:23:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed58029740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732bf8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed58029740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bea1d0 0x55c732bf5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed58029740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bf8fc0 0x55c732bf6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed58029740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c732bfbb90 con 0x55c732be98b0 2024-09-16T01:23:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed58029740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c732b0af20 con 0x55c732bea1d0 2024-09-16T01:23:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed58029740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c732bfbd10 con 0x55c732bf8fc0 2024-09-16T01:23:09.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed58029740 10 client.0 _ll_register_callbacks cb 0x55c732ad4030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed4f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732bf8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed4f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732bf8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52430/0 (socket says 172.21.15.63:52430) 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed4f7fe640 1 -- 172.21.15.63:0/920756866 learned_addr learned my addr 172.21.15.63:0/920756866 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed4ffff640 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bf8fc0 0x55c732bf6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed4effd640 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bea1d0 0x55c732bf5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed4f7fe640 1 -- 172.21.15.63:0/920756866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bf8fc0 msgr2=0x55c732bf6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bf8fc0 0x55c732bf6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.373+0000 7fed4f7fe640 1 -- 172.21.15.63:0/920756866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bea1d0 msgr2=0x55c732bf5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bea1d0 0x55c732bf5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed4f7fe640 1 -- 172.21.15.63:0/920756866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7328c12b0 con 0x55c732be98b0 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed4effd640 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bea1d0 0x55c732bf5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:09.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732bf8800 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fed400bc940 tx=0x7fed400b8c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc959ba1b2027a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed2effd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed2effd640 1 -- 172.21.15.63:0/920756866 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40049040 con 0x55c732be98b0 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed2effd640 1 -- 172.21.15.63:0/920756866 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fed40003c50 con 0x55c732be98b0 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed58029740 1 -- 172.21.15.63:0/920756866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed380113f0 con 0x55c732be98b0 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed2effd640 1 -- 172.21.15.63:0/920756866 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fed400bc310 con 0x55c732be98b0 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed58029740 10 client.15096 fetch_fsmap learned FSMap version 24 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed58029740 1 -- 172.21.15.63:0/920756866 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c732c07490 con 0x55c732be98b0 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed2effd640 1 -- 172.21.15.63:0/920756866 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed380113f0 con 0x55c732be98b0 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed2effd640 1 -- 172.21.15.63:0/920756866 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fed400bdce0 con 0x55c732be98b0 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed58029740 10 client.15096 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed58029740 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed58029740 20 client.15096 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:09.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed58029740 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c732c09b30 0x55c732c0afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed58029740 4 client.15096 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.374+0000 7fed58029740 1 -- 172.21.15.63:0/920756866 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c732b5d600 con 0x55c732c09b30 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.375+0000 7fed4effd640 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c732c09b30 0x55c732c0afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.375+0000 7fed2effd640 10 client.15096 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.375+0000 7fed4effd640 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c732c09b30 0x55c732c0afa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f340e546863b00 server_cookie=eb7faaaae7409a21 in_seq=0 out_seq=0 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed2effd640 1 -- 172.21.15.63:0/920756866 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c732b5d600 con 0x55c732c09b30 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed2effd640 10 client.15096 handle_command_reply: tid=0 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 client.15096 shutdown 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 -- 172.21.15.63:0/920756866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 msgr2=0x55c732bf8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732bf8800 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fed400bc940 tx=0x7fed400b8c50 comp rx=0 tx=0).stop 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 -- 172.21.15.63:0/920756866 shutdown_connections 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c732c09b30 0x55c732c0afa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bf8fc0 0x55c732bf6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bea1d0 0x55c732bf5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 --2- 172.21.15.63:0/920756866 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732bf8800 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 -- 172.21.15.63:0/920756866 >> 172.21.15.63:0/920756866 conn(0x55c732be5f60 msgr2=0x55c732bebcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed2effd640 0 client.15096 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:23:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 -- 172.21.15.63:0/920756866 shutdown_connections 2024-09-16T01:23:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 1 -- 172.21.15.63:0/920756866 wait complete. 2024-09-16T01:23:09.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.376+0000 7fed58029740 20 client.15096 trim_cache size 0 max 16384 2024-09-16T01:23:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.394+0000 7fed58029740 1 Processor -- start 2024-09-16T01:23:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed58029740 1 -- start start 2024-09-16T01:23:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed58029740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732c09460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed58029740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732c0a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed58029740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bf8fc0 0x55c732be0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed58029740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c732c092e0 con 0x55c732be98b0 2024-09-16T01:23:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed58029740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c732c099b0 con 0x55c732bf8fc0 2024-09-16T01:23:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed58029740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c732c0a080 con 0x55c732bea1d0 2024-09-16T01:23:09.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732c09460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732c09460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52446/0 (socket says 172.21.15.63:52446) 2024-09-16T01:23:09.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4f7fe640 1 -- 172.21.15.63:0/280038463 learned_addr learned my addr 172.21.15.63:0/280038463 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:09.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4effd640 1 --2- 172.21.15.63:0/280038463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732c0a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4f7fe640 1 -- 172.21.15.63:0/280038463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 msgr2=0x55c732c0a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:09.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/280038463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732c0a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4f7fe640 1 -- 172.21.15.63:0/280038463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bf8fc0 msgr2=0x55c732be0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:09.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4ffff640 1 --2- 172.21.15.63:0/280038463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bf8fc0 0x55c732be0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/280038463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bf8fc0 0x55c732be0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4f7fe640 1 -- 172.21.15.63:0/280038463 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c732beaef0 con 0x55c732be98b0 2024-09-16T01:23:09.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.395+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/280038463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732c09460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fed400bc6b0 tx=0x7fed40009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb640c24fd61514 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed457fa640 1 -- 172.21.15.63:0/280038463 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40049070 con 0x55c732be98b0 2024-09-16T01:23:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed457fa640 1 -- 172.21.15.63:0/280038463 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed400bc9b0 con 0x55c732be98b0 2024-09-16T01:23:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed457fa640 1 -- 172.21.15.63:0/280038463 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40003c50 con 0x55c732be98b0 2024-09-16T01:23:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed58029740 1 -- 172.21.15.63:0/280038463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 msgr2=0x55c732c09460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed58029740 1 --2- 172.21.15.63:0/280038463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732c09460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fed400bc6b0 tx=0x7fed40009290 comp rx=0 tx=0).stop 2024-09-16T01:23:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed58029740 1 -- 172.21.15.63:0/280038463 shutdown_connections 2024-09-16T01:23:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed58029740 1 --2- 172.21.15.63:0/280038463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732bf8fc0 0x55c732be0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed58029740 1 --2- 172.21.15.63:0/280038463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732c0a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed58029740 1 --2- 172.21.15.63:0/280038463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732be98b0 0x55c732c09460 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed58029740 1 -- 172.21.15.63:0/280038463 >> 172.21.15.63:0/280038463 conn(0x55c732be5f60 msgr2=0x55c732be6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.396+0000 7fed58029740 1 -- 172.21.15.63:0/280038463 shutdown_connections 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.397+0000 7fed58029740 1 -- 172.21.15.63:0/280038463 wait complete. 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.397+0000 7fed58029740 1 -- start start 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.397+0000 7fed58029740 1 Processor -- start 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.397+0000 7fed58029740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732be98b0 0x55c732c0c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.397+0000 7fed58029740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732c0c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.397+0000 7fed58029740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732c0cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.397+0000 7fed58029740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c732c0ae20 con 0x55c732bf8fc0 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.397+0000 7fed58029740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c732c0a750 con 0x55c732be98b0 2024-09-16T01:23:09.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.397+0000 7fed58029740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c732c0b4f0 con 0x55c732bea1d0 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.397+0000 7fed58029740 10 client.0 _ll_register_callbacks cb 0x7fed40005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732c0cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732c0cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52452/0 (socket says 172.21.15.63:52452) 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4effd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732c0c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4ffff640 1 -- 172.21.15.63:0/3282396463 learned_addr learned my addr 172.21.15.63:0/3282396463 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732be98b0 0x55c732c0c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4ffff640 1 -- 172.21.15.63:0/3282396463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 msgr2=0x55c732c0c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4ffff640 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732c0c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4ffff640 1 -- 172.21.15.63:0/3282396463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732be98b0 msgr2=0x55c732c0c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4ffff640 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732be98b0 0x55c732c0c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4ffff640 1 -- 172.21.15.63:0/3282396463 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c732c72230 con 0x55c732bf8fc0 2024-09-16T01:23:09.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed4ffff640 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732c0cc20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fed48011aa0 tx=0x7fed480084a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b6cbbf991a91f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:09.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed2effd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:09.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed2effd640 1 -- 172.21.15.63:0/3282396463 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4801dbd0 con 0x55c732bf8fc0 2024-09-16T01:23:09.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed2effd640 1 -- 172.21.15.63:0/3282396463 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fed4801dd70 con 0x55c732bf8fc0 2024-09-16T01:23:09.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed58029740 1 -- 172.21.15.63:0/3282396463 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed400bc9b0 con 0x55c732bf8fc0 2024-09-16T01:23:09.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed2effd640 1 -- 172.21.15.63:0/3282396463 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fed4801a440 con 0x55c732bf8fc0 2024-09-16T01:23:09.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.398+0000 7fed58029740 10 client.15102 fetch_fsmap learned FSMap version 24 2024-09-16T01:23:09.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.399+0000 7fed58029740 1 -- 172.21.15.63:0/3282396463 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c732c73440 con 0x55c732bf8fc0 2024-09-16T01:23:09.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.399+0000 7fed2effd640 1 -- 172.21.15.63:0/3282396463 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fed400bc9b0 con 0x55c732bf8fc0 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.399+0000 7fed2effd640 1 -- 172.21.15.63:0/3282396463 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fed48027620 con 0x55c732bf8fc0 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.399+0000 7fed58029740 10 client.15102 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.399+0000 7fed58029740 10 client.15102 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.399+0000 7fed58029740 20 client.15102 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.399+0000 7fed58029740 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c732c77fc0 0x55c732c76cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.399+0000 7fed58029740 4 client.15102 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.399+0000 7fed58029740 1 -- 172.21.15.63:0/3282396463 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "status"}) -- 0x55c732b57b10 con 0x55c732c77fc0 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.399+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c732c77fc0 0x55c732c76cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed4f7fe640 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c732c77fc0 0x55c732c76cd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=69c6d80a540945a2 server_cookie=342c5b31c7803bd in_seq=0 out_seq=0 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed2effd640 10 client.15102 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed2effd640 1 -- 172.21.15.63:0/3282396463 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c732b57b10 con 0x55c732c77fc0 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed2effd640 10 client.15102 handle_command_reply: tid=0 2024-09-16T01:23:09.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 client.15102 shutdown 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 -- 172.21.15.63:0/3282396463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 msgr2=0x55c732c0cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732c0cc20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fed48011aa0 tx=0x7fed480084a0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 -- 172.21.15.63:0/3282396463 shutdown_connections 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c732c77fc0 0x55c732c76cd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c732bf8fc0 0x55c732c0cc20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c732bea1d0 0x55c732c0c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 --2- 172.21.15.63:0/3282396463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c732be98b0 0x55c732c0c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 -- 172.21.15.63:0/3282396463 >> 172.21.15.63:0/3282396463 conn(0x55c732be5f60 msgr2=0x55c732be0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed2effd640 0 client.15102 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 -- 172.21.15.63:0/3282396463 shutdown_connections 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 1 -- 172.21.15.63:0/3282396463 wait complete. 2024-09-16T01:23:09.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.400+0000 7fed58029740 20 client.15102 trim_cache size 0 max 16384 2024-09-16T01:23:09.420 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:23:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "c42394ec-73c8-11ef-bceb-c7b262605968", 2024-09-16T01:23:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 1, 2024-09-16T01:23:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24460, 2024-09-16T01:23:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-16T01:23:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-16T01:23:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-16T01:23:09.420 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 93.326418244999999, 2024-09-16T01:23:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 24, 2024-09-16T01:23:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 84, 2024-09-16T01:23:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 84, 2024-09-16T01:23:09.421 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 120.23740050399999 2024-09-16T01:23:09.421 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 -- 172.21.15.63:0/1532814985 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fed3c0a3240 msgr2=0x7fed3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fed3c0a3240 0x7fed3c0a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed48005fd0 tx=0x7fed48004a40 comp rx=0 tx=0).stop 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 -- 172.21.15.63:0/1532814985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed50100e20 msgr2=0x7fed501984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed50100e20 0x7fed501984c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fed40006010 tx=0x7fed400042f0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 -- 172.21.15.63:0/1532814985 shutdown_connections 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fed3c0a3240 0x7fed3c0a5700 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed50102ef0 0x7fed5019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed50102570 0x7fed50198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 --2- 172.21.15.63:0/1532814985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fed50100e20 0x7fed501984c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 -- 172.21.15.63:0/1532814985 >> 172.21.15.63:0/1532814985 conn(0x7fed500fc7d0 msgr2=0x7fed50069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 -- 172.21.15.63:0/1532814985 shutdown_connections 2024-09-16T01:23:09.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:09.401+0000 7fed55c50640 1 -- 172.21.15.63:0/1532814985 wait complete. 2024-09-16T01:23:10.100 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-16T01:23:10.357 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:10.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:10 smithi063 ceph-mon[31070]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:10 smithi192 ceph-mon[34775]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:10.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:10 smithi162 ceph-mon[34539]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:10.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.827+0000 7f0da4ee2640 1 -- 172.21.15.63:0/3696791299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da0101420 msgr2=0x7f0da010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.827+0000 7f0da4ee2640 1 --2- 172.21.15.63:0/3696791299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da0101420 0x7f0da010d950 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009cd0 tx=0x7f0d9802a8e0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.827+0000 7f0da4ee2640 1 -- 172.21.15.63:0/3696791299 shutdown_connections 2024-09-16T01:23:10.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.827+0000 7f0da4ee2640 1 --2- 172.21.15.63:0/3696791299 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da0101420 0x7f0da010d950 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.827+0000 7f0da4ee2640 1 --2- 172.21.15.63:0/3696791299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0100a80 0x7f0da0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.827+0000 7f0da4ee2640 1 --2- 172.21.15.63:0/3696791299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0da0106a80 0x7f0da0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.827+0000 7f0da4ee2640 1 -- 172.21.15.63:0/3696791299 >> 172.21.15.63:0/3696791299 conn(0x7f0da00fc7a0 msgr2=0x7f0da00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:10.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.827+0000 7f0da4ee2640 1 -- 172.21.15.63:0/3696791299 shutdown_connections 2024-09-16T01:23:10.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.827+0000 7f0da4ee2640 1 -- 172.21.15.63:0/3696791299 wait complete. 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0da4ee2640 1 Processor -- start 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0da4ee2640 1 -- start start 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0da4ee2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da0100a80 0x7f0da0197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0da4ee2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0101420 0x7f0da0197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0da4ee2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0da0106a80 0x7f0da019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0da4ee2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0da0110d30 con 0x7f0da0100a80 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0da4ee2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0da0110bb0 con 0x7f0da0106a80 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0da4ee2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0da0110eb0 con 0x7f0da0101420 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da0100a80 0x7f0da0197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da0100a80 0x7f0da0197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52470/0 (socket says 172.21.15.63:52470) 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9e59c640 1 -- 172.21.15.63:0/2651306050 learned_addr learned my addr 172.21.15.63:0/2651306050 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9dd9b640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0101420 0x7f0da0197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9e59c640 1 -- 172.21.15.63:0/2651306050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0101420 msgr2=0x7f0da0197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0101420 0x7f0da0197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0da0106a80 0x7f0da019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9e59c640 1 -- 172.21.15.63:0/2651306050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0da0106a80 msgr2=0x7f0da019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0da0106a80 0x7f0da019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9e59c640 1 -- 172.21.15.63:0/2651306050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da019c200 con 0x7f0da0100a80 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0da0106a80 0x7f0da019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.828+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da0100a80 0x7f0da0197250 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800d950 tx=0x7f0d8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.829+0000 7f0d977fe640 1 -- 172.21.15.63:0/2651306050 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d88017070 con 0x7f0da0100a80 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.829+0000 7f0d977fe640 1 -- 172.21.15.63:0/2651306050 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d88009c30 con 0x7f0da0100a80 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.829+0000 7f0d977fe640 1 -- 172.21.15.63:0/2651306050 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800f620 con 0x7f0da0100a80 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.829+0000 7f0da4ee2640 1 -- 172.21.15.63:0/2651306050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da019c4f0 con 0x7f0da0100a80 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.829+0000 7f0da4ee2640 1 -- 172.21.15.63:0/2651306050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da01a3dd0 con 0x7f0da0100a80 2024-09-16T01:23:10.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.831+0000 7f0d977fe640 1 -- 172.21.15.63:0/2651306050 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0d880109a0 con 0x7f0da0100a80 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.831+0000 7f0da72bb740 1 Processor -- start 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.831+0000 7f0da72bb740 1 -- start start 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a57be0 0x557d78a57fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a58500 0x557d78a62880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a62dc0 0x557d78a651b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0da72bb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557d789bc090 con 0x557d78a57be0 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0da72bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557d78963a70 con 0x557d78a58500 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0da72bb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557d789b8050 con 0x557d78a62dc0 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a57be0 0x557d78a57fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a57be0 0x557d78a57fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52486/0 (socket says 172.21.15.63:52486) 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9ed9d640 1 -- 172.21.15.63:0/3998655148 learned_addr learned my addr 172.21.15.63:0/3998655148 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d977fe640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d8c0a32c0 0x7f0d8c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/3998655148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a58500 0x557d78a62880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9ed9d640 1 -- 172.21.15.63:0/3998655148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a62dc0 msgr2=0x557d78a651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/3998655148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a62dc0 0x557d78a651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9ed9d640 1 -- 172.21.15.63:0/3998655148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a58500 msgr2=0x557d78a62880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/3998655148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a58500 0x557d78a62880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9ed9d640 1 -- 172.21.15.63:0/3998655148 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d78970130 con 0x557d78a57be0 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d8c0a32c0 0x7f0d8c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d977fe640 1 -- 172.21.15.63:0/2651306050 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0d880cf550 con 0x7f0da0100a80 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.832+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/3998655148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a57be0 0x557d78a57fc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0d98005e30 tx=0x7f0d980314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ff577f3395ecdb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0d94ff9640 1 -- 172.21.15.63:0/3998655148 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9804d070 con 0x557d78a57be0 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0d94ff9640 1 -- 172.21.15.63:0/3998655148 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d98043070 con 0x557d78a57be0 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d8c0a32c0 0x7f0d8c0a5780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d9804a000 tx=0x7f0d9804b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:10.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0d94ff9640 1 -- 172.21.15.63:0/3998655148 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98030d40 con 0x557d78a57be0 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0da72bb740 1 -- 172.21.15.63:0/3998655148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a57be0 msgr2=0x557d78a57fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0da72bb740 1 --2- 172.21.15.63:0/3998655148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a57be0 0x557d78a57fc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0d98005e30 tx=0x7f0d980314b0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0da72bb740 1 -- 172.21.15.63:0/3998655148 shutdown_connections 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0da72bb740 1 --2- 172.21.15.63:0/3998655148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a62dc0 0x557d78a651b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0da72bb740 1 --2- 172.21.15.63:0/3998655148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a58500 0x557d78a62880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0da72bb740 1 --2- 172.21.15.63:0/3998655148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a57be0 0x557d78a57fc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0da72bb740 1 -- 172.21.15.63:0/3998655148 >> 172.21.15.63:0/3998655148 conn(0x557d78a54170 msgr2=0x557d78a54550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.833+0000 7f0da72bb740 1 -- 172.21.15.63:0/3998655148 shutdown_connections 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0da72bb740 1 -- 172.21.15.63:0/3998655148 wait complete. 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0da72bb740 1 -- start start 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0da72bb740 1 Processor -- start 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a57be0 0x557d78a5de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a58500 0x557d78a5e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a62dc0 0x557d78a5e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0da72bb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557d78a51b30 con 0x557d78a62dc0 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0da72bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557d78976f20 con 0x557d78a58500 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0da72bb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557d78a51cb0 con 0x557d78a57be0 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0da72bb740 10 client.0 _ll_register_callbacks cb 0x557d78940030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0d9ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a62dc0 0x557d78a5e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0d9ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a62dc0 0x557d78a5e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52498/0 (socket says 172.21.15.63:52498) 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0d9ed9d640 1 -- 172.21.15.63:0/2399358670 learned_addr learned my addr 172.21.15.63:0/2399358670 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0d9dd9b640 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a58500 0x557d78a5e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.834+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a57be0 0x557d78a5de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d9ed9d640 1 -- 172.21.15.63:0/2399358670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a57be0 msgr2=0x557d78a5de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a57be0 0x557d78a5de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d9ed9d640 1 -- 172.21.15.63:0/2399358670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a58500 msgr2=0x557d78a5e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a58500 0x557d78a5e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d9ed9d640 1 -- 172.21.15.63:0/2399358670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7872d2b0 con 0x557d78a62dc0 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a62dc0 0x557d78a5e880 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0d98033020 tx=0x7f0d98030e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c38fb7e312c87cc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d85ffb640 1 -- 172.21.15.63:0/2399358670 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9804d030 con 0x557d78a62dc0 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d85ffb640 1 -- 172.21.15.63:0/2399358670 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0d98004490 con 0x557d78a62dc0 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0da72bb740 1 -- 172.21.15.63:0/2399358670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d98043070 con 0x557d78a62dc0 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d85ffb640 1 -- 172.21.15.63:0/2399358670 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0d98004690 con 0x557d78a62dc0 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0da72bb740 10 client.15114 fetch_fsmap learned FSMap version 24 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0da72bb740 1 -- 172.21.15.63:0/2399358670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557d78a73410 con 0x557d78a62dc0 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.835+0000 7f0d85ffb640 1 -- 172.21.15.63:0/2399358670 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d98043070 con 0x557d78a62dc0 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.836+0000 7f0d85ffb640 1 -- 172.21.15.63:0/2399358670 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0d9805d020 con 0x557d78a62dc0 2024-09-16T01:23:10.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.836+0000 7f0da72bb740 10 client.15114 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.836+0000 7f0da72bb740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.836+0000 7f0da72bb740 20 client.15114 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.836+0000 7f0da72bb740 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557d78a75650 0x557d78a76ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.836+0000 7f0da72bb740 4 client.15114 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.836+0000 7f0da72bb740 1 -- 172.21.15.63:0/2399358670 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d789c9600 con 0x557d78a75650 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.836+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557d78a75650 0x557d78a76ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.836+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557d78a75650 0x557d78a76ac0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ee9da3b5a464b88 server_cookie=d05ba8132183b4b4 in_seq=0 out_seq=0 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.836+0000 7f0d85ffb640 10 client.15114 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0d85ffb640 1 -- 172.21.15.63:0/2399358670 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d789c9600 con 0x557d78a75650 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0d85ffb640 10 client.15114 handle_command_reply: tid=0 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 client.15114 shutdown 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 -- 172.21.15.63:0/2399358670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a62dc0 msgr2=0x557d78a5e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a62dc0 0x557d78a5e880 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0d98033020 tx=0x7f0d98030e50 comp rx=0 tx=0).stop 2024-09-16T01:23:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 -- 172.21.15.63:0/2399358670 shutdown_connections 2024-09-16T01:23:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557d78a75650 0x557d78a76ac0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a62dc0 0x557d78a5e880 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a58500 0x557d78a5e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 --2- 172.21.15.63:0/2399358670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a57be0 0x557d78a5de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 -- 172.21.15.63:0/2399358670 >> 172.21.15.63:0/2399358670 conn(0x557d78a54170 msgr2=0x557d78a59ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0d85ffb640 0 client.15114 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 -- 172.21.15.63:0/2399358670 shutdown_connections 2024-09-16T01:23:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 1 -- 172.21.15.63:0/2399358670 wait complete. 2024-09-16T01:23:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.837+0000 7f0da72bb740 20 client.15114 trim_cache size 0 max 16384 2024-09-16T01:23:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.855+0000 7f0da72bb740 1 Processor -- start 2024-09-16T01:23:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0da72bb740 1 -- start start 2024-09-16T01:23:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a57be0 0x557d78a64f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a5e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a62dc0 0x557d78a641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0da72bb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557d78a74e00 con 0x557d78a58500 2024-09-16T01:23:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0da72bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557d78a754d0 con 0x557d78a57be0 2024-09-16T01:23:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0da72bb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557d78a75ba0 con 0x557d78a62dc0 2024-09-16T01:23:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a5e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a5e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52510/0 (socket says 172.21.15.63:52510) 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9dd9b640 1 -- 172.21.15.63:0/2852549556 learned_addr learned my addr 172.21.15.63:0/2852549556 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/2852549556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a62dc0 0x557d78a641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/2852549556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a57be0 0x557d78a64f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9dd9b640 1 -- 172.21.15.63:0/2852549556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a62dc0 msgr2=0x557d78a641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9dd9b640 1 --2- 172.21.15.63:0/2852549556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a62dc0 0x557d78a641b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9dd9b640 1 -- 172.21.15.63:0/2852549556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a57be0 msgr2=0x557d78a64f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9dd9b640 1 --2- 172.21.15.63:0/2852549556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a57be0 0x557d78a64f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9dd9b640 1 -- 172.21.15.63:0/2852549556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d78a626f0 con 0x557d78a58500 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/2852549556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a57be0 0x557d78a64f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d9dd9b640 1 --2- 172.21.15.63:0/2852549556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a5e6d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000ba70 tx=0x7f0d9000bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d0dee4be71fd49 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.856+0000 7f0d87fff640 1 -- 172.21.15.63:0/2852549556 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90012db0 con 0x557d78a58500 2024-09-16T01:23:10.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0d87fff640 1 -- 172.21.15.63:0/2852549556 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d9001a890 con 0x557d78a58500 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0d87fff640 1 -- 172.21.15.63:0/2852549556 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d900198e0 con 0x557d78a58500 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0da72bb740 1 -- 172.21.15.63:0/2852549556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 msgr2=0x557d78a5e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0da72bb740 1 --2- 172.21.15.63:0/2852549556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a5e6d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000ba70 tx=0x7f0d9000bf30 comp rx=0 tx=0).stop 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0da72bb740 1 -- 172.21.15.63:0/2852549556 shutdown_connections 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0da72bb740 1 --2- 172.21.15.63:0/2852549556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a62dc0 0x557d78a641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0da72bb740 1 --2- 172.21.15.63:0/2852549556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a5e6d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0da72bb740 1 --2- 172.21.15.63:0/2852549556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a57be0 0x557d78a64f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0da72bb740 1 -- 172.21.15.63:0/2852549556 >> 172.21.15.63:0/2852549556 conn(0x557d78a54170 msgr2=0x557d78a54550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0da72bb740 1 -- 172.21.15.63:0/2852549556 shutdown_connections 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.857+0000 7f0da72bb740 1 -- 172.21.15.63:0/2852549556 wait complete. 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0da72bb740 1 -- start start 2024-09-16T01:23:10.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0da72bb740 1 Processor -- start 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a57be0 0x557d78a7f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a7dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0da72bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a62dc0 0x557d78a7e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0da72bb740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557d78a76940 con 0x557d78a58500 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0da72bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557d78a76270 con 0x557d78a62dc0 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0da72bb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557d78a77010 con 0x557d78a57be0 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0da72bb740 10 client.0 _ll_register_callbacks cb 0x7f0d9804b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0d9dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a7dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0d9dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a7dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52520/0 (socket says 172.21.15.63:52520) 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0d9dd9b640 1 -- 172.21.15.63:0/58025941 learned_addr learned my addr 172.21.15.63:0/58025941 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a57be0 0x557d78a7f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.858+0000 7f0d9ed9d640 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a62dc0 0x557d78a7e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d9dd9b640 1 -- 172.21.15.63:0/58025941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a57be0 msgr2=0x557d78a7f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d9dd9b640 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a57be0 0x557d78a7f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d9dd9b640 1 -- 172.21.15.63:0/58025941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a62dc0 msgr2=0x557d78a7e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d9dd9b640 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a62dc0 0x557d78a7e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d9dd9b640 1 -- 172.21.15.63:0/58025941 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d78a7eab0 con 0x557d78a58500 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d9dd9b640 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a7dd90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d90019460 tx=0x7f0d90012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482894b51fd4ebef server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d85ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d85ffb640 1 -- 172.21.15.63:0/58025941 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90027070 con 0x557d78a58500 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d85ffb640 1 -- 172.21.15.63:0/58025941 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0d9001aa40 con 0x557d78a58500 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0da72bb740 1 -- 172.21.15.63:0/58025941 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d9001a890 con 0x557d78a58500 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d85ffb640 1 -- 172.21.15.63:0/58025941 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0d90033050 con 0x557d78a58500 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0da72bb740 10 client.15120 fetch_fsmap learned FSMap version 24 2024-09-16T01:23:10.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0da72bb740 1 -- 172.21.15.63:0/58025941 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557d78adfd60 con 0x557d78a58500 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.859+0000 7f0d85ffb640 1 -- 172.21.15.63:0/58025941 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d9001a890 con 0x557d78a58500 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.860+0000 7f0d85ffb640 1 -- 172.21.15.63:0/58025941 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0d90019070 con 0x557d78a58500 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.860+0000 7f0da72bb740 10 client.15120 fetch_fsmap finished waiting for FSMap version 24 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.860+0000 7f0da72bb740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.860+0000 7f0da72bb740 20 client.15120 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.860+0000 7f0da72bb740 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557d78ae4560 0x557d78ae3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.860+0000 7f0da72bb740 4 client.15120 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.860+0000 7f0da72bb740 1 -- 172.21.15.63:0/58025941 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "status"}) -- 0x557d789c3b10 con 0x557d78ae4560 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.860+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557d78ae4560 0x557d78ae3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.860+0000 7f0d85ffb640 10 client.15120 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.860+0000 7f0d9e59c640 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557d78ae4560 0x557d78ae3270 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ccf9cd25143ce06 server_cookie=393956d0620087c4 in_seq=0 out_seq=0 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0d85ffb640 1 -- 172.21.15.63:0/58025941 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557d789c3b10 con 0x557d78ae4560 2024-09-16T01:23:10.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0d85ffb640 10 client.15120 handle_command_reply: tid=0 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 client.15120 shutdown 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 -- 172.21.15.63:0/58025941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 msgr2=0x557d78a7dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a7dd90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d90019460 tx=0x7f0d90012ed0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 -- 172.21.15.63:0/58025941 shutdown_connections 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d78a62dc0 0x557d78a7e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557d78ae4560 0x557d78ae3270 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557d78a58500 0x557d78a7dd90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 --2- 172.21.15.63:0/58025941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557d78a57be0 0x557d78a7f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 -- 172.21.15.63:0/58025941 >> 172.21.15.63:0/58025941 conn(0x557d78a54170 msgr2=0x557d78a61560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0d85ffb640 0 client.15120 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 -- 172.21.15.63:0/58025941 shutdown_connections 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 1 -- 172.21.15.63:0/58025941 wait complete. 2024-09-16T01:23:10.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.861+0000 7f0da72bb740 20 client.15120 trim_cache size 0 max 16384 2024-09-16T01:23:10.875 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:23:10.875 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "c42394ec-73c8-11ef-bceb-c7b262605968", 2024-09-16T01:23:10.875 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-16T01:23:10.875 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 24467, 2024-09-16T01:23:10.875 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-16T01:23:10.875 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-16T01:23:10.875 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-16T01:23:10.875 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 101.83332499700001, 2024-09-16T01:23:10.875 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 24, 2024-09-16T01:23:10.875 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 84, 2024-09-16T01:23:10.876 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 84, 2024-09-16T01:23:10.876 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 112.786467538 2024-09-16T01:23:10.876 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:23:10.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 -- 172.21.15.63:0/2651306050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d8c0a32c0 msgr2=0x7f0d8c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d8c0a32c0 0x7f0d8c0a5780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d9804a000 tx=0x7f0d9804b000 comp rx=0 tx=0).stop 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 -- 172.21.15.63:0/2651306050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da0100a80 msgr2=0x7f0da0197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da0100a80 0x7f0da0197250 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800d950 tx=0x7f0d8800de10 comp rx=0 tx=0).stop 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 -- 172.21.15.63:0/2651306050 shutdown_connections 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d8c0a32c0 0x7f0d8c0a5780 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0da0106a80 0x7f0da019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0da0101420 0x7f0da0197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 --2- 172.21.15.63:0/2651306050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da0100a80 0x7f0da0197250 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 -- 172.21.15.63:0/2651306050 >> 172.21.15.63:0/2651306050 conn(0x7f0da00fc7a0 msgr2=0x7f0da00fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 -- 172.21.15.63:0/2651306050 shutdown_connections 2024-09-16T01:23:10.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:10.862+0000 7f0da4ee2640 1 -- 172.21.15.63:0/2651306050 wait complete. 2024-09-16T01:23:11.699 INFO:teuthology.run_tasks:Running task sequential... 2024-09-16T01:23:11.710 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-16T01:23:11.711 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-16T01:23:11.711 INFO:teuthology.task.print:Enabling mgr modules 2024-09-16T01:23:11.711 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-16T01:23:11.775 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-16T01:23:11.776 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-16T01:23:11.776 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-16T01:23:11.776 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:23:11.776 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:11.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:11.776 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-16T01:23:11.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:11.795 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-16T01:23:11.865 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-09-16T01:23:11.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:23:11.867 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-16T01:23:11.867 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-16T01:23:11.867 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-16T01:23:12.166 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:12.539 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:12 smithi063 ceph-mon[31070]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-16T01:23:12.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.620+0000 7fea15851640 1 -- 172.21.15.63:0/834550540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea10100a80 msgr2=0x7fea10100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.620+0000 7fea15851640 1 --2- 172.21.15.63:0/834550540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea10100a80 0x7fea10100ee0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fea00009930 tx=0x7fea0002a420 comp rx=0 tx=0).stop 2024-09-16T01:23:12.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.620+0000 7fea15851640 1 -- 172.21.15.63:0/834550540 shutdown_connections 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.620+0000 7fea15851640 1 --2- 172.21.15.63:0/834550540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea10101420 0x7fea1010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.620+0000 7fea15851640 1 --2- 172.21.15.63:0/834550540 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea10100a80 0x7fea10100ee0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.620+0000 7fea15851640 1 --2- 172.21.15.63:0/834550540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea10106a80 0x7fea10106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.620+0000 7fea15851640 1 -- 172.21.15.63:0/834550540 >> 172.21.15.63:0/834550540 conn(0x7fea100fc7a0 msgr2=0x7fea100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.620+0000 7fea15851640 1 -- 172.21.15.63:0/834550540 shutdown_connections 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.620+0000 7fea15851640 1 -- 172.21.15.63:0/834550540 wait complete. 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea15851640 1 Processor -- start 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea15851640 1 -- start start 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea15851640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea10100a80 0x7fea10198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea15851640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea10101420 0x7fea101988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea15851640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea10106a80 0x7fea1019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea15851640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fea10110d50 con 0x7fea10101420 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea15851640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fea10110bd0 con 0x7fea10106a80 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea15851640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fea10110ed0 con 0x7fea10100a80 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea0e7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea10101420 0x7fea101988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea0e7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea10101420 0x7fea101988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52540/0 (socket says 172.21.15.63:52540) 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea0e7fc640 1 -- 172.21.15.63:0/281550214 learned_addr learned my addr 172.21.15.63:0/281550214 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea0e7fc640 1 -- 172.21.15.63:0/281550214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea10100a80 msgr2=0x7fea10198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea0e7fc640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea10100a80 0x7fea10198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.621+0000 7fea0e7fc640 1 -- 172.21.15.63:0/281550214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea10106a80 msgr2=0x7fea1019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.622+0000 7fea0e7fc640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea10106a80 0x7fea1019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.622+0000 7fea0e7fc640 1 -- 172.21.15.63:0/281550214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1019d330 con 0x7fea10101420 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.622+0000 7fea0e7fc640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea10101420 0x7fea101988c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fea00005940 tx=0x7fea000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.622+0000 7fea1484f640 1 -- 172.21.15.63:0/281550214 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0003f030 con 0x7fea10101420 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.622+0000 7fea15851640 1 -- 172.21.15.63:0/281550214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1019d5c0 con 0x7fea10101420 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.622+0000 7fea1484f640 1 -- 172.21.15.63:0/281550214 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea00003cb0 con 0x7fea10101420 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.622+0000 7fea1484f640 1 -- 172.21.15.63:0/281550214 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea00035070 con 0x7fea10101420 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.622+0000 7fea15851640 1 -- 172.21.15.63:0/281550214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea101a4f00 con 0x7fea10101420 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.623+0000 7fea15851640 1 -- 172.21.15.63:0/281550214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea10100ee0 con 0x7fea10101420 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.624+0000 7fea1484f640 1 -- 172.21.15.63:0/281550214 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fea00042030 con 0x7fea10101420 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.625+0000 7fea1484f640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe9fc0a3240 0x7fe9fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.625+0000 7fea0effd640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe9fc0a3240 0x7fe9fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.626+0000 7fea1484f640 1 -- 172.21.15.63:0/281550214 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fea000efbe0 con 0x7fea10101420 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.626+0000 7fea0effd640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe9fc0a3240 0x7fe9fc0a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800a990 tx=0x7fe9f8005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.630+0000 7fea1484f640 1 -- 172.21.15.63:0/281550214 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea000bc900 con 0x7fea10101420 2024-09-16T01:23:12.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:12 smithi192 ceph-mon[34775]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-16T01:23:12.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:12 smithi162 ceph-mon[34539]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-16T01:23:12.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.845+0000 7fea15851640 1 -- 172.21.15.63:0/281550214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fea1002d7c0 con 0x7fea10101420 2024-09-16T01:23:12.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.846+0000 7fea1484f640 1 -- 172.21.15.63:0/281550214 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fea000bc200 con 0x7fea10101420 2024-09-16T01:23:12.847 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:23:12.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 -- 172.21.15.63:0/281550214 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe9fc0a3240 msgr2=0x7fe9fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe9fc0a3240 0x7fe9fc0a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800a990 tx=0x7fe9f8005c70 comp rx=0 tx=0).stop 2024-09-16T01:23:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 -- 172.21.15.63:0/281550214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea10101420 msgr2=0x7fea101988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea10101420 0x7fea101988c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fea00005940 tx=0x7fea000042f0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 -- 172.21.15.63:0/281550214 shutdown_connections 2024-09-16T01:23:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe9fc0a3240 0x7fe9fc0a5700 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea10106a80 0x7fea1019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea10101420 0x7fea101988c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 --2- 172.21.15.63:0/281550214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea10100a80 0x7fea10198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 -- 172.21.15.63:0/281550214 >> 172.21.15.63:0/281550214 conn(0x7fea100fc7a0 msgr2=0x7fea1006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 -- 172.21.15.63:0/281550214 shutdown_connections 2024-09-16T01:23:12.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:12.848+0000 7fea15851640 1 -- 172.21.15.63:0/281550214 wait complete. 2024-09-16T01:23:13.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:13 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/281550214' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T01:23:13.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:13 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/281550214' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T01:23:13.677 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:23:13.677 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:23:13.677 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-16T01:23:13.677 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:23:13.677 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:13.677 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:23:13.677 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:23:13.677 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:23:13.677 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:23:13.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:13.678 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-16T01:23:13.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:13 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/281550214' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T01:23:13.695 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:23:13.695 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:23:13.695 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:23:13.695 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:13.695 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-16T01:23:13.695 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:13.695 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42231sec preferred_lft 42231sec 2024-09-16T01:23:13.696 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link noprefixroute 2024-09-16T01:23:13.697 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:13.697 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T01:23:13.697 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:23:13.697 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-16T01:23:13.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-09-16T01:23:13.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-09-16T01:23:13.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-09-16T01:23:13.698 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T01:23:13.698 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-16T01:23:13.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:23:13.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:13.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:13.911 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:23:13.938 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-16T01:23:13.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:13.939 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-16T01:23:14.011 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-16T01:23:14.011 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:23:14.011 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:23:14.011 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:23:14.011 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:23:14.012 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:23:14.012 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-16T01:23:14.012 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:23:14.012 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:23:14.012 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:23:14.012 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-16T01:23:14.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:23:14.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:14.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:14.316 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-16T01:23:14.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:14.333 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-09-16T01:23:14.389 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:23:14.389 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-16T01:23:14.390 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:23:14.390 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-16T01:23:14.390 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-16T01:23:14.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:23:14.488 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:14 smithi063 ceph-mon[31070]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-16T01:23:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:14.511 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-16T01:23:14.511 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:23:14.511 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-16T01:23:14.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-16T01:23:14.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T01:23:14.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-16T01:23:14.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-16T01:23:14.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-16T01:23:14.512 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-16T01:23:14.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:23:14.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:14.654 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:23:14.654 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-16T01:23:14.654 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-09-16T01:23:14.654 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T01:23:14.654 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-16T01:23:14.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:14 smithi192 ceph-mon[34775]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-16T01:23:14.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:14 smithi162 ceph-mon[34539]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-16T01:23:14.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:23:14.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:14.734 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-16T01:23:14.734 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:23:14.734 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:14.750 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:23:14.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:23:14.750 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:14.805 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-09-16T01:23:14.873 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T01:23:14.930 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-09-16T01:23:14.930 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-09-16T01:23:14.930 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-09-16T01:23:14.930 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-09-16T01:23:14.930 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-09-16T01:23:14.930 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-09-16T01:23:14.930 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-09-16T01:23:14.930 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/selinux 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T01:23:14.931 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-09-16T01:23:14.932 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T01:23:14.932 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-09-16T01:23:14.932 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T01:23:14.932 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T01:23:14.932 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-09-16T01:23:14.932 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-09-16T01:23:14.932 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay 2024-09-16T01:23:14.932 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/7159f5a810a631af034bac8d251608da0794778b9797abc4c9f1fd76f2183e07/merged 2024-09-16T01:23:14.932 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/b809f25f3a8a1ee992752de8033ba6f3d5a7c8ca9efa53dcffeaafdf23ea5889/merged 2024-09-16T01:23:14.932 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/0 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/7deb386c4cc625cde36a7d5e72e6b7dc161eedbb7cfba60f40f538c2a9f2a910/merged 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/41c678964baab9945b59aceae6c1461039f4bb603301440e6327b242f726ff83/merged 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/de65c04f26c7393935bd8b8b1be20799276efe4e46e578ff8cdbf40add2498ac/merged 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/61d35f341c67eb7eb6280b227c8d3331f08d30208d4ad9f183cb00b793de923f/merged 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/41250c6a350de978c418c94442751f097cc764336b66097dd12157eb6901d403/merged 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/d1888637ebf872456f0324a586fac27f1bc0d959020ce11d7c7d560be75726af/merged 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/9a0e74d768d69376327563148feed715fd8efb7665213033e4c95ebe356c66dd/merged 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/bfd54950b8ca9d5c9f6c62d68305f4deb8ff67b1077447a82fc52110e7263ce4/merged 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-09-16T01:23:14.933 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:23:14.934 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:23:14.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:14.934 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-09-16T01:23:14.986 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-16T01:23:14.986 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/29322e8e-26e1-416a-815f-cea6840f89a2 --client_fs=cephfs) 2024-09-16T01:23:15.029 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-09-16T01:23:15.055 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T01:23:15.112 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-09-16T01:23:15.112 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-09-16T01:23:15.112 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/selinux 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:23:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay 2024-09-16T01:23:15.114 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/7159f5a810a631af034bac8d251608da0794778b9797abc4c9f1fd76f2183e07/merged 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/b809f25f3a8a1ee992752de8033ba6f3d5a7c8ca9efa53dcffeaafdf23ea5889/merged 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/0 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/7deb386c4cc625cde36a7d5e72e6b7dc161eedbb7cfba60f40f538c2a9f2a910/merged 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/41c678964baab9945b59aceae6c1461039f4bb603301440e6327b242f726ff83/merged 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/de65c04f26c7393935bd8b8b1be20799276efe4e46e578ff8cdbf40add2498ac/merged 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/61d35f341c67eb7eb6280b227c8d3331f08d30208d4ad9f183cb00b793de923f/merged 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/41250c6a350de978c418c94442751f097cc764336b66097dd12157eb6901d403/merged 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/d1888637ebf872456f0324a586fac27f1bc0d959020ce11d7c7d560be75726af/merged 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/9a0e74d768d69376327563148feed715fd8efb7665213033e4c95ebe356c66dd/merged 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/containers/storage/overlay/bfd54950b8ca9d5c9f6c62d68305f4deb8ff67b1077447a82fc52110e7263ce4/merged 2024-09-16T01:23:15.115 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-09-16T01:23:15.116 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:23:15.116 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:23:15.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:15.116 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-09-16T01:23:15.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:2024-09-16T01:23:15.138+0000 7f6d09d40480 -1 init, newargv = 0x55eb6dbfccf0 newargc=15 2024-09-16T01:23:15.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[82135]: starting ceph client 2024-09-16T01:23:15.154 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[82135]: starting fuse 2024-09-16T01:23:15.155 INFO:teuthology.orchestra.run.smithi063.stdout:120 2024-09-16T01:23:15.155 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-16T01:23:15.155 DEBUG:teuthology.orchestra.run.smithi063:> sudo stdin-killer -- python3 -c ' 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> import glob 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> import re 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> import os 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> import subprocess 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> def _find_admin_socket(client_name): 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2024-09-16T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> return files[0] 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> for f in files: 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> contents = proc_f.read() 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> if mountpoint in contents: 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> return f 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> print(_find_admin_socket("client.0")) 2024-09-16T01:23:15.157 DEBUG:teuthology.orchestra.run.smithi063:> ' 2024-09-16T01:23:15.277 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.0.82135.asok 2024-09-16T01:23:15.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:15.287 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.82135.asok 2024-09-16T01:23:15.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:15.288 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.82135.asok status 2024-09-16T01:23:15.427 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:23:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2024-09-16T01:23:15.427 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-16T01:23:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T01:23:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "0", 2024-09-16T01:23:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2024-09-16T01:23:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-16T01:23:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "82135", 2024-09-16T01:23:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/volumes/qa/sv_0/29322e8e-26e1-416a-815f-cea6840f89a2" 2024-09-16T01:23:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:23:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2024-09-16T01:23:15.428 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2024-09-16T01:23:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 15132, 2024-09-16T01:23:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2024-09-16T01:23:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2024-09-16T01:23:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2024-09-16T01:23:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 15132 2024-09-16T01:23:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:23:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2024-09-16T01:23:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-16T01:23:15.429 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2024-09-16T01:23:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1266899739 2024-09-16T01:23:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:23:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:23:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2024-09-16T01:23:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-16T01:23:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2024-09-16T01:23:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1266899739 2024-09-16T01:23:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:23:15.430 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.15132 192.168.0.1:0/1266899739", 2024-09-16T01:23:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/1266899739", 2024-09-16T01:23:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 5, 2024-09-16T01:23:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 24, 2024-09-16T01:23:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 84, 2024-09-16T01:23:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2024-09-16T01:23:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklisted": false, 2024-09-16T01:23:15.431 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs" 2024-09-16T01:23:15.431 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:23:15.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:15.437 DEBUG:teuthology.orchestra.run.smithi063:> stat --file-system '--printf=%T 2024-09-16T01:23:15.437 DEBUG:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:15.455 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2024-09-16T01:23:15.455 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:15.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:15.456 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:15.522 INFO:teuthology.run_tasks:Running task exec... 2024-09-16T01:23:15.533 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T01:23:15.534 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi063.front.sepia.ceph.com 2024-09-16T01:23:15.534 DEBUG:teuthology.orchestra.run.smithi063:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-16T01:23:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.665+0000 7fcae5de4640 1 -- 172.21.15.63:0/4178333420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae01025e0 msgr2=0x7fcae01049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.665+0000 7fcae5de4640 1 --2- 172.21.15.63:0/4178333420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae01025e0 0x7fcae01049d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009900 tx=0x7fcad002a410 comp rx=0 tx=0).stop 2024-09-16T01:23:15.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.666+0000 7fcae5de4640 1 -- 172.21.15.63:0/4178333420 shutdown_connections 2024-09-16T01:23:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.666+0000 7fcae5de4640 1 --2- 172.21.15.63:0/4178333420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae0107840 0x7fcae0109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.666+0000 7fcae5de4640 1 --2- 172.21.15.63:0/4178333420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae0104f10 0x7fcae0107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.666+0000 7fcae5de4640 1 --2- 172.21.15.63:0/4178333420 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae01025e0 0x7fcae01049d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.666+0000 7fcae5de4640 1 -- 172.21.15.63:0/4178333420 >> 172.21.15.63:0/4178333420 conn(0x7fcae00fc1e0 msgr2=0x7fcae00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.666+0000 7fcae5de4640 1 -- 172.21.15.63:0/4178333420 shutdown_connections 2024-09-16T01:23:15.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.666+0000 7fcae5de4640 1 -- 172.21.15.63:0/4178333420 wait complete. 2024-09-16T01:23:15.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.666+0000 7fcae5de4640 1 Processor -- start 2024-09-16T01:23:15.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.666+0000 7fcae5de4640 1 -- start start 2024-09-16T01:23:15.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcae5de4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae01025e0 0x7fcae0101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:15.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcae5de4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae0104f10 0x7fcae0100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:15.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcae5de4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae0107840 0x7fcae0100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:15.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcae5de4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcae010d700 con 0x7fcae01025e0 2024-09-16T01:23:15.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcae5de4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcae010d580 con 0x7fcae0104f10 2024-09-16T01:23:15.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcae5de4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcae010d880 con 0x7fcae0107840 2024-09-16T01:23:15.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae01025e0 0x7fcae0101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:15.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae01025e0 0x7fcae0101f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52560/0 (socket says 172.21.15.63:52560) 2024-09-16T01:23:15.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadf7fe640 1 -- 172.21.15.63:0/2791516911 learned_addr learned my addr 172.21.15.63:0/2791516911 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:15.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadffff640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae0107840 0x7fcae0100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:15.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadf7fe640 1 -- 172.21.15.63:0/2791516911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae0107840 msgr2=0x7fcae0100ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:15.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadf7fe640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae0107840 0x7fcae0100ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadf7fe640 1 -- 172.21.15.63:0/2791516911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae0104f10 msgr2=0x7fcae0100590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:15.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcad6ffd640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae0104f10 0x7fcae0100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:15.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadf7fe640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae0104f10 0x7fcae0100590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadf7fe640 1 -- 172.21.15.63:0/2791516911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae0101360 con 0x7fcae01025e0 2024-09-16T01:23:15.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadffff640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae0107840 0x7fcae0100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:15.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadf7fe640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae01025e0 0x7fcae0101f50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcad0004770 tx=0x7fcad00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:15.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadd7fa640 1 -- 172.21.15.63:0/2791516911 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad003f030 con 0x7fcae01025e0 2024-09-16T01:23:15.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadd7fa640 1 -- 172.21.15.63:0/2791516911 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcad0003cb0 con 0x7fcae01025e0 2024-09-16T01:23:15.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcae5de4640 1 -- 172.21.15.63:0/2791516911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae01a1e50 con 0x7fcae01025e0 2024-09-16T01:23:15.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcadd7fa640 1 -- 172.21.15.63:0/2791516911 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad0035070 con 0x7fcae01025e0 2024-09-16T01:23:15.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.667+0000 7fcae5de4640 1 -- 172.21.15.63:0/2791516911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae01a2260 con 0x7fcae01025e0 2024-09-16T01:23:15.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.668+0000 7fcae5de4640 1 -- 172.21.15.63:0/2791516911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcae00fdcd0 con 0x7fcae01025e0 2024-09-16T01:23:15.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.670+0000 7fcadd7fa640 1 -- 172.21.15.63:0/2791516911 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcad0042030 con 0x7fcae01025e0 2024-09-16T01:23:15.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.671+0000 7fcadd7fa640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcacc0a32f0 0x7fcacc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:15.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.671+0000 7fcad6ffd640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcacc0a32f0 0x7fcacc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:15.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.671+0000 7fcadd7fa640 1 -- 172.21.15.63:0/2791516911 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcad00f02c0 con 0x7fcae01025e0 2024-09-16T01:23:15.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.671+0000 7fcad6ffd640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcacc0a32f0 0x7fcacc0a57b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcac8005fd0 tx=0x7fcac8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:15.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.675+0000 7fcadd7fa640 1 -- 172.21.15.63:0/2791516911 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcad00bcfe0 con 0x7fcae01025e0 2024-09-16T01:23:15.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:15.889+0000 7fcae5de4640 1 -- 172.21.15.63:0/2791516911 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fcae0062630 con 0x7fcae01025e0 2024-09-16T01:23:16.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.364+0000 7fcadd7fa640 1 -- 172.21.15.63:0/2791516911 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7fcad00bc8e0 con 0x7fcae01025e0 2024-09-16T01:23:16.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 -- 172.21.15.63:0/2791516911 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcacc0a32f0 msgr2=0x7fcacc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcacc0a32f0 0x7fcacc0a57b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcac8005fd0 tx=0x7fcac8005850 comp rx=0 tx=0).stop 2024-09-16T01:23:16.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 -- 172.21.15.63:0/2791516911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae01025e0 msgr2=0x7fcae0101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae01025e0 0x7fcae0101f50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcad0004770 tx=0x7fcad00042f0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 -- 172.21.15.63:0/2791516911 shutdown_connections 2024-09-16T01:23:16.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcacc0a32f0 0x7fcacc0a57b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae0107840 0x7fcae0100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcae0104f10 0x7fcae0100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 --2- 172.21.15.63:0/2791516911 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcae01025e0 0x7fcae0101f50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 -- 172.21.15.63:0/2791516911 >> 172.21.15.63:0/2791516911 conn(0x7fcae00fc1e0 msgr2=0x7fcae0102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:16.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 -- 172.21.15.63:0/2791516911 shutdown_connections 2024-09-16T01:23:16.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.366+0000 7fcae5de4640 1 -- 172.21.15.63:0/2791516911 wait complete. 2024-09-16T01:23:16.379 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-16T01:23:16.390 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-16T01:23:16.413 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:23:16.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.516+0000 7f2984578640 1 -- 172.21.15.63:0/3559169718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f297c1025b0 msgr2=0x7f297c1049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.516+0000 7f2984578640 1 --2- 172.21.15.63:0/3559169718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f297c1025b0 0x7f297c1049a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2978009900 tx=0x7f297802a410 comp rx=0 tx=0).stop 2024-09-16T01:23:16.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.516+0000 7f2984578640 1 -- 172.21.15.63:0/3559169718 shutdown_connections 2024-09-16T01:23:16.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.516+0000 7f2984578640 1 --2- 172.21.15.63:0/3559169718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f297c107810 0x7f297c109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.516+0000 7f2984578640 1 --2- 172.21.15.63:0/3559169718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f297c104ee0 0x7f297c1072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.516+0000 7f2984578640 1 --2- 172.21.15.63:0/3559169718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f297c1025b0 0x7f297c1049a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.516+0000 7f2984578640 1 -- 172.21.15.63:0/3559169718 >> 172.21.15.63:0/3559169718 conn(0x7f297c0fc1b0 msgr2=0x7f297c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:16.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.516+0000 7f2984578640 1 -- 172.21.15.63:0/3559169718 shutdown_connections 2024-09-16T01:23:16.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.516+0000 7f2984578640 1 -- 172.21.15.63:0/3559169718 wait complete. 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2984578640 1 Processor -- start 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2984578640 1 -- start start 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2984578640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f297c1025b0 0x7f297c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2984578640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f297c104ee0 0x7f297c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2984578640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f297c107810 0x7f297c1a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2984578640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f297c10d6d0 con 0x7f297c104ee0 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2984578640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f297c10d550 con 0x7f297c1025b0 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2984578640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f297c10d850 con 0x7f297c107810 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2981b13640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f297c104ee0 0x7f297c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2981b13640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f297c104ee0 0x7f297c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52572/0 (socket says 172.21.15.63:52572) 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2981b13640 1 -- 172.21.15.63:0/487389246 learned_addr learned my addr 172.21.15.63:0/487389246 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:16.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2982b15640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f297c107810 0x7f297c1a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2981b13640 1 -- 172.21.15.63:0/487389246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f297c107810 msgr2=0x7f297c1a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2981b13640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f297c107810 0x7f297c1a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2982314640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f297c1025b0 0x7f297c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2981b13640 1 -- 172.21.15.63:0/487389246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f297c1025b0 msgr2=0x7f297c19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2981b13640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f297c1025b0 0x7f297c19a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.517+0000 7f2981b13640 1 -- 172.21.15.63:0/487389246 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c1a1c50 con 0x7f297c104ee0 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.518+0000 7f2981b13640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f297c104ee0 0x7f297c19a570 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f297000d770 tx=0x7f297000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.518+0000 7f296f7fe640 1 -- 172.21.15.63:0/487389246 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970017070 con 0x7f297c104ee0 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.518+0000 7f296f7fe640 1 -- 172.21.15.63:0/487389246 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2970009c30 con 0x7f297c104ee0 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.518+0000 7f296f7fe640 1 -- 172.21.15.63:0/487389246 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297000f620 con 0x7f297c104ee0 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.518+0000 7f2984578640 1 -- 172.21.15.63:0/487389246 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297c1a1f40 con 0x7f297c104ee0 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.518+0000 7f2984578640 1 -- 172.21.15.63:0/487389246 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f297c1a2450 con 0x7f297c104ee0 2024-09-16T01:23:16.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.519+0000 7f2984578640 1 -- 172.21.15.63:0/487389246 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297c109380 con 0x7f297c104ee0 2024-09-16T01:23:16.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.520+0000 7f296f7fe640 1 -- 172.21.15.63:0/487389246 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f297001a070 con 0x7f297c104ee0 2024-09-16T01:23:16.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.521+0000 7f296f7fe640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f29680a32d0 0x7f29680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.521+0000 7f2982314640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f29680a32d0 0x7f29680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.521+0000 7f296f7fe640 1 -- 172.21.15.63:0/487389246 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f29700cf390 con 0x7f297c104ee0 2024-09-16T01:23:16.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.521+0000 7f2982314640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f29680a32d0 0x7f29680a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f297802a930 tx=0x7f2978000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:16.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.524+0000 7f296f7fe640 1 -- 172.21.15.63:0/487389246 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2970009de0 con 0x7f297c104ee0 2024-09-16T01:23:16.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:16 smithi063 ceph-mon[31070]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-16T01:23:16.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:16 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2791516911' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-16T01:23:16.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:16 smithi192 ceph-mon[34775]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-16T01:23:16.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:16 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2791516911' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-16T01:23:16.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:16 smithi162 ceph-mon[34539]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-16T01:23:16.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:16 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2791516911' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-16T01:23:16.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.701+0000 7f2984578640 1 -- 172.21.15.63:0/487389246 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f297c02da10 con 0x7f297c104ee0 2024-09-16T01:23:16.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.702+0000 7f296f7fe640 1 -- 172.21.15.63:0/487389246 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22710 (secure 0 0 0) 0x7f297009c130 con 0x7f297c104ee0 2024-09-16T01:23:16.704 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:23:16.704 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:39.083854+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:16.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 -- 172.21.15.63:0/487389246 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f29680a32d0 msgr2=0x7f29680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f29680a32d0 0x7f29680a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f297802a930 tx=0x7f2978000bc0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 -- 172.21.15.63:0/487389246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f297c104ee0 msgr2=0x7f297c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f297c104ee0 0x7f297c19a570 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f297000d770 tx=0x7f297000dc30 comp rx=0 tx=0).stop 2024-09-16T01:23:16.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 -- 172.21.15.63:0/487389246 shutdown_connections 2024-09-16T01:23:16.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f29680a32d0 0x7f29680a5790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f297c107810 0x7f297c1a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f297c104ee0 0x7f297c19a570 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 --2- 172.21.15.63:0/487389246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f297c1025b0 0x7f297c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 -- 172.21.15.63:0/487389246 >> 172.21.15.63:0/487389246 conn(0x7f297c0fc1b0 msgr2=0x7f297c101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:16.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 -- 172.21.15.63:0/487389246 shutdown_connections 2024-09-16T01:23:16.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.704+0000 7f2984578640 1 -- 172.21.15.63:0/487389246 wait complete. 2024-09-16T01:23:16.717 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:16:51.610676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T01:21:24.729872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T01:21:27.006661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:23:16.717 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:23:16.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.823+0000 7f603c9c4640 1 -- 172.21.15.63:0/2298868077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6038101b30 msgr2=0x7f6038101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.823+0000 7f603c9c4640 1 --2- 172.21.15.63:0/2298868077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6038101b30 0x7f6038101f30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6028009ca0 tx=0x7f602802a8c0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.823+0000 7f603c9c4640 1 -- 172.21.15.63:0/2298868077 shutdown_connections 2024-09-16T01:23:16.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.823+0000 7f603c9c4640 1 --2- 172.21.15.63:0/2298868077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60381036e0 0x7f6038109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.823+0000 7f603c9c4640 1 --2- 172.21.15.63:0/2298868077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6038102d20 0x7f60381031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.823+0000 7f603c9c4640 1 --2- 172.21.15.63:0/2298868077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6038101b30 0x7f6038101f30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.823+0000 7f603c9c4640 1 -- 172.21.15.63:0/2298868077 >> 172.21.15.63:0/2298868077 conn(0x7f60380fd2b0 msgr2=0x7f60380ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.823+0000 7f603c9c4640 1 -- 172.21.15.63:0/2298868077 shutdown_connections 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.823+0000 7f603c9c4640 1 -- 172.21.15.63:0/2298868077 wait complete. 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.823+0000 7f603c9c4640 1 Processor -- start 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f603c9c4640 1 -- start start 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f603c9c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6038101b30 0x7f6038197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f603c9c4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6038102d20 0x7f60381982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f603c9c4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60381036e0 0x7f603819f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f603c9c4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f603810d660 con 0x7f60381036e0 2024-09-16T01:23:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f603c9c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f603810d4e0 con 0x7f6038101b30 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f603c9c4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f603810d7e0 con 0x7f6038102d20 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6036d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60381036e0 0x7f603819f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6036d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60381036e0 0x7f603819f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52602/0 (socket says 172.21.15.63:52602) 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6036d9d640 1 -- 172.21.15.63:0/2111062693 learned_addr learned my addr 172.21.15.63:0/2111062693 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f603659c640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6038101b30 0x7f6038197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6035d9b640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6038102d20 0x7f60381982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6036d9d640 1 -- 172.21.15.63:0/2111062693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6038102d20 msgr2=0x7f60381982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6036d9d640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6038102d20 0x7f60381982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6036d9d640 1 -- 172.21.15.63:0/2111062693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6038101b30 msgr2=0x7f6038197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6036d9d640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6038101b30 0x7f6038197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6036d9d640 1 -- 172.21.15.63:0/2111062693 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603819f9d0 con 0x7f60381036e0 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6035d9b640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6038102d20 0x7f60381982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:16.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f6036d9d640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60381036e0 0x7f603819f360 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f603000e970 tx=0x7f603000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:16.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.824+0000 7f602f7fe640 1 -- 172.21.15.63:0/2111062693 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603000ccc0 con 0x7f60381036e0 2024-09-16T01:23:16.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.825+0000 7f603c9c4640 1 -- 172.21.15.63:0/2111062693 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f603819fcc0 con 0x7f60381036e0 2024-09-16T01:23:16.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.825+0000 7f602f7fe640 1 -- 172.21.15.63:0/2111062693 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f603000ce60 con 0x7f60381036e0 2024-09-16T01:23:16.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.825+0000 7f602f7fe640 1 -- 172.21.15.63:0/2111062693 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030010430 con 0x7f60381036e0 2024-09-16T01:23:16.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.825+0000 7f603c9c4640 1 -- 172.21.15.63:0/2111062693 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60381a01c0 con 0x7f60381036e0 2024-09-16T01:23:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.826+0000 7f603c9c4640 1 -- 172.21.15.63:0/2111062693 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6038109030 con 0x7f60381036e0 2024-09-16T01:23:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.827+0000 7f602f7fe640 1 -- 172.21.15.63:0/2111062693 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6030004ff0 con 0x7f60381036e0 2024-09-16T01:23:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.828+0000 7f602f7fe640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60240a3250 0x7f60240a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.828+0000 7f602f7fe640 1 -- 172.21.15.63:0/2111062693 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f60300cfdd0 con 0x7f60381036e0 2024-09-16T01:23:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.828+0000 7f603659c640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60240a3250 0x7f60240a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.828+0000 7f603659c640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60240a3250 0x7f60240a5710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6028000f80 tx=0x7f6028031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:16.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:16.832+0000 7f602f7fe640 1 -- 172.21.15.63:0/2111062693 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60300d3030 con 0x7f60381036e0 2024-09-16T01:23:17.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.006+0000 7f603c9c4640 1 -- 172.21.15.63:0/2111062693 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6038062df0 con 0x7f60381036e0 2024-09-16T01:23:17.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.006+0000 7f602f7fe640 1 -- 172.21.15.63:0/2111062693 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f603009caf0 con 0x7f60381036e0 2024-09-16T01:23:17.007 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-09-16T01:23:17.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 -- 172.21.15.63:0/2111062693 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60240a3250 msgr2=0x7f60240a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60240a3250 0x7f60240a5710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6028000f80 tx=0x7f6028031000 comp rx=0 tx=0).stop 2024-09-16T01:23:17.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 -- 172.21.15.63:0/2111062693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60381036e0 msgr2=0x7f603819f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60381036e0 0x7f603819f360 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f603000e970 tx=0x7f603000ed70 comp rx=0 tx=0).stop 2024-09-16T01:23:17.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 -- 172.21.15.63:0/2111062693 shutdown_connections 2024-09-16T01:23:17.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60240a3250 0x7f60240a5710 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60381036e0 0x7f603819f360 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6038102d20 0x7f60381982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 --2- 172.21.15.63:0/2111062693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6038101b30 0x7f6038197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 -- 172.21.15.63:0/2111062693 >> 172.21.15.63:0/2111062693 conn(0x7f60380fd2b0 msgr2=0x7f6038106200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:17.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 -- 172.21.15.63:0/2111062693 shutdown_connections 2024-09-16T01:23:17.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.008+0000 7f603c9c4640 1 -- 172.21.15.63:0/2111062693 wait complete. 2024-09-16T01:23:17.021 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T01:23:17.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.126+0000 7fc82e911640 1 -- 172.21.15.63:0/2401099944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc828102e80 msgr2=0x7fc828103300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.126+0000 7fc82e911640 1 --2- 172.21.15.63:0/2401099944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc828102e80 0x7fc828103300 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009900 tx=0x7fc81c02a410 comp rx=0 tx=0).stop 2024-09-16T01:23:17.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.126+0000 7fc82e911640 1 -- 172.21.15.63:0/2401099944 shutdown_connections 2024-09-16T01:23:17.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.126+0000 7fc82e911640 1 --2- 172.21.15.63:0/2401099944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc828103840 0x7fc82810a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.126+0000 7fc82e911640 1 --2- 172.21.15.63:0/2401099944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc828102e80 0x7fc828103300 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.126+0000 7fc82e911640 1 --2- 172.21.15.63:0/2401099944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8280ffe10 0x7fc828100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.126+0000 7fc82e911640 1 -- 172.21.15.63:0/2401099944 >> 172.21.15.63:0/2401099944 conn(0x7fc8280fb950 msgr2=0x7fc8280fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.126+0000 7fc82e911640 1 -- 172.21.15.63:0/2401099944 shutdown_connections 2024-09-16T01:23:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.126+0000 7fc82e911640 1 -- 172.21.15.63:0/2401099944 wait complete. 2024-09-16T01:23:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc82e911640 1 Processor -- start 2024-09-16T01:23:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc82e911640 1 -- start start 2024-09-16T01:23:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc82e911640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8280ffe10 0x7fc828197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc82e911640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc828102e80 0x7fc828198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc82e911640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc828103840 0x7fc82819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc82e911640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc82810d650 con 0x7fc828102e80 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc82e911640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc82810d4d0 con 0x7fc8280ffe10 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc82e911640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc82810d7d0 con 0x7fc828103840 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc8277fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc828102e80 0x7fc828198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc8277fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc828102e80 0x7fc828198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52612/0 (socket says 172.21.15.63:52612) 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc8277fe640 1 -- 172.21.15.63:0/2641666301 learned_addr learned my addr 172.21.15.63:0/2641666301 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc827fff640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8280ffe10 0x7fc828197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.127+0000 7fc82ceae640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc828103840 0x7fc82819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc8277fe640 1 -- 172.21.15.63:0/2641666301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc828103840 msgr2=0x7fc82819f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc8277fe640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc828103840 0x7fc82819f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc8277fe640 1 -- 172.21.15.63:0/2641666301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8280ffe10 msgr2=0x7fc828197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc8277fe640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8280ffe10 0x7fc828197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc8277fe640 1 -- 172.21.15.63:0/2641666301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82819fa40 con 0x7fc828102e80 2024-09-16T01:23:17.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc8277fe640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc828102e80 0x7fc828198360 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc81c005940 tx=0x7fc81c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:17.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc8257fa640 1 -- 172.21.15.63:0/2641666301 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c03f030 con 0x7fc828102e80 2024-09-16T01:23:17.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc8257fa640 1 -- 172.21.15.63:0/2641666301 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc81c003cb0 con 0x7fc828102e80 2024-09-16T01:23:17.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc82e911640 1 -- 172.21.15.63:0/2641666301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82819fcd0 con 0x7fc828102e80 2024-09-16T01:23:17.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc8257fa640 1 -- 172.21.15.63:0/2641666301 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c035070 con 0x7fc828102e80 2024-09-16T01:23:17.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.128+0000 7fc82e911640 1 -- 172.21.15.63:0/2641666301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8281a01c0 con 0x7fc828102e80 2024-09-16T01:23:17.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.129+0000 7fc82e911640 1 -- 172.21.15.63:0/2641666301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc828109210 con 0x7fc828102e80 2024-09-16T01:23:17.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.130+0000 7fc8257fa640 1 -- 172.21.15.63:0/2641666301 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc81c042030 con 0x7fc828102e80 2024-09-16T01:23:17.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.131+0000 7fc8257fa640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc8100a3250 0x7fc8100a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.131+0000 7fc827fff640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc8100a3250 0x7fc8100a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.131+0000 7fc8257fa640 1 -- 172.21.15.63:0/2641666301 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc81c0eff60 con 0x7fc828102e80 2024-09-16T01:23:17.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.131+0000 7fc827fff640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc8100a3250 0x7fc8100a5710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc818005fd0 tx=0x7fc818005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:17.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.135+0000 7fc8257fa640 1 -- 172.21.15.63:0/2641666301 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc81c0bcc80 con 0x7fc828102e80 2024-09-16T01:23:17.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.312+0000 7fc82e911640 1 -- 172.21.15.63:0/2641666301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc828062df0 con 0x7fc828102e80 2024-09-16T01:23:17.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.313+0000 7fc8257fa640 1 -- 172.21.15.63:0/2641666301 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7fc81c0bc580 con 0x7fc828102e80 2024-09-16T01:23:17.314 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-09-16T01:23:17.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 -- 172.21.15.63:0/2641666301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc8100a3250 msgr2=0x7fc8100a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc8100a3250 0x7fc8100a5710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc818005fd0 tx=0x7fc818005850 comp rx=0 tx=0).stop 2024-09-16T01:23:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 -- 172.21.15.63:0/2641666301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc828102e80 msgr2=0x7fc828198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc828102e80 0x7fc828198360 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc81c005940 tx=0x7fc81c004340 comp rx=0 tx=0).stop 2024-09-16T01:23:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 -- 172.21.15.63:0/2641666301 shutdown_connections 2024-09-16T01:23:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc8100a3250 0x7fc8100a5710 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc828103840 0x7fc82819f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc828102e80 0x7fc828198360 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 --2- 172.21.15.63:0/2641666301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8280ffe10 0x7fc828197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 -- 172.21.15.63:0/2641666301 >> 172.21.15.63:0/2641666301 conn(0x7fc8280fb950 msgr2=0x7fc8281063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 -- 172.21.15.63:0/2641666301 shutdown_connections 2024-09-16T01:23:17.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.315+0000 7fc82e911640 1 -- 172.21.15.63:0/2641666301 wait complete. 2024-09-16T01:23:17.327 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T01:23:17.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.434+0000 7f327ee5e640 1 -- 172.21.15.63:0/1474335886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32781036c0 msgr2=0x7f3278109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.434+0000 7f327ee5e640 1 --2- 172.21.15.63:0/1474335886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32781036c0 0x7f3278109f50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3270009ca0 tx=0x7f327002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.434+0000 7f327ee5e640 1 -- 172.21.15.63:0/1474335886 shutdown_connections 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.434+0000 7f327ee5e640 1 --2- 172.21.15.63:0/1474335886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32781036c0 0x7f3278109f50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.434+0000 7f327ee5e640 1 --2- 172.21.15.63:0/1474335886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3278102d00 0x7f3278103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.434+0000 7f327ee5e640 1 --2- 172.21.15.63:0/1474335886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3278101b10 0x7f3278101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.434+0000 7f327ee5e640 1 -- 172.21.15.63:0/1474335886 >> 172.21.15.63:0/1474335886 conn(0x7f32780fd2b0 msgr2=0x7f32780ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.434+0000 7f327ee5e640 1 -- 172.21.15.63:0/1474335886 shutdown_connections 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.434+0000 7f327ee5e640 1 -- 172.21.15.63:0/1474335886 wait complete. 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f327ee5e640 1 Processor -- start 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f327ee5e640 1 -- start start 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f327ee5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3278101b10 0x7f3278197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f327ee5e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3278102d00 0x7f3278198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f327ee5e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32781036c0 0x7f327819f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f327ee5e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f327810d620 con 0x7f3278102d00 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f327ee5e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f327810d4a0 con 0x7f3278101b10 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f327ee5e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f327810d7a0 con 0x7f32781036c0 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f3277fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3278102d00 0x7f3278198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f3277fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3278102d00 0x7f3278198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52626/0 (socket says 172.21.15.63:52626) 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f3277fff640 1 -- 172.21.15.63:0/3931290828 learned_addr learned my addr 172.21.15.63:0/3931290828 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f327cbfa640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3278101b10 0x7f3278197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f3277fff640 1 -- 172.21.15.63:0/3931290828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32781036c0 msgr2=0x7f327819f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f3277fff640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32781036c0 0x7f327819f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f3277fff640 1 -- 172.21.15.63:0/3931290828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3278101b10 msgr2=0x7f3278197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f3277fff640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3278101b10 0x7f3278197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f3277fff640 1 -- 172.21.15.63:0/3931290828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327819f940 con 0x7f3278102d00 2024-09-16T01:23:17.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.435+0000 7f327cbfa640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3278101b10 0x7f3278197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:17.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.436+0000 7f3277fff640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3278102d00 0x7f3278198270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f326400d950 tx=0x7f326400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:17.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.436+0000 7f3275ffb640 1 -- 172.21.15.63:0/3931290828 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264017070 con 0x7f3278102d00 2024-09-16T01:23:17.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.436+0000 7f3275ffb640 1 -- 172.21.15.63:0/3931290828 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3264009c30 con 0x7f3278102d00 2024-09-16T01:23:17.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.436+0000 7f327ee5e640 1 -- 172.21.15.63:0/3931290828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f327819fc30 con 0x7f3278102d00 2024-09-16T01:23:17.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.436+0000 7f3275ffb640 1 -- 172.21.15.63:0/3931290828 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326400f620 con 0x7f3278102d00 2024-09-16T01:23:17.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.436+0000 7f327ee5e640 1 -- 172.21.15.63:0/3931290828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32781a01d0 con 0x7f3278102d00 2024-09-16T01:23:17.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.437+0000 7f327ee5e640 1 -- 172.21.15.63:0/3931290828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3278108ff0 con 0x7f3278102d00 2024-09-16T01:23:17.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.438+0000 7f3275ffb640 1 -- 172.21.15.63:0/3931290828 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f32640109a0 con 0x7f3278102d00 2024-09-16T01:23:17.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.439+0000 7f3275ffb640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f32680a32d0 0x7f32680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.439+0000 7f3275ffb640 1 -- 172.21.15.63:0/3931290828 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f32640cf620 con 0x7f3278102d00 2024-09-16T01:23:17.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.439+0000 7f327cbfa640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f32680a32d0 0x7f32680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.439+0000 7f327cbfa640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f32680a32d0 0x7f32680a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f326c005fd0 tx=0x7f326c005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:17.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.443+0000 7f3275ffb640 1 -- 172.21.15.63:0/3931290828 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3264009de0 con 0x7f3278102d00 2024-09-16T01:23:17.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:17 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2791516911' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-16T01:23:17.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:17 smithi063 ceph-mon[31070]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:23:17.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:17 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/487389246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:23:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:17 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2111062693' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:23:17.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:17 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2641666301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:23:17.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.620+0000 7f327ee5e640 1 -- 172.21.15.63:0/3931290828 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f327802d7c0 con 0x7f3278102d00 2024-09-16T01:23:17.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.621+0000 7f3275ffb640 1 -- 172.21.15.63:0/3931290828 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f327802d7c0 con 0x7f3278102d00 2024-09-16T01:23:17.622 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-09-16T01:23:17.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 -- 172.21.15.63:0/3931290828 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f32680a32d0 msgr2=0x7f32680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f32680a32d0 0x7f32680a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f326c005fd0 tx=0x7f326c005ee0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 -- 172.21.15.63:0/3931290828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3278102d00 msgr2=0x7f3278198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3278102d00 0x7f3278198270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f326400d950 tx=0x7f326400de10 comp rx=0 tx=0).stop 2024-09-16T01:23:17.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 -- 172.21.15.63:0/3931290828 shutdown_connections 2024-09-16T01:23:17.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f32680a32d0 0x7f32680a5790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32781036c0 0x7f327819f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3278102d00 0x7f3278198270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 --2- 172.21.15.63:0/3931290828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3278101b10 0x7f3278197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 -- 172.21.15.63:0/3931290828 >> 172.21.15.63:0/3931290828 conn(0x7f32780fd2b0 msgr2=0x7f32781061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:17.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 -- 172.21.15.63:0/3931290828 shutdown_connections 2024-09-16T01:23:17.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:17.623+0000 7f327ee5e640 1 -- 172.21.15.63:0/3931290828 wait complete. 2024-09-16T01:23:17.636 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-16T01:23:17.636 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:23:17.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:17 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2791516911' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-16T01:23:17.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:17 smithi192 ceph-mon[34775]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:23:17.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:17 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/487389246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:23:17.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:17 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2111062693' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:23:17.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:17 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2641666301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:23:17.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:17 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2791516911' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-16T01:23:17.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:17 smithi162 ceph-mon[34539]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:23:17.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:17 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/487389246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:23:17.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:17 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2111062693' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:23:17.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:17 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2641666301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:23:17.893 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.443+0000 7f935b30f640 1 -- 172.21.15.63:0/3958080889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9354106f20 msgr2=0x7f935410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.443+0000 7f935b30f640 1 --2- 172.21.15.63:0/3958080889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9354106f20 0x7f935410eaa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f934c009900 tx=0x7f934c02a410 comp rx=0 tx=0).stop 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.443+0000 7f935b30f640 1 -- 172.21.15.63:0/3958080889 shutdown_connections 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.443+0000 7f935b30f640 1 --2- 172.21.15.63:0/3958080889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9354106f20 0x7f935410eaa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.443+0000 7f935b30f640 1 --2- 172.21.15.63:0/3958080889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93541027a0 0x7f93541067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.443+0000 7f935b30f640 1 --2- 172.21.15.63:0/3958080889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9354101df0 0x7f93541021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.443+0000 7f935b30f640 1 -- 172.21.15.63:0/3958080889 >> 172.21.15.63:0/3958080889 conn(0x7f93540fd8f0 msgr2=0x7f93540ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.443+0000 7f935b30f640 1 -- 172.21.15.63:0/3958080889 shutdown_connections 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.443+0000 7f935b30f640 1 -- 172.21.15.63:0/3958080889 wait complete. 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f935b30f640 1 Processor -- start 2024-09-16T01:23:18.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f935b30f640 1 -- start start 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f935b30f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9354101df0 0x7f93541983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f935b30f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93541027a0 0x7f93541988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f935b30f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9354106f20 0x7f935419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f935b30f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9354111e50 con 0x7f9354106f20 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f935b30f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9354111cd0 con 0x7f93541027a0 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f935b30f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9354111fd0 con 0x7f9354101df0 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f93598ac640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9354106f20 0x7f935419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f93598ac640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9354106f20 0x7f935419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52654/0 (socket says 172.21.15.63:52654) 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f93598ac640 1 -- 172.21.15.63:0/4202758962 learned_addr learned my addr 172.21.15.63:0/4202758962 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f93590ab640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9354101df0 0x7f93541983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f93588aa640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93541027a0 0x7f93541988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f93598ac640 1 -- 172.21.15.63:0/4202758962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9354101df0 msgr2=0x7f93541983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f93598ac640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9354101df0 0x7f93541983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f93598ac640 1 -- 172.21.15.63:0/4202758962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93541027a0 msgr2=0x7f93541988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f93598ac640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93541027a0 0x7f93541988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.444+0000 7f93598ac640 1 -- 172.21.15.63:0/4202758962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935419d360 con 0x7f9354106f20 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.445+0000 7f93598ac640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9354106f20 0x7f935419cc80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f934c009a20 tx=0x7f934c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.445+0000 7f93467fc640 1 -- 172.21.15.63:0/4202758962 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c03f030 con 0x7f9354106f20 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.445+0000 7f935b30f640 1 -- 172.21.15.63:0/4202758962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935419d5f0 con 0x7f9354106f20 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.445+0000 7f93467fc640 1 -- 172.21.15.63:0/4202758962 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f934c0044d0 con 0x7f9354106f20 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.445+0000 7f93467fc640 1 -- 172.21.15.63:0/4202758962 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c035070 con 0x7f9354106f20 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.445+0000 7f935b30f640 1 -- 172.21.15.63:0/4202758962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93541a4f30 con 0x7f9354106f20 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.446+0000 7f935b30f640 1 -- 172.21.15.63:0/4202758962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93541032d0 con 0x7f9354106f20 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.447+0000 7f93467fc640 1 -- 172.21.15.63:0/4202758962 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f934c042030 con 0x7f9354106f20 2024-09-16T01:23:18.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.448+0000 7f93467fc640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93400a3240 0x7f93400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.448+0000 7f93590ab640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93400a3240 0x7f93400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.448+0000 7f93467fc640 1 -- 172.21.15.63:0/4202758962 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f934c0f0030 con 0x7f9354106f20 2024-09-16T01:23:18.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.448+0000 7f93590ab640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93400a3240 0x7f93400a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9348005c40 tx=0x7f934800a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:18.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.451+0000 7f93467fc640 1 -- 172.21.15.63:0/4202758962 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f934c0bcd50 con 0x7f9354106f20 2024-09-16T01:23:18.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.665+0000 7f935b30f640 1 -- 172.21.15.63:0/4202758962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93541021d0 con 0x7f9354106f20 2024-09-16T01:23:18.667 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:18 smithi063 ceph-mon[31070]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-16T01:23:18.667 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:18 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3931290828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:23:18.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.666+0000 7f93467fc640 1 -- 172.21.15.63:0/4202758962 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11909 (secure 0 0 0) 0x7f934c0bc650 con 0x7f9354106f20 2024-09-16T01:23:18.668 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:23:18.668 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"btime":"2024-09-16T01:23:16:355817+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:23:15.890925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24467,24460,24445]},"id":1}]} 2024-09-16T01:23:18.668 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 25 2024-09-16T01:23:18.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.668+0000 7f935b30f640 1 -- 172.21.15.63:0/4202758962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93400a3240 msgr2=0x7f93400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.668+0000 7f935b30f640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93400a3240 0x7f93400a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9348005c40 tx=0x7f934800a590 comp rx=0 tx=0).stop 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.668+0000 7f935b30f640 1 -- 172.21.15.63:0/4202758962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9354106f20 msgr2=0x7f935419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.668+0000 7f935b30f640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9354106f20 0x7f935419cc80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f934c009a20 tx=0x7f934c0042e0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.668+0000 7f935b30f640 1 -- 172.21.15.63:0/4202758962 shutdown_connections 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.668+0000 7f935b30f640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f93400a3240 0x7f93400a5700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.668+0000 7f935b30f640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9354106f20 0x7f935419cc80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.668+0000 7f935b30f640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93541027a0 0x7f93541988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.668+0000 7f935b30f640 1 --2- 172.21.15.63:0/4202758962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9354101df0 0x7f93541983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.668+0000 7f935b30f640 1 -- 172.21.15.63:0/4202758962 >> 172.21.15.63:0/4202758962 conn(0x7f93540fd8f0 msgr2=0x7f93540fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.669+0000 7f935b30f640 1 -- 172.21.15.63:0/4202758962 shutdown_connections 2024-09-16T01:23:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:18.669+0000 7f935b30f640 1 -- 172.21.15.63:0/4202758962 wait complete. 2024-09-16T01:23:18.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:18 smithi192 ceph-mon[34775]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-16T01:23:18.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:18 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3931290828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:23:18.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:18 smithi162 ceph-mon[34539]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-16T01:23:18.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:18 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3931290828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:23:19.500 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-16T01:23:19.500 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-16T01:23:19.500 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:23:19.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.610+0000 7f191ce77640 1 -- 172.21.15.63:0/2310164200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1918102d20 msgr2=0x7f19181031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.610+0000 7f191ce77640 1 --2- 172.21.15.63:0/2310164200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1918102d20 0x7f19181031a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1900009900 tx=0x7f190002a410 comp rx=0 tx=0).stop 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.610+0000 7f191ce77640 1 -- 172.21.15.63:0/2310164200 shutdown_connections 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.610+0000 7f191ce77640 1 --2- 172.21.15.63:0/2310164200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19181036e0 0x7f1918109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.610+0000 7f191ce77640 1 --2- 172.21.15.63:0/2310164200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1918102d20 0x7f19181031a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.610+0000 7f191ce77640 1 --2- 172.21.15.63:0/2310164200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1918101b30 0x7f1918101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.610+0000 7f191ce77640 1 -- 172.21.15.63:0/2310164200 >> 172.21.15.63:0/2310164200 conn(0x7f19180fd2b0 msgr2=0x7f19180ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.610+0000 7f191ce77640 1 -- 172.21.15.63:0/2310164200 shutdown_connections 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.610+0000 7f191ce77640 1 -- 172.21.15.63:0/2310164200 wait complete. 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.611+0000 7f191ce77640 1 Processor -- start 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.611+0000 7f191ce77640 1 -- start start 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.611+0000 7f191ce77640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1918101b30 0x7f1918197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.611+0000 7f191ce77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1918102d20 0x7f19181982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.611+0000 7f191ce77640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19181036e0 0x7f191819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.611+0000 7f191ce77640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f191810d640 con 0x7f1918101b30 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.611+0000 7f191ce77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f191810d4c0 con 0x7f1918102d20 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.611+0000 7f191ce77640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f191810d7c0 con 0x7f19181036e0 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.611+0000 7f191659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1918101b30 0x7f1918197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f191659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1918101b30 0x7f1918197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44892/0 (socket says 172.21.15.63:44892) 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f191659c640 1 -- 172.21.15.63:0/853872180 learned_addr learned my addr 172.21.15.63:0/853872180 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f1916d9d640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19181036e0 0x7f191819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f1915d9b640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1918102d20 0x7f19181982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f191659c640 1 -- 172.21.15.63:0/853872180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19181036e0 msgr2=0x7f191819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f191659c640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19181036e0 0x7f191819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f191659c640 1 -- 172.21.15.63:0/853872180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1918102d20 msgr2=0x7f19181982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f191659c640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1918102d20 0x7f19181982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f191659c640 1 -- 172.21.15.63:0/853872180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191819f9b0 con 0x7f1918101b30 2024-09-16T01:23:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f191659c640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1918101b30 0x7f1918197da0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f190800d770 tx=0x7f190800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f190f7fe640 1 -- 172.21.15.63:0/853872180 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908017070 con 0x7f1918101b30 2024-09-16T01:23:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f190f7fe640 1 -- 172.21.15.63:0/853872180 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1908009c30 con 0x7f1918101b30 2024-09-16T01:23:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f191ce77640 1 -- 172.21.15.63:0/853872180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191819fca0 con 0x7f1918101b30 2024-09-16T01:23:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f190f7fe640 1 -- 172.21.15.63:0/853872180 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908003d00 con 0x7f1918101b30 2024-09-16T01:23:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.612+0000 7f191ce77640 1 -- 172.21.15.63:0/853872180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19181a01a0 con 0x7f1918101b30 2024-09-16T01:23:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.613+0000 7f191ce77640 1 -- 172.21.15.63:0/853872180 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1918108f90 con 0x7f1918101b30 2024-09-16T01:23:19.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.614+0000 7f190f7fe640 1 -- 172.21.15.63:0/853872180 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1908003ea0 con 0x7f1918101b30 2024-09-16T01:23:19.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.615+0000 7f190f7fe640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f19040a3250 0x7f19040a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.615+0000 7f1915d9b640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f19040a3250 0x7f19040a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.615+0000 7f190f7fe640 1 -- 172.21.15.63:0/853872180 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f19080cf6a0 con 0x7f1918101b30 2024-09-16T01:23:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.616+0000 7f1915d9b640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f19040a3250 0x7f19040a5710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1900000c00 tx=0x7f19000314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:19.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.618+0000 7f190f7fe640 1 -- 172.21.15.63:0/853872180 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f190809c3c0 con 0x7f1918101b30 2024-09-16T01:23:19.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:19 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/4202758962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:19.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:19 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/4202758962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:19.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.791+0000 7f191ce77640 1 -- 172.21.15.63:0/853872180 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1918062630 con 0x7f19040a3250 2024-09-16T01:23:19.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.798+0000 7f190f7fe640 1 -- 172.21.15.63:0/853872180 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259076 (secure 0 0 0) 0x7f1918062630 con 0x7f19040a3250 2024-09-16T01:23:19.802 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:23:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-16T01:23:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 -- 172.21.15.63:0/853872180 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f19040a3250 msgr2=0x7f19040a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f19040a3250 0x7f19040a5710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1900000c00 tx=0x7f19000314a0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 -- 172.21.15.63:0/853872180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1918101b30 msgr2=0x7f1918197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1918101b30 0x7f1918197da0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f190800d770 tx=0x7f190800dc30 comp rx=0 tx=0).stop 2024-09-16T01:23:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 -- 172.21.15.63:0/853872180 shutdown_connections 2024-09-16T01:23:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f19040a3250 0x7f19040a5710 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19181036e0 0x7f191819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1918102d20 0x7f19181982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 --2- 172.21.15.63:0/853872180 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1918101b30 0x7f1918197da0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 -- 172.21.15.63:0/853872180 >> 172.21.15.63:0/853872180 conn(0x7f19180fd2b0 msgr2=0x7f1918106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:19.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 -- 172.21.15.63:0/853872180 shutdown_connections 2024-09-16T01:23:19.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.801+0000 7f191ce77640 1 -- 172.21.15.63:0/853872180 wait complete. 2024-09-16T01:23:19.812 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:19 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/4202758962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:19.813 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-16T01:23:19.206438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656283,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":747,"num_read_kb":490,"num_write":358,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":788,"ondisk_log_size":788,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360384,"kb_used_data":11136,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581440,"statfs":{"total":1151940427776,"available":1151571394560,"internally_reserved":0,"allocated":11403264,"data_stored":7257153,"data_compressed":177609,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1521,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002909"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196446+0000","last_change":"2024-09-16T01:21:28.051261+0000","last_active":"2024-09-16T01:23:07.196446+0000","last_peered":"2024-09-16T01:23:07.196446+0000","last_clean":"2024-09-16T01:23:07.196446+0000","last_became_active":"2024-09-16T01:21:28.049073+0000","last_became_peered":"2024-09-16T01:21:28.049073+0000","last_unstale":"2024-09-16T01:23:07.196446+0000","last_undegraded":"2024-09-16T01:23:07.196446+0000","last_fullsized":"2024-09-16T01:23:07.196446+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:06.863766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195008+0000","last_change":"2024-09-16T01:21:28.049457+0000","last_active":"2024-09-16T01:23:07.195008+0000","last_peered":"2024-09-16T01:23:07.195008+0000","last_clean":"2024-09-16T01:23:07.195008+0000","last_became_active":"2024-09-16T01:21:28.048707+0000","last_became_peered":"2024-09-16T01:21:28.048707+0000","last_unstale":"2024-09-16T01:23:07.195008+0000","last_undegraded":"2024-09-16T01:23:07.195008+0000","last_fullsized":"2024-09-16T01:23:07.195008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:56.346506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199710+0000","last_change":"2024-09-16T01:21:28.052931+0000","last_active":"2024-09-16T01:23:07.199710+0000","last_peered":"2024-09-16T01:23:07.199710+0000","last_clean":"2024-09-16T01:23:07.199710+0000","last_became_active":"2024-09-16T01:21:28.052501+0000","last_became_peered":"2024-09-16T01:21:28.052501+0000","last_unstale":"2024-09-16T01:23:07.199710+0000","last_undegraded":"2024-09-16T01:23:07.199710+0000","last_fullsized":"2024-09-16T01:23:07.199710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:45:23.351452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.188397+0000","last_change":"2024-09-16T01:21:39.096279+0000","last_active":"2024-09-16T01:23:07.188397+0000","last_peered":"2024-09-16T01:23:07.188397+0000","last_clean":"2024-09-16T01:23:07.188397+0000","last_became_active":"2024-09-16T01:21:39.095886+0000","last_became_peered":"2024-09-16T01:21:39.095886+0000","last_unstale":"2024-09-16T01:23:07.188397+0000","last_undegraded":"2024-09-16T01:23:07.188397+0000","last_fullsized":"2024-09-16T01:23:07.188397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:56.530007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196025+0000","last_change":"2024-09-16T01:21:28.043473+0000","last_active":"2024-09-16T01:23:07.196025+0000","last_peered":"2024-09-16T01:23:07.196025+0000","last_clean":"2024-09-16T01:23:07.196025+0000","last_became_active":"2024-09-16T01:21:28.043127+0000","last_became_peered":"2024-09-16T01:21:28.043127+0000","last_unstale":"2024-09-16T01:23:07.196025+0000","last_undegraded":"2024-09-16T01:23:07.196025+0000","last_fullsized":"2024-09-16T01:23:07.196025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.714834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191119+0000","last_change":"2024-09-16T01:21:28.047210+0000","last_active":"2024-09-16T01:23:07.191119+0000","last_peered":"2024-09-16T01:23:07.191119+0000","last_clean":"2024-09-16T01:23:07.191119+0000","last_became_active":"2024-09-16T01:21:28.046872+0000","last_became_peered":"2024-09-16T01:21:28.046872+0000","last_unstale":"2024-09-16T01:23:07.191119+0000","last_undegraded":"2024-09-16T01:23:07.191119+0000","last_fullsized":"2024-09-16T01:23:07.191119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:22.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203794+0000","last_change":"2024-09-16T01:21:28.052212+0000","last_active":"2024-09-16T01:23:07.203794+0000","last_peered":"2024-09-16T01:23:07.203794+0000","last_clean":"2024-09-16T01:23:07.203794+0000","last_became_active":"2024-09-16T01:21:28.050307+0000","last_became_peered":"2024-09-16T01:21:28.050307+0000","last_unstale":"2024-09-16T01:23:07.203794+0000","last_undegraded":"2024-09-16T01:23:07.203794+0000","last_fullsized":"2024-09-16T01:23:07.203794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:21.869103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195182+0000","last_change":"2024-09-16T01:21:28.047980+0000","last_active":"2024-09-16T01:23:07.195182+0000","last_peered":"2024-09-16T01:23:07.195182+0000","last_clean":"2024-09-16T01:23:07.195182+0000","last_became_active":"2024-09-16T01:21:28.047671+0000","last_became_peered":"2024-09-16T01:21:28.047671+0000","last_unstale":"2024-09-16T01:23:07.195182+0000","last_undegraded":"2024-09-16T01:23:07.195182+0000","last_fullsized":"2024-09-16T01:23:07.195182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:30.501419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195767+0000","last_change":"2024-09-16T01:21:28.052468+0000","last_active":"2024-09-16T01:23:07.195767+0000","last_peered":"2024-09-16T01:23:07.195767+0000","last_clean":"2024-09-16T01:23:07.195767+0000","last_became_active":"2024-09-16T01:21:28.052156+0000","last_became_peered":"2024-09-16T01:21:28.052156+0000","last_unstale":"2024-09-16T01:23:07.195767+0000","last_undegraded":"2024-09-16T01:23:07.195767+0000","last_fullsized":"2024-09-16T01:23:07.195767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:44.631498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191145+0000","last_change":"2024-09-16T01:21:28.048278+0000","last_active":"2024-09-16T01:23:07.191145+0000","last_peered":"2024-09-16T01:23:07.191145+0000","last_clean":"2024-09-16T01:23:07.191145+0000","last_became_active":"2024-09-16T01:21:28.047892+0000","last_became_peered":"2024-09-16T01:21:28.047892+0000","last_unstale":"2024-09-16T01:23:07.191145+0000","last_undegraded":"2024-09-16T01:23:07.191145+0000","last_fullsized":"2024-09-16T01:23:07.191145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.949956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203239+0000","last_change":"2024-09-16T01:21:28.052814+0000","last_active":"2024-09-16T01:23:07.203239+0000","last_peered":"2024-09-16T01:23:07.203239+0000","last_clean":"2024-09-16T01:23:07.203239+0000","last_became_active":"2024-09-16T01:21:28.052440+0000","last_became_peered":"2024-09-16T01:21:28.052440+0000","last_unstale":"2024-09-16T01:23:07.203239+0000","last_undegraded":"2024-09-16T01:23:07.203239+0000","last_fullsized":"2024-09-16T01:23:07.203239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:47.470646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.178893+0000","last_change":"2024-09-16T01:21:28.053917+0000","last_active":"2024-09-16T01:23:07.178893+0000","last_peered":"2024-09-16T01:23:07.178893+0000","last_clean":"2024-09-16T01:23:07.178893+0000","last_became_active":"2024-09-16T01:21:28.052625+0000","last_became_peered":"2024-09-16T01:21:28.052625+0000","last_unstale":"2024-09-16T01:23:07.178893+0000","last_undegraded":"2024-09-16T01:23:07.178893+0000","last_fullsized":"2024-09-16T01:23:07.178893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:32.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.190810+0000","last_change":"2024-09-16T01:21:28.046588+0000","last_active":"2024-09-16T01:23:07.190810+0000","last_peered":"2024-09-16T01:23:07.190810+0000","last_clean":"2024-09-16T01:23:07.190810+0000","last_became_active":"2024-09-16T01:21:28.046268+0000","last_became_peered":"2024-09-16T01:21:28.046268+0000","last_unstale":"2024-09-16T01:23:07.190810+0000","last_undegraded":"2024-09-16T01:23:07.190810+0000","last_fullsized":"2024-09-16T01:23:07.190810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:49.659707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195312+0000","last_change":"2024-09-16T01:21:28.051946+0000","last_active":"2024-09-16T01:23:07.195312+0000","last_peered":"2024-09-16T01:23:07.195312+0000","last_clean":"2024-09-16T01:23:07.195312+0000","last_became_active":"2024-09-16T01:21:28.051615+0000","last_became_peered":"2024-09-16T01:21:28.051615+0000","last_unstale":"2024-09-16T01:23:07.195312+0000","last_undegraded":"2024-09-16T01:23:07.195312+0000","last_fullsized":"2024-09-16T01:23:07.195312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.462830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.197023+0000","last_change":"2024-09-16T01:21:28.047382+0000","last_active":"2024-09-16T01:23:07.197023+0000","last_peered":"2024-09-16T01:23:07.197023+0000","last_clean":"2024-09-16T01:23:07.197023+0000","last_became_active":"2024-09-16T01:21:28.045361+0000","last_became_peered":"2024-09-16T01:21:28.045361+0000","last_unstale":"2024-09-16T01:23:07.197023+0000","last_undegraded":"2024-09-16T01:23:07.197023+0000","last_fullsized":"2024-09-16T01:23:07.197023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:26.099519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.204145+0000","last_change":"2024-09-16T01:21:28.054028+0000","last_active":"2024-09-16T01:23:07.204145+0000","last_peered":"2024-09-16T01:23:07.204145+0000","last_clean":"2024-09-16T01:23:07.204145+0000","last_became_active":"2024-09-16T01:21:28.052698+0000","last_became_peered":"2024-09-16T01:21:28.052698+0000","last_unstale":"2024-09-16T01:23:07.204145+0000","last_undegraded":"2024-09-16T01:23:07.204145+0000","last_fullsized":"2024-09-16T01:23:07.204145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:01.745424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196758+0000","last_change":"2024-09-16T01:21:28.049032+0000","last_active":"2024-09-16T01:23:07.196758+0000","last_peered":"2024-09-16T01:23:07.196758+0000","last_clean":"2024-09-16T01:23:07.196758+0000","last_became_active":"2024-09-16T01:21:28.048357+0000","last_became_peered":"2024-09-16T01:21:28.048357+0000","last_unstale":"2024-09-16T01:23:07.196758+0000","last_undegraded":"2024-09-16T01:23:07.196758+0000","last_fullsized":"2024-09-16T01:23:07.196758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:17.963329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.188365+0000","last_change":"2024-09-16T01:21:28.051126+0000","last_active":"2024-09-16T01:23:07.188365+0000","last_peered":"2024-09-16T01:23:07.188365+0000","last_clean":"2024-09-16T01:23:07.188365+0000","last_became_active":"2024-09-16T01:21:28.050789+0000","last_became_peered":"2024-09-16T01:21:28.050789+0000","last_unstale":"2024-09-16T01:23:07.188365+0000","last_undegraded":"2024-09-16T01:23:07.188365+0000","last_fullsized":"2024-09-16T01:23:07.188365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:35.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199665+0000","last_change":"2024-09-16T01:21:28.045569+0000","last_active":"2024-09-16T01:23:07.199665+0000","last_peered":"2024-09-16T01:23:07.199665+0000","last_clean":"2024-09-16T01:23:07.199665+0000","last_became_active":"2024-09-16T01:21:28.044496+0000","last_became_peered":"2024-09-16T01:21:28.044496+0000","last_unstale":"2024-09-16T01:23:07.199665+0000","last_undegraded":"2024-09-16T01:23:07.199665+0000","last_fullsized":"2024-09-16T01:23:07.199665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:10.665322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191808+0000","last_change":"2024-09-16T01:21:28.047522+0000","last_active":"2024-09-16T01:23:07.191808+0000","last_peered":"2024-09-16T01:23:07.191808+0000","last_clean":"2024-09-16T01:23:07.191808+0000","last_became_active":"2024-09-16T01:21:28.047192+0000","last_became_peered":"2024-09-16T01:21:28.047192+0000","last_unstale":"2024-09-16T01:23:07.191808+0000","last_undegraded":"2024-09-16T01:23:07.191808+0000","last_fullsized":"2024-09-16T01:23:07.191808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.044980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.197674+0000","last_change":"2024-09-16T01:21:28.043184+0000","last_active":"2024-09-16T01:23:07.197674+0000","last_peered":"2024-09-16T01:23:07.197674+0000","last_clean":"2024-09-16T01:23:07.197674+0000","last_became_active":"2024-09-16T01:21:28.042787+0000","last_became_peered":"2024-09-16T01:21:28.042787+0000","last_unstale":"2024-09-16T01:23:07.197674+0000","last_undegraded":"2024-09-16T01:23:07.197674+0000","last_fullsized":"2024-09-16T01:23:07.197674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:00.633731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.204616+0000","last_change":"2024-09-16T01:21:28.050141+0000","last_active":"2024-09-16T01:23:07.204616+0000","last_peered":"2024-09-16T01:23:07.204616+0000","last_clean":"2024-09-16T01:23:07.204616+0000","last_became_active":"2024-09-16T01:21:28.049843+0000","last_became_peered":"2024-09-16T01:21:28.049843+0000","last_unstale":"2024-09-16T01:23:07.204616+0000","last_undegraded":"2024-09-16T01:23:07.204616+0000","last_fullsized":"2024-09-16T01:23:07.204616+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:39.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199563+0000","last_change":"2024-09-16T01:21:28.044260+0000","last_active":"2024-09-16T01:23:07.199563+0000","last_peered":"2024-09-16T01:23:07.199563+0000","last_clean":"2024-09-16T01:23:07.199563+0000","last_became_active":"2024-09-16T01:21:28.043959+0000","last_became_peered":"2024-09-16T01:21:28.043959+0000","last_unstale":"2024-09-16T01:23:07.199563+0000","last_undegraded":"2024-09-16T01:23:07.199563+0000","last_fullsized":"2024-09-16T01:23:07.199563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198368+0000","last_change":"2024-09-16T01:21:28.044143+0000","last_active":"2024-09-16T01:23:07.198368+0000","last_peered":"2024-09-16T01:23:07.198368+0000","last_clean":"2024-09-16T01:23:07.198368+0000","last_became_active":"2024-09-16T01:21:28.043767+0000","last_became_peered":"2024-09-16T01:21:28.043767+0000","last_unstale":"2024-09-16T01:23:07.198368+0000","last_undegraded":"2024-09-16T01:23:07.198368+0000","last_fullsized":"2024-09-16T01:23:07.198368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:25.269737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199234+0000","last_change":"2024-09-16T01:21:28.047663+0000","last_active":"2024-09-16T01:23:07.199234+0000","last_peered":"2024-09-16T01:23:07.199234+0000","last_clean":"2024-09-16T01:23:07.199234+0000","last_became_active":"2024-09-16T01:21:28.047044+0000","last_became_peered":"2024-09-16T01:21:28.047044+0000","last_unstale":"2024-09-16T01:23:07.199234+0000","last_undegraded":"2024-09-16T01:23:07.199234+0000","last_fullsized":"2024-09-16T01:23:07.199234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:44.539096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198916+0000","last_change":"2024-09-16T01:21:28.052740+0000","last_active":"2024-09-16T01:23:07.198916+0000","last_peered":"2024-09-16T01:23:07.198916+0000","last_clean":"2024-09-16T01:23:07.198916+0000","last_became_active":"2024-09-16T01:21:28.052396+0000","last_became_peered":"2024-09-16T01:21:28.052396+0000","last_unstale":"2024-09-16T01:23:07.198916+0000","last_undegraded":"2024-09-16T01:23:07.198916+0000","last_fullsized":"2024-09-16T01:23:07.198916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:49.021594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195294+0000","last_change":"2024-09-16T01:21:28.050867+0000","last_active":"2024-09-16T01:23:07.195294+0000","last_peered":"2024-09-16T01:23:07.195294+0000","last_clean":"2024-09-16T01:23:07.195294+0000","last_became_active":"2024-09-16T01:21:28.050412+0000","last_became_peered":"2024-09-16T01:21:28.050412+0000","last_unstale":"2024-09-16T01:23:07.195294+0000","last_undegraded":"2024-09-16T01:23:07.195294+0000","last_fullsized":"2024-09-16T01:23:07.195294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.286864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195783+0000","last_change":"2024-09-16T01:21:28.037593+0000","last_active":"2024-09-16T01:23:07.195783+0000","last_peered":"2024-09-16T01:23:07.195783+0000","last_clean":"2024-09-16T01:23:07.195783+0000","last_became_active":"2024-09-16T01:21:28.037268+0000","last_became_peered":"2024-09-16T01:21:28.037268+0000","last_unstale":"2024-09-16T01:23:07.195783+0000","last_undegraded":"2024-09-16T01:23:07.195783+0000","last_fullsized":"2024-09-16T01:23:07.195783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:09.625480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.194407+0000","last_change":"2024-09-16T01:21:28.044744+0000","last_active":"2024-09-16T01:23:07.194407+0000","last_peered":"2024-09-16T01:23:07.194407+0000","last_clean":"2024-09-16T01:23:07.194407+0000","last_became_active":"2024-09-16T01:21:28.044440+0000","last_became_peered":"2024-09-16T01:21:28.044440+0000","last_unstale":"2024-09-16T01:23:07.194407+0000","last_undegraded":"2024-09-16T01:23:07.194407+0000","last_fullsized":"2024-09-16T01:23:07.194407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:20.404778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.200147+0000","last_change":"2024-09-16T01:21:28.044498+0000","last_active":"2024-09-16T01:23:07.200147+0000","last_peered":"2024-09-16T01:23:07.200147+0000","last_clean":"2024-09-16T01:23:07.200147+0000","last_became_active":"2024-09-16T01:21:28.044028+0000","last_became_peered":"2024-09-16T01:21:28.044028+0000","last_unstale":"2024-09-16T01:23:07.200147+0000","last_undegraded":"2024-09-16T01:23:07.200147+0000","last_fullsized":"2024-09-16T01:23:07.200147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:46.134484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198919+0000","last_change":"2024-09-16T01:21:28.047796+0000","last_active":"2024-09-16T01:23:07.198919+0000","last_peered":"2024-09-16T01:23:07.198919+0000","last_clean":"2024-09-16T01:23:07.198919+0000","last_became_active":"2024-09-16T01:21:28.046289+0000","last_became_peered":"2024-09-16T01:21:28.046289+0000","last_unstale":"2024-09-16T01:23:07.198919+0000","last_undegraded":"2024-09-16T01:23:07.198919+0000","last_fullsized":"2024-09-16T01:23:07.198919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:53.709261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.197343+0000","last_change":"2024-09-16T01:21:28.050767+0000","last_active":"2024-09-16T01:23:07.197343+0000","last_peered":"2024-09-16T01:23:07.197343+0000","last_clean":"2024-09-16T01:23:07.197343+0000","last_became_active":"2024-09-16T01:21:28.050430+0000","last_became_peered":"2024-09-16T01:21:28.050430+0000","last_unstale":"2024-09-16T01:23:07.197343+0000","last_undegraded":"2024-09-16T01:23:07.197343+0000","last_fullsized":"2024-09-16T01:23:07.197343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:37.436612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.177055+0000","last_change":"2024-09-16T01:21:28.045374+0000","last_active":"2024-09-16T01:23:07.177055+0000","last_peered":"2024-09-16T01:23:07.177055+0000","last_clean":"2024-09-16T01:23:07.177055+0000","last_became_active":"2024-09-16T01:21:28.045072+0000","last_became_peered":"2024-09-16T01:21:28.045072+0000","last_unstale":"2024-09-16T01:23:07.177055+0000","last_undegraded":"2024-09-16T01:23:07.177055+0000","last_fullsized":"2024-09-16T01:23:07.177055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:10.579680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:13.229660+0000","last_change":"2024-09-16T01:21:25.922017+0000","last_active":"2024-09-16T01:23:13.229660+0000","last_peered":"2024-09-16T01:23:13.229660+0000","last_clean":"2024-09-16T01:23:13.229660+0000","last_became_active":"2024-09-16T01:21:25.921580+0000","last_became_peered":"2024-09-16T01:21:25.921580+0000","last_unstale":"2024-09-16T01:23:13.229660+0000","last_undegraded":"2024-09-16T01:23:13.229660+0000","last_fullsized":"2024-09-16T01:23:13.229660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.745844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198279+0000","last_change":"2024-09-16T01:21:39.094811+0000","last_active":"2024-09-16T01:23:07.198279+0000","last_peered":"2024-09-16T01:23:07.198279+0000","last_clean":"2024-09-16T01:23:07.198279+0000","last_became_active":"2024-09-16T01:21:39.094399+0000","last_became_peered":"2024-09-16T01:21:39.094399+0000","last_unstale":"2024-09-16T01:23:07.198279+0000","last_undegraded":"2024-09-16T01:23:07.198279+0000","last_fullsized":"2024-09-16T01:23:07.198279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:48.363791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.110226+0000","last_change":"2024-09-16T01:21:39.110226+0000","last_active":"2024-09-16T01:21:39.110226+0000","last_peered":"2024-09-16T01:21:39.110226+0000","last_clean":"2024-09-16T01:21:39.110226+0000","last_became_active":"2024-09-16T01:21:39.107676+0000","last_became_peered":"2024-09-16T01:21:39.107676+0000","last_unstale":"2024-09-16T01:21:39.110226+0000","last_undegraded":"2024-09-16T01:21:39.110226+0000","last_fullsized":"2024-09-16T01:21:39.110226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:57:14.854181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086856+0000","last_change":"2024-09-16T01:21:25.924434+0000","last_active":"2024-09-16T01:21:39.086856+0000","last_peered":"2024-09-16T01:21:39.086856+0000","last_clean":"2024-09-16T01:21:39.086856+0000","last_became_active":"2024-09-16T01:21:25.924092+0000","last_became_peered":"2024-09-16T01:21:25.924092+0000","last_unstale":"2024-09-16T01:21:39.086856+0000","last_undegraded":"2024-09-16T01:21:39.086856+0000","last_fullsized":"2024-09-16T01:21:39.086856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:20.956985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196900+0000","last_change":"2024-09-16T01:21:28.037273+0000","last_active":"2024-09-16T01:23:07.196900+0000","last_peered":"2024-09-16T01:23:07.196900+0000","last_clean":"2024-09-16T01:23:07.196900+0000","last_became_active":"2024-09-16T01:21:28.036958+0000","last_became_peered":"2024-09-16T01:21:28.036958+0000","last_unstale":"2024-09-16T01:23:07.196900+0000","last_undegraded":"2024-09-16T01:23:07.196900+0000","last_fullsized":"2024-09-16T01:23:07.196900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:53.376640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088161+0000","last_change":"2024-09-16T01:21:25.923208+0000","last_active":"2024-09-16T01:21:39.088161+0000","last_peered":"2024-09-16T01:21:39.088161+0000","last_clean":"2024-09-16T01:21:39.088161+0000","last_became_active":"2024-09-16T01:21:25.922882+0000","last_became_peered":"2024-09-16T01:21:25.922882+0000","last_unstale":"2024-09-16T01:21:39.088161+0000","last_undegraded":"2024-09-16T01:21:39.088161+0000","last_fullsized":"2024-09-16T01:21:39.088161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:44.359615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.189681+0000","last_change":"2024-09-16T01:21:28.035901+0000","last_active":"2024-09-16T01:23:07.189681+0000","last_peered":"2024-09-16T01:23:07.189681+0000","last_clean":"2024-09-16T01:23:07.189681+0000","last_became_active":"2024-09-16T01:21:28.035568+0000","last_became_peered":"2024-09-16T01:21:28.035568+0000","last_unstale":"2024-09-16T01:23:07.189681+0000","last_undegraded":"2024-09-16T01:23:07.189681+0000","last_fullsized":"2024-09-16T01:23:07.189681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:42.270380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":124,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:14.230417+0000","last_change":"2024-09-16T01:21:25.923692+0000","last_active":"2024-09-16T01:23:14.230417+0000","last_peered":"2024-09-16T01:23:14.230417+0000","last_clean":"2024-09-16T01:23:14.230417+0000","last_became_active":"2024-09-16T01:21:25.923325+0000","last_became_peered":"2024-09-16T01:21:25.923325+0000","last_unstale":"2024-09-16T01:23:14.230417+0000","last_undegraded":"2024-09-16T01:23:14.230417+0000","last_fullsized":"2024-09-16T01:23:14.230417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:55.075655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.192428+0000","last_change":"2024-09-16T01:21:28.054697+0000","last_active":"2024-09-16T01:23:07.192428+0000","last_peered":"2024-09-16T01:23:07.192428+0000","last_clean":"2024-09-16T01:23:07.192428+0000","last_became_active":"2024-09-16T01:21:28.054416+0000","last_became_peered":"2024-09-16T01:21:28.054416+0000","last_unstale":"2024-09-16T01:23:07.192428+0000","last_undegraded":"2024-09-16T01:23:07.192428+0000","last_fullsized":"2024-09-16T01:23:07.192428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:42.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089652+0000","last_change":"2024-09-16T01:21:25.920939+0000","last_active":"2024-09-16T01:21:39.089652+0000","last_peered":"2024-09-16T01:21:39.089652+0000","last_clean":"2024-09-16T01:21:39.089652+0000","last_became_active":"2024-09-16T01:21:25.920574+0000","last_became_peered":"2024-09-16T01:21:25.920574+0000","last_unstale":"2024-09-16T01:21:39.089652+0000","last_undegraded":"2024-09-16T01:21:39.089652+0000","last_fullsized":"2024-09-16T01:21:39.089652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:15.640800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.186777+0000","last_change":"2024-09-16T01:21:28.048981+0000","last_active":"2024-09-16T01:23:07.186777+0000","last_peered":"2024-09-16T01:23:07.186777+0000","last_clean":"2024-09-16T01:23:07.186777+0000","last_became_active":"2024-09-16T01:21:28.048675+0000","last_became_peered":"2024-09-16T01:21:28.048675+0000","last_unstale":"2024-09-16T01:23:07.186777+0000","last_undegraded":"2024-09-16T01:23:07.186777+0000","last_fullsized":"2024-09-16T01:23:07.186777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:30.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088725+0000","last_change":"2024-09-16T01:21:26.660117+0000","last_active":"2024-09-16T01:21:39.088725+0000","last_peered":"2024-09-16T01:21:39.088725+0000","last_clean":"2024-09-16T01:21:39.088725+0000","last_became_active":"2024-09-16T01:21:26.659743+0000","last_became_peered":"2024-09-16T01:21:26.659743+0000","last_unstale":"2024-09-16T01:21:39.088725+0000","last_undegraded":"2024-09-16T01:21:39.088725+0000","last_fullsized":"2024-09-16T01:21:39.088725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:10.220612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191486+0000","last_change":"2024-09-16T01:21:28.051057+0000","last_active":"2024-09-16T01:23:07.191486+0000","last_peered":"2024-09-16T01:23:07.191486+0000","last_clean":"2024-09-16T01:23:07.191486+0000","last_became_active":"2024-09-16T01:21:28.050756+0000","last_became_peered":"2024-09-16T01:21:28.050756+0000","last_unstale":"2024-09-16T01:23:07.191486+0000","last_undegraded":"2024-09-16T01:23:07.191486+0000","last_fullsized":"2024-09-16T01:23:07.191486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:16.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'32","reported_seq":261,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:15.232149+0000","last_change":"2024-09-16T01:21:25.927384+0000","last_active":"2024-09-16T01:23:15.232149+0000","last_peered":"2024-09-16T01:23:15.232149+0000","last_clean":"2024-09-16T01:23:15.232149+0000","last_became_active":"2024-09-16T01:21:25.927017+0000","last_became_peered":"2024-09-16T01:21:25.927017+0000","last_unstale":"2024-09-16T01:23:15.232149+0000","last_undegraded":"2024-09-16T01:23:15.232149+0000","last_fullsized":"2024-09-16T01:23:15.232149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:03.267625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60508,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":162,"num_write":33,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.193364+0000","last_change":"2024-09-16T01:21:28.049410+0000","last_active":"2024-09-16T01:23:07.193364+0000","last_peered":"2024-09-16T01:23:07.193364+0000","last_clean":"2024-09-16T01:23:07.193364+0000","last_became_active":"2024-09-16T01:21:28.049058+0000","last_became_peered":"2024-09-16T01:21:28.049058+0000","last_unstale":"2024-09-16T01:23:07.193364+0000","last_undegraded":"2024-09-16T01:23:07.193364+0000","last_fullsized":"2024-09-16T01:23:07.193364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091098+0000","last_change":"2024-09-16T01:21:25.922040+0000","last_active":"2024-09-16T01:21:39.091098+0000","last_peered":"2024-09-16T01:21:39.091098+0000","last_clean":"2024-09-16T01:21:39.091098+0000","last_became_active":"2024-09-16T01:21:25.921487+0000","last_became_peered":"2024-09-16T01:21:25.921487+0000","last_unstale":"2024-09-16T01:21:39.091098+0000","last_undegraded":"2024-09-16T01:21:39.091098+0000","last_fullsized":"2024-09-16T01:21:39.091098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:15.361010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.200738+0000","last_change":"2024-09-16T01:21:28.043344+0000","last_active":"2024-09-16T01:23:07.200738+0000","last_peered":"2024-09-16T01:23:07.200738+0000","last_clean":"2024-09-16T01:23:07.200738+0000","last_became_active":"2024-09-16T01:21:28.042495+0000","last_became_peered":"2024-09-16T01:21:28.042495+0000","last_unstale":"2024-09-16T01:23:07.200738+0000","last_undegraded":"2024-09-16T01:23:07.200738+0000","last_fullsized":"2024-09-16T01:23:07.200738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:28.957975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087280+0000","last_change":"2024-09-16T01:21:25.924144+0000","last_active":"2024-09-16T01:21:39.087280+0000","last_peered":"2024-09-16T01:21:39.087280+0000","last_clean":"2024-09-16T01:21:39.087280+0000","last_became_active":"2024-09-16T01:21:25.923761+0000","last_became_peered":"2024-09-16T01:21:25.923761+0000","last_unstale":"2024-09-16T01:21:39.087280+0000","last_undegraded":"2024-09-16T01:21:39.087280+0000","last_fullsized":"2024-09-16T01:21:39.087280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.651575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.202313+0000","last_change":"2024-09-16T01:21:28.049329+0000","last_active":"2024-09-16T01:23:07.202313+0000","last_peered":"2024-09-16T01:23:07.202313+0000","last_clean":"2024-09-16T01:23:07.202313+0000","last_became_active":"2024-09-16T01:21:28.048976+0000","last_became_peered":"2024-09-16T01:21:28.048976+0000","last_unstale":"2024-09-16T01:23:07.202313+0000","last_undegraded":"2024-09-16T01:23:07.202313+0000","last_fullsized":"2024-09-16T01:23:07.202313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:11.564388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":131,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:15.232212+0000","last_change":"2024-09-16T01:21:25.923608+0000","last_active":"2024-09-16T01:23:15.232212+0000","last_peered":"2024-09-16T01:23:15.232212+0000","last_clean":"2024-09-16T01:23:15.232212+0000","last_became_active":"2024-09-16T01:21:25.923284+0000","last_became_peered":"2024-09-16T01:21:25.923284+0000","last_unstale":"2024-09-16T01:23:15.232212+0000","last_undegraded":"2024-09-16T01:23:15.232212+0000","last_fullsized":"2024-09-16T01:23:15.232212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:41.195014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.204287+0000","last_change":"2024-09-16T01:21:39.091872+0000","last_active":"2024-09-16T01:23:07.204287+0000","last_peered":"2024-09-16T01:23:07.204287+0000","last_clean":"2024-09-16T01:23:07.204287+0000","last_became_active":"2024-09-16T01:21:39.091480+0000","last_became_peered":"2024-09-16T01:21:39.091480+0000","last_unstale":"2024-09-16T01:23:07.204287+0000","last_undegraded":"2024-09-16T01:23:07.204287+0000","last_fullsized":"2024-09-16T01:23:07.204287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:23.606447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092805+0000","last_change":"2024-09-16T01:21:26.661446+0000","last_active":"2024-09-16T01:21:39.092805+0000","last_peered":"2024-09-16T01:21:39.092805+0000","last_clean":"2024-09-16T01:21:39.092805+0000","last_became_active":"2024-09-16T01:21:26.661047+0000","last_became_peered":"2024-09-16T01:21:26.661047+0000","last_unstale":"2024-09-16T01:21:39.092805+0000","last_undegraded":"2024-09-16T01:21:39.092805+0000","last_fullsized":"2024-09-16T01:21:39.092805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:22.983581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191326+0000","last_change":"2024-09-16T01:21:28.054663+0000","last_active":"2024-09-16T01:23:07.191326+0000","last_peered":"2024-09-16T01:23:07.191326+0000","last_clean":"2024-09-16T01:23:07.191326+0000","last_became_active":"2024-09-16T01:21:28.054350+0000","last_became_peered":"2024-09-16T01:21:28.054350+0000","last_unstale":"2024-09-16T01:23:07.191326+0000","last_undegraded":"2024-09-16T01:23:07.191326+0000","last_fullsized":"2024-09-16T01:23:07.191326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:22.963709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094004+0000","last_change":"2024-09-16T01:21:25.921910+0000","last_active":"2024-09-16T01:21:39.094004+0000","last_peered":"2024-09-16T01:21:39.094004+0000","last_clean":"2024-09-16T01:21:39.094004+0000","last_became_active":"2024-09-16T01:21:25.921578+0000","last_became_peered":"2024-09-16T01:21:25.921578+0000","last_unstale":"2024-09-16T01:21:39.094004+0000","last_undegraded":"2024-09-16T01:21:39.094004+0000","last_fullsized":"2024-09-16T01:21:39.094004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:20.210397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195441+0000","last_change":"2024-09-16T01:21:28.049953+0000","last_active":"2024-09-16T01:23:07.195441+0000","last_peered":"2024-09-16T01:23:07.195441+0000","last_clean":"2024-09-16T01:23:07.195441+0000","last_became_active":"2024-09-16T01:21:28.049450+0000","last_became_peered":"2024-09-16T01:21:28.049450+0000","last_unstale":"2024-09-16T01:23:07.195441+0000","last_undegraded":"2024-09-16T01:23:07.195441+0000","last_fullsized":"2024-09-16T01:23:07.195441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:49.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.098150+0000","last_change":"2024-09-16T01:21:39.098150+0000","last_active":"2024-09-16T01:21:39.098150+0000","last_peered":"2024-09-16T01:21:39.098150+0000","last_clean":"2024-09-16T01:21:39.098150+0000","last_became_active":"2024-09-16T01:21:39.094297+0000","last_became_peered":"2024-09-16T01:21:39.094297+0000","last_unstale":"2024-09-16T01:21:39.098150+0000","last_undegraded":"2024-09-16T01:21:39.098150+0000","last_fullsized":"2024-09-16T01:21:39.098150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:30:25.297230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.201932+0000","last_change":"2024-09-16T01:21:28.053920+0000","last_active":"2024-09-16T01:23:07.201932+0000","last_peered":"2024-09-16T01:23:07.201932+0000","last_clean":"2024-09-16T01:23:07.201932+0000","last_became_active":"2024-09-16T01:21:28.053397+0000","last_became_peered":"2024-09-16T01:21:28.053397+0000","last_unstale":"2024-09-16T01:23:07.201932+0000","last_undegraded":"2024-09-16T01:23:07.201932+0000","last_fullsized":"2024-09-16T01:23:07.201932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:27.079374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088854+0000","last_change":"2024-09-16T01:21:25.920527+0000","last_active":"2024-09-16T01:21:39.088854+0000","last_peered":"2024-09-16T01:21:39.088854+0000","last_clean":"2024-09-16T01:21:39.088854+0000","last_became_active":"2024-09-16T01:21:25.920162+0000","last_became_peered":"2024-09-16T01:21:25.920162+0000","last_unstale":"2024-09-16T01:21:39.088854+0000","last_undegraded":"2024-09-16T01:21:39.088854+0000","last_fullsized":"2024-09-16T01:21:39.088854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:31.995141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.200844+0000","last_change":"2024-09-16T01:21:28.050068+0000","last_active":"2024-09-16T01:23:07.200844+0000","last_peered":"2024-09-16T01:23:07.200844+0000","last_clean":"2024-09-16T01:23:07.200844+0000","last_became_active":"2024-09-16T01:21:28.049678+0000","last_became_peered":"2024-09-16T01:21:28.049678+0000","last_unstale":"2024-09-16T01:23:07.200844+0000","last_undegraded":"2024-09-16T01:23:07.200844+0000","last_fullsized":"2024-09-16T01:23:07.200844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:57.870550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091065+0000","last_change":"2024-09-16T01:21:26.663670+0000","last_active":"2024-09-16T01:21:39.091065+0000","last_peered":"2024-09-16T01:21:39.091065+0000","last_clean":"2024-09-16T01:21:39.091065+0000","last_became_active":"2024-09-16T01:21:26.663173+0000","last_became_peered":"2024-09-16T01:21:26.663173+0000","last_unstale":"2024-09-16T01:21:39.091065+0000","last_undegraded":"2024-09-16T01:21:39.091065+0000","last_fullsized":"2024-09-16T01:21:39.091065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:01.747039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203210+0000","last_change":"2024-09-16T01:21:28.053354+0000","last_active":"2024-09-16T01:23:07.203210+0000","last_peered":"2024-09-16T01:23:07.203210+0000","last_clean":"2024-09-16T01:23:07.203210+0000","last_became_active":"2024-09-16T01:21:28.052985+0000","last_became_peered":"2024-09-16T01:21:28.052985+0000","last_unstale":"2024-09-16T01:23:07.203210+0000","last_undegraded":"2024-09-16T01:23:07.203210+0000","last_fullsized":"2024-09-16T01:23:07.203210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:09.360220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089417+0000","last_change":"2024-09-16T01:20:14.084036+0000","last_active":"2024-09-16T01:21:39.089417+0000","last_peered":"2024-09-16T01:21:39.089417+0000","last_clean":"2024-09-16T01:21:39.089417+0000","last_became_active":"2024-09-16T01:20:14.083552+0000","last_became_peered":"2024-09-16T01:20:14.083552+0000","last_unstale":"2024-09-16T01:21:39.089417+0000","last_undegraded":"2024-09-16T01:21:39.089417+0000","last_fullsized":"2024-09-16T01:21:39.089417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_clean_scrub_stamp":"2024-09-16T01:16:51.922126+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:37.598878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106614+0000","last_change":"2024-09-16T01:21:25.923170+0000","last_active":"2024-09-16T01:21:39.106614+0000","last_peered":"2024-09-16T01:21:39.106614+0000","last_clean":"2024-09-16T01:21:39.106614+0000","last_became_active":"2024-09-16T01:21:25.922555+0000","last_became_peered":"2024-09-16T01:21:25.922555+0000","last_unstale":"2024-09-16T01:21:39.106614+0000","last_undegraded":"2024-09-16T01:21:39.106614+0000","last_fullsized":"2024-09-16T01:21:39.106614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:14.948264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.188186+0000","last_change":"2024-09-16T01:21:39.093752+0000","last_active":"2024-09-16T01:23:07.188186+0000","last_peered":"2024-09-16T01:23:07.188186+0000","last_clean":"2024-09-16T01:23:07.188186+0000","last_became_active":"2024-09-16T01:21:39.093394+0000","last_became_peered":"2024-09-16T01:21:39.093394+0000","last_unstale":"2024-09-16T01:23:07.188186+0000","last_undegraded":"2024-09-16T01:23:07.188186+0000","last_fullsized":"2024-09-16T01:23:07.188186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:32.703408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:21:25.925009+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:21:25.924661+0000","last_became_peered":"2024-09-16T01:21:25.924661+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.703241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199546+0000","last_change":"2024-09-16T01:21:28.045745+0000","last_active":"2024-09-16T01:23:07.199546+0000","last_peered":"2024-09-16T01:23:07.199546+0000","last_clean":"2024-09-16T01:23:07.199546+0000","last_became_active":"2024-09-16T01:21:28.045398+0000","last_became_peered":"2024-09-16T01:21:28.045398+0000","last_unstale":"2024-09-16T01:23:07.199546+0000","last_undegraded":"2024-09-16T01:23:07.199546+0000","last_fullsized":"2024-09-16T01:23:07.199546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:17.422858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:14.230366+0000","last_change":"2024-09-16T01:21:26.660859+0000","last_active":"2024-09-16T01:23:14.230366+0000","last_peered":"2024-09-16T01:23:14.230366+0000","last_clean":"2024-09-16T01:23:14.230366+0000","last_became_active":"2024-09-16T01:21:26.660515+0000","last_became_peered":"2024-09-16T01:21:26.660515+0000","last_unstale":"2024-09-16T01:23:14.230366+0000","last_undegraded":"2024-09-16T01:23:14.230366+0000","last_fullsized":"2024-09-16T01:23:14.230366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:57.301546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.194448+0000","last_change":"2024-09-16T01:21:39.092617+0000","last_active":"2024-09-16T01:23:07.194448+0000","last_peered":"2024-09-16T01:23:07.194448+0000","last_clean":"2024-09-16T01:23:07.194448+0000","last_became_active":"2024-09-16T01:21:39.092212+0000","last_became_peered":"2024-09-16T01:21:39.092212+0000","last_unstale":"2024-09-16T01:23:07.194448+0000","last_undegraded":"2024-09-16T01:23:07.194448+0000","last_fullsized":"2024-09-16T01:23:07.194448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.894975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089151+0000","last_change":"2024-09-16T01:21:25.924485+0000","last_active":"2024-09-16T01:21:39.089151+0000","last_peered":"2024-09-16T01:21:39.089151+0000","last_clean":"2024-09-16T01:21:39.089151+0000","last_became_active":"2024-09-16T01:21:25.924075+0000","last_became_peered":"2024-09-16T01:21:25.924075+0000","last_unstale":"2024-09-16T01:21:39.089151+0000","last_undegraded":"2024-09-16T01:21:39.089151+0000","last_fullsized":"2024-09-16T01:21:39.089151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:13.034668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.183381+0000","last_change":"2024-09-16T01:21:28.048152+0000","last_active":"2024-09-16T01:23:07.183381+0000","last_peered":"2024-09-16T01:23:07.183381+0000","last_clean":"2024-09-16T01:23:07.183381+0000","last_became_active":"2024-09-16T01:21:28.047818+0000","last_became_peered":"2024-09-16T01:21:28.047818+0000","last_unstale":"2024-09-16T01:23:07.183381+0000","last_undegraded":"2024-09-16T01:23:07.183381+0000","last_fullsized":"2024-09-16T01:23:07.183381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:19.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089286+0000","last_change":"2024-09-16T01:21:26.660336+0000","last_active":"2024-09-16T01:21:39.089286+0000","last_peered":"2024-09-16T01:21:39.089286+0000","last_clean":"2024-09-16T01:21:39.089286+0000","last_became_active":"2024-09-16T01:21:26.660005+0000","last_became_peered":"2024-09-16T01:21:26.660005+0000","last_unstale":"2024-09-16T01:21:39.089286+0000","last_undegraded":"2024-09-16T01:21:39.089286+0000","last_fullsized":"2024-09-16T01:21:39.089286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:37.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.180180+0000","last_change":"2024-09-16T01:21:28.043112+0000","last_active":"2024-09-16T01:23:07.180180+0000","last_peered":"2024-09-16T01:23:07.180180+0000","last_clean":"2024-09-16T01:23:07.180180+0000","last_became_active":"2024-09-16T01:21:28.042752+0000","last_became_peered":"2024-09-16T01:21:28.042752+0000","last_unstale":"2024-09-16T01:23:07.180180+0000","last_undegraded":"2024-09-16T01:23:07.180180+0000","last_fullsized":"2024-09-16T01:23:07.180180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:57.379826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093748+0000","last_change":"2024-09-16T01:21:26.661003+0000","last_active":"2024-09-16T01:21:39.093748+0000","last_peered":"2024-09-16T01:21:39.093748+0000","last_clean":"2024-09-16T01:21:39.093748+0000","last_became_active":"2024-09-16T01:21:26.660407+0000","last_became_peered":"2024-09-16T01:21:26.660407+0000","last_unstale":"2024-09-16T01:21:39.093748+0000","last_undegraded":"2024-09-16T01:21:39.093748+0000","last_fullsized":"2024-09-16T01:21:39.093748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:52.229473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199076+0000","last_change":"2024-09-16T01:21:28.046938+0000","last_active":"2024-09-16T01:23:07.199076+0000","last_peered":"2024-09-16T01:23:07.199076+0000","last_clean":"2024-09-16T01:23:07.199076+0000","last_became_active":"2024-09-16T01:21:28.046620+0000","last_became_peered":"2024-09-16T01:21:28.046620+0000","last_unstale":"2024-09-16T01:23:07.199076+0000","last_undegraded":"2024-09-16T01:23:07.199076+0000","last_fullsized":"2024-09-16T01:23:07.199076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:04.845341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:08.048322+0000","last_change":"2024-09-16T01:21:25.915315+0000","last_active":"2024-09-16T01:23:08.048322+0000","last_peered":"2024-09-16T01:23:08.048322+0000","last_clean":"2024-09-16T01:23:08.048322+0000","last_became_active":"2024-09-16T01:21:25.915001+0000","last_became_peered":"2024-09-16T01:21:25.915001+0000","last_unstale":"2024-09-16T01:23:08.048322+0000","last_undegraded":"2024-09-16T01:23:08.048322+0000","last_fullsized":"2024-09-16T01:23:08.048322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:30.163050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198048+0000","last_change":"2024-09-16T01:21:28.047157+0000","last_active":"2024-09-16T01:23:07.198048+0000","last_peered":"2024-09-16T01:23:07.198048+0000","last_clean":"2024-09-16T01:23:07.198048+0000","last_became_active":"2024-09-16T01:21:28.046583+0000","last_became_peered":"2024-09-16T01:21:28.046583+0000","last_unstale":"2024-09-16T01:23:07.198048+0000","last_undegraded":"2024-09-16T01:23:07.198048+0000","last_fullsized":"2024-09-16T01:23:07.198048+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:47.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106885+0000","last_change":"2024-09-16T01:21:26.663047+0000","last_active":"2024-09-16T01:21:39.106885+0000","last_peered":"2024-09-16T01:21:39.106885+0000","last_clean":"2024-09-16T01:21:39.106885+0000","last_became_active":"2024-09-16T01:21:26.662627+0000","last_became_peered":"2024-09-16T01:21:26.662627+0000","last_unstale":"2024-09-16T01:21:39.106885+0000","last_undegraded":"2024-09-16T01:21:39.106885+0000","last_fullsized":"2024-09-16T01:21:39.106885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:59.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196911+0000","last_change":"2024-09-16T01:21:28.046954+0000","last_active":"2024-09-16T01:23:07.196911+0000","last_peered":"2024-09-16T01:23:07.196911+0000","last_clean":"2024-09-16T01:23:07.196911+0000","last_became_active":"2024-09-16T01:21:28.046550+0000","last_became_peered":"2024-09-16T01:21:28.046550+0000","last_unstale":"2024-09-16T01:23:07.196911+0000","last_undegraded":"2024-09-16T01:23:07.196911+0000","last_fullsized":"2024-09-16T01:23:07.196911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:30.880672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.100910+0000","last_change":"2024-09-16T01:21:39.100910+0000","last_active":"2024-09-16T01:21:39.100910+0000","last_peered":"2024-09-16T01:21:39.100910+0000","last_clean":"2024-09-16T01:21:39.100910+0000","last_became_active":"2024-09-16T01:21:39.095257+0000","last_became_peered":"2024-09-16T01:21:39.095257+0000","last_unstale":"2024-09-16T01:21:39.100910+0000","last_undegraded":"2024-09-16T01:21:39.100910+0000","last_fullsized":"2024-09-16T01:21:39.100910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:17.957295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.160646+0000","last_change":"2024-09-16T01:21:28.052061+0000","last_active":"2024-09-16T01:23:07.160646+0000","last_peered":"2024-09-16T01:23:07.160646+0000","last_clean":"2024-09-16T01:23:07.160646+0000","last_became_active":"2024-09-16T01:21:28.051705+0000","last_became_peered":"2024-09-16T01:21:28.051705+0000","last_unstale":"2024-09-16T01:23:07.160646+0000","last_undegraded":"2024-09-16T01:23:07.160646+0000","last_fullsized":"2024-09-16T01:23:07.160646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:05.546846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090258+0000","last_change":"2024-09-16T01:21:25.921635+0000","last_active":"2024-09-16T01:21:39.090258+0000","last_peered":"2024-09-16T01:21:39.090258+0000","last_clean":"2024-09-16T01:21:39.090258+0000","last_became_active":"2024-09-16T01:21:25.921281+0000","last_became_peered":"2024-09-16T01:21:25.921281+0000","last_unstale":"2024-09-16T01:21:39.090258+0000","last_undegraded":"2024-09-16T01:21:39.090258+0000","last_fullsized":"2024-09-16T01:21:39.090258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:02.933803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198236+0000","last_change":"2024-09-16T01:21:28.043636+0000","last_active":"2024-09-16T01:23:07.198236+0000","last_peered":"2024-09-16T01:23:07.198236+0000","last_clean":"2024-09-16T01:23:07.198236+0000","last_became_active":"2024-09-16T01:21:28.043273+0000","last_became_peered":"2024-09-16T01:21:28.043273+0000","last_unstale":"2024-09-16T01:23:07.198236+0000","last_undegraded":"2024-09-16T01:23:07.198236+0000","last_fullsized":"2024-09-16T01:23:07.198236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:05.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090771+0000","last_change":"2024-09-16T01:21:25.917934+0000","last_active":"2024-09-16T01:21:39.090771+0000","last_peered":"2024-09-16T01:21:39.090771+0000","last_clean":"2024-09-16T01:21:39.090771+0000","last_became_active":"2024-09-16T01:21:25.917545+0000","last_became_peered":"2024-09-16T01:21:25.917545+0000","last_unstale":"2024-09-16T01:21:39.090771+0000","last_undegraded":"2024-09-16T01:21:39.090771+0000","last_fullsized":"2024-09-16T01:21:39.090771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:07.119546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.193744+0000","last_change":"2024-09-16T01:21:28.043270+0000","last_active":"2024-09-16T01:23:07.193744+0000","last_peered":"2024-09-16T01:23:07.193744+0000","last_clean":"2024-09-16T01:23:07.193744+0000","last_became_active":"2024-09-16T01:21:28.042957+0000","last_became_peered":"2024-09-16T01:21:28.042957+0000","last_unstale":"2024-09-16T01:23:07.193744+0000","last_undegraded":"2024-09-16T01:23:07.193744+0000","last_fullsized":"2024-09-16T01:23:07.193744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:11.052387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093263+0000","last_change":"2024-09-16T01:21:25.923224+0000","last_active":"2024-09-16T01:21:39.093263+0000","last_peered":"2024-09-16T01:21:39.093263+0000","last_clean":"2024-09-16T01:21:39.093263+0000","last_became_active":"2024-09-16T01:21:25.922873+0000","last_became_peered":"2024-09-16T01:21:25.922873+0000","last_unstale":"2024-09-16T01:21:39.093263+0000","last_undegraded":"2024-09-16T01:21:39.093263+0000","last_fullsized":"2024-09-16T01:21:39.093263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:14.747752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203114+0000","last_change":"2024-09-16T01:21:28.054706+0000","last_active":"2024-09-16T01:23:07.203114+0000","last_peered":"2024-09-16T01:23:07.203114+0000","last_clean":"2024-09-16T01:23:07.203114+0000","last_became_active":"2024-09-16T01:21:28.054382+0000","last_became_peered":"2024-09-16T01:21:28.054382+0000","last_unstale":"2024-09-16T01:23:07.203114+0000","last_undegraded":"2024-09-16T01:23:07.203114+0000","last_fullsized":"2024-09-16T01:23:07.203114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.908252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.192962+0000","last_change":"2024-09-16T01:21:28.051807+0000","last_active":"2024-09-16T01:23:07.192962+0000","last_peered":"2024-09-16T01:23:07.192962+0000","last_clean":"2024-09-16T01:23:07.192962+0000","last_became_active":"2024-09-16T01:21:28.051474+0000","last_became_peered":"2024-09-16T01:21:28.051474+0000","last_unstale":"2024-09-16T01:23:07.192962+0000","last_undegraded":"2024-09-16T01:23:07.192962+0000","last_fullsized":"2024-09-16T01:23:07.192962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:48.006691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.101161+0000","last_change":"2024-09-16T01:21:39.100723+0000","last_active":"2024-09-16T01:21:39.101161+0000","last_peered":"2024-09-16T01:21:39.101161+0000","last_clean":"2024-09-16T01:21:39.101161+0000","last_became_active":"2024-09-16T01:21:39.094895+0000","last_became_peered":"2024-09-16T01:21:39.094895+0000","last_unstale":"2024-09-16T01:21:39.101161+0000","last_undegraded":"2024-09-16T01:21:39.101161+0000","last_fullsized":"2024-09-16T01:21:39.101161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.663815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.194567+0000","last_change":"2024-09-16T01:21:28.055506+0000","last_active":"2024-09-16T01:23:07.194567+0000","last_peered":"2024-09-16T01:23:07.194567+0000","last_clean":"2024-09-16T01:23:07.194567+0000","last_became_active":"2024-09-16T01:21:28.055167+0000","last_became_peered":"2024-09-16T01:21:28.055167+0000","last_unstale":"2024-09-16T01:23:07.194567+0000","last_undegraded":"2024-09-16T01:23:07.194567+0000","last_fullsized":"2024-09-16T01:23:07.194567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:38.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093642+0000","last_change":"2024-09-16T01:21:25.920611+0000","last_active":"2024-09-16T01:21:39.093642+0000","last_peered":"2024-09-16T01:21:39.093642+0000","last_clean":"2024-09-16T01:21:39.093642+0000","last_became_active":"2024-09-16T01:21:25.920255+0000","last_became_peered":"2024-09-16T01:21:25.920255+0000","last_unstale":"2024-09-16T01:21:39.093642+0000","last_undegraded":"2024-09-16T01:21:39.093642+0000","last_fullsized":"2024-09-16T01:21:39.093642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:17.268621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195544+0000","last_change":"2024-09-16T01:21:28.054009+0000","last_active":"2024-09-16T01:23:07.195544+0000","last_peered":"2024-09-16T01:23:07.195544+0000","last_clean":"2024-09-16T01:23:07.195544+0000","last_became_active":"2024-09-16T01:21:28.053631+0000","last_became_peered":"2024-09-16T01:21:28.053631+0000","last_unstale":"2024-09-16T01:23:07.195544+0000","last_undegraded":"2024-09-16T01:23:07.195544+0000","last_fullsized":"2024-09-16T01:23:07.195544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:28.298398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090095+0000","last_change":"2024-09-16T01:21:26.659753+0000","last_active":"2024-09-16T01:21:39.090095+0000","last_peered":"2024-09-16T01:21:39.090095+0000","last_clean":"2024-09-16T01:21:39.090095+0000","last_became_active":"2024-09-16T01:21:26.659343+0000","last_became_peered":"2024-09-16T01:21:26.659343+0000","last_unstale":"2024-09-16T01:21:39.090095+0000","last_undegraded":"2024-09-16T01:21:39.090095+0000","last_fullsized":"2024-09-16T01:21:39.090095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:47.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199114+0000","last_change":"2024-09-16T01:21:28.050748+0000","last_active":"2024-09-16T01:23:07.199114+0000","last_peered":"2024-09-16T01:23:07.199114+0000","last_clean":"2024-09-16T01:23:07.199114+0000","last_became_active":"2024-09-16T01:21:28.050457+0000","last_became_peered":"2024-09-16T01:21:28.050457+0000","last_unstale":"2024-09-16T01:23:07.199114+0000","last_undegraded":"2024-09-16T01:23:07.199114+0000","last_fullsized":"2024-09-16T01:23:07.199114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:21.552080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089346+0000","last_change":"2024-09-16T01:21:25.924505+0000","last_active":"2024-09-16T01:21:39.089346+0000","last_peered":"2024-09-16T01:21:39.089346+0000","last_clean":"2024-09-16T01:21:39.089346+0000","last_became_active":"2024-09-16T01:21:25.924076+0000","last_became_peered":"2024-09-16T01:21:25.924076+0000","last_unstale":"2024-09-16T01:21:39.089346+0000","last_undegraded":"2024-09-16T01:21:39.089346+0000","last_fullsized":"2024-09-16T01:21:39.089346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:00.630772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65681,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":621,"num_read_kb":381,"num_write":175,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282677,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514532,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":441274,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1094292,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906990,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441510,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135923,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441430,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364854,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1034037,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528381,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":440899,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1033187,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442365,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":441210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":503579,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":501200,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":442170,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:23:19.818 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:23:19.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.956+0000 7fa4716c9640 1 -- 172.21.15.63:0/2700809858 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa46c1036e0 msgr2=0x7fa46c109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.956+0000 7fa4716c9640 1 --2- 172.21.15.63:0/2700809858 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa46c1036e0 0x7fa46c109f70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa464009900 tx=0x7fa46402a410 comp rx=0 tx=0).stop 2024-09-16T01:23:19.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.956+0000 7fa4716c9640 1 -- 172.21.15.63:0/2700809858 shutdown_connections 2024-09-16T01:23:19.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.956+0000 7fa4716c9640 1 --2- 172.21.15.63:0/2700809858 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa46c1036e0 0x7fa46c109f70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.956+0000 7fa4716c9640 1 --2- 172.21.15.63:0/2700809858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa46c102d20 0x7fa46c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.956+0000 7fa4716c9640 1 --2- 172.21.15.63:0/2700809858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c101b30 0x7fa46c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.956+0000 7fa4716c9640 1 -- 172.21.15.63:0/2700809858 >> 172.21.15.63:0/2700809858 conn(0x7fa46c0fd270 msgr2=0x7fa46c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.956+0000 7fa4716c9640 1 -- 172.21.15.63:0/2700809858 shutdown_connections 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.956+0000 7fa4716c9640 1 -- 172.21.15.63:0/2700809858 wait complete. 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa4716c9640 1 Processor -- start 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa4716c9640 1 -- start start 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa4716c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c101b30 0x7fa46c197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa4716c9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa46c102d20 0x7fa46c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa4716c9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa46c1036e0 0x7fa46c19f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa4716c9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c10d660 con 0x7fa46c102d20 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa4716c9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c10d4e0 con 0x7fa46c101b30 2024-09-16T01:23:19.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa4716c9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c10d7e0 con 0x7fa46c1036e0 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa46c102d20 0x7fa46c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa46c102d20 0x7fa46c198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44904/0 (socket says 172.21.15.63:44904) 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46a7fc640 1 -- 172.21.15.63:0/3500298268 learned_addr learned my addr 172.21.15.63:0/3500298268 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46affd640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c101b30 0x7fa46c197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46b7fe640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa46c1036e0 0x7fa46c19f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46a7fc640 1 -- 172.21.15.63:0/3500298268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa46c1036e0 msgr2=0x7fa46c19f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46a7fc640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa46c1036e0 0x7fa46c19f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46a7fc640 1 -- 172.21.15.63:0/3500298268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c101b30 msgr2=0x7fa46c197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46a7fc640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c101b30 0x7fa46c197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46a7fc640 1 -- 172.21.15.63:0/3500298268 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c19f960 con 0x7fa46c102d20 2024-09-16T01:23:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.957+0000 7fa46b7fe640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa46c1036e0 0x7fa46c19f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.958+0000 7fa46a7fc640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa46c102d20 0x7fa46c198280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa45400d770 tx=0x7fa45400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.958+0000 7fa463fff640 1 -- 172.21.15.63:0/3500298268 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454017070 con 0x7fa46c102d20 2024-09-16T01:23:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.958+0000 7fa4716c9640 1 -- 172.21.15.63:0/3500298268 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c19fc50 con 0x7fa46c102d20 2024-09-16T01:23:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.958+0000 7fa463fff640 1 -- 172.21.15.63:0/3500298268 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4540054d0 con 0x7fa46c102d20 2024-09-16T01:23:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.958+0000 7fa463fff640 1 -- 172.21.15.63:0/3500298268 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454004cf0 con 0x7fa46c102d20 2024-09-16T01:23:19.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.958+0000 7fa4716c9640 1 -- 172.21.15.63:0/3500298268 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c1a0150 con 0x7fa46c102d20 2024-09-16T01:23:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.959+0000 7fa4716c9640 1 -- 172.21.15.63:0/3500298268 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c108f70 con 0x7fa46c102d20 2024-09-16T01:23:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.960+0000 7fa463fff640 1 -- 172.21.15.63:0/3500298268 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa454004e90 con 0x7fa46c102d20 2024-09-16T01:23:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.961+0000 7fa463fff640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa4580a3250 0x7fa4580a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.961+0000 7fa46affd640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa4580a3250 0x7fa4580a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.961+0000 7fa463fff640 1 -- 172.21.15.63:0/3500298268 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa4540cf390 con 0x7fa46c102d20 2024-09-16T01:23:19.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.961+0000 7fa46affd640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa4580a3250 0x7fa4580a5710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa46c102b80 tx=0x7fa45c0098f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:19.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:19.965+0000 7fa463fff640 1 -- 172.21.15.63:0/3500298268 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa45409c0b0 con 0x7fa46c102d20 2024-09-16T01:23:20.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.142+0000 7fa4716c9640 1 -- 172.21.15.63:0/3500298268 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa46c062630 con 0x7fa4580a3250 2024-09-16T01:23:20.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.148+0000 7fa463fff640 1 -- 172.21.15.63:0/3500298268 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259076 (secure 0 0 0) 0x7fa46c062630 con 0x7fa4580a3250 2024-09-16T01:23:20.154 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:23:20.157 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-16T01:23:20.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 -- 172.21.15.63:0/3500298268 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa4580a3250 msgr2=0x7fa4580a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa4580a3250 0x7fa4580a5710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa46c102b80 tx=0x7fa45c0098f0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 -- 172.21.15.63:0/3500298268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa46c102d20 msgr2=0x7fa46c198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa46c102d20 0x7fa46c198280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa45400d770 tx=0x7fa45400dc30 comp rx=0 tx=0).stop 2024-09-16T01:23:20.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 -- 172.21.15.63:0/3500298268 shutdown_connections 2024-09-16T01:23:20.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa4580a3250 0x7fa4580a5710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa46c1036e0 0x7fa46c19f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa46c102d20 0x7fa46c198280 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 --2- 172.21.15.63:0/3500298268 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c101b30 0x7fa46c197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 -- 172.21.15.63:0/3500298268 >> 172.21.15.63:0/3500298268 conn(0x7fa46c0fd270 msgr2=0x7fa46c106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:20.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 -- 172.21.15.63:0/3500298268 shutdown_connections 2024-09-16T01:23:20.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.152+0000 7fa4716c9640 1 -- 172.21.15.63:0/3500298268 wait complete. 2024-09-16T01:23:20.164 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-16T01:23:19.206438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656283,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":747,"num_read_kb":490,"num_write":358,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":788,"ondisk_log_size":788,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360384,"kb_used_data":11136,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581440,"statfs":{"total":1151940427776,"available":1151571394560,"internally_reserved":0,"allocated":11403264,"data_stored":7257153,"data_compressed":177609,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1521,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002909"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196446+0000","last_change":"2024-09-16T01:21:28.051261+0000","last_active":"2024-09-16T01:23:07.196446+0000","last_peered":"2024-09-16T01:23:07.196446+0000","last_clean":"2024-09-16T01:23:07.196446+0000","last_became_active":"2024-09-16T01:21:28.049073+0000","last_became_peered":"2024-09-16T01:21:28.049073+0000","last_unstale":"2024-09-16T01:23:07.196446+0000","last_undegraded":"2024-09-16T01:23:07.196446+0000","last_fullsized":"2024-09-16T01:23:07.196446+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:06.863766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195008+0000","last_change":"2024-09-16T01:21:28.049457+0000","last_active":"2024-09-16T01:23:07.195008+0000","last_peered":"2024-09-16T01:23:07.195008+0000","last_clean":"2024-09-16T01:23:07.195008+0000","last_became_active":"2024-09-16T01:21:28.048707+0000","last_became_peered":"2024-09-16T01:21:28.048707+0000","last_unstale":"2024-09-16T01:23:07.195008+0000","last_undegraded":"2024-09-16T01:23:07.195008+0000","last_fullsized":"2024-09-16T01:23:07.195008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:56.346506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199710+0000","last_change":"2024-09-16T01:21:28.052931+0000","last_active":"2024-09-16T01:23:07.199710+0000","last_peered":"2024-09-16T01:23:07.199710+0000","last_clean":"2024-09-16T01:23:07.199710+0000","last_became_active":"2024-09-16T01:21:28.052501+0000","last_became_peered":"2024-09-16T01:21:28.052501+0000","last_unstale":"2024-09-16T01:23:07.199710+0000","last_undegraded":"2024-09-16T01:23:07.199710+0000","last_fullsized":"2024-09-16T01:23:07.199710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:45:23.351452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.188397+0000","last_change":"2024-09-16T01:21:39.096279+0000","last_active":"2024-09-16T01:23:07.188397+0000","last_peered":"2024-09-16T01:23:07.188397+0000","last_clean":"2024-09-16T01:23:07.188397+0000","last_became_active":"2024-09-16T01:21:39.095886+0000","last_became_peered":"2024-09-16T01:21:39.095886+0000","last_unstale":"2024-09-16T01:23:07.188397+0000","last_undegraded":"2024-09-16T01:23:07.188397+0000","last_fullsized":"2024-09-16T01:23:07.188397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:56.530007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196025+0000","last_change":"2024-09-16T01:21:28.043473+0000","last_active":"2024-09-16T01:23:07.196025+0000","last_peered":"2024-09-16T01:23:07.196025+0000","last_clean":"2024-09-16T01:23:07.196025+0000","last_became_active":"2024-09-16T01:21:28.043127+0000","last_became_peered":"2024-09-16T01:21:28.043127+0000","last_unstale":"2024-09-16T01:23:07.196025+0000","last_undegraded":"2024-09-16T01:23:07.196025+0000","last_fullsized":"2024-09-16T01:23:07.196025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.714834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191119+0000","last_change":"2024-09-16T01:21:28.047210+0000","last_active":"2024-09-16T01:23:07.191119+0000","last_peered":"2024-09-16T01:23:07.191119+0000","last_clean":"2024-09-16T01:23:07.191119+0000","last_became_active":"2024-09-16T01:21:28.046872+0000","last_became_peered":"2024-09-16T01:21:28.046872+0000","last_unstale":"2024-09-16T01:23:07.191119+0000","last_undegraded":"2024-09-16T01:23:07.191119+0000","last_fullsized":"2024-09-16T01:23:07.191119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:22.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203794+0000","last_change":"2024-09-16T01:21:28.052212+0000","last_active":"2024-09-16T01:23:07.203794+0000","last_peered":"2024-09-16T01:23:07.203794+0000","last_clean":"2024-09-16T01:23:07.203794+0000","last_became_active":"2024-09-16T01:21:28.050307+0000","last_became_peered":"2024-09-16T01:21:28.050307+0000","last_unstale":"2024-09-16T01:23:07.203794+0000","last_undegraded":"2024-09-16T01:23:07.203794+0000","last_fullsized":"2024-09-16T01:23:07.203794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:21.869103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195182+0000","last_change":"2024-09-16T01:21:28.047980+0000","last_active":"2024-09-16T01:23:07.195182+0000","last_peered":"2024-09-16T01:23:07.195182+0000","last_clean":"2024-09-16T01:23:07.195182+0000","last_became_active":"2024-09-16T01:21:28.047671+0000","last_became_peered":"2024-09-16T01:21:28.047671+0000","last_unstale":"2024-09-16T01:23:07.195182+0000","last_undegraded":"2024-09-16T01:23:07.195182+0000","last_fullsized":"2024-09-16T01:23:07.195182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:30.501419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195767+0000","last_change":"2024-09-16T01:21:28.052468+0000","last_active":"2024-09-16T01:23:07.195767+0000","last_peered":"2024-09-16T01:23:07.195767+0000","last_clean":"2024-09-16T01:23:07.195767+0000","last_became_active":"2024-09-16T01:21:28.052156+0000","last_became_peered":"2024-09-16T01:21:28.052156+0000","last_unstale":"2024-09-16T01:23:07.195767+0000","last_undegraded":"2024-09-16T01:23:07.195767+0000","last_fullsized":"2024-09-16T01:23:07.195767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:44.631498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191145+0000","last_change":"2024-09-16T01:21:28.048278+0000","last_active":"2024-09-16T01:23:07.191145+0000","last_peered":"2024-09-16T01:23:07.191145+0000","last_clean":"2024-09-16T01:23:07.191145+0000","last_became_active":"2024-09-16T01:21:28.047892+0000","last_became_peered":"2024-09-16T01:21:28.047892+0000","last_unstale":"2024-09-16T01:23:07.191145+0000","last_undegraded":"2024-09-16T01:23:07.191145+0000","last_fullsized":"2024-09-16T01:23:07.191145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.949956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203239+0000","last_change":"2024-09-16T01:21:28.052814+0000","last_active":"2024-09-16T01:23:07.203239+0000","last_peered":"2024-09-16T01:23:07.203239+0000","last_clean":"2024-09-16T01:23:07.203239+0000","last_became_active":"2024-09-16T01:21:28.052440+0000","last_became_peered":"2024-09-16T01:21:28.052440+0000","last_unstale":"2024-09-16T01:23:07.203239+0000","last_undegraded":"2024-09-16T01:23:07.203239+0000","last_fullsized":"2024-09-16T01:23:07.203239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:47.470646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.178893+0000","last_change":"2024-09-16T01:21:28.053917+0000","last_active":"2024-09-16T01:23:07.178893+0000","last_peered":"2024-09-16T01:23:07.178893+0000","last_clean":"2024-09-16T01:23:07.178893+0000","last_became_active":"2024-09-16T01:21:28.052625+0000","last_became_peered":"2024-09-16T01:21:28.052625+0000","last_unstale":"2024-09-16T01:23:07.178893+0000","last_undegraded":"2024-09-16T01:23:07.178893+0000","last_fullsized":"2024-09-16T01:23:07.178893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:32.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.190810+0000","last_change":"2024-09-16T01:21:28.046588+0000","last_active":"2024-09-16T01:23:07.190810+0000","last_peered":"2024-09-16T01:23:07.190810+0000","last_clean":"2024-09-16T01:23:07.190810+0000","last_became_active":"2024-09-16T01:21:28.046268+0000","last_became_peered":"2024-09-16T01:21:28.046268+0000","last_unstale":"2024-09-16T01:23:07.190810+0000","last_undegraded":"2024-09-16T01:23:07.190810+0000","last_fullsized":"2024-09-16T01:23:07.190810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:49.659707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195312+0000","last_change":"2024-09-16T01:21:28.051946+0000","last_active":"2024-09-16T01:23:07.195312+0000","last_peered":"2024-09-16T01:23:07.195312+0000","last_clean":"2024-09-16T01:23:07.195312+0000","last_became_active":"2024-09-16T01:21:28.051615+0000","last_became_peered":"2024-09-16T01:21:28.051615+0000","last_unstale":"2024-09-16T01:23:07.195312+0000","last_undegraded":"2024-09-16T01:23:07.195312+0000","last_fullsized":"2024-09-16T01:23:07.195312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.462830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.197023+0000","last_change":"2024-09-16T01:21:28.047382+0000","last_active":"2024-09-16T01:23:07.197023+0000","last_peered":"2024-09-16T01:23:07.197023+0000","last_clean":"2024-09-16T01:23:07.197023+0000","last_became_active":"2024-09-16T01:21:28.045361+0000","last_became_peered":"2024-09-16T01:21:28.045361+0000","last_unstale":"2024-09-16T01:23:07.197023+0000","last_undegraded":"2024-09-16T01:23:07.197023+0000","last_fullsized":"2024-09-16T01:23:07.197023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:26.099519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.204145+0000","last_change":"2024-09-16T01:21:28.054028+0000","last_active":"2024-09-16T01:23:07.204145+0000","last_peered":"2024-09-16T01:23:07.204145+0000","last_clean":"2024-09-16T01:23:07.204145+0000","last_became_active":"2024-09-16T01:21:28.052698+0000","last_became_peered":"2024-09-16T01:21:28.052698+0000","last_unstale":"2024-09-16T01:23:07.204145+0000","last_undegraded":"2024-09-16T01:23:07.204145+0000","last_fullsized":"2024-09-16T01:23:07.204145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:01.745424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196758+0000","last_change":"2024-09-16T01:21:28.049032+0000","last_active":"2024-09-16T01:23:07.196758+0000","last_peered":"2024-09-16T01:23:07.196758+0000","last_clean":"2024-09-16T01:23:07.196758+0000","last_became_active":"2024-09-16T01:21:28.048357+0000","last_became_peered":"2024-09-16T01:21:28.048357+0000","last_unstale":"2024-09-16T01:23:07.196758+0000","last_undegraded":"2024-09-16T01:23:07.196758+0000","last_fullsized":"2024-09-16T01:23:07.196758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:17.963329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.188365+0000","last_change":"2024-09-16T01:21:28.051126+0000","last_active":"2024-09-16T01:23:07.188365+0000","last_peered":"2024-09-16T01:23:07.188365+0000","last_clean":"2024-09-16T01:23:07.188365+0000","last_became_active":"2024-09-16T01:21:28.050789+0000","last_became_peered":"2024-09-16T01:21:28.050789+0000","last_unstale":"2024-09-16T01:23:07.188365+0000","last_undegraded":"2024-09-16T01:23:07.188365+0000","last_fullsized":"2024-09-16T01:23:07.188365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:35.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199665+0000","last_change":"2024-09-16T01:21:28.045569+0000","last_active":"2024-09-16T01:23:07.199665+0000","last_peered":"2024-09-16T01:23:07.199665+0000","last_clean":"2024-09-16T01:23:07.199665+0000","last_became_active":"2024-09-16T01:21:28.044496+0000","last_became_peered":"2024-09-16T01:21:28.044496+0000","last_unstale":"2024-09-16T01:23:07.199665+0000","last_undegraded":"2024-09-16T01:23:07.199665+0000","last_fullsized":"2024-09-16T01:23:07.199665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:10.665322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191808+0000","last_change":"2024-09-16T01:21:28.047522+0000","last_active":"2024-09-16T01:23:07.191808+0000","last_peered":"2024-09-16T01:23:07.191808+0000","last_clean":"2024-09-16T01:23:07.191808+0000","last_became_active":"2024-09-16T01:21:28.047192+0000","last_became_peered":"2024-09-16T01:21:28.047192+0000","last_unstale":"2024-09-16T01:23:07.191808+0000","last_undegraded":"2024-09-16T01:23:07.191808+0000","last_fullsized":"2024-09-16T01:23:07.191808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.044980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.197674+0000","last_change":"2024-09-16T01:21:28.043184+0000","last_active":"2024-09-16T01:23:07.197674+0000","last_peered":"2024-09-16T01:23:07.197674+0000","last_clean":"2024-09-16T01:23:07.197674+0000","last_became_active":"2024-09-16T01:21:28.042787+0000","last_became_peered":"2024-09-16T01:21:28.042787+0000","last_unstale":"2024-09-16T01:23:07.197674+0000","last_undegraded":"2024-09-16T01:23:07.197674+0000","last_fullsized":"2024-09-16T01:23:07.197674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:00.633731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.204616+0000","last_change":"2024-09-16T01:21:28.050141+0000","last_active":"2024-09-16T01:23:07.204616+0000","last_peered":"2024-09-16T01:23:07.204616+0000","last_clean":"2024-09-16T01:23:07.204616+0000","last_became_active":"2024-09-16T01:21:28.049843+0000","last_became_peered":"2024-09-16T01:21:28.049843+0000","last_unstale":"2024-09-16T01:23:07.204616+0000","last_undegraded":"2024-09-16T01:23:07.204616+0000","last_fullsized":"2024-09-16T01:23:07.204616+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:39.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199563+0000","last_change":"2024-09-16T01:21:28.044260+0000","last_active":"2024-09-16T01:23:07.199563+0000","last_peered":"2024-09-16T01:23:07.199563+0000","last_clean":"2024-09-16T01:23:07.199563+0000","last_became_active":"2024-09-16T01:21:28.043959+0000","last_became_peered":"2024-09-16T01:21:28.043959+0000","last_unstale":"2024-09-16T01:23:07.199563+0000","last_undegraded":"2024-09-16T01:23:07.199563+0000","last_fullsized":"2024-09-16T01:23:07.199563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198368+0000","last_change":"2024-09-16T01:21:28.044143+0000","last_active":"2024-09-16T01:23:07.198368+0000","last_peered":"2024-09-16T01:23:07.198368+0000","last_clean":"2024-09-16T01:23:07.198368+0000","last_became_active":"2024-09-16T01:21:28.043767+0000","last_became_peered":"2024-09-16T01:21:28.043767+0000","last_unstale":"2024-09-16T01:23:07.198368+0000","last_undegraded":"2024-09-16T01:23:07.198368+0000","last_fullsized":"2024-09-16T01:23:07.198368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:25.269737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199234+0000","last_change":"2024-09-16T01:21:28.047663+0000","last_active":"2024-09-16T01:23:07.199234+0000","last_peered":"2024-09-16T01:23:07.199234+0000","last_clean":"2024-09-16T01:23:07.199234+0000","last_became_active":"2024-09-16T01:21:28.047044+0000","last_became_peered":"2024-09-16T01:21:28.047044+0000","last_unstale":"2024-09-16T01:23:07.199234+0000","last_undegraded":"2024-09-16T01:23:07.199234+0000","last_fullsized":"2024-09-16T01:23:07.199234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:44.539096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198916+0000","last_change":"2024-09-16T01:21:28.052740+0000","last_active":"2024-09-16T01:23:07.198916+0000","last_peered":"2024-09-16T01:23:07.198916+0000","last_clean":"2024-09-16T01:23:07.198916+0000","last_became_active":"2024-09-16T01:21:28.052396+0000","last_became_peered":"2024-09-16T01:21:28.052396+0000","last_unstale":"2024-09-16T01:23:07.198916+0000","last_undegraded":"2024-09-16T01:23:07.198916+0000","last_fullsized":"2024-09-16T01:23:07.198916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:49.021594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195294+0000","last_change":"2024-09-16T01:21:28.050867+0000","last_active":"2024-09-16T01:23:07.195294+0000","last_peered":"2024-09-16T01:23:07.195294+0000","last_clean":"2024-09-16T01:23:07.195294+0000","last_became_active":"2024-09-16T01:21:28.050412+0000","last_became_peered":"2024-09-16T01:21:28.050412+0000","last_unstale":"2024-09-16T01:23:07.195294+0000","last_undegraded":"2024-09-16T01:23:07.195294+0000","last_fullsized":"2024-09-16T01:23:07.195294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.286864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195783+0000","last_change":"2024-09-16T01:21:28.037593+0000","last_active":"2024-09-16T01:23:07.195783+0000","last_peered":"2024-09-16T01:23:07.195783+0000","last_clean":"2024-09-16T01:23:07.195783+0000","last_became_active":"2024-09-16T01:21:28.037268+0000","last_became_peered":"2024-09-16T01:21:28.037268+0000","last_unstale":"2024-09-16T01:23:07.195783+0000","last_undegraded":"2024-09-16T01:23:07.195783+0000","last_fullsized":"2024-09-16T01:23:07.195783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:09.625480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.194407+0000","last_change":"2024-09-16T01:21:28.044744+0000","last_active":"2024-09-16T01:23:07.194407+0000","last_peered":"2024-09-16T01:23:07.194407+0000","last_clean":"2024-09-16T01:23:07.194407+0000","last_became_active":"2024-09-16T01:21:28.044440+0000","last_became_peered":"2024-09-16T01:21:28.044440+0000","last_unstale":"2024-09-16T01:23:07.194407+0000","last_undegraded":"2024-09-16T01:23:07.194407+0000","last_fullsized":"2024-09-16T01:23:07.194407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:20.404778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.200147+0000","last_change":"2024-09-16T01:21:28.044498+0000","last_active":"2024-09-16T01:23:07.200147+0000","last_peered":"2024-09-16T01:23:07.200147+0000","last_clean":"2024-09-16T01:23:07.200147+0000","last_became_active":"2024-09-16T01:21:28.044028+0000","last_became_peered":"2024-09-16T01:21:28.044028+0000","last_unstale":"2024-09-16T01:23:07.200147+0000","last_undegraded":"2024-09-16T01:23:07.200147+0000","last_fullsized":"2024-09-16T01:23:07.200147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:46.134484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198919+0000","last_change":"2024-09-16T01:21:28.047796+0000","last_active":"2024-09-16T01:23:07.198919+0000","last_peered":"2024-09-16T01:23:07.198919+0000","last_clean":"2024-09-16T01:23:07.198919+0000","last_became_active":"2024-09-16T01:21:28.046289+0000","last_became_peered":"2024-09-16T01:21:28.046289+0000","last_unstale":"2024-09-16T01:23:07.198919+0000","last_undegraded":"2024-09-16T01:23:07.198919+0000","last_fullsized":"2024-09-16T01:23:07.198919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:53.709261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.197343+0000","last_change":"2024-09-16T01:21:28.050767+0000","last_active":"2024-09-16T01:23:07.197343+0000","last_peered":"2024-09-16T01:23:07.197343+0000","last_clean":"2024-09-16T01:23:07.197343+0000","last_became_active":"2024-09-16T01:21:28.050430+0000","last_became_peered":"2024-09-16T01:21:28.050430+0000","last_unstale":"2024-09-16T01:23:07.197343+0000","last_undegraded":"2024-09-16T01:23:07.197343+0000","last_fullsized":"2024-09-16T01:23:07.197343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:37.436612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.177055+0000","last_change":"2024-09-16T01:21:28.045374+0000","last_active":"2024-09-16T01:23:07.177055+0000","last_peered":"2024-09-16T01:23:07.177055+0000","last_clean":"2024-09-16T01:23:07.177055+0000","last_became_active":"2024-09-16T01:21:28.045072+0000","last_became_peered":"2024-09-16T01:21:28.045072+0000","last_unstale":"2024-09-16T01:23:07.177055+0000","last_undegraded":"2024-09-16T01:23:07.177055+0000","last_fullsized":"2024-09-16T01:23:07.177055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:10.579680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:13.229660+0000","last_change":"2024-09-16T01:21:25.922017+0000","last_active":"2024-09-16T01:23:13.229660+0000","last_peered":"2024-09-16T01:23:13.229660+0000","last_clean":"2024-09-16T01:23:13.229660+0000","last_became_active":"2024-09-16T01:21:25.921580+0000","last_became_peered":"2024-09-16T01:21:25.921580+0000","last_unstale":"2024-09-16T01:23:13.229660+0000","last_undegraded":"2024-09-16T01:23:13.229660+0000","last_fullsized":"2024-09-16T01:23:13.229660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.745844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198279+0000","last_change":"2024-09-16T01:21:39.094811+0000","last_active":"2024-09-16T01:23:07.198279+0000","last_peered":"2024-09-16T01:23:07.198279+0000","last_clean":"2024-09-16T01:23:07.198279+0000","last_became_active":"2024-09-16T01:21:39.094399+0000","last_became_peered":"2024-09-16T01:21:39.094399+0000","last_unstale":"2024-09-16T01:23:07.198279+0000","last_undegraded":"2024-09-16T01:23:07.198279+0000","last_fullsized":"2024-09-16T01:23:07.198279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:48.363791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.110226+0000","last_change":"2024-09-16T01:21:39.110226+0000","last_active":"2024-09-16T01:21:39.110226+0000","last_peered":"2024-09-16T01:21:39.110226+0000","last_clean":"2024-09-16T01:21:39.110226+0000","last_became_active":"2024-09-16T01:21:39.107676+0000","last_became_peered":"2024-09-16T01:21:39.107676+0000","last_unstale":"2024-09-16T01:21:39.110226+0000","last_undegraded":"2024-09-16T01:21:39.110226+0000","last_fullsized":"2024-09-16T01:21:39.110226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:57:14.854181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086856+0000","last_change":"2024-09-16T01:21:25.924434+0000","last_active":"2024-09-16T01:21:39.086856+0000","last_peered":"2024-09-16T01:21:39.086856+0000","last_clean":"2024-09-16T01:21:39.086856+0000","last_became_active":"2024-09-16T01:21:25.924092+0000","last_became_peered":"2024-09-16T01:21:25.924092+0000","last_unstale":"2024-09-16T01:21:39.086856+0000","last_undegraded":"2024-09-16T01:21:39.086856+0000","last_fullsized":"2024-09-16T01:21:39.086856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:20.956985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196900+0000","last_change":"2024-09-16T01:21:28.037273+0000","last_active":"2024-09-16T01:23:07.196900+0000","last_peered":"2024-09-16T01:23:07.196900+0000","last_clean":"2024-09-16T01:23:07.196900+0000","last_became_active":"2024-09-16T01:21:28.036958+0000","last_became_peered":"2024-09-16T01:21:28.036958+0000","last_unstale":"2024-09-16T01:23:07.196900+0000","last_undegraded":"2024-09-16T01:23:07.196900+0000","last_fullsized":"2024-09-16T01:23:07.196900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:53.376640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088161+0000","last_change":"2024-09-16T01:21:25.923208+0000","last_active":"2024-09-16T01:21:39.088161+0000","last_peered":"2024-09-16T01:21:39.088161+0000","last_clean":"2024-09-16T01:21:39.088161+0000","last_became_active":"2024-09-16T01:21:25.922882+0000","last_became_peered":"2024-09-16T01:21:25.922882+0000","last_unstale":"2024-09-16T01:21:39.088161+0000","last_undegraded":"2024-09-16T01:21:39.088161+0000","last_fullsized":"2024-09-16T01:21:39.088161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:44.359615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.189681+0000","last_change":"2024-09-16T01:21:28.035901+0000","last_active":"2024-09-16T01:23:07.189681+0000","last_peered":"2024-09-16T01:23:07.189681+0000","last_clean":"2024-09-16T01:23:07.189681+0000","last_became_active":"2024-09-16T01:21:28.035568+0000","last_became_peered":"2024-09-16T01:21:28.035568+0000","last_unstale":"2024-09-16T01:23:07.189681+0000","last_undegraded":"2024-09-16T01:23:07.189681+0000","last_fullsized":"2024-09-16T01:23:07.189681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:42.270380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":124,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:14.230417+0000","last_change":"2024-09-16T01:21:25.923692+0000","last_active":"2024-09-16T01:23:14.230417+0000","last_peered":"2024-09-16T01:23:14.230417+0000","last_clean":"2024-09-16T01:23:14.230417+0000","last_became_active":"2024-09-16T01:21:25.923325+0000","last_became_peered":"2024-09-16T01:21:25.923325+0000","last_unstale":"2024-09-16T01:23:14.230417+0000","last_undegraded":"2024-09-16T01:23:14.230417+0000","last_fullsized":"2024-09-16T01:23:14.230417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:55.075655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.192428+0000","last_change":"2024-09-16T01:21:28.054697+0000","last_active":"2024-09-16T01:23:07.192428+0000","last_peered":"2024-09-16T01:23:07.192428+0000","last_clean":"2024-09-16T01:23:07.192428+0000","last_became_active":"2024-09-16T01:21:28.054416+0000","last_became_peered":"2024-09-16T01:21:28.054416+0000","last_unstale":"2024-09-16T01:23:07.192428+0000","last_undegraded":"2024-09-16T01:23:07.192428+0000","last_fullsized":"2024-09-16T01:23:07.192428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:42.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089652+0000","last_change":"2024-09-16T01:21:25.920939+0000","last_active":"2024-09-16T01:21:39.089652+0000","last_peered":"2024-09-16T01:21:39.089652+0000","last_clean":"2024-09-16T01:21:39.089652+0000","last_became_active":"2024-09-16T01:21:25.920574+0000","last_became_peered":"2024-09-16T01:21:25.920574+0000","last_unstale":"2024-09-16T01:21:39.089652+0000","last_undegraded":"2024-09-16T01:21:39.089652+0000","last_fullsized":"2024-09-16T01:21:39.089652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:15.640800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.186777+0000","last_change":"2024-09-16T01:21:28.048981+0000","last_active":"2024-09-16T01:23:07.186777+0000","last_peered":"2024-09-16T01:23:07.186777+0000","last_clean":"2024-09-16T01:23:07.186777+0000","last_became_active":"2024-09-16T01:21:28.048675+0000","last_became_peered":"2024-09-16T01:21:28.048675+0000","last_unstale":"2024-09-16T01:23:07.186777+0000","last_undegraded":"2024-09-16T01:23:07.186777+0000","last_fullsized":"2024-09-16T01:23:07.186777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:30.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088725+0000","last_change":"2024-09-16T01:21:26.660117+0000","last_active":"2024-09-16T01:21:39.088725+0000","last_peered":"2024-09-16T01:21:39.088725+0000","last_clean":"2024-09-16T01:21:39.088725+0000","last_became_active":"2024-09-16T01:21:26.659743+0000","last_became_peered":"2024-09-16T01:21:26.659743+0000","last_unstale":"2024-09-16T01:21:39.088725+0000","last_undegraded":"2024-09-16T01:21:39.088725+0000","last_fullsized":"2024-09-16T01:21:39.088725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:10.220612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191486+0000","last_change":"2024-09-16T01:21:28.051057+0000","last_active":"2024-09-16T01:23:07.191486+0000","last_peered":"2024-09-16T01:23:07.191486+0000","last_clean":"2024-09-16T01:23:07.191486+0000","last_became_active":"2024-09-16T01:21:28.050756+0000","last_became_peered":"2024-09-16T01:21:28.050756+0000","last_unstale":"2024-09-16T01:23:07.191486+0000","last_undegraded":"2024-09-16T01:23:07.191486+0000","last_fullsized":"2024-09-16T01:23:07.191486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:16.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'32","reported_seq":261,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:15.232149+0000","last_change":"2024-09-16T01:21:25.927384+0000","last_active":"2024-09-16T01:23:15.232149+0000","last_peered":"2024-09-16T01:23:15.232149+0000","last_clean":"2024-09-16T01:23:15.232149+0000","last_became_active":"2024-09-16T01:21:25.927017+0000","last_became_peered":"2024-09-16T01:21:25.927017+0000","last_unstale":"2024-09-16T01:23:15.232149+0000","last_undegraded":"2024-09-16T01:23:15.232149+0000","last_fullsized":"2024-09-16T01:23:15.232149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:03.267625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60508,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":162,"num_write":33,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.193364+0000","last_change":"2024-09-16T01:21:28.049410+0000","last_active":"2024-09-16T01:23:07.193364+0000","last_peered":"2024-09-16T01:23:07.193364+0000","last_clean":"2024-09-16T01:23:07.193364+0000","last_became_active":"2024-09-16T01:21:28.049058+0000","last_became_peered":"2024-09-16T01:21:28.049058+0000","last_unstale":"2024-09-16T01:23:07.193364+0000","last_undegraded":"2024-09-16T01:23:07.193364+0000","last_fullsized":"2024-09-16T01:23:07.193364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091098+0000","last_change":"2024-09-16T01:21:25.922040+0000","last_active":"2024-09-16T01:21:39.091098+0000","last_peered":"2024-09-16T01:21:39.091098+0000","last_clean":"2024-09-16T01:21:39.091098+0000","last_became_active":"2024-09-16T01:21:25.921487+0000","last_became_peered":"2024-09-16T01:21:25.921487+0000","last_unstale":"2024-09-16T01:21:39.091098+0000","last_undegraded":"2024-09-16T01:21:39.091098+0000","last_fullsized":"2024-09-16T01:21:39.091098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:15.361010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.200738+0000","last_change":"2024-09-16T01:21:28.043344+0000","last_active":"2024-09-16T01:23:07.200738+0000","last_peered":"2024-09-16T01:23:07.200738+0000","last_clean":"2024-09-16T01:23:07.200738+0000","last_became_active":"2024-09-16T01:21:28.042495+0000","last_became_peered":"2024-09-16T01:21:28.042495+0000","last_unstale":"2024-09-16T01:23:07.200738+0000","last_undegraded":"2024-09-16T01:23:07.200738+0000","last_fullsized":"2024-09-16T01:23:07.200738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:28.957975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087280+0000","last_change":"2024-09-16T01:21:25.924144+0000","last_active":"2024-09-16T01:21:39.087280+0000","last_peered":"2024-09-16T01:21:39.087280+0000","last_clean":"2024-09-16T01:21:39.087280+0000","last_became_active":"2024-09-16T01:21:25.923761+0000","last_became_peered":"2024-09-16T01:21:25.923761+0000","last_unstale":"2024-09-16T01:21:39.087280+0000","last_undegraded":"2024-09-16T01:21:39.087280+0000","last_fullsized":"2024-09-16T01:21:39.087280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.651575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.202313+0000","last_change":"2024-09-16T01:21:28.049329+0000","last_active":"2024-09-16T01:23:07.202313+0000","last_peered":"2024-09-16T01:23:07.202313+0000","last_clean":"2024-09-16T01:23:07.202313+0000","last_became_active":"2024-09-16T01:21:28.048976+0000","last_became_peered":"2024-09-16T01:21:28.048976+0000","last_unstale":"2024-09-16T01:23:07.202313+0000","last_undegraded":"2024-09-16T01:23:07.202313+0000","last_fullsized":"2024-09-16T01:23:07.202313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:11.564388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":131,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:15.232212+0000","last_change":"2024-09-16T01:21:25.923608+0000","last_active":"2024-09-16T01:23:15.232212+0000","last_peered":"2024-09-16T01:23:15.232212+0000","last_clean":"2024-09-16T01:23:15.232212+0000","last_became_active":"2024-09-16T01:21:25.923284+0000","last_became_peered":"2024-09-16T01:21:25.923284+0000","last_unstale":"2024-09-16T01:23:15.232212+0000","last_undegraded":"2024-09-16T01:23:15.232212+0000","last_fullsized":"2024-09-16T01:23:15.232212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:41.195014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.204287+0000","last_change":"2024-09-16T01:21:39.091872+0000","last_active":"2024-09-16T01:23:07.204287+0000","last_peered":"2024-09-16T01:23:07.204287+0000","last_clean":"2024-09-16T01:23:07.204287+0000","last_became_active":"2024-09-16T01:21:39.091480+0000","last_became_peered":"2024-09-16T01:21:39.091480+0000","last_unstale":"2024-09-16T01:23:07.204287+0000","last_undegraded":"2024-09-16T01:23:07.204287+0000","last_fullsized":"2024-09-16T01:23:07.204287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:23.606447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092805+0000","last_change":"2024-09-16T01:21:26.661446+0000","last_active":"2024-09-16T01:21:39.092805+0000","last_peered":"2024-09-16T01:21:39.092805+0000","last_clean":"2024-09-16T01:21:39.092805+0000","last_became_active":"2024-09-16T01:21:26.661047+0000","last_became_peered":"2024-09-16T01:21:26.661047+0000","last_unstale":"2024-09-16T01:21:39.092805+0000","last_undegraded":"2024-09-16T01:21:39.092805+0000","last_fullsized":"2024-09-16T01:21:39.092805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:22.983581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191326+0000","last_change":"2024-09-16T01:21:28.054663+0000","last_active":"2024-09-16T01:23:07.191326+0000","last_peered":"2024-09-16T01:23:07.191326+0000","last_clean":"2024-09-16T01:23:07.191326+0000","last_became_active":"2024-09-16T01:21:28.054350+0000","last_became_peered":"2024-09-16T01:21:28.054350+0000","last_unstale":"2024-09-16T01:23:07.191326+0000","last_undegraded":"2024-09-16T01:23:07.191326+0000","last_fullsized":"2024-09-16T01:23:07.191326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:22.963709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094004+0000","last_change":"2024-09-16T01:21:25.921910+0000","last_active":"2024-09-16T01:21:39.094004+0000","last_peered":"2024-09-16T01:21:39.094004+0000","last_clean":"2024-09-16T01:21:39.094004+0000","last_became_active":"2024-09-16T01:21:25.921578+0000","last_became_peered":"2024-09-16T01:21:25.921578+0000","last_unstale":"2024-09-16T01:21:39.094004+0000","last_undegraded":"2024-09-16T01:21:39.094004+0000","last_fullsized":"2024-09-16T01:21:39.094004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:20.210397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195441+0000","last_change":"2024-09-16T01:21:28.049953+0000","last_active":"2024-09-16T01:23:07.195441+0000","last_peered":"2024-09-16T01:23:07.195441+0000","last_clean":"2024-09-16T01:23:07.195441+0000","last_became_active":"2024-09-16T01:21:28.049450+0000","last_became_peered":"2024-09-16T01:21:28.049450+0000","last_unstale":"2024-09-16T01:23:07.195441+0000","last_undegraded":"2024-09-16T01:23:07.195441+0000","last_fullsized":"2024-09-16T01:23:07.195441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:49.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.098150+0000","last_change":"2024-09-16T01:21:39.098150+0000","last_active":"2024-09-16T01:21:39.098150+0000","last_peered":"2024-09-16T01:21:39.098150+0000","last_clean":"2024-09-16T01:21:39.098150+0000","last_became_active":"2024-09-16T01:21:39.094297+0000","last_became_peered":"2024-09-16T01:21:39.094297+0000","last_unstale":"2024-09-16T01:21:39.098150+0000","last_undegraded":"2024-09-16T01:21:39.098150+0000","last_fullsized":"2024-09-16T01:21:39.098150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:30:25.297230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.201932+0000","last_change":"2024-09-16T01:21:28.053920+0000","last_active":"2024-09-16T01:23:07.201932+0000","last_peered":"2024-09-16T01:23:07.201932+0000","last_clean":"2024-09-16T01:23:07.201932+0000","last_became_active":"2024-09-16T01:21:28.053397+0000","last_became_peered":"2024-09-16T01:21:28.053397+0000","last_unstale":"2024-09-16T01:23:07.201932+0000","last_undegraded":"2024-09-16T01:23:07.201932+0000","last_fullsized":"2024-09-16T01:23:07.201932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:27.079374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088854+0000","last_change":"2024-09-16T01:21:25.920527+0000","last_active":"2024-09-16T01:21:39.088854+0000","last_peered":"2024-09-16T01:21:39.088854+0000","last_clean":"2024-09-16T01:21:39.088854+0000","last_became_active":"2024-09-16T01:21:25.920162+0000","last_became_peered":"2024-09-16T01:21:25.920162+0000","last_unstale":"2024-09-16T01:21:39.088854+0000","last_undegraded":"2024-09-16T01:21:39.088854+0000","last_fullsized":"2024-09-16T01:21:39.088854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:31.995141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.200844+0000","last_change":"2024-09-16T01:21:28.050068+0000","last_active":"2024-09-16T01:23:07.200844+0000","last_peered":"2024-09-16T01:23:07.200844+0000","last_clean":"2024-09-16T01:23:07.200844+0000","last_became_active":"2024-09-16T01:21:28.049678+0000","last_became_peered":"2024-09-16T01:21:28.049678+0000","last_unstale":"2024-09-16T01:23:07.200844+0000","last_undegraded":"2024-09-16T01:23:07.200844+0000","last_fullsized":"2024-09-16T01:23:07.200844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:57.870550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091065+0000","last_change":"2024-09-16T01:21:26.663670+0000","last_active":"2024-09-16T01:21:39.091065+0000","last_peered":"2024-09-16T01:21:39.091065+0000","last_clean":"2024-09-16T01:21:39.091065+0000","last_became_active":"2024-09-16T01:21:26.663173+0000","last_became_peered":"2024-09-16T01:21:26.663173+0000","last_unstale":"2024-09-16T01:21:39.091065+0000","last_undegraded":"2024-09-16T01:21:39.091065+0000","last_fullsized":"2024-09-16T01:21:39.091065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:01.747039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203210+0000","last_change":"2024-09-16T01:21:28.053354+0000","last_active":"2024-09-16T01:23:07.203210+0000","last_peered":"2024-09-16T01:23:07.203210+0000","last_clean":"2024-09-16T01:23:07.203210+0000","last_became_active":"2024-09-16T01:21:28.052985+0000","last_became_peered":"2024-09-16T01:21:28.052985+0000","last_unstale":"2024-09-16T01:23:07.203210+0000","last_undegraded":"2024-09-16T01:23:07.203210+0000","last_fullsized":"2024-09-16T01:23:07.203210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:09.360220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089417+0000","last_change":"2024-09-16T01:20:14.084036+0000","last_active":"2024-09-16T01:21:39.089417+0000","last_peered":"2024-09-16T01:21:39.089417+0000","last_clean":"2024-09-16T01:21:39.089417+0000","last_became_active":"2024-09-16T01:20:14.083552+0000","last_became_peered":"2024-09-16T01:20:14.083552+0000","last_unstale":"2024-09-16T01:21:39.089417+0000","last_undegraded":"2024-09-16T01:21:39.089417+0000","last_fullsized":"2024-09-16T01:21:39.089417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_clean_scrub_stamp":"2024-09-16T01:16:51.922126+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:37.598878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106614+0000","last_change":"2024-09-16T01:21:25.923170+0000","last_active":"2024-09-16T01:21:39.106614+0000","last_peered":"2024-09-16T01:21:39.106614+0000","last_clean":"2024-09-16T01:21:39.106614+0000","last_became_active":"2024-09-16T01:21:25.922555+0000","last_became_peered":"2024-09-16T01:21:25.922555+0000","last_unstale":"2024-09-16T01:21:39.106614+0000","last_undegraded":"2024-09-16T01:21:39.106614+0000","last_fullsized":"2024-09-16T01:21:39.106614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:14.948264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.188186+0000","last_change":"2024-09-16T01:21:39.093752+0000","last_active":"2024-09-16T01:23:07.188186+0000","last_peered":"2024-09-16T01:23:07.188186+0000","last_clean":"2024-09-16T01:23:07.188186+0000","last_became_active":"2024-09-16T01:21:39.093394+0000","last_became_peered":"2024-09-16T01:21:39.093394+0000","last_unstale":"2024-09-16T01:23:07.188186+0000","last_undegraded":"2024-09-16T01:23:07.188186+0000","last_fullsized":"2024-09-16T01:23:07.188186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:32.703408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:21:25.925009+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:21:25.924661+0000","last_became_peered":"2024-09-16T01:21:25.924661+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.703241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199546+0000","last_change":"2024-09-16T01:21:28.045745+0000","last_active":"2024-09-16T01:23:07.199546+0000","last_peered":"2024-09-16T01:23:07.199546+0000","last_clean":"2024-09-16T01:23:07.199546+0000","last_became_active":"2024-09-16T01:21:28.045398+0000","last_became_peered":"2024-09-16T01:21:28.045398+0000","last_unstale":"2024-09-16T01:23:07.199546+0000","last_undegraded":"2024-09-16T01:23:07.199546+0000","last_fullsized":"2024-09-16T01:23:07.199546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:17.422858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:14.230366+0000","last_change":"2024-09-16T01:21:26.660859+0000","last_active":"2024-09-16T01:23:14.230366+0000","last_peered":"2024-09-16T01:23:14.230366+0000","last_clean":"2024-09-16T01:23:14.230366+0000","last_became_active":"2024-09-16T01:21:26.660515+0000","last_became_peered":"2024-09-16T01:21:26.660515+0000","last_unstale":"2024-09-16T01:23:14.230366+0000","last_undegraded":"2024-09-16T01:23:14.230366+0000","last_fullsized":"2024-09-16T01:23:14.230366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:57.301546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.194448+0000","last_change":"2024-09-16T01:21:39.092617+0000","last_active":"2024-09-16T01:23:07.194448+0000","last_peered":"2024-09-16T01:23:07.194448+0000","last_clean":"2024-09-16T01:23:07.194448+0000","last_became_active":"2024-09-16T01:21:39.092212+0000","last_became_peered":"2024-09-16T01:21:39.092212+0000","last_unstale":"2024-09-16T01:23:07.194448+0000","last_undegraded":"2024-09-16T01:23:07.194448+0000","last_fullsized":"2024-09-16T01:23:07.194448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.894975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089151+0000","last_change":"2024-09-16T01:21:25.924485+0000","last_active":"2024-09-16T01:21:39.089151+0000","last_peered":"2024-09-16T01:21:39.089151+0000","last_clean":"2024-09-16T01:21:39.089151+0000","last_became_active":"2024-09-16T01:21:25.924075+0000","last_became_peered":"2024-09-16T01:21:25.924075+0000","last_unstale":"2024-09-16T01:21:39.089151+0000","last_undegraded":"2024-09-16T01:21:39.089151+0000","last_fullsized":"2024-09-16T01:21:39.089151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:13.034668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.183381+0000","last_change":"2024-09-16T01:21:28.048152+0000","last_active":"2024-09-16T01:23:07.183381+0000","last_peered":"2024-09-16T01:23:07.183381+0000","last_clean":"2024-09-16T01:23:07.183381+0000","last_became_active":"2024-09-16T01:21:28.047818+0000","last_became_peered":"2024-09-16T01:21:28.047818+0000","last_unstale":"2024-09-16T01:23:07.183381+0000","last_undegraded":"2024-09-16T01:23:07.183381+0000","last_fullsized":"2024-09-16T01:23:07.183381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:19.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089286+0000","last_change":"2024-09-16T01:21:26.660336+0000","last_active":"2024-09-16T01:21:39.089286+0000","last_peered":"2024-09-16T01:21:39.089286+0000","last_clean":"2024-09-16T01:21:39.089286+0000","last_became_active":"2024-09-16T01:21:26.660005+0000","last_became_peered":"2024-09-16T01:21:26.660005+0000","last_unstale":"2024-09-16T01:21:39.089286+0000","last_undegraded":"2024-09-16T01:21:39.089286+0000","last_fullsized":"2024-09-16T01:21:39.089286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:37.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.180180+0000","last_change":"2024-09-16T01:21:28.043112+0000","last_active":"2024-09-16T01:23:07.180180+0000","last_peered":"2024-09-16T01:23:07.180180+0000","last_clean":"2024-09-16T01:23:07.180180+0000","last_became_active":"2024-09-16T01:21:28.042752+0000","last_became_peered":"2024-09-16T01:21:28.042752+0000","last_unstale":"2024-09-16T01:23:07.180180+0000","last_undegraded":"2024-09-16T01:23:07.180180+0000","last_fullsized":"2024-09-16T01:23:07.180180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:57.379826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093748+0000","last_change":"2024-09-16T01:21:26.661003+0000","last_active":"2024-09-16T01:21:39.093748+0000","last_peered":"2024-09-16T01:21:39.093748+0000","last_clean":"2024-09-16T01:21:39.093748+0000","last_became_active":"2024-09-16T01:21:26.660407+0000","last_became_peered":"2024-09-16T01:21:26.660407+0000","last_unstale":"2024-09-16T01:21:39.093748+0000","last_undegraded":"2024-09-16T01:21:39.093748+0000","last_fullsized":"2024-09-16T01:21:39.093748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:52.229473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199076+0000","last_change":"2024-09-16T01:21:28.046938+0000","last_active":"2024-09-16T01:23:07.199076+0000","last_peered":"2024-09-16T01:23:07.199076+0000","last_clean":"2024-09-16T01:23:07.199076+0000","last_became_active":"2024-09-16T01:21:28.046620+0000","last_became_peered":"2024-09-16T01:21:28.046620+0000","last_unstale":"2024-09-16T01:23:07.199076+0000","last_undegraded":"2024-09-16T01:23:07.199076+0000","last_fullsized":"2024-09-16T01:23:07.199076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:04.845341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:08.048322+0000","last_change":"2024-09-16T01:21:25.915315+0000","last_active":"2024-09-16T01:23:08.048322+0000","last_peered":"2024-09-16T01:23:08.048322+0000","last_clean":"2024-09-16T01:23:08.048322+0000","last_became_active":"2024-09-16T01:21:25.915001+0000","last_became_peered":"2024-09-16T01:21:25.915001+0000","last_unstale":"2024-09-16T01:23:08.048322+0000","last_undegraded":"2024-09-16T01:23:08.048322+0000","last_fullsized":"2024-09-16T01:23:08.048322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:30.163050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198048+0000","last_change":"2024-09-16T01:21:28.047157+0000","last_active":"2024-09-16T01:23:07.198048+0000","last_peered":"2024-09-16T01:23:07.198048+0000","last_clean":"2024-09-16T01:23:07.198048+0000","last_became_active":"2024-09-16T01:21:28.046583+0000","last_became_peered":"2024-09-16T01:21:28.046583+0000","last_unstale":"2024-09-16T01:23:07.198048+0000","last_undegraded":"2024-09-16T01:23:07.198048+0000","last_fullsized":"2024-09-16T01:23:07.198048+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:47.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106885+0000","last_change":"2024-09-16T01:21:26.663047+0000","last_active":"2024-09-16T01:21:39.106885+0000","last_peered":"2024-09-16T01:21:39.106885+0000","last_clean":"2024-09-16T01:21:39.106885+0000","last_became_active":"2024-09-16T01:21:26.662627+0000","last_became_peered":"2024-09-16T01:21:26.662627+0000","last_unstale":"2024-09-16T01:21:39.106885+0000","last_undegraded":"2024-09-16T01:21:39.106885+0000","last_fullsized":"2024-09-16T01:21:39.106885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:59.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196911+0000","last_change":"2024-09-16T01:21:28.046954+0000","last_active":"2024-09-16T01:23:07.196911+0000","last_peered":"2024-09-16T01:23:07.196911+0000","last_clean":"2024-09-16T01:23:07.196911+0000","last_became_active":"2024-09-16T01:21:28.046550+0000","last_became_peered":"2024-09-16T01:21:28.046550+0000","last_unstale":"2024-09-16T01:23:07.196911+0000","last_undegraded":"2024-09-16T01:23:07.196911+0000","last_fullsized":"2024-09-16T01:23:07.196911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:30.880672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.100910+0000","last_change":"2024-09-16T01:21:39.100910+0000","last_active":"2024-09-16T01:21:39.100910+0000","last_peered":"2024-09-16T01:21:39.100910+0000","last_clean":"2024-09-16T01:21:39.100910+0000","last_became_active":"2024-09-16T01:21:39.095257+0000","last_became_peered":"2024-09-16T01:21:39.095257+0000","last_unstale":"2024-09-16T01:21:39.100910+0000","last_undegraded":"2024-09-16T01:21:39.100910+0000","last_fullsized":"2024-09-16T01:21:39.100910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:17.957295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.160646+0000","last_change":"2024-09-16T01:21:28.052061+0000","last_active":"2024-09-16T01:23:07.160646+0000","last_peered":"2024-09-16T01:23:07.160646+0000","last_clean":"2024-09-16T01:23:07.160646+0000","last_became_active":"2024-09-16T01:21:28.051705+0000","last_became_peered":"2024-09-16T01:21:28.051705+0000","last_unstale":"2024-09-16T01:23:07.160646+0000","last_undegraded":"2024-09-16T01:23:07.160646+0000","last_fullsized":"2024-09-16T01:23:07.160646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:05.546846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090258+0000","last_change":"2024-09-16T01:21:25.921635+0000","last_active":"2024-09-16T01:21:39.090258+0000","last_peered":"2024-09-16T01:21:39.090258+0000","last_clean":"2024-09-16T01:21:39.090258+0000","last_became_active":"2024-09-16T01:21:25.921281+0000","last_became_peered":"2024-09-16T01:21:25.921281+0000","last_unstale":"2024-09-16T01:21:39.090258+0000","last_undegraded":"2024-09-16T01:21:39.090258+0000","last_fullsized":"2024-09-16T01:21:39.090258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:02.933803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198236+0000","last_change":"2024-09-16T01:21:28.043636+0000","last_active":"2024-09-16T01:23:07.198236+0000","last_peered":"2024-09-16T01:23:07.198236+0000","last_clean":"2024-09-16T01:23:07.198236+0000","last_became_active":"2024-09-16T01:21:28.043273+0000","last_became_peered":"2024-09-16T01:21:28.043273+0000","last_unstale":"2024-09-16T01:23:07.198236+0000","last_undegraded":"2024-09-16T01:23:07.198236+0000","last_fullsized":"2024-09-16T01:23:07.198236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:05.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090771+0000","last_change":"2024-09-16T01:21:25.917934+0000","last_active":"2024-09-16T01:21:39.090771+0000","last_peered":"2024-09-16T01:21:39.090771+0000","last_clean":"2024-09-16T01:21:39.090771+0000","last_became_active":"2024-09-16T01:21:25.917545+0000","last_became_peered":"2024-09-16T01:21:25.917545+0000","last_unstale":"2024-09-16T01:21:39.090771+0000","last_undegraded":"2024-09-16T01:21:39.090771+0000","last_fullsized":"2024-09-16T01:21:39.090771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:07.119546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.193744+0000","last_change":"2024-09-16T01:21:28.043270+0000","last_active":"2024-09-16T01:23:07.193744+0000","last_peered":"2024-09-16T01:23:07.193744+0000","last_clean":"2024-09-16T01:23:07.193744+0000","last_became_active":"2024-09-16T01:21:28.042957+0000","last_became_peered":"2024-09-16T01:21:28.042957+0000","last_unstale":"2024-09-16T01:23:07.193744+0000","last_undegraded":"2024-09-16T01:23:07.193744+0000","last_fullsized":"2024-09-16T01:23:07.193744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:11.052387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093263+0000","last_change":"2024-09-16T01:21:25.923224+0000","last_active":"2024-09-16T01:21:39.093263+0000","last_peered":"2024-09-16T01:21:39.093263+0000","last_clean":"2024-09-16T01:21:39.093263+0000","last_became_active":"2024-09-16T01:21:25.922873+0000","last_became_peered":"2024-09-16T01:21:25.922873+0000","last_unstale":"2024-09-16T01:21:39.093263+0000","last_undegraded":"2024-09-16T01:21:39.093263+0000","last_fullsized":"2024-09-16T01:21:39.093263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:14.747752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203114+0000","last_change":"2024-09-16T01:21:28.054706+0000","last_active":"2024-09-16T01:23:07.203114+0000","last_peered":"2024-09-16T01:23:07.203114+0000","last_clean":"2024-09-16T01:23:07.203114+0000","last_became_active":"2024-09-16T01:21:28.054382+0000","last_became_peered":"2024-09-16T01:21:28.054382+0000","last_unstale":"2024-09-16T01:23:07.203114+0000","last_undegraded":"2024-09-16T01:23:07.203114+0000","last_fullsized":"2024-09-16T01:23:07.203114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.908252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.192962+0000","last_change":"2024-09-16T01:21:28.051807+0000","last_active":"2024-09-16T01:23:07.192962+0000","last_peered":"2024-09-16T01:23:07.192962+0000","last_clean":"2024-09-16T01:23:07.192962+0000","last_became_active":"2024-09-16T01:21:28.051474+0000","last_became_peered":"2024-09-16T01:21:28.051474+0000","last_unstale":"2024-09-16T01:23:07.192962+0000","last_undegraded":"2024-09-16T01:23:07.192962+0000","last_fullsized":"2024-09-16T01:23:07.192962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:48.006691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.101161+0000","last_change":"2024-09-16T01:21:39.100723+0000","last_active":"2024-09-16T01:21:39.101161+0000","last_peered":"2024-09-16T01:21:39.101161+0000","last_clean":"2024-09-16T01:21:39.101161+0000","last_became_active":"2024-09-16T01:21:39.094895+0000","last_became_peered":"2024-09-16T01:21:39.094895+0000","last_unstale":"2024-09-16T01:21:39.101161+0000","last_undegraded":"2024-09-16T01:21:39.101161+0000","last_fullsized":"2024-09-16T01:21:39.101161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.663815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.194567+0000","last_change":"2024-09-16T01:21:28.055506+0000","last_active":"2024-09-16T01:23:07.194567+0000","last_peered":"2024-09-16T01:23:07.194567+0000","last_clean":"2024-09-16T01:23:07.194567+0000","last_became_active":"2024-09-16T01:21:28.055167+0000","last_became_peered":"2024-09-16T01:21:28.055167+0000","last_unstale":"2024-09-16T01:23:07.194567+0000","last_undegraded":"2024-09-16T01:23:07.194567+0000","last_fullsized":"2024-09-16T01:23:07.194567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:38.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093642+0000","last_change":"2024-09-16T01:21:25.920611+0000","last_active":"2024-09-16T01:21:39.093642+0000","last_peered":"2024-09-16T01:21:39.093642+0000","last_clean":"2024-09-16T01:21:39.093642+0000","last_became_active":"2024-09-16T01:21:25.920255+0000","last_became_peered":"2024-09-16T01:21:25.920255+0000","last_unstale":"2024-09-16T01:21:39.093642+0000","last_undegraded":"2024-09-16T01:21:39.093642+0000","last_fullsized":"2024-09-16T01:21:39.093642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:17.268621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195544+0000","last_change":"2024-09-16T01:21:28.054009+0000","last_active":"2024-09-16T01:23:07.195544+0000","last_peered":"2024-09-16T01:23:07.195544+0000","last_clean":"2024-09-16T01:23:07.195544+0000","last_became_active":"2024-09-16T01:21:28.053631+0000","last_became_peered":"2024-09-16T01:21:28.053631+0000","last_unstale":"2024-09-16T01:23:07.195544+0000","last_undegraded":"2024-09-16T01:23:07.195544+0000","last_fullsized":"2024-09-16T01:23:07.195544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:28.298398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090095+0000","last_change":"2024-09-16T01:21:26.659753+0000","last_active":"2024-09-16T01:21:39.090095+0000","last_peered":"2024-09-16T01:21:39.090095+0000","last_clean":"2024-09-16T01:21:39.090095+0000","last_became_active":"2024-09-16T01:21:26.659343+0000","last_became_peered":"2024-09-16T01:21:26.659343+0000","last_unstale":"2024-09-16T01:21:39.090095+0000","last_undegraded":"2024-09-16T01:21:39.090095+0000","last_fullsized":"2024-09-16T01:21:39.090095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:47.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199114+0000","last_change":"2024-09-16T01:21:28.050748+0000","last_active":"2024-09-16T01:23:07.199114+0000","last_peered":"2024-09-16T01:23:07.199114+0000","last_clean":"2024-09-16T01:23:07.199114+0000","last_became_active":"2024-09-16T01:21:28.050457+0000","last_became_peered":"2024-09-16T01:21:28.050457+0000","last_unstale":"2024-09-16T01:23:07.199114+0000","last_undegraded":"2024-09-16T01:23:07.199114+0000","last_fullsized":"2024-09-16T01:23:07.199114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:21.552080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089346+0000","last_change":"2024-09-16T01:21:25.924505+0000","last_active":"2024-09-16T01:21:39.089346+0000","last_peered":"2024-09-16T01:21:39.089346+0000","last_clean":"2024-09-16T01:21:39.089346+0000","last_became_active":"2024-09-16T01:21:25.924076+0000","last_became_peered":"2024-09-16T01:21:25.924076+0000","last_unstale":"2024-09-16T01:21:39.089346+0000","last_undegraded":"2024-09-16T01:21:39.089346+0000","last_fullsized":"2024-09-16T01:21:39.089346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:00.630772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65681,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":621,"num_read_kb":381,"num_write":175,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282677,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514532,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":441274,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1094292,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906990,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441510,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135923,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441430,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364854,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1034037,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528381,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":440899,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1033187,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442365,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":441210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":503579,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":501200,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":442170,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:23:20.168 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-16T01:23:20.168 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:23:20.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.306+0000 7f125e986640 1 -- 172.21.15.63:0/4161833476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12581025e0 msgr2=0x7f1258108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.306+0000 7f125e986640 1 --2- 172.21.15.63:0/4161833476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12581025e0 0x7f1258108e70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1250009ca0 tx=0x7f125002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.306+0000 7f125e986640 1 -- 172.21.15.63:0/4161833476 shutdown_connections 2024-09-16T01:23:20.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.306+0000 7f125e986640 1 --2- 172.21.15.63:0/4161833476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12581025e0 0x7f1258108e70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.306+0000 7f125e986640 1 --2- 172.21.15.63:0/4161833476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258101c20 0x7f12581020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.306+0000 7f125e986640 1 --2- 172.21.15.63:0/4161833476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1258100a30 0x7f1258100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.306+0000 7f125e986640 1 -- 172.21.15.63:0/4161833476 >> 172.21.15.63:0/4161833476 conn(0x7f12580fc1b0 msgr2=0x7f12580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:20.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.306+0000 7f125e986640 1 -- 172.21.15.63:0/4161833476 shutdown_connections 2024-09-16T01:23:20.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.306+0000 7f125e986640 1 -- 172.21.15.63:0/4161833476 wait complete. 2024-09-16T01:23:20.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f125e986640 1 Processor -- start 2024-09-16T01:23:20.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f125e986640 1 -- start start 2024-09-16T01:23:20.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f125e986640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1258100a30 0x7f1258197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f125e986640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258101c20 0x7f1258198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f125e986640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12581025e0 0x7f125819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f125e986640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f125810d6b0 con 0x7f1258100a30 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f125e986640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f125810d530 con 0x7f1258101c20 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f125e986640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f125810d830 con 0x7f12581025e0 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f1257fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1258100a30 0x7f1258197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f1257fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1258100a30 0x7f1258197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44924/0 (socket says 172.21.15.63:44924) 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f1257fff640 1 -- 172.21.15.63:0/3243156672 learned_addr learned my addr 172.21.15.63:0/3243156672 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f12577fe640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258101c20 0x7f1258198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f1257fff640 1 -- 172.21.15.63:0/3243156672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12581025e0 msgr2=0x7f125819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f1257fff640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12581025e0 0x7f125819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f1257fff640 1 -- 172.21.15.63:0/3243156672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258101c20 msgr2=0x7f1258198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f1257fff640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258101c20 0x7f1258198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.307+0000 7f1257fff640 1 -- 172.21.15.63:0/3243156672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125819f970 con 0x7f1258100a30 2024-09-16T01:23:20.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.308+0000 7f1257fff640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1258100a30 0x7f1258197d50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f124800d950 tx=0x7f124800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.308+0000 7f12557fa640 1 -- 172.21.15.63:0/3243156672 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248017070 con 0x7f1258100a30 2024-09-16T01:23:20.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.308+0000 7f12557fa640 1 -- 172.21.15.63:0/3243156672 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1248009c30 con 0x7f1258100a30 2024-09-16T01:23:20.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.308+0000 7f125e986640 1 -- 172.21.15.63:0/3243156672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125819fc60 con 0x7f1258100a30 2024-09-16T01:23:20.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.308+0000 7f12557fa640 1 -- 172.21.15.63:0/3243156672 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124800f620 con 0x7f1258100a30 2024-09-16T01:23:20.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.308+0000 7f125e986640 1 -- 172.21.15.63:0/3243156672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12581a0160 con 0x7f1258100a30 2024-09-16T01:23:20.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.309+0000 7f125e986640 1 -- 172.21.15.63:0/3243156672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1258107e60 con 0x7f1258100a30 2024-09-16T01:23:20.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.310+0000 7f12557fa640 1 -- 172.21.15.63:0/3243156672 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f124801a070 con 0x7f1258100a30 2024-09-16T01:23:20.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.311+0000 7f12557fa640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f12400a3250 0x7f12400a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.311+0000 7f12577fe640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f12400a3250 0x7f12400a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.311+0000 7f12557fa640 1 -- 172.21.15.63:0/3243156672 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f12480cf420 con 0x7f1258100a30 2024-09-16T01:23:20.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.311+0000 7f12577fe640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f12400a3250 0x7f12400a5710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f124c005fd0 tx=0x7f124c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.315+0000 7f12557fa640 1 -- 172.21.15.63:0/3243156672 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1248009de0 con 0x7f1258100a30 2024-09-16T01:23:20.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.489+0000 7f125e986640 1 -- 172.21.15.63:0/3243156672 --> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1258062630 con 0x7f12400a3250 2024-09-16T01:23:20.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.496+0000 7f12557fa640 1 -- 172.21.15.63:0/3243156672 <== mgr.14150 v2:172.21.15.63:6800/3860332424 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259076 (secure 0 0 0) 0x7f1258062630 con 0x7f12400a3250 2024-09-16T01:23:20.499 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:23:20.501 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-16T01:23:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 -- 172.21.15.63:0/3243156672 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f12400a3250 msgr2=0x7f12400a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f12400a3250 0x7f12400a5710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f124c005fd0 tx=0x7f124c005850 comp rx=0 tx=0).stop 2024-09-16T01:23:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 -- 172.21.15.63:0/3243156672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1258100a30 msgr2=0x7f1258197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1258100a30 0x7f1258197d50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f124800d950 tx=0x7f124800de10 comp rx=0 tx=0).stop 2024-09-16T01:23:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 -- 172.21.15.63:0/3243156672 shutdown_connections 2024-09-16T01:23:20.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f12400a3250 0x7f12400a5710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12581025e0 0x7f125819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1258101c20 0x7f1258198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 --2- 172.21.15.63:0/3243156672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1258100a30 0x7f1258197d50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 -- 172.21.15.63:0/3243156672 >> 172.21.15.63:0/3243156672 conn(0x7f12580fc1b0 msgr2=0x7f1258105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:20.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 -- 172.21.15.63:0/3243156672 shutdown_connections 2024-09-16T01:23:20.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:20.499+0000 7f125e986640 1 -- 172.21.15.63:0/3243156672 wait complete. 2024-09-16T01:23:20.510 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:20 smithi063 ceph-mon[31070]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-16T01:23:20.511 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:20 smithi063 ceph-mon[31070]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:23:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-16T01:23:19.206438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656283,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":747,"num_read_kb":490,"num_write":358,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":788,"ondisk_log_size":788,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360384,"kb_used_data":11136,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581440,"statfs":{"total":1151940427776,"available":1151571394560,"internally_reserved":0,"allocated":11403264,"data_stored":7257153,"data_compressed":177609,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1521,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002909"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196446+0000","last_change":"2024-09-16T01:21:28.051261+0000","last_active":"2024-09-16T01:23:07.196446+0000","last_peered":"2024-09-16T01:23:07.196446+0000","last_clean":"2024-09-16T01:23:07.196446+0000","last_became_active":"2024-09-16T01:21:28.049073+0000","last_became_peered":"2024-09-16T01:21:28.049073+0000","last_unstale":"2024-09-16T01:23:07.196446+0000","last_undegraded":"2024-09-16T01:23:07.196446+0000","last_fullsized":"2024-09-16T01:23:07.196446+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:06.863766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195008+0000","last_change":"2024-09-16T01:21:28.049457+0000","last_active":"2024-09-16T01:23:07.195008+0000","last_peered":"2024-09-16T01:23:07.195008+0000","last_clean":"2024-09-16T01:23:07.195008+0000","last_became_active":"2024-09-16T01:21:28.048707+0000","last_became_peered":"2024-09-16T01:21:28.048707+0000","last_unstale":"2024-09-16T01:23:07.195008+0000","last_undegraded":"2024-09-16T01:23:07.195008+0000","last_fullsized":"2024-09-16T01:23:07.195008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:56.346506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199710+0000","last_change":"2024-09-16T01:21:28.052931+0000","last_active":"2024-09-16T01:23:07.199710+0000","last_peered":"2024-09-16T01:23:07.199710+0000","last_clean":"2024-09-16T01:23:07.199710+0000","last_became_active":"2024-09-16T01:21:28.052501+0000","last_became_peered":"2024-09-16T01:21:28.052501+0000","last_unstale":"2024-09-16T01:23:07.199710+0000","last_undegraded":"2024-09-16T01:23:07.199710+0000","last_fullsized":"2024-09-16T01:23:07.199710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:45:23.351452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.188397+0000","last_change":"2024-09-16T01:21:39.096279+0000","last_active":"2024-09-16T01:23:07.188397+0000","last_peered":"2024-09-16T01:23:07.188397+0000","last_clean":"2024-09-16T01:23:07.188397+0000","last_became_active":"2024-09-16T01:21:39.095886+0000","last_became_peered":"2024-09-16T01:21:39.095886+0000","last_unstale":"2024-09-16T01:23:07.188397+0000","last_undegraded":"2024-09-16T01:23:07.188397+0000","last_fullsized":"2024-09-16T01:23:07.188397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:56.530007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196025+0000","last_change":"2024-09-16T01:21:28.043473+0000","last_active":"2024-09-16T01:23:07.196025+0000","last_peered":"2024-09-16T01:23:07.196025+0000","last_clean":"2024-09-16T01:23:07.196025+0000","last_became_active":"2024-09-16T01:21:28.043127+0000","last_became_peered":"2024-09-16T01:21:28.043127+0000","last_unstale":"2024-09-16T01:23:07.196025+0000","last_undegraded":"2024-09-16T01:23:07.196025+0000","last_fullsized":"2024-09-16T01:23:07.196025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.714834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191119+0000","last_change":"2024-09-16T01:21:28.047210+0000","last_active":"2024-09-16T01:23:07.191119+0000","last_peered":"2024-09-16T01:23:07.191119+0000","last_clean":"2024-09-16T01:23:07.191119+0000","last_became_active":"2024-09-16T01:21:28.046872+0000","last_became_peered":"2024-09-16T01:21:28.046872+0000","last_unstale":"2024-09-16T01:23:07.191119+0000","last_undegraded":"2024-09-16T01:23:07.191119+0000","last_fullsized":"2024-09-16T01:23:07.191119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:22.200105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203794+0000","last_change":"2024-09-16T01:21:28.052212+0000","last_active":"2024-09-16T01:23:07.203794+0000","last_peered":"2024-09-16T01:23:07.203794+0000","last_clean":"2024-09-16T01:23:07.203794+0000","last_became_active":"2024-09-16T01:21:28.050307+0000","last_became_peered":"2024-09-16T01:21:28.050307+0000","last_unstale":"2024-09-16T01:23:07.203794+0000","last_undegraded":"2024-09-16T01:23:07.203794+0000","last_fullsized":"2024-09-16T01:23:07.203794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:21.869103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195182+0000","last_change":"2024-09-16T01:21:28.047980+0000","last_active":"2024-09-16T01:23:07.195182+0000","last_peered":"2024-09-16T01:23:07.195182+0000","last_clean":"2024-09-16T01:23:07.195182+0000","last_became_active":"2024-09-16T01:21:28.047671+0000","last_became_peered":"2024-09-16T01:21:28.047671+0000","last_unstale":"2024-09-16T01:23:07.195182+0000","last_undegraded":"2024-09-16T01:23:07.195182+0000","last_fullsized":"2024-09-16T01:23:07.195182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:30.501419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195767+0000","last_change":"2024-09-16T01:21:28.052468+0000","last_active":"2024-09-16T01:23:07.195767+0000","last_peered":"2024-09-16T01:23:07.195767+0000","last_clean":"2024-09-16T01:23:07.195767+0000","last_became_active":"2024-09-16T01:21:28.052156+0000","last_became_peered":"2024-09-16T01:21:28.052156+0000","last_unstale":"2024-09-16T01:23:07.195767+0000","last_undegraded":"2024-09-16T01:23:07.195767+0000","last_fullsized":"2024-09-16T01:23:07.195767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:44.631498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191145+0000","last_change":"2024-09-16T01:21:28.048278+0000","last_active":"2024-09-16T01:23:07.191145+0000","last_peered":"2024-09-16T01:23:07.191145+0000","last_clean":"2024-09-16T01:23:07.191145+0000","last_became_active":"2024-09-16T01:21:28.047892+0000","last_became_peered":"2024-09-16T01:21:28.047892+0000","last_unstale":"2024-09-16T01:23:07.191145+0000","last_undegraded":"2024-09-16T01:23:07.191145+0000","last_fullsized":"2024-09-16T01:23:07.191145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:38.949956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203239+0000","last_change":"2024-09-16T01:21:28.052814+0000","last_active":"2024-09-16T01:23:07.203239+0000","last_peered":"2024-09-16T01:23:07.203239+0000","last_clean":"2024-09-16T01:23:07.203239+0000","last_became_active":"2024-09-16T01:21:28.052440+0000","last_became_peered":"2024-09-16T01:21:28.052440+0000","last_unstale":"2024-09-16T01:23:07.203239+0000","last_undegraded":"2024-09-16T01:23:07.203239+0000","last_fullsized":"2024-09-16T01:23:07.203239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:47.470646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.178893+0000","last_change":"2024-09-16T01:21:28.053917+0000","last_active":"2024-09-16T01:23:07.178893+0000","last_peered":"2024-09-16T01:23:07.178893+0000","last_clean":"2024-09-16T01:23:07.178893+0000","last_became_active":"2024-09-16T01:21:28.052625+0000","last_became_peered":"2024-09-16T01:21:28.052625+0000","last_unstale":"2024-09-16T01:23:07.178893+0000","last_undegraded":"2024-09-16T01:23:07.178893+0000","last_fullsized":"2024-09-16T01:23:07.178893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:32.441025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.190810+0000","last_change":"2024-09-16T01:21:28.046588+0000","last_active":"2024-09-16T01:23:07.190810+0000","last_peered":"2024-09-16T01:23:07.190810+0000","last_clean":"2024-09-16T01:23:07.190810+0000","last_became_active":"2024-09-16T01:21:28.046268+0000","last_became_peered":"2024-09-16T01:21:28.046268+0000","last_unstale":"2024-09-16T01:23:07.190810+0000","last_undegraded":"2024-09-16T01:23:07.190810+0000","last_fullsized":"2024-09-16T01:23:07.190810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:49.659707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195312+0000","last_change":"2024-09-16T01:21:28.051946+0000","last_active":"2024-09-16T01:23:07.195312+0000","last_peered":"2024-09-16T01:23:07.195312+0000","last_clean":"2024-09-16T01:23:07.195312+0000","last_became_active":"2024-09-16T01:21:28.051615+0000","last_became_peered":"2024-09-16T01:21:28.051615+0000","last_unstale":"2024-09-16T01:23:07.195312+0000","last_undegraded":"2024-09-16T01:23:07.195312+0000","last_fullsized":"2024-09-16T01:23:07.195312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:06.462830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.197023+0000","last_change":"2024-09-16T01:21:28.047382+0000","last_active":"2024-09-16T01:23:07.197023+0000","last_peered":"2024-09-16T01:23:07.197023+0000","last_clean":"2024-09-16T01:23:07.197023+0000","last_became_active":"2024-09-16T01:21:28.045361+0000","last_became_peered":"2024-09-16T01:21:28.045361+0000","last_unstale":"2024-09-16T01:23:07.197023+0000","last_undegraded":"2024-09-16T01:23:07.197023+0000","last_fullsized":"2024-09-16T01:23:07.197023+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:26.099519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.204145+0000","last_change":"2024-09-16T01:21:28.054028+0000","last_active":"2024-09-16T01:23:07.204145+0000","last_peered":"2024-09-16T01:23:07.204145+0000","last_clean":"2024-09-16T01:23:07.204145+0000","last_became_active":"2024-09-16T01:21:28.052698+0000","last_became_peered":"2024-09-16T01:21:28.052698+0000","last_unstale":"2024-09-16T01:23:07.204145+0000","last_undegraded":"2024-09-16T01:23:07.204145+0000","last_fullsized":"2024-09-16T01:23:07.204145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:01.745424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196758+0000","last_change":"2024-09-16T01:21:28.049032+0000","last_active":"2024-09-16T01:23:07.196758+0000","last_peered":"2024-09-16T01:23:07.196758+0000","last_clean":"2024-09-16T01:23:07.196758+0000","last_became_active":"2024-09-16T01:21:28.048357+0000","last_became_peered":"2024-09-16T01:21:28.048357+0000","last_unstale":"2024-09-16T01:23:07.196758+0000","last_undegraded":"2024-09-16T01:23:07.196758+0000","last_fullsized":"2024-09-16T01:23:07.196758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:17.963329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.188365+0000","last_change":"2024-09-16T01:21:28.051126+0000","last_active":"2024-09-16T01:23:07.188365+0000","last_peered":"2024-09-16T01:23:07.188365+0000","last_clean":"2024-09-16T01:23:07.188365+0000","last_became_active":"2024-09-16T01:21:28.050789+0000","last_became_peered":"2024-09-16T01:21:28.050789+0000","last_unstale":"2024-09-16T01:23:07.188365+0000","last_undegraded":"2024-09-16T01:23:07.188365+0000","last_fullsized":"2024-09-16T01:23:07.188365+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:35.212518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199665+0000","last_change":"2024-09-16T01:21:28.045569+0000","last_active":"2024-09-16T01:23:07.199665+0000","last_peered":"2024-09-16T01:23:07.199665+0000","last_clean":"2024-09-16T01:23:07.199665+0000","last_became_active":"2024-09-16T01:21:28.044496+0000","last_became_peered":"2024-09-16T01:21:28.044496+0000","last_unstale":"2024-09-16T01:23:07.199665+0000","last_undegraded":"2024-09-16T01:23:07.199665+0000","last_fullsized":"2024-09-16T01:23:07.199665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:10.665322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191808+0000","last_change":"2024-09-16T01:21:28.047522+0000","last_active":"2024-09-16T01:23:07.191808+0000","last_peered":"2024-09-16T01:23:07.191808+0000","last_clean":"2024-09-16T01:23:07.191808+0000","last_became_active":"2024-09-16T01:21:28.047192+0000","last_became_peered":"2024-09-16T01:21:28.047192+0000","last_unstale":"2024-09-16T01:23:07.191808+0000","last_undegraded":"2024-09-16T01:23:07.191808+0000","last_fullsized":"2024-09-16T01:23:07.191808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:51.044980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.197674+0000","last_change":"2024-09-16T01:21:28.043184+0000","last_active":"2024-09-16T01:23:07.197674+0000","last_peered":"2024-09-16T01:23:07.197674+0000","last_clean":"2024-09-16T01:23:07.197674+0000","last_became_active":"2024-09-16T01:21:28.042787+0000","last_became_peered":"2024-09-16T01:21:28.042787+0000","last_unstale":"2024-09-16T01:23:07.197674+0000","last_undegraded":"2024-09-16T01:23:07.197674+0000","last_fullsized":"2024-09-16T01:23:07.197674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:00.633731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.204616+0000","last_change":"2024-09-16T01:21:28.050141+0000","last_active":"2024-09-16T01:23:07.204616+0000","last_peered":"2024-09-16T01:23:07.204616+0000","last_clean":"2024-09-16T01:23:07.204616+0000","last_became_active":"2024-09-16T01:21:28.049843+0000","last_became_peered":"2024-09-16T01:21:28.049843+0000","last_unstale":"2024-09-16T01:23:07.204616+0000","last_undegraded":"2024-09-16T01:23:07.204616+0000","last_fullsized":"2024-09-16T01:23:07.204616+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:39.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199563+0000","last_change":"2024-09-16T01:21:28.044260+0000","last_active":"2024-09-16T01:23:07.199563+0000","last_peered":"2024-09-16T01:23:07.199563+0000","last_clean":"2024-09-16T01:23:07.199563+0000","last_became_active":"2024-09-16T01:21:28.043959+0000","last_became_peered":"2024-09-16T01:21:28.043959+0000","last_unstale":"2024-09-16T01:23:07.199563+0000","last_undegraded":"2024-09-16T01:23:07.199563+0000","last_fullsized":"2024-09-16T01:23:07.199563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198368+0000","last_change":"2024-09-16T01:21:28.044143+0000","last_active":"2024-09-16T01:23:07.198368+0000","last_peered":"2024-09-16T01:23:07.198368+0000","last_clean":"2024-09-16T01:23:07.198368+0000","last_became_active":"2024-09-16T01:21:28.043767+0000","last_became_peered":"2024-09-16T01:21:28.043767+0000","last_unstale":"2024-09-16T01:23:07.198368+0000","last_undegraded":"2024-09-16T01:23:07.198368+0000","last_fullsized":"2024-09-16T01:23:07.198368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:25.269737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199234+0000","last_change":"2024-09-16T01:21:28.047663+0000","last_active":"2024-09-16T01:23:07.199234+0000","last_peered":"2024-09-16T01:23:07.199234+0000","last_clean":"2024-09-16T01:23:07.199234+0000","last_became_active":"2024-09-16T01:21:28.047044+0000","last_became_peered":"2024-09-16T01:21:28.047044+0000","last_unstale":"2024-09-16T01:23:07.199234+0000","last_undegraded":"2024-09-16T01:23:07.199234+0000","last_fullsized":"2024-09-16T01:23:07.199234+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:44.539096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198916+0000","last_change":"2024-09-16T01:21:28.052740+0000","last_active":"2024-09-16T01:23:07.198916+0000","last_peered":"2024-09-16T01:23:07.198916+0000","last_clean":"2024-09-16T01:23:07.198916+0000","last_became_active":"2024-09-16T01:21:28.052396+0000","last_became_peered":"2024-09-16T01:21:28.052396+0000","last_unstale":"2024-09-16T01:23:07.198916+0000","last_undegraded":"2024-09-16T01:23:07.198916+0000","last_fullsized":"2024-09-16T01:23:07.198916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:49.021594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195294+0000","last_change":"2024-09-16T01:21:28.050867+0000","last_active":"2024-09-16T01:23:07.195294+0000","last_peered":"2024-09-16T01:23:07.195294+0000","last_clean":"2024-09-16T01:23:07.195294+0000","last_became_active":"2024-09-16T01:21:28.050412+0000","last_became_peered":"2024-09-16T01:21:28.050412+0000","last_unstale":"2024-09-16T01:23:07.195294+0000","last_undegraded":"2024-09-16T01:23:07.195294+0000","last_fullsized":"2024-09-16T01:23:07.195294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:02.286864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195783+0000","last_change":"2024-09-16T01:21:28.037593+0000","last_active":"2024-09-16T01:23:07.195783+0000","last_peered":"2024-09-16T01:23:07.195783+0000","last_clean":"2024-09-16T01:23:07.195783+0000","last_became_active":"2024-09-16T01:21:28.037268+0000","last_became_peered":"2024-09-16T01:21:28.037268+0000","last_unstale":"2024-09-16T01:23:07.195783+0000","last_undegraded":"2024-09-16T01:23:07.195783+0000","last_fullsized":"2024-09-16T01:23:07.195783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:09.625480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.194407+0000","last_change":"2024-09-16T01:21:28.044744+0000","last_active":"2024-09-16T01:23:07.194407+0000","last_peered":"2024-09-16T01:23:07.194407+0000","last_clean":"2024-09-16T01:23:07.194407+0000","last_became_active":"2024-09-16T01:21:28.044440+0000","last_became_peered":"2024-09-16T01:21:28.044440+0000","last_unstale":"2024-09-16T01:23:07.194407+0000","last_undegraded":"2024-09-16T01:23:07.194407+0000","last_fullsized":"2024-09-16T01:23:07.194407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:20.404778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.200147+0000","last_change":"2024-09-16T01:21:28.044498+0000","last_active":"2024-09-16T01:23:07.200147+0000","last_peered":"2024-09-16T01:23:07.200147+0000","last_clean":"2024-09-16T01:23:07.200147+0000","last_became_active":"2024-09-16T01:21:28.044028+0000","last_became_peered":"2024-09-16T01:21:28.044028+0000","last_unstale":"2024-09-16T01:23:07.200147+0000","last_undegraded":"2024-09-16T01:23:07.200147+0000","last_fullsized":"2024-09-16T01:23:07.200147+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:50:46.134484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198919+0000","last_change":"2024-09-16T01:21:28.047796+0000","last_active":"2024-09-16T01:23:07.198919+0000","last_peered":"2024-09-16T01:23:07.198919+0000","last_clean":"2024-09-16T01:23:07.198919+0000","last_became_active":"2024-09-16T01:21:28.046289+0000","last_became_peered":"2024-09-16T01:21:28.046289+0000","last_unstale":"2024-09-16T01:23:07.198919+0000","last_undegraded":"2024-09-16T01:23:07.198919+0000","last_fullsized":"2024-09-16T01:23:07.198919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:49:53.709261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.197343+0000","last_change":"2024-09-16T01:21:28.050767+0000","last_active":"2024-09-16T01:23:07.197343+0000","last_peered":"2024-09-16T01:23:07.197343+0000","last_clean":"2024-09-16T01:23:07.197343+0000","last_became_active":"2024-09-16T01:21:28.050430+0000","last_became_peered":"2024-09-16T01:21:28.050430+0000","last_unstale":"2024-09-16T01:23:07.197343+0000","last_undegraded":"2024-09-16T01:23:07.197343+0000","last_fullsized":"2024-09-16T01:23:07.197343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:37.436612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.177055+0000","last_change":"2024-09-16T01:21:28.045374+0000","last_active":"2024-09-16T01:23:07.177055+0000","last_peered":"2024-09-16T01:23:07.177055+0000","last_clean":"2024-09-16T01:23:07.177055+0000","last_became_active":"2024-09-16T01:21:28.045072+0000","last_became_peered":"2024-09-16T01:21:28.045072+0000","last_unstale":"2024-09-16T01:23:07.177055+0000","last_undegraded":"2024-09-16T01:23:07.177055+0000","last_fullsized":"2024-09-16T01:23:07.177055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:10.579680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:13.229660+0000","last_change":"2024-09-16T01:21:25.922017+0000","last_active":"2024-09-16T01:23:13.229660+0000","last_peered":"2024-09-16T01:23:13.229660+0000","last_clean":"2024-09-16T01:23:13.229660+0000","last_became_active":"2024-09-16T01:21:25.921580+0000","last_became_peered":"2024-09-16T01:21:25.921580+0000","last_unstale":"2024-09-16T01:23:13.229660+0000","last_undegraded":"2024-09-16T01:23:13.229660+0000","last_fullsized":"2024-09-16T01:23:13.229660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.745844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198279+0000","last_change":"2024-09-16T01:21:39.094811+0000","last_active":"2024-09-16T01:23:07.198279+0000","last_peered":"2024-09-16T01:23:07.198279+0000","last_clean":"2024-09-16T01:23:07.198279+0000","last_became_active":"2024-09-16T01:21:39.094399+0000","last_became_peered":"2024-09-16T01:21:39.094399+0000","last_unstale":"2024-09-16T01:23:07.198279+0000","last_undegraded":"2024-09-16T01:23:07.198279+0000","last_fullsized":"2024-09-16T01:23:07.198279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:48.363791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'3","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.110226+0000","last_change":"2024-09-16T01:21:39.110226+0000","last_active":"2024-09-16T01:21:39.110226+0000","last_peered":"2024-09-16T01:21:39.110226+0000","last_clean":"2024-09-16T01:21:39.110226+0000","last_became_active":"2024-09-16T01:21:39.107676+0000","last_became_peered":"2024-09-16T01:21:39.107676+0000","last_unstale":"2024-09-16T01:21:39.110226+0000","last_undegraded":"2024-09-16T01:21:39.110226+0000","last_fullsized":"2024-09-16T01:21:39.110226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:57:14.854181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.086856+0000","last_change":"2024-09-16T01:21:25.924434+0000","last_active":"2024-09-16T01:21:39.086856+0000","last_peered":"2024-09-16T01:21:39.086856+0000","last_clean":"2024-09-16T01:21:39.086856+0000","last_became_active":"2024-09-16T01:21:25.924092+0000","last_became_peered":"2024-09-16T01:21:25.924092+0000","last_unstale":"2024-09-16T01:21:39.086856+0000","last_undegraded":"2024-09-16T01:21:39.086856+0000","last_fullsized":"2024-09-16T01:21:39.086856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:20.956985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196900+0000","last_change":"2024-09-16T01:21:28.037273+0000","last_active":"2024-09-16T01:23:07.196900+0000","last_peered":"2024-09-16T01:23:07.196900+0000","last_clean":"2024-09-16T01:23:07.196900+0000","last_became_active":"2024-09-16T01:21:28.036958+0000","last_became_peered":"2024-09-16T01:21:28.036958+0000","last_unstale":"2024-09-16T01:23:07.196900+0000","last_undegraded":"2024-09-16T01:23:07.196900+0000","last_fullsized":"2024-09-16T01:23:07.196900+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:53.376640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088161+0000","last_change":"2024-09-16T01:21:25.923208+0000","last_active":"2024-09-16T01:21:39.088161+0000","last_peered":"2024-09-16T01:21:39.088161+0000","last_clean":"2024-09-16T01:21:39.088161+0000","last_became_active":"2024-09-16T01:21:25.922882+0000","last_became_peered":"2024-09-16T01:21:25.922882+0000","last_unstale":"2024-09-16T01:21:39.088161+0000","last_undegraded":"2024-09-16T01:21:39.088161+0000","last_fullsized":"2024-09-16T01:21:39.088161+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:44.359615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.189681+0000","last_change":"2024-09-16T01:21:28.035901+0000","last_active":"2024-09-16T01:23:07.189681+0000","last_peered":"2024-09-16T01:23:07.189681+0000","last_clean":"2024-09-16T01:23:07.189681+0000","last_became_active":"2024-09-16T01:21:28.035568+0000","last_became_peered":"2024-09-16T01:21:28.035568+0000","last_unstale":"2024-09-16T01:23:07.189681+0000","last_undegraded":"2024-09-16T01:23:07.189681+0000","last_fullsized":"2024-09-16T01:23:07.189681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:42.270380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":124,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:14.230417+0000","last_change":"2024-09-16T01:21:25.923692+0000","last_active":"2024-09-16T01:23:14.230417+0000","last_peered":"2024-09-16T01:23:14.230417+0000","last_clean":"2024-09-16T01:23:14.230417+0000","last_became_active":"2024-09-16T01:21:25.923325+0000","last_became_peered":"2024-09-16T01:21:25.923325+0000","last_unstale":"2024-09-16T01:23:14.230417+0000","last_undegraded":"2024-09-16T01:23:14.230417+0000","last_fullsized":"2024-09-16T01:23:14.230417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:55.075655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.192428+0000","last_change":"2024-09-16T01:21:28.054697+0000","last_active":"2024-09-16T01:23:07.192428+0000","last_peered":"2024-09-16T01:23:07.192428+0000","last_clean":"2024-09-16T01:23:07.192428+0000","last_became_active":"2024-09-16T01:21:28.054416+0000","last_became_peered":"2024-09-16T01:21:28.054416+0000","last_unstale":"2024-09-16T01:23:07.192428+0000","last_undegraded":"2024-09-16T01:23:07.192428+0000","last_fullsized":"2024-09-16T01:23:07.192428+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:42.905778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089652+0000","last_change":"2024-09-16T01:21:25.920939+0000","last_active":"2024-09-16T01:21:39.089652+0000","last_peered":"2024-09-16T01:21:39.089652+0000","last_clean":"2024-09-16T01:21:39.089652+0000","last_became_active":"2024-09-16T01:21:25.920574+0000","last_became_peered":"2024-09-16T01:21:25.920574+0000","last_unstale":"2024-09-16T01:21:39.089652+0000","last_undegraded":"2024-09-16T01:21:39.089652+0000","last_fullsized":"2024-09-16T01:21:39.089652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:15.640800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.186777+0000","last_change":"2024-09-16T01:21:28.048981+0000","last_active":"2024-09-16T01:23:07.186777+0000","last_peered":"2024-09-16T01:23:07.186777+0000","last_clean":"2024-09-16T01:23:07.186777+0000","last_became_active":"2024-09-16T01:21:28.048675+0000","last_became_peered":"2024-09-16T01:21:28.048675+0000","last_unstale":"2024-09-16T01:23:07.186777+0000","last_undegraded":"2024-09-16T01:23:07.186777+0000","last_fullsized":"2024-09-16T01:23:07.186777+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:30.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088725+0000","last_change":"2024-09-16T01:21:26.660117+0000","last_active":"2024-09-16T01:21:39.088725+0000","last_peered":"2024-09-16T01:21:39.088725+0000","last_clean":"2024-09-16T01:21:39.088725+0000","last_became_active":"2024-09-16T01:21:26.659743+0000","last_became_peered":"2024-09-16T01:21:26.659743+0000","last_unstale":"2024-09-16T01:21:39.088725+0000","last_undegraded":"2024-09-16T01:21:39.088725+0000","last_fullsized":"2024-09-16T01:21:39.088725+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:10.220612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191486+0000","last_change":"2024-09-16T01:21:28.051057+0000","last_active":"2024-09-16T01:23:07.191486+0000","last_peered":"2024-09-16T01:23:07.191486+0000","last_clean":"2024-09-16T01:23:07.191486+0000","last_became_active":"2024-09-16T01:21:28.050756+0000","last_became_peered":"2024-09-16T01:21:28.050756+0000","last_unstale":"2024-09-16T01:23:07.191486+0000","last_undegraded":"2024-09-16T01:23:07.191486+0000","last_fullsized":"2024-09-16T01:23:07.191486+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:16.917041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'32","reported_seq":261,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:15.232149+0000","last_change":"2024-09-16T01:21:25.927384+0000","last_active":"2024-09-16T01:23:15.232149+0000","last_peered":"2024-09-16T01:23:15.232149+0000","last_clean":"2024-09-16T01:23:15.232149+0000","last_became_active":"2024-09-16T01:21:25.927017+0000","last_became_peered":"2024-09-16T01:21:25.927017+0000","last_unstale":"2024-09-16T01:23:15.232149+0000","last_undegraded":"2024-09-16T01:23:15.232149+0000","last_fullsized":"2024-09-16T01:23:15.232149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:03.267625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60508,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":162,"num_write":33,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.193364+0000","last_change":"2024-09-16T01:21:28.049410+0000","last_active":"2024-09-16T01:23:07.193364+0000","last_peered":"2024-09-16T01:23:07.193364+0000","last_clean":"2024-09-16T01:23:07.193364+0000","last_became_active":"2024-09-16T01:21:28.049058+0000","last_became_peered":"2024-09-16T01:21:28.049058+0000","last_unstale":"2024-09-16T01:23:07.193364+0000","last_undegraded":"2024-09-16T01:23:07.193364+0000","last_fullsized":"2024-09-16T01:23:07.193364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091098+0000","last_change":"2024-09-16T01:21:25.922040+0000","last_active":"2024-09-16T01:21:39.091098+0000","last_peered":"2024-09-16T01:21:39.091098+0000","last_clean":"2024-09-16T01:21:39.091098+0000","last_became_active":"2024-09-16T01:21:25.921487+0000","last_became_peered":"2024-09-16T01:21:25.921487+0000","last_unstale":"2024-09-16T01:21:39.091098+0000","last_undegraded":"2024-09-16T01:21:39.091098+0000","last_fullsized":"2024-09-16T01:21:39.091098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:57:15.361010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.200738+0000","last_change":"2024-09-16T01:21:28.043344+0000","last_active":"2024-09-16T01:23:07.200738+0000","last_peered":"2024-09-16T01:23:07.200738+0000","last_clean":"2024-09-16T01:23:07.200738+0000","last_became_active":"2024-09-16T01:21:28.042495+0000","last_became_peered":"2024-09-16T01:21:28.042495+0000","last_unstale":"2024-09-16T01:23:07.200738+0000","last_undegraded":"2024-09-16T01:23:07.200738+0000","last_fullsized":"2024-09-16T01:23:07.200738+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:28.957975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.087280+0000","last_change":"2024-09-16T01:21:25.924144+0000","last_active":"2024-09-16T01:21:39.087280+0000","last_peered":"2024-09-16T01:21:39.087280+0000","last_clean":"2024-09-16T01:21:39.087280+0000","last_became_active":"2024-09-16T01:21:25.923761+0000","last_became_peered":"2024-09-16T01:21:25.923761+0000","last_unstale":"2024-09-16T01:21:39.087280+0000","last_undegraded":"2024-09-16T01:21:39.087280+0000","last_fullsized":"2024-09-16T01:21:39.087280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.651575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.202313+0000","last_change":"2024-09-16T01:21:28.049329+0000","last_active":"2024-09-16T01:23:07.202313+0000","last_peered":"2024-09-16T01:23:07.202313+0000","last_clean":"2024-09-16T01:23:07.202313+0000","last_became_active":"2024-09-16T01:21:28.048976+0000","last_became_peered":"2024-09-16T01:21:28.048976+0000","last_unstale":"2024-09-16T01:23:07.202313+0000","last_undegraded":"2024-09-16T01:23:07.202313+0000","last_fullsized":"2024-09-16T01:23:07.202313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:11.564388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":131,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:15.232212+0000","last_change":"2024-09-16T01:21:25.923608+0000","last_active":"2024-09-16T01:23:15.232212+0000","last_peered":"2024-09-16T01:23:15.232212+0000","last_clean":"2024-09-16T01:23:15.232212+0000","last_became_active":"2024-09-16T01:21:25.923284+0000","last_became_peered":"2024-09-16T01:21:25.923284+0000","last_unstale":"2024-09-16T01:23:15.232212+0000","last_undegraded":"2024-09-16T01:23:15.232212+0000","last_fullsized":"2024-09-16T01:23:15.232212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:41.195014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.204287+0000","last_change":"2024-09-16T01:21:39.091872+0000","last_active":"2024-09-16T01:23:07.204287+0000","last_peered":"2024-09-16T01:23:07.204287+0000","last_clean":"2024-09-16T01:23:07.204287+0000","last_became_active":"2024-09-16T01:21:39.091480+0000","last_became_peered":"2024-09-16T01:21:39.091480+0000","last_unstale":"2024-09-16T01:23:07.204287+0000","last_undegraded":"2024-09-16T01:23:07.204287+0000","last_fullsized":"2024-09-16T01:23:07.204287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:23.606447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.092805+0000","last_change":"2024-09-16T01:21:26.661446+0000","last_active":"2024-09-16T01:21:39.092805+0000","last_peered":"2024-09-16T01:21:39.092805+0000","last_clean":"2024-09-16T01:21:39.092805+0000","last_became_active":"2024-09-16T01:21:26.661047+0000","last_became_peered":"2024-09-16T01:21:26.661047+0000","last_unstale":"2024-09-16T01:21:39.092805+0000","last_undegraded":"2024-09-16T01:21:39.092805+0000","last_fullsized":"2024-09-16T01:21:39.092805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:22.983581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.191326+0000","last_change":"2024-09-16T01:21:28.054663+0000","last_active":"2024-09-16T01:23:07.191326+0000","last_peered":"2024-09-16T01:23:07.191326+0000","last_clean":"2024-09-16T01:23:07.191326+0000","last_became_active":"2024-09-16T01:21:28.054350+0000","last_became_peered":"2024-09-16T01:21:28.054350+0000","last_unstale":"2024-09-16T01:23:07.191326+0000","last_undegraded":"2024-09-16T01:23:07.191326+0000","last_fullsized":"2024-09-16T01:23:07.191326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:22.963709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.094004+0000","last_change":"2024-09-16T01:21:25.921910+0000","last_active":"2024-09-16T01:21:39.094004+0000","last_peered":"2024-09-16T01:21:39.094004+0000","last_clean":"2024-09-16T01:21:39.094004+0000","last_became_active":"2024-09-16T01:21:25.921578+0000","last_became_peered":"2024-09-16T01:21:25.921578+0000","last_unstale":"2024-09-16T01:21:39.094004+0000","last_undegraded":"2024-09-16T01:21:39.094004+0000","last_fullsized":"2024-09-16T01:21:39.094004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:20.210397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195441+0000","last_change":"2024-09-16T01:21:28.049953+0000","last_active":"2024-09-16T01:23:07.195441+0000","last_peered":"2024-09-16T01:23:07.195441+0000","last_clean":"2024-09-16T01:23:07.195441+0000","last_became_active":"2024-09-16T01:21:28.049450+0000","last_became_peered":"2024-09-16T01:21:28.049450+0000","last_unstale":"2024-09-16T01:23:07.195441+0000","last_undegraded":"2024-09-16T01:23:07.195441+0000","last_fullsized":"2024-09-16T01:23:07.195441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:49.137295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.098150+0000","last_change":"2024-09-16T01:21:39.098150+0000","last_active":"2024-09-16T01:21:39.098150+0000","last_peered":"2024-09-16T01:21:39.098150+0000","last_clean":"2024-09-16T01:21:39.098150+0000","last_became_active":"2024-09-16T01:21:39.094297+0000","last_became_peered":"2024-09-16T01:21:39.094297+0000","last_unstale":"2024-09-16T01:21:39.098150+0000","last_undegraded":"2024-09-16T01:21:39.098150+0000","last_fullsized":"2024-09-16T01:21:39.098150+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:30:25.297230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.201932+0000","last_change":"2024-09-16T01:21:28.053920+0000","last_active":"2024-09-16T01:23:07.201932+0000","last_peered":"2024-09-16T01:23:07.201932+0000","last_clean":"2024-09-16T01:23:07.201932+0000","last_became_active":"2024-09-16T01:21:28.053397+0000","last_became_peered":"2024-09-16T01:21:28.053397+0000","last_unstale":"2024-09-16T01:23:07.201932+0000","last_undegraded":"2024-09-16T01:23:07.201932+0000","last_fullsized":"2024-09-16T01:23:07.201932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:27.079374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.088854+0000","last_change":"2024-09-16T01:21:25.920527+0000","last_active":"2024-09-16T01:21:39.088854+0000","last_peered":"2024-09-16T01:21:39.088854+0000","last_clean":"2024-09-16T01:21:39.088854+0000","last_became_active":"2024-09-16T01:21:25.920162+0000","last_became_peered":"2024-09-16T01:21:25.920162+0000","last_unstale":"2024-09-16T01:21:39.088854+0000","last_undegraded":"2024-09-16T01:21:39.088854+0000","last_fullsized":"2024-09-16T01:21:39.088854+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:31.995141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.200844+0000","last_change":"2024-09-16T01:21:28.050068+0000","last_active":"2024-09-16T01:23:07.200844+0000","last_peered":"2024-09-16T01:23:07.200844+0000","last_clean":"2024-09-16T01:23:07.200844+0000","last_became_active":"2024-09-16T01:21:28.049678+0000","last_became_peered":"2024-09-16T01:21:28.049678+0000","last_unstale":"2024-09-16T01:23:07.200844+0000","last_undegraded":"2024-09-16T01:23:07.200844+0000","last_fullsized":"2024-09-16T01:23:07.200844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:57.870550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.091065+0000","last_change":"2024-09-16T01:21:26.663670+0000","last_active":"2024-09-16T01:21:39.091065+0000","last_peered":"2024-09-16T01:21:39.091065+0000","last_clean":"2024-09-16T01:21:39.091065+0000","last_became_active":"2024-09-16T01:21:26.663173+0000","last_became_peered":"2024-09-16T01:21:26.663173+0000","last_unstale":"2024-09-16T01:21:39.091065+0000","last_undegraded":"2024-09-16T01:21:39.091065+0000","last_fullsized":"2024-09-16T01:21:39.091065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:01.747039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203210+0000","last_change":"2024-09-16T01:21:28.053354+0000","last_active":"2024-09-16T01:23:07.203210+0000","last_peered":"2024-09-16T01:23:07.203210+0000","last_clean":"2024-09-16T01:23:07.203210+0000","last_became_active":"2024-09-16T01:21:28.052985+0000","last_became_peered":"2024-09-16T01:21:28.052985+0000","last_unstale":"2024-09-16T01:23:07.203210+0000","last_undegraded":"2024-09-16T01:23:07.203210+0000","last_fullsized":"2024-09-16T01:23:07.203210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:09.360220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":338,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089417+0000","last_change":"2024-09-16T01:20:14.084036+0000","last_active":"2024-09-16T01:21:39.089417+0000","last_peered":"2024-09-16T01:21:39.089417+0000","last_clean":"2024-09-16T01:21:39.089417+0000","last_became_active":"2024-09-16T01:20:14.083552+0000","last_became_peered":"2024-09-16T01:20:14.083552+0000","last_unstale":"2024-09-16T01:21:39.089417+0000","last_undegraded":"2024-09-16T01:21:39.089417+0000","last_fullsized":"2024-09-16T01:21:39.089417+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:51.922126+0000","last_clean_scrub_stamp":"2024-09-16T01:16:51.922126+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:37.598878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106614+0000","last_change":"2024-09-16T01:21:25.923170+0000","last_active":"2024-09-16T01:21:39.106614+0000","last_peered":"2024-09-16T01:21:39.106614+0000","last_clean":"2024-09-16T01:21:39.106614+0000","last_became_active":"2024-09-16T01:21:25.922555+0000","last_became_peered":"2024-09-16T01:21:25.922555+0000","last_unstale":"2024-09-16T01:21:39.106614+0000","last_undegraded":"2024-09-16T01:21:39.106614+0000","last_fullsized":"2024-09-16T01:21:39.106614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:14.948264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.188186+0000","last_change":"2024-09-16T01:21:39.093752+0000","last_active":"2024-09-16T01:23:07.188186+0000","last_peered":"2024-09-16T01:23:07.188186+0000","last_clean":"2024-09-16T01:23:07.188186+0000","last_became_active":"2024-09-16T01:21:39.093394+0000","last_became_peered":"2024-09-16T01:21:39.093394+0000","last_unstale":"2024-09-16T01:23:07.188186+0000","last_undegraded":"2024-09-16T01:23:07.188186+0000","last_fullsized":"2024-09-16T01:23:07.188186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:32.703408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089350+0000","last_change":"2024-09-16T01:21:25.925009+0000","last_active":"2024-09-16T01:21:39.089350+0000","last_peered":"2024-09-16T01:21:39.089350+0000","last_clean":"2024-09-16T01:21:39.089350+0000","last_became_active":"2024-09-16T01:21:25.924661+0000","last_became_peered":"2024-09-16T01:21:25.924661+0000","last_unstale":"2024-09-16T01:21:39.089350+0000","last_undegraded":"2024-09-16T01:21:39.089350+0000","last_fullsized":"2024-09-16T01:21:39.089350+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.703241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199546+0000","last_change":"2024-09-16T01:21:28.045745+0000","last_active":"2024-09-16T01:23:07.199546+0000","last_peered":"2024-09-16T01:23:07.199546+0000","last_clean":"2024-09-16T01:23:07.199546+0000","last_became_active":"2024-09-16T01:21:28.045398+0000","last_became_peered":"2024-09-16T01:21:28.045398+0000","last_unstale":"2024-09-16T01:23:07.199546+0000","last_undegraded":"2024-09-16T01:23:07.199546+0000","last_fullsized":"2024-09-16T01:23:07.199546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:17.422858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":125,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:14.230366+0000","last_change":"2024-09-16T01:21:26.660859+0000","last_active":"2024-09-16T01:23:14.230366+0000","last_peered":"2024-09-16T01:23:14.230366+0000","last_clean":"2024-09-16T01:23:14.230366+0000","last_became_active":"2024-09-16T01:21:26.660515+0000","last_became_peered":"2024-09-16T01:21:26.660515+0000","last_unstale":"2024-09-16T01:23:14.230366+0000","last_undegraded":"2024-09-16T01:23:14.230366+0000","last_fullsized":"2024-09-16T01:23:14.230366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:57.301546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.194448+0000","last_change":"2024-09-16T01:21:39.092617+0000","last_active":"2024-09-16T01:23:07.194448+0000","last_peered":"2024-09-16T01:23:07.194448+0000","last_clean":"2024-09-16T01:23:07.194448+0000","last_became_active":"2024-09-16T01:21:39.092212+0000","last_became_peered":"2024-09-16T01:21:39.092212+0000","last_unstale":"2024-09-16T01:23:07.194448+0000","last_undegraded":"2024-09-16T01:23:07.194448+0000","last_fullsized":"2024-09-16T01:23:07.194448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.894975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089151+0000","last_change":"2024-09-16T01:21:25.924485+0000","last_active":"2024-09-16T01:21:39.089151+0000","last_peered":"2024-09-16T01:21:39.089151+0000","last_clean":"2024-09-16T01:21:39.089151+0000","last_became_active":"2024-09-16T01:21:25.924075+0000","last_became_peered":"2024-09-16T01:21:25.924075+0000","last_unstale":"2024-09-16T01:21:39.089151+0000","last_undegraded":"2024-09-16T01:21:39.089151+0000","last_fullsized":"2024-09-16T01:21:39.089151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:13.034668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.183381+0000","last_change":"2024-09-16T01:21:28.048152+0000","last_active":"2024-09-16T01:23:07.183381+0000","last_peered":"2024-09-16T01:23:07.183381+0000","last_clean":"2024-09-16T01:23:07.183381+0000","last_became_active":"2024-09-16T01:21:28.047818+0000","last_became_peered":"2024-09-16T01:21:28.047818+0000","last_unstale":"2024-09-16T01:23:07.183381+0000","last_undegraded":"2024-09-16T01:23:07.183381+0000","last_fullsized":"2024-09-16T01:23:07.183381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:19.002576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089286+0000","last_change":"2024-09-16T01:21:26.660336+0000","last_active":"2024-09-16T01:21:39.089286+0000","last_peered":"2024-09-16T01:21:39.089286+0000","last_clean":"2024-09-16T01:21:39.089286+0000","last_became_active":"2024-09-16T01:21:26.660005+0000","last_became_peered":"2024-09-16T01:21:26.660005+0000","last_unstale":"2024-09-16T01:21:39.089286+0000","last_undegraded":"2024-09-16T01:21:39.089286+0000","last_fullsized":"2024-09-16T01:21:39.089286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:37.116093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.180180+0000","last_change":"2024-09-16T01:21:28.043112+0000","last_active":"2024-09-16T01:23:07.180180+0000","last_peered":"2024-09-16T01:23:07.180180+0000","last_clean":"2024-09-16T01:23:07.180180+0000","last_became_active":"2024-09-16T01:21:28.042752+0000","last_became_peered":"2024-09-16T01:21:28.042752+0000","last_unstale":"2024-09-16T01:23:07.180180+0000","last_undegraded":"2024-09-16T01:23:07.180180+0000","last_fullsized":"2024-09-16T01:23:07.180180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:57.379826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093748+0000","last_change":"2024-09-16T01:21:26.661003+0000","last_active":"2024-09-16T01:21:39.093748+0000","last_peered":"2024-09-16T01:21:39.093748+0000","last_clean":"2024-09-16T01:21:39.093748+0000","last_became_active":"2024-09-16T01:21:26.660407+0000","last_became_peered":"2024-09-16T01:21:26.660407+0000","last_unstale":"2024-09-16T01:21:39.093748+0000","last_undegraded":"2024-09-16T01:21:39.093748+0000","last_fullsized":"2024-09-16T01:21:39.093748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:52.229473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199076+0000","last_change":"2024-09-16T01:21:28.046938+0000","last_active":"2024-09-16T01:23:07.199076+0000","last_peered":"2024-09-16T01:23:07.199076+0000","last_clean":"2024-09-16T01:23:07.199076+0000","last_became_active":"2024-09-16T01:21:28.046620+0000","last_became_peered":"2024-09-16T01:21:28.046620+0000","last_unstale":"2024-09-16T01:23:07.199076+0000","last_undegraded":"2024-09-16T01:23:07.199076+0000","last_fullsized":"2024-09-16T01:23:07.199076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:04.845341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'12","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:08.048322+0000","last_change":"2024-09-16T01:21:25.915315+0000","last_active":"2024-09-16T01:23:08.048322+0000","last_peered":"2024-09-16T01:23:08.048322+0000","last_clean":"2024-09-16T01:23:08.048322+0000","last_became_active":"2024-09-16T01:21:25.915001+0000","last_became_peered":"2024-09-16T01:21:25.915001+0000","last_unstale":"2024-09-16T01:23:08.048322+0000","last_undegraded":"2024-09-16T01:23:08.048322+0000","last_fullsized":"2024-09-16T01:23:08.048322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:30.163050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198048+0000","last_change":"2024-09-16T01:21:28.047157+0000","last_active":"2024-09-16T01:23:07.198048+0000","last_peered":"2024-09-16T01:23:07.198048+0000","last_clean":"2024-09-16T01:23:07.198048+0000","last_became_active":"2024-09-16T01:21:28.046583+0000","last_became_peered":"2024-09-16T01:21:28.046583+0000","last_unstale":"2024-09-16T01:23:07.198048+0000","last_undegraded":"2024-09-16T01:23:07.198048+0000","last_fullsized":"2024-09-16T01:23:07.198048+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:47.767814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.106885+0000","last_change":"2024-09-16T01:21:26.663047+0000","last_active":"2024-09-16T01:21:39.106885+0000","last_peered":"2024-09-16T01:21:39.106885+0000","last_clean":"2024-09-16T01:21:39.106885+0000","last_became_active":"2024-09-16T01:21:26.662627+0000","last_became_peered":"2024-09-16T01:21:26.662627+0000","last_unstale":"2024-09-16T01:21:39.106885+0000","last_undegraded":"2024-09-16T01:21:39.106885+0000","last_fullsized":"2024-09-16T01:21:39.106885+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:59.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.196911+0000","last_change":"2024-09-16T01:21:28.046954+0000","last_active":"2024-09-16T01:23:07.196911+0000","last_peered":"2024-09-16T01:23:07.196911+0000","last_clean":"2024-09-16T01:23:07.196911+0000","last_became_active":"2024-09-16T01:21:28.046550+0000","last_became_peered":"2024-09-16T01:21:28.046550+0000","last_unstale":"2024-09-16T01:23:07.196911+0000","last_undegraded":"2024-09-16T01:23:07.196911+0000","last_fullsized":"2024-09-16T01:23:07.196911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:30.880672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.100910+0000","last_change":"2024-09-16T01:21:39.100910+0000","last_active":"2024-09-16T01:21:39.100910+0000","last_peered":"2024-09-16T01:21:39.100910+0000","last_clean":"2024-09-16T01:21:39.100910+0000","last_became_active":"2024-09-16T01:21:39.095257+0000","last_became_peered":"2024-09-16T01:21:39.095257+0000","last_unstale":"2024-09-16T01:21:39.100910+0000","last_undegraded":"2024-09-16T01:21:39.100910+0000","last_fullsized":"2024-09-16T01:21:39.100910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:17.957295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.160646+0000","last_change":"2024-09-16T01:21:28.052061+0000","last_active":"2024-09-16T01:23:07.160646+0000","last_peered":"2024-09-16T01:23:07.160646+0000","last_clean":"2024-09-16T01:23:07.160646+0000","last_became_active":"2024-09-16T01:21:28.051705+0000","last_became_peered":"2024-09-16T01:21:28.051705+0000","last_unstale":"2024-09-16T01:23:07.160646+0000","last_undegraded":"2024-09-16T01:23:07.160646+0000","last_fullsized":"2024-09-16T01:23:07.160646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:05.546846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090258+0000","last_change":"2024-09-16T01:21:25.921635+0000","last_active":"2024-09-16T01:21:39.090258+0000","last_peered":"2024-09-16T01:21:39.090258+0000","last_clean":"2024-09-16T01:21:39.090258+0000","last_became_active":"2024-09-16T01:21:25.921281+0000","last_became_peered":"2024-09-16T01:21:25.921281+0000","last_unstale":"2024-09-16T01:21:39.090258+0000","last_undegraded":"2024-09-16T01:21:39.090258+0000","last_fullsized":"2024-09-16T01:21:39.090258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:02.933803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.198236+0000","last_change":"2024-09-16T01:21:28.043636+0000","last_active":"2024-09-16T01:23:07.198236+0000","last_peered":"2024-09-16T01:23:07.198236+0000","last_clean":"2024-09-16T01:23:07.198236+0000","last_became_active":"2024-09-16T01:21:28.043273+0000","last_became_peered":"2024-09-16T01:21:28.043273+0000","last_unstale":"2024-09-16T01:23:07.198236+0000","last_undegraded":"2024-09-16T01:23:07.198236+0000","last_fullsized":"2024-09-16T01:23:07.198236+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:05.432537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090771+0000","last_change":"2024-09-16T01:21:25.917934+0000","last_active":"2024-09-16T01:21:39.090771+0000","last_peered":"2024-09-16T01:21:39.090771+0000","last_clean":"2024-09-16T01:21:39.090771+0000","last_became_active":"2024-09-16T01:21:25.917545+0000","last_became_peered":"2024-09-16T01:21:25.917545+0000","last_unstale":"2024-09-16T01:21:39.090771+0000","last_undegraded":"2024-09-16T01:21:39.090771+0000","last_fullsized":"2024-09-16T01:21:39.090771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:07.119546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.193744+0000","last_change":"2024-09-16T01:21:28.043270+0000","last_active":"2024-09-16T01:23:07.193744+0000","last_peered":"2024-09-16T01:23:07.193744+0000","last_clean":"2024-09-16T01:23:07.193744+0000","last_became_active":"2024-09-16T01:21:28.042957+0000","last_became_peered":"2024-09-16T01:21:28.042957+0000","last_unstale":"2024-09-16T01:23:07.193744+0000","last_undegraded":"2024-09-16T01:23:07.193744+0000","last_fullsized":"2024-09-16T01:23:07.193744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:11.052387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093263+0000","last_change":"2024-09-16T01:21:25.923224+0000","last_active":"2024-09-16T01:21:39.093263+0000","last_peered":"2024-09-16T01:21:39.093263+0000","last_clean":"2024-09-16T01:21:39.093263+0000","last_became_active":"2024-09-16T01:21:25.922873+0000","last_became_peered":"2024-09-16T01:21:25.922873+0000","last_unstale":"2024-09-16T01:21:39.093263+0000","last_undegraded":"2024-09-16T01:21:39.093263+0000","last_fullsized":"2024-09-16T01:21:39.093263+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:14.747752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.203114+0000","last_change":"2024-09-16T01:21:28.054706+0000","last_active":"2024-09-16T01:23:07.203114+0000","last_peered":"2024-09-16T01:23:07.203114+0000","last_clean":"2024-09-16T01:23:07.203114+0000","last_became_active":"2024-09-16T01:21:28.054382+0000","last_became_peered":"2024-09-16T01:21:28.054382+0000","last_unstale":"2024-09-16T01:23:07.203114+0000","last_undegraded":"2024-09-16T01:23:07.203114+0000","last_fullsized":"2024-09-16T01:23:07.203114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:20:16.908252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.192962+0000","last_change":"2024-09-16T01:21:28.051807+0000","last_active":"2024-09-16T01:23:07.192962+0000","last_peered":"2024-09-16T01:23:07.192962+0000","last_clean":"2024-09-16T01:23:07.192962+0000","last_became_active":"2024-09-16T01:21:28.051474+0000","last_became_peered":"2024-09-16T01:21:28.051474+0000","last_unstale":"2024-09-16T01:23:07.192962+0000","last_undegraded":"2024-09-16T01:23:07.192962+0000","last_fullsized":"2024-09-16T01:23:07.192962+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:48.006691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.101161+0000","last_change":"2024-09-16T01:21:39.100723+0000","last_active":"2024-09-16T01:21:39.101161+0000","last_peered":"2024-09-16T01:21:39.101161+0000","last_clean":"2024-09-16T01:21:39.101161+0000","last_became_active":"2024-09-16T01:21:39.094895+0000","last_became_peered":"2024-09-16T01:21:39.094895+0000","last_unstale":"2024-09-16T01:21:39.101161+0000","last_undegraded":"2024-09-16T01:21:39.101161+0000","last_fullsized":"2024-09-16T01:21:39.101161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.663815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.194567+0000","last_change":"2024-09-16T01:21:28.055506+0000","last_active":"2024-09-16T01:23:07.194567+0000","last_peered":"2024-09-16T01:23:07.194567+0000","last_clean":"2024-09-16T01:23:07.194567+0000","last_became_active":"2024-09-16T01:21:28.055167+0000","last_became_peered":"2024-09-16T01:21:28.055167+0000","last_unstale":"2024-09-16T01:23:07.194567+0000","last_undegraded":"2024-09-16T01:23:07.194567+0000","last_fullsized":"2024-09-16T01:23:07.194567+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:38.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.093642+0000","last_change":"2024-09-16T01:21:25.920611+0000","last_active":"2024-09-16T01:21:39.093642+0000","last_peered":"2024-09-16T01:21:39.093642+0000","last_clean":"2024-09-16T01:21:39.093642+0000","last_became_active":"2024-09-16T01:21:25.920255+0000","last_became_peered":"2024-09-16T01:21:25.920255+0000","last_unstale":"2024-09-16T01:21:39.093642+0000","last_undegraded":"2024-09-16T01:21:39.093642+0000","last_fullsized":"2024-09-16T01:21:39.093642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:17.268621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.195544+0000","last_change":"2024-09-16T01:21:28.054009+0000","last_active":"2024-09-16T01:23:07.195544+0000","last_peered":"2024-09-16T01:23:07.195544+0000","last_clean":"2024-09-16T01:23:07.195544+0000","last_became_active":"2024-09-16T01:21:28.053631+0000","last_became_peered":"2024-09-16T01:21:28.053631+0000","last_unstale":"2024-09-16T01:23:07.195544+0000","last_undegraded":"2024-09-16T01:23:07.195544+0000","last_fullsized":"2024-09-16T01:23:07.195544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:28.298398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.090095+0000","last_change":"2024-09-16T01:21:26.659753+0000","last_active":"2024-09-16T01:21:39.090095+0000","last_peered":"2024-09-16T01:21:39.090095+0000","last_clean":"2024-09-16T01:21:39.090095+0000","last_became_active":"2024-09-16T01:21:26.659343+0000","last_became_peered":"2024-09-16T01:21:26.659343+0000","last_unstale":"2024-09-16T01:21:39.090095+0000","last_undegraded":"2024-09-16T01:21:39.090095+0000","last_fullsized":"2024-09-16T01:21:39.090095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:47.722330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:23:07.199114+0000","last_change":"2024-09-16T01:21:28.050748+0000","last_active":"2024-09-16T01:23:07.199114+0000","last_peered":"2024-09-16T01:23:07.199114+0000","last_clean":"2024-09-16T01:23:07.199114+0000","last_became_active":"2024-09-16T01:21:28.050457+0000","last_became_peered":"2024-09-16T01:21:28.050457+0000","last_unstale":"2024-09-16T01:23:07.199114+0000","last_undegraded":"2024-09-16T01:23:07.199114+0000","last_fullsized":"2024-09-16T01:23:07.199114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:27.011473+0000","last_clean_scrub_stamp":"2024-09-16T01:21:27.011473+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:21.552080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:21:39.089346+0000","last_change":"2024-09-16T01:21:25.924505+0000","last_active":"2024-09-16T01:21:39.089346+0000","last_peered":"2024-09-16T01:21:39.089346+0000","last_clean":"2024-09-16T01:21:39.089346+0000","last_became_active":"2024-09-16T01:21:25.924076+0000","last_became_peered":"2024-09-16T01:21:25.924076+0000","last_unstale":"2024-09-16T01:21:39.089346+0000","last_undegraded":"2024-09-16T01:21:39.089346+0000","last_fullsized":"2024-09-16T01:21:39.089346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:24.899003+0000","last_clean_scrub_stamp":"2024-09-16T01:21:24.899003+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:00.630772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65681,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":621,"num_read_kb":381,"num_write":175,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282677,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514532,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":441274,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743464,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1094292,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906990,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441510,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":57,"seq":244813135923,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441430,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364854,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":1034037,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":45,"seq":193273528381,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":440899,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1033187,"data_compressed":41770,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":442365,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":441210,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":503579,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":501200,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":442170,"data_compressed":5811,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34294,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35959,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:23:20.517 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:23:20.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:20 smithi192 ceph-mon[34775]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-16T01:23:20.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:20 smithi192 ceph-mon[34775]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:23:20.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:20 smithi162 ceph-mon[34539]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-16T01:23:20.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:20 smithi162 ceph-mon[34539]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:23:20.810 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 -- 172.21.15.63:0/3516515548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5100101de0 msgr2=0x7f51001021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 --2- 172.21.15.63:0/3516515548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5100101de0 0x7f51001021c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009900 tx=0x7f50fc02a410 comp rx=0 tx=0).stop 2024-09-16T01:23:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 -- 172.21.15.63:0/3516515548 shutdown_connections 2024-09-16T01:23:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 --2- 172.21.15.63:0/3516515548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5100106f10 0x7f510010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 --2- 172.21.15.63:0/3516515548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5100102790 0x7f51001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 --2- 172.21.15.63:0/3516515548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5100101de0 0x7f51001021c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 -- 172.21.15.63:0/3516515548 >> 172.21.15.63:0/3516515548 conn(0x7f51000fd8c0 msgr2=0x7f51000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 -- 172.21.15.63:0/3516515548 shutdown_connections 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 -- 172.21.15.63:0/3516515548 wait complete. 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 Processor -- start 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.284+0000 7f510732d640 1 -- start start 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f510732d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5100101de0 0x7f51001983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f510732d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5100102790 0x7f5100198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f510732d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5100106f10 0x7f510019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f510732d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5100111de0 con 0x7f5100106f10 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f510732d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5100111c60 con 0x7f5100101de0 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f510732d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5100111f60 con 0x7f5100102790 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51058ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5100106f10 0x7f510019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51058ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5100106f10 0x7f510019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44940/0 (socket says 172.21.15.63:44940) 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51058ca640 1 -- 172.21.15.63:0/1789695242 learned_addr learned my addr 172.21.15.63:0/1789695242 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51050c9640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5100101de0 0x7f51001983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51048c8640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5100102790 0x7f5100198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51058ca640 1 -- 172.21.15.63:0/1789695242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5100102790 msgr2=0x7f5100198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51058ca640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5100102790 0x7f5100198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51058ca640 1 -- 172.21.15.63:0/1789695242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5100101de0 msgr2=0x7f51001983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51058ca640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5100101de0 0x7f51001983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51058ca640 1 -- 172.21.15.63:0/1789695242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510019d370 con 0x7f5100106f10 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51050c9640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5100101de0 0x7f51001983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51048c8640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5100102790 0x7f5100198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.285+0000 7f51058ca640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5100106f10 0x7f510019cc90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009fd0 tx=0x7f50f800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.286+0000 7f50f67fc640 1 -- 172.21.15.63:0/1789695242 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8017070 con 0x7f5100106f10 2024-09-16T01:23:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.286+0000 7f50f67fc640 1 -- 172.21.15.63:0/1789695242 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f50f8003e20 con 0x7f5100106f10 2024-09-16T01:23:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.286+0000 7f510732d640 1 -- 172.21.15.63:0/1789695242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510019d660 con 0x7f5100106f10 2024-09-16T01:23:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.286+0000 7f50f67fc640 1 -- 172.21.15.63:0/1789695242 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8010460 con 0x7f5100106f10 2024-09-16T01:23:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.286+0000 7f510732d640 1 -- 172.21.15.63:0/1789695242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51001a4f40 con 0x7f5100106f10 2024-09-16T01:23:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.287+0000 7f510732d640 1 -- 172.21.15.63:0/1789695242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51001021c0 con 0x7f5100106f10 2024-09-16T01:23:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.288+0000 7f50f67fc640 1 -- 172.21.15.63:0/1789695242 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f50f8003970 con 0x7f5100106f10 2024-09-16T01:23:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.289+0000 7f50f67fc640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f50ec0a3240 0x7f50ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.289+0000 7f50f67fc640 1 -- 172.21.15.63:0/1789695242 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f50f80cf7c0 con 0x7f5100106f10 2024-09-16T01:23:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.289+0000 7f51050c9640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f50ec0a3240 0x7f50ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.289+0000 7f51050c9640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f50ec0a3240 0x7f50ec0a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f50fc031440 tx=0x7f50fc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.293+0000 7f50f67fc640 1 -- 172.21.15.63:0/1789695242 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50f809c4e0 con 0x7f5100106f10 2024-09-16T01:23:21.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.503+0000 7f510732d640 1 -- 172.21.15.63:0/1789695242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5100109b60 con 0x7f5100106f10 2024-09-16T01:23:21.505 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:21 smithi063 ceph-mon[31070]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:23:21.505 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:21 smithi063 ceph-mon[31070]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:23:21.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.504+0000 7f50f67fc640 1 -- 172.21.15.63:0/1789695242 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11909 (secure 0 0 0) 0x7f50f809bde0 con 0x7f5100106f10 2024-09-16T01:23:21.505 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:23:21.506 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"btime":"2024-09-16T01:23:16:355817+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:23:15.890925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24467,24460,24445]},"id":1}]} 2024-09-16T01:23:21.506 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 25 2024-09-16T01:23:21.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 -- 172.21.15.63:0/1789695242 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f50ec0a3240 msgr2=0x7f50ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:21.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f50ec0a3240 0x7f50ec0a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f50fc031440 tx=0x7f50fc005a20 comp rx=0 tx=0).stop 2024-09-16T01:23:21.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 -- 172.21.15.63:0/1789695242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5100106f10 msgr2=0x7f510019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:21.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5100106f10 0x7f510019cc90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009fd0 tx=0x7f50f800b260 comp rx=0 tx=0).stop 2024-09-16T01:23:21.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 -- 172.21.15.63:0/1789695242 shutdown_connections 2024-09-16T01:23:21.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f50ec0a3240 0x7f50ec0a5700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5100106f10 0x7f510019cc90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5100102790 0x7f5100198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 --2- 172.21.15.63:0/1789695242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5100101de0 0x7f51001983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 -- 172.21.15.63:0/1789695242 >> 172.21.15.63:0/1789695242 conn(0x7f51000fd8c0 msgr2=0x7f51000fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:21.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 -- 172.21.15.63:0/1789695242 shutdown_connections 2024-09-16T01:23:21.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:21.506+0000 7f510732d640 1 -- 172.21.15.63:0/1789695242 wait complete. 2024-09-16T01:23:21.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:21 smithi192 ceph-mon[34775]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:23:21.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:21 smithi192 ceph-mon[34775]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:23:21.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:21 smithi162 ceph-mon[34539]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:23:21.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:21 smithi162 ceph-mon[34539]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T01:23:22.314 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:23:22.575 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:22.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:22 smithi063 ceph-mon[31070]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-16T01:23:22.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:22 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1789695242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:22.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:22 smithi192 ceph-mon[34775]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-16T01:23:22.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:22 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1789695242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:22.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:22 smithi162 ceph-mon[34539]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-16T01:23:22.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:22 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1789695242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:23:23.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 -- 172.21.15.63:0/2497425893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e00100a80 msgr2=0x7f3e00100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 --2- 172.21.15.63:0/2497425893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e00100a80 0x7f3e00100ee0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009930 tx=0x7f3df402a420 comp rx=0 tx=0).stop 2024-09-16T01:23:23.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 -- 172.21.15.63:0/2497425893 shutdown_connections 2024-09-16T01:23:23.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 --2- 172.21.15.63:0/2497425893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e00101420 0x7f3e0010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 --2- 172.21.15.63:0/2497425893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e00100a80 0x7f3e00100ee0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 --2- 172.21.15.63:0/2497425893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e00106a80 0x7f3e00106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 -- 172.21.15.63:0/2497425893 >> 172.21.15.63:0/2497425893 conn(0x7f3e000fc7a0 msgr2=0x7f3e000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:23.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 -- 172.21.15.63:0/2497425893 shutdown_connections 2024-09-16T01:23:23.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 -- 172.21.15.63:0/2497425893 wait complete. 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 Processor -- start 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.083+0000 7f3e06605640 1 -- start start 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3e06605640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e00100a80 0x7f3e00197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3e06605640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e00101420 0x7f3e00197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3e06605640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e00106a80 0x7f3e0019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3e06605640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3e00110d30 con 0x7f3e00101420 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3e06605640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e00110bb0 con 0x7f3e00100a80 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3e06605640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e00110eb0 con 0x7f3e00106a80 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3dff7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e00101420 0x7f3e00197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3dff7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e00101420 0x7f3e00197790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44956/0 (socket says 172.21.15.63:44956) 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3dff7fe640 1 -- 172.21.15.63:0/562689854 learned_addr learned my addr 172.21.15.63:0/562689854 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:23.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3e04ba2640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e00106a80 0x7f3e0019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3dfffff640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e00100a80 0x7f3e00197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3dff7fe640 1 -- 172.21.15.63:0/562689854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e00106a80 msgr2=0x7f3e0019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3dff7fe640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e00106a80 0x7f3e0019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3dff7fe640 1 -- 172.21.15.63:0/562689854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e00100a80 msgr2=0x7f3e00197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3dff7fe640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e00100a80 0x7f3e00197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3dff7fe640 1 -- 172.21.15.63:0/562689854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0019c200 con 0x7f3e00101420 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.084+0000 7f3dfffff640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e00100a80 0x7f3e00197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.085+0000 7f3dff7fe640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e00101420 0x7f3e00197790 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3df4004770 tx=0x7f3df40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.085+0000 7f3dfd7fa640 1 -- 172.21.15.63:0/562689854 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df403f070 con 0x7f3e00101420 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.085+0000 7f3dfd7fa640 1 -- 172.21.15.63:0/562689854 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3df403b460 con 0x7f3e00101420 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.085+0000 7f3e06605640 1 -- 172.21.15.63:0/562689854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0019c430 con 0x7f3e00101420 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.085+0000 7f3dfd7fa640 1 -- 172.21.15.63:0/562689854 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4035070 con 0x7f3e00101420 2024-09-16T01:23:23.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.085+0000 7f3e06605640 1 -- 172.21.15.63:0/562689854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0019c8e0 con 0x7f3e00101420 2024-09-16T01:23:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.086+0000 7f3e06605640 1 -- 172.21.15.63:0/562689854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e00100ee0 con 0x7f3e00101420 2024-09-16T01:23:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.087+0000 7f3dfd7fa640 1 -- 172.21.15.63:0/562689854 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3df403b610 con 0x7f3e00101420 2024-09-16T01:23:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.088+0000 7f3dfd7fa640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3de80a3240 0x7f3de80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.088+0000 7f3dfffff640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3de80a3240 0x7f3de80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.088+0000 7f3dfd7fa640 1 -- 172.21.15.63:0/562689854 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3df40effb0 con 0x7f3e00101420 2024-09-16T01:23:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.089+0000 7f3dfffff640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3de80a3240 0x7f3de80a5700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3df0005d90 tx=0x7f3df0005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.092+0000 7f3dfd7fa640 1 -- 172.21.15.63:0/562689854 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3df40bccd0 con 0x7f3e00101420 2024-09-16T01:23:23.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.270+0000 7f3e06605640 1 -- 172.21.15.63:0/562689854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e00108cd0 con 0x7f3e00101420 2024-09-16T01:23:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.271+0000 7f3dfd7fa640 1 -- 172.21.15.63:0/562689854 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22710 (secure 0 0 0) 0x7f3df40bc5d0 con 0x7f3e00101420 2024-09-16T01:23:23.273 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:23:23.273 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:39.083854+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.273+0000 7f3e06605640 1 -- 172.21.15.63:0/562689854 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3de80a3240 msgr2=0x7f3de80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3de80a3240 0x7f3de80a5700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3df0005d90 tx=0x7f3df0005d20 comp rx=0 tx=0).stop 2024-09-16T01:23:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 -- 172.21.15.63:0/562689854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e00101420 msgr2=0x7f3e00197790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e00101420 0x7f3e00197790 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3df4004770 tx=0x7f3df40042f0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 -- 172.21.15.63:0/562689854 shutdown_connections 2024-09-16T01:23:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f3de80a3240 0x7f3de80a5700 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e00106a80 0x7f3e0019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e00101420 0x7f3e00197790 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 --2- 172.21.15.63:0/562689854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e00100a80 0x7f3e00197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 -- 172.21.15.63:0/562689854 >> 172.21.15.63:0/562689854 conn(0x7f3e000fc7a0 msgr2=0x7f3e000fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 -- 172.21.15.63:0/562689854 shutdown_connections 2024-09-16T01:23:23.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:23.274+0000 7f3e06605640 1 -- 172.21.15.63:0/562689854 wait complete. 2024-09-16T01:23:23.589 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:23 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/562689854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:23:23.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:23 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/562689854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:23:23.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:23 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/562689854' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:23:24.250 DEBUG:tasks.fwd_scrub:Yielding 2024-09-16T01:23:24.250 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T01:23:24.264 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T01:23:24.265 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T01:23:24.265 INFO:tasks.workunit:timeout=6h 2024-09-16T01:23:24.265 INFO:tasks.workunit:cleanup=True 2024-09-16T01:23:24.265 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:24.266 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-16T01:23:24.266 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-16T01:23:24.266 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-16T01:23:24.286 INFO:teuthology.orchestra.run.smithi063.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:24.286 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-16T01:23:24.286 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-16T01:23:24.287 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:23:24.287 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-16T01:23:24.287 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-16 01:21:43.442575877 +0000 2024-09-16T01:23:24.287 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-16 01:21:43.442575877 +0000 2024-09-16T01:23:24.287 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-16 01:23:15.519528146 +0000 2024-09-16T01:23:24.287 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2024-09-16T01:23:24.287 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:24.287 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-16T01:23:24.360 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-16T01:23:24.418 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T01:23:24.538 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:24.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:24 smithi063 ceph-mon[31070]: pgmap v337: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-16T01:23:24.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:24 smithi192 ceph-mon[34775]: pgmap v337: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-16T01:23:24.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:24 smithi162 ceph-mon[34539]: pgmap v337: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-16T01:23:25.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.056+0000 7f8daacba640 1 -- 172.21.15.63:0/4270983211 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8da4108290 msgr2=0x7f8da410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:25.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.056+0000 7f8daacba640 1 --2- 172.21.15.63:0/4270983211 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8da4108290 0x7f8da410ec30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009cd0 tx=0x7f8d9c02a8e0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.056+0000 7f8daacba640 1 -- 172.21.15.63:0/4270983211 shutdown_connections 2024-09-16T01:23:25.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.056+0000 7f8daacba640 1 --2- 172.21.15.63:0/4270983211 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8da4108290 0x7f8da410ec30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.056+0000 7f8daacba640 1 --2- 172.21.15.63:0/4270983211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8da4103740 0x7f8da4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.056+0000 7f8daacba640 1 --2- 172.21.15.63:0/4270983211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8da4102d90 0x7f8da4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.056+0000 7f8daacba640 1 -- 172.21.15.63:0/4270983211 >> 172.21.15.63:0/4270983211 conn(0x7f8da40fc7d0 msgr2=0x7f8da40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.056+0000 7f8daacba640 1 -- 172.21.15.63:0/4270983211 shutdown_connections 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.056+0000 7f8daacba640 1 -- 172.21.15.63:0/4270983211 wait complete. 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8daacba640 1 Processor -- start 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8daacba640 1 -- start start 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8daacba640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8da4102d90 0x7f8da419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8daacba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8da4103740 0x7f8da419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8daacba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8da4108290 0x7f8da419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8daacba640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8da4111f40 con 0x7f8da4102d90 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8daacba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8da4111dc0 con 0x7f8da4103740 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8daacba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41120c0 con 0x7f8da4108290 2024-09-16T01:23:25.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8da8a56640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8da4102d90 0x7f8da419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8da8a56640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8da4102d90 0x7f8da419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44974/0 (socket says 172.21.15.63:44974) 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8da8a56640 1 -- 172.21.15.63:0/2635299332 learned_addr learned my addr 172.21.15.63:0/2635299332 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8da3fff640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8da4103740 0x7f8da419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.057+0000 7f8da9257640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8da4108290 0x7f8da419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8da8a56640 1 -- 172.21.15.63:0/2635299332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8da4108290 msgr2=0x7f8da419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8da8a56640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8da4108290 0x7f8da419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8da8a56640 1 -- 172.21.15.63:0/2635299332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8da4103740 msgr2=0x7f8da419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8da8a56640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8da4103740 0x7f8da419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8da8a56640 1 -- 172.21.15.63:0/2635299332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da419f570 con 0x7f8da4102d90 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8da8a56640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8da4102d90 0x7f8da419a5c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800c920 tx=0x7f8d9800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8da1ffb640 1 -- 172.21.15.63:0/2635299332 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98007c70 con 0x7f8da4102d90 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8da1ffb640 1 -- 172.21.15.63:0/2635299332 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d98007e10 con 0x7f8da4102d90 2024-09-16T01:23:25.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8daacba640 1 -- 172.21.15.63:0/2635299332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da419f860 con 0x7f8da4102d90 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8da1ffb640 1 -- 172.21.15.63:0/2635299332 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98018820 con 0x7f8da4102d90 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.058+0000 7f8daacba640 1 -- 172.21.15.63:0/2635299332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da41a7140 con 0x7f8da4102d90 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.061+0000 7f8da1ffb640 1 -- 172.21.15.63:0/2635299332 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8d980189c0 con 0x7f8da4102d90 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.061+0000 7f8dad093740 1 Processor -- start 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.061+0000 7f8dad093740 1 -- start start 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.061+0000 7f8dad093740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba3b60 0x558fcaba3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.061+0000 7f8dad093740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba4480 0x558fcabae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.061+0000 7f8dad093740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.061+0000 7f8dad093740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558fcab09280 con 0x558fcabaed40 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.061+0000 7f8dad093740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558fcaab0b10 con 0x558fcaba3b60 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.061+0000 7f8dad093740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558fcab05240 con 0x558fcaba4480 2024-09-16T01:23:25.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44988/0 (socket says 172.21.15.63:44988) 2024-09-16T01:23:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da3fff640 1 -- 172.21.15.63:0/1650497913 learned_addr learned my addr 172.21.15.63:0/1650497913 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da8a56640 1 --2- 172.21.15.63:0/1650497913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba4480 0x558fcabae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da9257640 1 --2- 172.21.15.63:0/1650497913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba3b60 0x558fcaba3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da1ffb640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d940a3240 0x7f8d940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da3fff640 1 -- 172.21.15.63:0/1650497913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba4480 msgr2=0x558fcabae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da3fff640 1 --2- 172.21.15.63:0/1650497913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba4480 0x558fcabae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da3fff640 1 -- 172.21.15.63:0/1650497913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba3b60 msgr2=0x558fcaba3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da3fff640 1 --2- 172.21.15.63:0/1650497913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba3b60 0x558fcaba3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da3fff640 1 -- 172.21.15.63:0/1650497913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fcaabd1f0 con 0x558fcabaed40 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da9257640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d940a3240 0x7f8d940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da3fff640 1 --2- 172.21.15.63:0/1650497913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb1130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000ab30 tx=0x7f8d9000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb89f2e90d68482 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8da1ffb640 1 -- 172.21.15.63:0/2635299332 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8d980cfa80 con 0x7f8da4102d90 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.062+0000 7f8d8effd640 1 -- 172.21.15.63:0/1650497913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9001d070 con 0x558fcabaed40 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8d8effd640 1 -- 172.21.15.63:0/1650497913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d900188f0 con 0x558fcabaed40 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8d8effd640 1 -- 172.21.15.63:0/1650497913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d90010aa0 con 0x558fcabaed40 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8dad093740 1 -- 172.21.15.63:0/1650497913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 msgr2=0x558fcabb1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8dad093740 1 --2- 172.21.15.63:0/1650497913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb1130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000ab30 tx=0x7f8d9000f3c0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8da9257640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d940a3240 0x7f8d940a5700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005cc0 tx=0x7f8d9c03e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8dad093740 1 -- 172.21.15.63:0/1650497913 shutdown_connections 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8dad093740 1 --2- 172.21.15.63:0/1650497913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb1130 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8dad093740 1 --2- 172.21.15.63:0/1650497913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba4480 0x558fcabae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8dad093740 1 --2- 172.21.15.63:0/1650497913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba3b60 0x558fcaba3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8dad093740 1 -- 172.21.15.63:0/1650497913 >> 172.21.15.63:0/1650497913 conn(0x558fcaba00f0 msgr2=0x558fcaba04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8dad093740 1 -- 172.21.15.63:0/1650497913 shutdown_connections 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.063+0000 7f8dad093740 1 -- 172.21.15.63:0/1650497913 wait complete. 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.064+0000 7f8dad093740 1 -- start start 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.064+0000 7f8dad093740 1 Processor -- start 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.064+0000 7f8dad093740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba3b60 0x558fcababbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.064+0000 7f8dad093740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.064+0000 7f8dad093740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabac650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.064+0000 7f8dad093740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558fcabb1910 con 0x558fcabaed40 2024-09-16T01:23:25.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.064+0000 7f8dad093740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558fcaac3f10 con 0x558fcaba4480 2024-09-16T01:23:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.064+0000 7f8dad093740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558fcabb1a90 con 0x558fcaba3b60 2024-09-16T01:23:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8dad093740 10 client.0 _ll_register_callbacks cb 0x558fcaa8ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da9257640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da9257640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabac650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45002/0 (socket says 172.21.15.63:45002) 2024-09-16T01:23:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da9257640 1 -- 172.21.15.63:0/3915687931 learned_addr learned my addr 172.21.15.63:0/3915687931 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da8a56640 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba3b60 0x558fcababbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da3fff640 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da9257640 1 -- 172.21.15.63:0/3915687931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba3b60 msgr2=0x558fcababbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da9257640 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba3b60 0x558fcababbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da9257640 1 -- 172.21.15.63:0/3915687931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 msgr2=0x558fcabac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da9257640 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da9257640 1 -- 172.21.15.63:0/3915687931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fca87a6a0 con 0x558fcabaed40 2024-09-16T01:23:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8da9257640 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabac650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c003bf0 tx=0x7f8d9c005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428e8186297a4d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8d83fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8d83fff640 1 -- 172.21.15.63:0/3915687931 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c0047c0 con 0x558fcabaed40 2024-09-16T01:23:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8d83fff640 1 -- 172.21.15.63:0/3915687931 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8d9c0305a0 con 0x558fcabaed40 2024-09-16T01:23:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.065+0000 7f8dad093740 1 -- 172.21.15.63:0/3915687931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d900188f0 con 0x558fcabaed40 2024-09-16T01:23:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8d83fff640 1 -- 172.21.15.63:0/3915687931 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d9c0307a0 con 0x558fcabaed40 2024-09-16T01:23:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8dad093740 10 client.15210 fetch_fsmap learned FSMap version 25 2024-09-16T01:23:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8dad093740 1 -- 172.21.15.63:0/3915687931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558fcabbd4c0 con 0x558fcabaed40 2024-09-16T01:23:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8d83fff640 1 -- 172.21.15.63:0/3915687931 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d900188f0 con 0x558fcabaed40 2024-09-16T01:23:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8d83fff640 1 -- 172.21.15.63:0/3915687931 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8d9c04e070 con 0x558fcabaed40 2024-09-16T01:23:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8dad093740 10 client.15210 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:23:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8dad093740 10 client.15210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:23:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8dad093740 20 client.15210 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:25.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8dad093740 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x558fcabbe8d0 0x558fcabc0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8dad093740 4 client.15210 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8dad093740 1 -- 172.21.15.63:0/3915687931 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fcab167f0 con 0x558fcabbe8d0 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.066+0000 7f8da8a56640 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x558fcabbe8d0 0x558fcabc0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.067+0000 7f8d83fff640 10 client.15210 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.067+0000 7f8da8a56640 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x558fcabbe8d0 0x558fcabc0d70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b437a77612ca9028 server_cookie=2f946e29b547c899 in_seq=0 out_seq=0 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8d83fff640 1 -- 172.21.15.63:0/3915687931 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558fcab167f0 con 0x558fcabbe8d0 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8d83fff640 10 client.15210 handle_command_reply: tid=0 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 client.15210 shutdown 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 -- 172.21.15.63:0/3915687931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 msgr2=0x558fcabac650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabac650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c003bf0 tx=0x7f8d9c005c30 comp rx=0 tx=0).stop 2024-09-16T01:23:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 -- 172.21.15.63:0/3915687931 shutdown_connections 2024-09-16T01:23:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x558fcabbe8d0 0x558fcabc0d70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabac650 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8d83fff640 0 client.15210 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 --2- 172.21.15.63:0/3915687931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba3b60 0x558fcababbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 -- 172.21.15.63:0/3915687931 >> 172.21.15.63:0/3915687931 conn(0x558fcaba00f0 msgr2=0x558fcaba5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 -- 172.21.15.63:0/3915687931 shutdown_connections 2024-09-16T01:23:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 1 -- 172.21.15.63:0/3915687931 wait complete. 2024-09-16T01:23:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.068+0000 7f8dad093740 20 client.15210 trim_cache size 0 max 16384 2024-09-16T01:23:25.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8dad093740 1 Processor -- start 2024-09-16T01:23:25.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8dad093740 1 -- start start 2024-09-16T01:23:25.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8dad093740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcaba3b60 0x558fcabaab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8dad093740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabc6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8dad093740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcabaed40 0x558fcabc6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8dad093740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41b1f50 con 0x558fcaba3b60 2024-09-16T01:23:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8dad093740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41af820 con 0x558fcaba4480 2024-09-16T01:23:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8dad093740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41ad650 con 0x558fcabaed40 2024-09-16T01:23:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da8a56640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcaba3b60 0x558fcabaab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da8a56640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcaba3b60 0x558fcabaab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45006/0 (socket says 172.21.15.63:45006) 2024-09-16T01:23:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da8a56640 1 -- 172.21.15.63:0/2239324860 learned_addr learned my addr 172.21.15.63:0/2239324860 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da9257640 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcabaed40 0x558fcabc6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da3fff640 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabc6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da8a56640 1 -- 172.21.15.63:0/2239324860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcabaed40 msgr2=0x558fcabc6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da8a56640 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcabaed40 0x558fcabc6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da8a56640 1 -- 172.21.15.63:0/2239324860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 msgr2=0x558fcabc6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da8a56640 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabc6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da8a56640 1 -- 172.21.15.63:0/2239324860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fcab9ff20 con 0x558fcaba3b60 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da9257640 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcabaed40 0x558fcabc6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.086+0000 7f8da3fff640 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabc6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.087+0000 7f8da8a56640 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcaba3b60 0x558fcabaab30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d9809bd60 tx=0x7f8d980cd410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a95533378beba7d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.087+0000 7f8d8e7fc640 1 -- 172.21.15.63:0/2239324860 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98018cb0 con 0x558fcaba3b60 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.087+0000 7f8d8e7fc640 1 -- 172.21.15.63:0/2239324860 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d9800fb00 con 0x558fcaba3b60 2024-09-16T01:23:25.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.087+0000 7f8d8e7fc640 1 -- 172.21.15.63:0/2239324860 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d980cd650 con 0x558fcaba3b60 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.087+0000 7f8dad093740 1 -- 172.21.15.63:0/2239324860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcaba3b60 msgr2=0x558fcabaab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.087+0000 7f8dad093740 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcaba3b60 0x558fcabaab30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d9809bd60 tx=0x7f8d980cd410 comp rx=0 tx=0).stop 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.088+0000 7f8dad093740 1 -- 172.21.15.63:0/2239324860 shutdown_connections 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.088+0000 7f8dad093740 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcabaed40 0x558fcabc6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.088+0000 7f8dad093740 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabc6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.088+0000 7f8dad093740 1 --2- 172.21.15.63:0/2239324860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcaba3b60 0x558fcabaab30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.088+0000 7f8dad093740 1 -- 172.21.15.63:0/2239324860 >> 172.21.15.63:0/2239324860 conn(0x558fcaba00f0 msgr2=0x558fcabadb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.088+0000 7f8dad093740 1 -- 172.21.15.63:0/2239324860 shutdown_connections 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.088+0000 7f8dad093740 1 -- 172.21.15.63:0/2239324860 wait complete. 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.088+0000 7f8dad093740 1 -- start start 2024-09-16T01:23:25.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.088+0000 7f8dad093740 1 Processor -- start 2024-09-16T01:23:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.088+0000 7f8dad093740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba3b60 0x558fcabb6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8dad093740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabb7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8dad093740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8dad093740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41adce0 con 0x558fcabaed40 2024-09-16T01:23:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8dad093740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41af150 con 0x558fcaba4480 2024-09-16T01:23:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8dad093740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41ae3b0 con 0x558fcaba3b60 2024-09-16T01:23:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8dad093740 10 client.0 _ll_register_callbacks cb 0x7f8d9c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da9257640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da9257640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45008/0 (socket says 172.21.15.63:45008) 2024-09-16T01:23:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da9257640 1 -- 172.21.15.63:0/4019770021 learned_addr learned my addr 172.21.15.63:0/4019770021 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da3fff640 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabb7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da8a56640 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba3b60 0x558fcabb6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da9257640 1 -- 172.21.15.63:0/4019770021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba3b60 msgr2=0x558fcabb6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da9257640 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba3b60 0x558fcabb6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da9257640 1 -- 172.21.15.63:0/4019770021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 msgr2=0x558fcabb7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da9257640 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabb7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da9257640 1 -- 172.21.15.63:0/4019770021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fcabb44c0 con 0x558fcabaed40 2024-09-16T01:23:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8da9257640 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb3cb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c02a920 tx=0x7f8d9c031bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c924172d9f9111 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.089+0000 7f8d83fff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8d83fff640 1 -- 172.21.15.63:0/4019770021 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c045c50 con 0x558fcabaed40 2024-09-16T01:23:25.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8d83fff640 1 -- 172.21.15.63:0/4019770021 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8d9c004410 con 0x558fcabaed40 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8dad093740 1 -- 172.21.15.63:0/4019770021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558fcab10d00 con 0x558fcabaed40 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8d83fff640 1 -- 172.21.15.63:0/4019770021 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d9c004610 con 0x558fcabaed40 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8dad093740 10 client.15216 fetch_fsmap learned FSMap version 25 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8dad093740 1 -- 172.21.15.63:0/4019770021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558fcac2a120 con 0x558fcabaed40 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8d83fff640 1 -- 172.21.15.63:0/4019770021 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x558fcab10d00 con 0x558fcabaed40 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8d83fff640 1 -- 172.21.15.63:0/4019770021 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8d9c04e070 con 0x558fcabaed40 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8dad093740 10 client.15216 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8dad093740 10 client.15216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8dad093740 20 client.15216 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8dad093740 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x558fcac2a810 0x558fcac2cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8dad093740 4 client.15216 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.090+0000 7f8dad093740 1 -- 172.21.15.63:0/4019770021 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558fcaa8d110 con 0x558fcac2a810 2024-09-16T01:23:25.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.091+0000 7f8da8a56640 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x558fcac2a810 0x558fcac2cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.091+0000 7f8d83fff640 10 client.15216 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.091+0000 7f8da8a56640 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x558fcac2a810 0x558fcac2cc30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da92b96fc3515b11 server_cookie=e32b0915301a1a39 in_seq=0 out_seq=0 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.092+0000 7f8d83fff640 1 -- 172.21.15.63:0/4019770021 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558fcaa8d110 con 0x558fcac2a810 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.092+0000 7f8d83fff640 10 client.15216 handle_command_reply: tid=0 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.092+0000 7f8dad093740 1 client.15216 shutdown 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 1 -- 172.21.15.63:0/4019770021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 msgr2=0x558fcabb3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb3cb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c02a920 tx=0x7f8d9c031bf0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 1 -- 172.21.15.63:0/4019770021 shutdown_connections 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x558fcac2a810 0x558fcac2cc30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8d83fff640 0 client.15216 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:25.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558fcabaed40 0x558fcabb3cb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558fcaba4480 0x558fcabb7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 1 --2- 172.21.15.63:0/4019770021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558fcaba3b60 0x558fcabb6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 1 -- 172.21.15.63:0/4019770021 >> 172.21.15.63:0/4019770021 conn(0x558fcaba00f0 msgr2=0x558fcababb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:25.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 1 -- 172.21.15.63:0/4019770021 shutdown_connections 2024-09-16T01:23:25.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 1 -- 172.21.15.63:0/4019770021 wait complete. 2024-09-16T01:23:25.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.093+0000 7f8dad093740 20 client.15216 trim_cache size 0 max 16384 2024-09-16T01:23:25.100 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:23:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-16T01:23:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "76f8bf2e-290d-4658-8248-a8aa2c7b13eb", 2024-09-16T01:23:25.100 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-16T01:23:25.101 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:23:25.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 -- 172.21.15.63:0/2635299332 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d940a3240 msgr2=0x7f8d940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:25.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d940a3240 0x7f8d940a5700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c005cc0 tx=0x7f8d9c03e040 comp rx=0 tx=0).stop 2024-09-16T01:23:25.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 -- 172.21.15.63:0/2635299332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8da4102d90 msgr2=0x7f8da419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:25.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8da4102d90 0x7f8da419a5c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800c920 tx=0x7f8d9800cde0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 -- 172.21.15.63:0/2635299332 shutdown_connections 2024-09-16T01:23:25.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d940a3240 0x7f8d940a5700 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8da4108290 0x7f8da419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8da4103740 0x7f8da419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 --2- 172.21.15.63:0/2635299332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8da4102d90 0x7f8da419a5c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:25.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 -- 172.21.15.63:0/2635299332 >> 172.21.15.63:0/2635299332 conn(0x7f8da40fc7d0 msgr2=0x7f8da4100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:25.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 -- 172.21.15.63:0/2635299332 shutdown_connections 2024-09-16T01:23:25.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:25.094+0000 7f8daacba640 1 -- 172.21.15.63:0/2635299332 wait complete. 2024-09-16T01:23:25.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:23:26.244 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:26.626 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:26 smithi063 ceph-mon[31070]: scrub queued for path: / 2024-09-16T01:23:26.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:26 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:23:26.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:26 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:23:26.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:26 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:23:26.627 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:26 smithi063 ceph-mon[31070]: pgmap v338: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-16T01:23:26.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:26 smithi192 ceph-mon[34775]: scrub queued for path: / 2024-09-16T01:23:26.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:26 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:23:26.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:26 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:23:26.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:26 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:23:26.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:26 smithi192 ceph-mon[34775]: pgmap v338: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-16T01:23:26.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:26 smithi162 ceph-mon[34539]: scrub queued for path: / 2024-09-16T01:23:26.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:26 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:23:26.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:26 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:23:26.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:26 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:23:26.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:26 smithi162 ceph-mon[34539]: pgmap v338: 97 pgs: 97 active+clean; 646 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-16T01:23:26.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.709+0000 7fc06da96640 1 -- 172.21.15.63:0/3840650690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc06810c170 msgr2=0x7fc06810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:26.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.709+0000 7fc06da96640 1 --2- 172.21.15.63:0/3840650690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc06810c170 0x7fc06810e610 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc060009ca0 tx=0x7fc06002a950 comp rx=0 tx=0).stop 2024-09-16T01:23:26.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.709+0000 7fc06da96640 1 -- 172.21.15.63:0/3840650690 shutdown_connections 2024-09-16T01:23:26.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.709+0000 7fc06da96640 1 --2- 172.21.15.63:0/3840650690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc06810c170 0x7fc06810e610 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.709+0000 7fc06da96640 1 --2- 172.21.15.63:0/3840650690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc068103660 0x7fc06810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.709+0000 7fc06da96640 1 --2- 172.21.15.63:0/3840650690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068102d40 0x7fc068103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.709+0000 7fc06da96640 1 -- 172.21.15.63:0/3840650690 >> 172.21.15.63:0/3840650690 conn(0x7fc0680fc7a0 msgr2=0x7fc0680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.710+0000 7fc06da96640 1 -- 172.21.15.63:0/3840650690 shutdown_connections 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.710+0000 7fc06da96640 1 -- 172.21.15.63:0/3840650690 wait complete. 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.710+0000 7fc06da96640 1 Processor -- start 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.710+0000 7fc06da96640 1 -- start start 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.710+0000 7fc06da96640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc068102d40 0x7fc0681982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.710+0000 7fc06da96640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068103660 0x7fc068198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.710+0000 7fc06da96640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc06810c170 0x7fc06819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc06da96640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc068111e20 con 0x7fc068102d40 2024-09-16T01:23:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc06da96640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc068111ca0 con 0x7fc068103660 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc06da96640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc068111fa0 con 0x7fc06810c170 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc0677fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc068102d40 0x7fc0681982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc0677fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc068102d40 0x7fc0681982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45030/0 (socket says 172.21.15.63:45030) 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc0677fe640 1 -- 172.21.15.63:0/72167031 learned_addr learned my addr 172.21.15.63:0/72167031 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc067fff640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc06810c170 0x7fc06819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc066ffd640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068103660 0x7fc068198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc0677fe640 1 -- 172.21.15.63:0/72167031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc06810c170 msgr2=0x7fc06819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc0677fe640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc06810c170 0x7fc06819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc0677fe640 1 -- 172.21.15.63:0/72167031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068103660 msgr2=0x7fc068198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc0677fe640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068103660 0x7fc068198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc0677fe640 1 -- 172.21.15.63:0/72167031 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06819d290 con 0x7fc068102d40 2024-09-16T01:23:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc0677fe640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc068102d40 0x7fc0681982e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c890 tx=0x7fc05800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc064ff9640 1 -- 172.21.15.63:0/72167031 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058004220 con 0x7fc068102d40 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc064ff9640 1 -- 172.21.15.63:0/72167031 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc0580043c0 con 0x7fc068102d40 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc06da96640 1 -- 172.21.15.63:0/72167031 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06819d580 con 0x7fc068102d40 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc064ff9640 1 -- 172.21.15.63:0/72167031 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058004a00 con 0x7fc068102d40 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.711+0000 7fc06da96640 1 -- 172.21.15.63:0/72167031 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0681a4e60 con 0x7fc068102d40 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.714+0000 7fc064ff9640 1 -- 172.21.15.63:0/72167031 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc058004ba0 con 0x7fc068102d40 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.714+0000 7fc06fe6f740 1 Processor -- start 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.714+0000 7fc06fe6f740 1 -- start start 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.714+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f627780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.714+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f636550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.714+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f636a90 0x55f73f638e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.714+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f73f58d2e0 con 0x55f73f627cc0 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.714+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f73f534ce0 con 0x55f73f636a90 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.714+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f73f5892a0 con 0x55f73f6273a0 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc0677fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f636550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc0677fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f636550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45038/0 (socket says 172.21.15.63:45038) 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc0677fe640 1 -- 172.21.15.63:0/3252733843 learned_addr learned my addr 172.21.15.63:0/3252733843 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc066ffd640 1 --2- 172.21.15.63:0/3252733843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f636a90 0x55f73f638e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc064ff9640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc0500a3240 0x7fc0500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc067fff640 1 --2- 172.21.15.63:0/3252733843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f627780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc067fff640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc0500a3240 0x7fc0500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc064ff9640 1 -- 172.21.15.63:0/72167031 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc0580cf5d0 con 0x7fc068102d40 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc0677fe640 1 -- 172.21.15.63:0/3252733843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 msgr2=0x55f73f627780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc0677fe640 1 --2- 172.21.15.63:0/3252733843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f627780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc0677fe640 1 -- 172.21.15.63:0/3252733843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f636a90 msgr2=0x55f73f638e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc0677fe640 1 --2- 172.21.15.63:0/3252733843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f636a90 0x55f73f638e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc0677fe640 1 -- 172.21.15.63:0/3252733843 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73f519440 con 0x55f73f627cc0 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc0677fe640 1 --2- 172.21.15.63:0/3252733843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f636550 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc0580d2fd0 tx=0x7fc058000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8880652c28e51a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc067fff640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc0500a3240 0x7fc0500a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc060030040 tx=0x7fc060005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc04dffb640 1 -- 172.21.15.63:0/3252733843 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05801d070 con 0x55f73f627cc0 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc04dffb640 1 -- 172.21.15.63:0/3252733843 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc05809c2f0 con 0x55f73f627cc0 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.715+0000 7fc04dffb640 1 -- 172.21.15.63:0/3252733843 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0580a4860 con 0x55f73f627cc0 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.716+0000 7fc06fe6f740 1 -- 172.21.15.63:0/3252733843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 msgr2=0x55f73f636550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.716+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/3252733843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f636550 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc0580d2fd0 tx=0x7fc058000bc0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.716+0000 7fc06fe6f740 1 -- 172.21.15.63:0/3252733843 shutdown_connections 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.716+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/3252733843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f636a90 0x55f73f638e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.716+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/3252733843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f636550 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.716+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/3252733843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f627780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.716+0000 7fc06fe6f740 1 -- 172.21.15.63:0/3252733843 >> 172.21.15.63:0/3252733843 conn(0x55f73f623a30 msgr2=0x55f73f623e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.716+0000 7fc06fe6f740 1 -- 172.21.15.63:0/3252733843 shutdown_connections 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.716+0000 7fc06fe6f740 1 -- 172.21.15.63:0/3252733843 wait complete. 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc06fe6f740 1 -- start start 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc06fe6f740 1 Processor -- start 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f6363d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f627cc0 0x55f73f633680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f633bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55f73f639660 con 0x55f73f636a90 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f73f548050 con 0x55f73f627cc0 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f73f6397e0 con 0x55f73f6273a0 2024-09-16T01:23:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc06fe6f740 10 client.0 _ll_register_callbacks cb 0x55f73f588160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc067fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f633bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc067fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f633bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45044/0 (socket says 172.21.15.63:45044) 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc067fff640 1 -- 172.21.15.63:0/1528447772 learned_addr learned my addr 172.21.15.63:0/1528447772 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc0677fe640 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f6363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.717+0000 7fc066ffd640 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f627cc0 0x55f73f633680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.718+0000 7fc067fff640 1 -- 172.21.15.63:0/1528447772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 msgr2=0x55f73f6363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.718+0000 7fc067fff640 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f6363d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.718+0000 7fc067fff640 1 -- 172.21.15.63:0/1528447772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f627cc0 msgr2=0x55f73f633680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.718+0000 7fc067fff640 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f627cc0 0x55f73f633680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.718+0000 7fc067fff640 1 -- 172.21.15.63:0/1528447772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f73f2fe3c0 con 0x55f73f636a90 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.718+0000 7fc067fff640 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f633bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc060035000 tx=0x7fc0600095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f2e5f26fe29a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.718+0000 7fc046ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc046ffd640 1 -- 172.21.15.63:0/1528447772 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060050030 con 0x55f73f636a90 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc046ffd640 1 -- 172.21.15.63:0/1528447772 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc060004040 con 0x55f73f636a90 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1528447772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc05809c2f0 con 0x55f73f636a90 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc046ffd640 1 -- 172.21.15.63:0/1528447772 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc060034040 con 0x55f73f636a90 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc06fe6f740 10 client.15228 fetch_fsmap learned FSMap version 25 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1528447772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f73f645050 con 0x55f73f636a90 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc046ffd640 1 -- 172.21.15.63:0/1528447772 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc05809c2f0 con 0x55f73f636a90 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc046ffd640 1 -- 172.21.15.63:0/1528447772 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc0600574c0 con 0x55f73f636a90 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc06fe6f740 10 client.15228 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc06fe6f740 10 client.15228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc06fe6f740 20 client.15228 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55f73f646520 0x55f73f648980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc06fe6f740 4 client.15228 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.719+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1528447772 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f73f59a850 con 0x55f73f646520 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.720+0000 7fc0677fe640 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55f73f646520 0x55f73f648980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.720+0000 7fc046ffd640 10 client.15228 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.720+0000 7fc0677fe640 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55f73f646520 0x55f73f648980 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b7746cb19f3db7 server_cookie=a07629eed99fdc39 in_seq=0 out_seq=0 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc046ffd640 1 -- 172.21.15.63:0/1528447772 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f73f59a850 con 0x55f73f646520 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc046ffd640 10 client.15228 handle_command_reply: tid=0 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 client.15228 shutdown 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1528447772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 msgr2=0x55f73f633bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f633bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc060035000 tx=0x7fc0600095c0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1528447772 shutdown_connections 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55f73f646520 0x55f73f648980 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f633bc0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f627cc0 0x55f73f633680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/1528447772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f6363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc046ffd640 0 client.15228 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1528447772 >> 172.21.15.63:0/1528447772 conn(0x55f73f623a30 msgr2=0x55f73f629790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1528447772 shutdown_connections 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1528447772 wait complete. 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.721+0000 7fc06fe6f740 20 client.15228 trim_cache size 0 max 16384 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc06fe6f740 1 Processor -- start 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc06fe6f740 1 -- start start 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f6273a0 0x55f73f642900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f627cc0 0x55f73f64e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f64e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681adb90 con 0x55f73f636a90 2024-09-16T01:23:26.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681ab460 con 0x55f73f6273a0 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681a9290 con 0x55f73f627cc0 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc067fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f64e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc067fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f64e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45056/0 (socket says 172.21.15.63:45056) 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc067fff640 1 -- 172.21.15.63:0/1951380050 learned_addr learned my addr 172.21.15.63:0/1951380050 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc0677fe640 1 --2- 172.21.15.63:0/1951380050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f6273a0 0x55f73f642900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc066ffd640 1 --2- 172.21.15.63:0/1951380050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f627cc0 0x55f73f64e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc067fff640 1 -- 172.21.15.63:0/1951380050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f627cc0 msgr2=0x55f73f64e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc067fff640 1 --2- 172.21.15.63:0/1951380050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f627cc0 0x55f73f64e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc067fff640 1 -- 172.21.15.63:0/1951380050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f6273a0 msgr2=0x55f73f642900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc067fff640 1 --2- 172.21.15.63:0/1951380050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f6273a0 0x55f73f642900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc067fff640 1 -- 172.21.15.63:0/1951380050 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73f623860 con 0x55f73f636a90 2024-09-16T01:23:26.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.740+0000 7fc0677fe640 1 --2- 172.21.15.63:0/1951380050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f6273a0 0x55f73f642900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc067fff640 1 --2- 172.21.15.63:0/1951380050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f64e740 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc060057ad0 tx=0x7fc060009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902e346f5232962b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc04d7fa640 1 -- 172.21.15.63:0/1951380050 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060050070 con 0x55f73f636a90 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc04d7fa640 1 -- 172.21.15.63:0/1951380050 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc060057d50 con 0x55f73f636a90 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc04d7fa640 1 -- 172.21.15.63:0/1951380050 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060003ef0 con 0x55f73f636a90 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1951380050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 msgr2=0x55f73f64e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/1951380050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f64e740 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc060057ad0 tx=0x7fc060009800 comp rx=0 tx=0).stop 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1951380050 shutdown_connections 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/1951380050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f636a90 0x55f73f64e740 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/1951380050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f627cc0 0x55f73f64e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/1951380050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f6273a0 0x55f73f642900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.741+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1951380050 >> 172.21.15.63:0/1951380050 conn(0x55f73f623a30 msgr2=0x55f73f62ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1951380050 shutdown_connections 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 1 -- 172.21.15.63:0/1951380050 wait complete. 2024-09-16T01:23:26.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 1 -- start start 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 1 Processor -- start 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f63f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f63a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f636a90 0x55f73f63aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681a9920 con 0x55f73f627cc0 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681aad90 con 0x55f73f636a90 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681a9ff0 con 0x55f73f6273a0 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc06fe6f740 10 client.0 _ll_register_callbacks cb 0x7fc06002faa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc066ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f63a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc066ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f63a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45072/0 (socket says 172.21.15.63:45072) 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.742+0000 7fc066ffd640 1 -- 172.21.15.63:0/2348383983 learned_addr learned my addr 172.21.15.63:0/2348383983 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc0677fe640 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f63f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc067fff640 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f636a90 0x55f73f63aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc066ffd640 1 -- 172.21.15.63:0/2348383983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 msgr2=0x55f73f63f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc066ffd640 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f63f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc066ffd640 1 -- 172.21.15.63:0/2348383983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f636a90 msgr2=0x55f73f63aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc066ffd640 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f636a90 0x55f73f63aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc066ffd640 1 -- 172.21.15.63:0/2348383983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f73f63b300 con 0x55f73f627cc0 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc066ffd640 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f63a570 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc05c005fd0 tx=0x7fc05c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e99d51df091cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc046ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc046ffd640 1 -- 172.21.15.63:0/2348383983 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c005220 con 0x55f73f627cc0 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc046ffd640 1 -- 172.21.15.63:0/2348383983 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc05c0053c0 con 0x55f73f627cc0 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc06fe6f740 1 -- 172.21.15.63:0/2348383983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc060057d50 con 0x55f73f627cc0 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc046ffd640 1 -- 172.21.15.63:0/2348383983 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc05c0055c0 con 0x55f73f627cc0 2024-09-16T01:23:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc06fe6f740 10 client.15234 fetch_fsmap learned FSMap version 25 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc06fe6f740 1 -- 172.21.15.63:0/2348383983 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f73f6b1300 con 0x55f73f627cc0 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.743+0000 7fc046ffd640 1 -- 172.21.15.63:0/2348383983 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc060057d50 con 0x55f73f627cc0 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.744+0000 7fc046ffd640 1 -- 172.21.15.63:0/2348383983 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc05c01b070 con 0x55f73f627cc0 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.744+0000 7fc06fe6f740 10 client.15234 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.744+0000 7fc06fe6f740 10 client.15234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.744+0000 7fc06fe6f740 20 client.15234 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.744+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55f73f6b1b30 0x55f73f6b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.744+0000 7fc06fe6f740 4 client.15234 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.744+0000 7fc06fe6f740 1 -- 172.21.15.63:0/2348383983 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f73f594d60 con 0x55f73f6b1b30 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.744+0000 7fc0677fe640 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55f73f6b1b30 0x55f73f6b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.744+0000 7fc0677fe640 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55f73f6b1b30 0x55f73f6b3f50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c606c9cbb73cd2f0 server_cookie=8df0dd9f490b0bbf in_seq=0 out_seq=0 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.744+0000 7fc046ffd640 10 client.15234 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc046ffd640 1 -- 172.21.15.63:0/2348383983 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f73f594d60 con 0x55f73f6b1b30 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc046ffd640 10 client.15234 handle_command_reply: tid=0 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 client.15234 shutdown 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 -- 172.21.15.63:0/2348383983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 msgr2=0x55f73f63a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f63a570 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc05c005fd0 tx=0x7fc05c012820 comp rx=0 tx=0).stop 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 -- 172.21.15.63:0/2348383983 shutdown_connections 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f73f636a90 0x55f73f63aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55f73f6b1b30 0x55f73f6b3f50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55f73f627cc0 0x55f73f63a570 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc046ffd640 0 client.15234 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 --2- 172.21.15.63:0/2348383983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f73f6273a0 0x55f73f63f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 -- 172.21.15.63:0/2348383983 >> 172.21.15.63:0/2348383983 conn(0x55f73f623a30 msgr2=0x55f73f631f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:26.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 -- 172.21.15.63:0/2348383983 shutdown_connections 2024-09-16T01:23:26.778 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:23:26.778 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-16T01:23:26.778 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-16T01:23:26.778 INFO:teuthology.orchestra.run.smithi063.stdout: "76f8bf2e-290d-4658-8248-a8aa2c7b13eb": { 2024-09-16T01:23:26.778 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-16T01:23:26.778 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "76f8bf2e-290d-4658-8248-a8aa2c7b13eb", 2024-09-16T01:23:26.778 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-16T01:23:26.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:23:26.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 1 -- 172.21.15.63:0/2348383983 wait complete. 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06fe6f740 20 client.15234 trim_cache size 0 max 16384 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06da96640 1 -- 172.21.15.63:0/72167031 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc0500a3240 msgr2=0x7fc0500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06da96640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc0500a3240 0x7fc0500a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc060030040 tx=0x7fc060005c50 comp rx=0 tx=0).stop 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06da96640 1 -- 172.21.15.63:0/72167031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc068102d40 msgr2=0x7fc0681982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.745+0000 7fc06da96640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc068102d40 0x7fc0681982e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c890 tx=0x7fc05800cd50 comp rx=0 tx=0).stop 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.746+0000 7fc06da96640 1 -- 172.21.15.63:0/72167031 shutdown_connections 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.746+0000 7fc06da96640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc0500a3240 0x7fc0500a5700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.746+0000 7fc06da96640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc06810c170 0x7fc06819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.746+0000 7fc06da96640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc068103660 0x7fc068198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.746+0000 7fc06da96640 1 --2- 172.21.15.63:0/72167031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc068102d40 0x7fc0681982e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.746+0000 7fc06da96640 1 -- 172.21.15.63:0/72167031 >> 172.21.15.63:0/72167031 conn(0x7fc0680fc7a0 msgr2=0x7fc0680fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.746+0000 7fc06da96640 1 -- 172.21.15.63:0/72167031 shutdown_connections 2024-09-16T01:23:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:26.746+0000 7fc06da96640 1 -- 172.21.15.63:0/72167031 wait complete. 2024-09-16T01:23:27.726 INFO:tasks.cephfs.filesystem:scrub status for tag:76f8bf2e-290d-4658-8248-a8aa2c7b13eb - {'path': '/', 'tag': '76f8bf2e-290d-4658-8248-a8aa2c7b13eb', 'options': 'recursive,force'} 2024-09-16T01:23:28.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:28 smithi192 ceph-mon[34775]: pgmap v339: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-16T01:23:28.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:28 smithi162 ceph-mon[34539]: pgmap v339: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-16T01:23:28.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:28 smithi063 ceph-mon[31070]: pgmap v339: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-16T01:23:30.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:30 smithi192 ceph-mon[34775]: pgmap v340: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-16T01:23:30.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:30 smithi162 ceph-mon[34539]: pgmap v340: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-16T01:23:30.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:30 smithi063 ceph-mon[31070]: pgmap v340: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-16T01:23:32.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:32 smithi192 ceph-mon[34775]: pgmap v341: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-16T01:23:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:32 smithi162 ceph-mon[34539]: pgmap v341: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-16T01:23:32.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:32 smithi063 ceph-mon[31070]: pgmap v341: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-16T01:23:34.661 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:34 smithi063 ceph-mon[31070]: pgmap v342: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-16T01:23:34.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:34 smithi192 ceph-mon[34775]: pgmap v342: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-16T01:23:34.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:34 smithi162 ceph-mon[34539]: pgmap v342: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-16T01:23:36.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:36 smithi063 ceph-mon[31070]: pgmap v343: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:23:36.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:36 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:23:36.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:36 smithi192 ceph-mon[34775]: pgmap v343: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:23:36.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:36 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:23:36.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:36 smithi162 ceph-mon[34539]: pgmap v343: 97 pgs: 97 active+clean; 651 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:23:36.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:36 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:23:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:23:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:23:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:23:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:23:38.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:23:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:23:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:23:39.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:39 smithi063 ceph-mon[31070]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-16T01:23:39.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:39 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:23:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:39 smithi192 ceph-mon[34775]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-16T01:23:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:39 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:23:39.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:39 smithi162 ceph-mon[34539]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-16T01:23:39.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:39 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:23:41.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:41 smithi063 ceph-mon[31070]: pgmap v345: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-16T01:23:41.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:41 smithi192 ceph-mon[34775]: pgmap v345: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-16T01:23:41.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:41 smithi162 ceph-mon[34539]: pgmap v345: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-16T01:23:43.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:43 smithi063 ceph-mon[31070]: pgmap v346: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-16T01:23:43.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:43 smithi192 ceph-mon[34775]: pgmap v346: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-16T01:23:43.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:43 smithi162 ceph-mon[34539]: pgmap v346: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-16T01:23:45.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:45 smithi063 ceph-mon[31070]: pgmap v347: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-16T01:23:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:45 smithi192 ceph-mon[34775]: pgmap v347: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-16T01:23:45.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:45 smithi162 ceph-mon[34539]: pgmap v347: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-16T01:23:47.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:47 smithi063 ceph-mon[31070]: pgmap v348: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-16T01:23:47.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:47 smithi192 ceph-mon[34775]: pgmap v348: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-16T01:23:47.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:47 smithi162 ceph-mon[34539]: pgmap v348: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-16T01:23:49.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:49 smithi063 ceph-mon[31070]: pgmap v349: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-16T01:23:49.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:49 smithi192 ceph-mon[34775]: pgmap v349: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-16T01:23:49.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:49 smithi162 ceph-mon[34539]: pgmap v349: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-16T01:23:51.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:51 smithi063 ceph-mon[31070]: pgmap v350: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:51.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:51 smithi192 ceph-mon[34775]: pgmap v350: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:51.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:51 smithi162 ceph-mon[34539]: pgmap v350: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:53.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:53 smithi063 ceph-mon[31070]: pgmap v351: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:53.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:53 smithi192 ceph-mon[34775]: pgmap v351: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:53.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:53 smithi162 ceph-mon[34539]: pgmap v351: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:55.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:55 smithi063 ceph-mon[31070]: pgmap v352: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:55.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:55 smithi192 ceph-mon[34775]: pgmap v352: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:55.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:55 smithi162 ceph-mon[34539]: pgmap v352: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:23:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:57 smithi063 ceph-mon[31070]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:23:57.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:57 smithi192 ceph-mon[34775]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:23:57.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:57 smithi162 ceph-mon[34539]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:23:57.727 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:23:58.007 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:23:58.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.555+0000 7fee71e8a640 1 -- 172.21.15.63:0/702085351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6c102ef0 msgr2=0x7fee6c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.555+0000 7fee71e8a640 1 --2- 172.21.15.63:0/702085351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6c102ef0 0x7fee6c10da40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fee64009ca0 tx=0x7fee6402a950 comp rx=0 tx=0).stop 2024-09-16T01:23:58.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.555+0000 7fee71e8a640 1 -- 172.21.15.63:0/702085351 shutdown_connections 2024-09-16T01:23:58.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.555+0000 7fee71e8a640 1 --2- 172.21.15.63:0/702085351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6c102ef0 0x7fee6c10da40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.555+0000 7fee71e8a640 1 --2- 172.21.15.63:0/702085351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6c102570 0x7fee6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.555+0000 7fee71e8a640 1 --2- 172.21.15.63:0/702085351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee6c100e20 0x7fee6c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.555+0000 7fee71e8a640 1 -- 172.21.15.63:0/702085351 >> 172.21.15.63:0/702085351 conn(0x7fee6c0fc7d0 msgr2=0x7fee6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.555+0000 7fee71e8a640 1 -- 172.21.15.63:0/702085351 shutdown_connections 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.556+0000 7fee71e8a640 1 -- 172.21.15.63:0/702085351 wait complete. 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.556+0000 7fee71e8a640 1 Processor -- start 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee71e8a640 1 -- start start 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee71e8a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6c100e20 0x7fee6c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee71e8a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6c102570 0x7fee6c197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee71e8a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee6c102ef0 0x7fee6c19bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee6b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6c100e20 0x7fee6c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee6b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6c100e20 0x7fee6c197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32916/0 (socket says 172.21.15.63:32916) 2024-09-16T01:23:58.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee6b7fe640 1 -- 172.21.15.63:0/632895156 learned_addr learned my addr 172.21.15.63:0/632895156 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:58.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee6affd640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6c102570 0x7fee6c197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c110e30 con 0x7fee6c100e20 2024-09-16T01:23:58.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c110cb0 con 0x7fee6c102570 2024-09-16T01:23:58.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.557+0000 7fee6bfff640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee6c102ef0 0x7fee6c19bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.558+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c110fb0 con 0x7fee6c102ef0 2024-09-16T01:23:58.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.558+0000 7fee6affd640 1 -- 172.21.15.63:0/632895156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee6c102ef0 msgr2=0x7fee6c19bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.558+0000 7fee6affd640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee6c102ef0 0x7fee6c19bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.558+0000 7fee6affd640 1 -- 172.21.15.63:0/632895156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6c100e20 msgr2=0x7fee6c197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.558+0000 7fee6affd640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6c100e20 0x7fee6c197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.558+0000 7fee6affd640 1 -- 172.21.15.63:0/632895156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c19c300 con 0x7fee6c102570 2024-09-16T01:23:58.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.558+0000 7fee6affd640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6c102570 0x7fee6c197890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fee60009e90 tx=0x7fee6000ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.559+0000 7fee68ff9640 1 -- 172.21.15.63:0/632895156 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6001e070 con 0x7fee6c102570 2024-09-16T01:23:58.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.559+0000 7fee68ff9640 1 -- 172.21.15.63:0/632895156 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee6000cc40 con 0x7fee6c102570 2024-09-16T01:23:58.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.559+0000 7fee68ff9640 1 -- 172.21.15.63:0/632895156 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60019880 con 0x7fee6c102570 2024-09-16T01:23:58.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.559+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c19c5f0 con 0x7fee6c102570 2024-09-16T01:23:58.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.559+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c069f70 con 0x7fee6c102570 2024-09-16T01:23:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.562+0000 7fee68ff9640 1 -- 172.21.15.63:0/632895156 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fee60021070 con 0x7fee6c102570 2024-09-16T01:23:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.562+0000 7fee74263740 1 Processor -- start 2024-09-16T01:23:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.562+0000 7fee74263740 1 -- start start 2024-09-16T01:23:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee74263740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df164a0 0x56435df16880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee74263740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df21140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee74263740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df21680 0x56435df23a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee74263740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56435de7c2e0 con 0x56435df16dc0 2024-09-16T01:23:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee74263740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56435de23ce0 con 0x56435df164a0 2024-09-16T01:23:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee74263740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56435de782a0 con 0x56435df21680 2024-09-16T01:23:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee6b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df21140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee68ff9640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fee540a3240 0x7fee540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee6b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df21140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32924/0 (socket says 172.21.15.63:32924) 2024-09-16T01:23:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee6b7fe640 1 -- 172.21.15.63:0/2244802145 learned_addr learned my addr 172.21.15.63:0/2244802145 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee6affd640 1 --2- 172.21.15.63:0/2244802145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df21680 0x56435df23a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee6bfff640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fee540a3240 0x7fee540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee68ff9640 1 -- 172.21.15.63:0/632895156 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fee600d1740 con 0x7fee6c102570 2024-09-16T01:23:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee6b7fe640 1 -- 172.21.15.63:0/2244802145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df21680 msgr2=0x56435df23a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.563+0000 7fee6b7fe640 1 --2- 172.21.15.63:0/2244802145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df21680 0x56435df23a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.564+0000 7fee6b7fe640 1 -- 172.21.15.63:0/2244802145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df164a0 msgr2=0x56435df16880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.564+0000 7fee6b7fe640 1 --2- 172.21.15.63:0/2244802145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df164a0 0x56435df16880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.564+0000 7fee6b7fe640 1 -- 172.21.15.63:0/2244802145 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56435de08440 con 0x56435df16dc0 2024-09-16T01:23:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.564+0000 7fee6affd640 1 --2- 172.21.15.63:0/2244802145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df21680 0x56435df23a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.564+0000 7fee6b7fe640 1 --2- 172.21.15.63:0/2244802145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df21140 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009e10 tx=0x7fee5c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e13de7e9ceb5c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.564+0000 7fee51ffb640 1 -- 172.21.15.63:0/2244802145 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c01e070 con 0x56435df16dc0 2024-09-16T01:23:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.564+0000 7fee51ffb640 1 -- 172.21.15.63:0/2244802145 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee5c019ae0 con 0x56435df16dc0 2024-09-16T01:23:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.564+0000 7fee51ffb640 1 -- 172.21.15.63:0/2244802145 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00fb30 con 0x56435df16dc0 2024-09-16T01:23:58.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.565+0000 7fee6bfff640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fee540a3240 0x7fee540a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fee64005e30 tx=0x7fee6403e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.565+0000 7fee74263740 1 -- 172.21.15.63:0/2244802145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 msgr2=0x56435df21140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.565+0000 7fee74263740 1 --2- 172.21.15.63:0/2244802145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df21140 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fee5c009e10 tx=0x7fee5c011810 comp rx=0 tx=0).stop 2024-09-16T01:23:58.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.565+0000 7fee74263740 1 -- 172.21.15.63:0/2244802145 shutdown_connections 2024-09-16T01:23:58.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.565+0000 7fee74263740 1 --2- 172.21.15.63:0/2244802145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df21680 0x56435df23a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.565+0000 7fee74263740 1 --2- 172.21.15.63:0/2244802145 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df21140 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.565+0000 7fee74263740 1 --2- 172.21.15.63:0/2244802145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df164a0 0x56435df16880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.565+0000 7fee74263740 1 -- 172.21.15.63:0/2244802145 >> 172.21.15.63:0/2244802145 conn(0x56435df12a30 msgr2=0x56435df12e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.565+0000 7fee74263740 1 -- 172.21.15.63:0/2244802145 shutdown_connections 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.565+0000 7fee74263740 1 -- 172.21.15.63:0/2244802145 wait complete. 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee74263740 1 -- start start 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee74263740 1 Processor -- start 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee74263740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df164a0 0x56435df20fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee74263740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df1e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee74263740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df21680 0x56435df1e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee74263740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56435df24250 con 0x56435df16dc0 2024-09-16T01:23:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee74263740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56435de37050 con 0x56435df164a0 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee74263740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56435df243d0 con 0x56435df21680 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee74263740 10 client.0 _ll_register_callbacks cb 0x56435de77160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee6affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df1e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee6affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df1e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32932/0 (socket says 172.21.15.63:32932) 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.566+0000 7fee6affd640 1 -- 172.21.15.63:0/3704770402 learned_addr learned my addr 172.21.15.63:0/3704770402 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.567+0000 7fee6affd640 1 -- 172.21.15.63:0/3704770402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df21680 msgr2=0x56435df1e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.567+0000 7fee6affd640 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df21680 0x56435df1e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.567+0000 7fee6affd640 1 -- 172.21.15.63:0/3704770402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df164a0 msgr2=0x56435df20fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.567+0000 7fee6affd640 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df164a0 0x56435df20fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.567+0000 7fee6affd640 1 -- 172.21.15.63:0/3704770402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56435dbed3c0 con 0x56435df16dc0 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.567+0000 7fee6affd640 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df1e270 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fee6009dad0 tx=0x7fee6006cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a2671c43b62228 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.567+0000 7fee4affd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:58.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.567+0000 7fee4affd640 1 -- 172.21.15.63:0/3704770402 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee600a6990 con 0x56435df16dc0 2024-09-16T01:23:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.567+0000 7fee4affd640 1 -- 172.21.15.63:0/3704770402 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fee6009a440 con 0x56435df16dc0 2024-09-16T01:23:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.567+0000 7fee74263740 1 -- 172.21.15.63:0/3704770402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee5c019ae0 con 0x56435df16dc0 2024-09-16T01:23:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee4affd640 1 -- 172.21.15.63:0/3704770402 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee600a6500 con 0x56435df16dc0 2024-09-16T01:23:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee74263740 10 client.15246 fetch_fsmap learned FSMap version 25 2024-09-16T01:23:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee74263740 1 -- 172.21.15.63:0/3704770402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56435df38440 con 0x56435df16dc0 2024-09-16T01:23:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee4affd640 1 -- 172.21.15.63:0/3704770402 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee5c019ae0 con 0x56435df16dc0 2024-09-16T01:23:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee4affd640 1 -- 172.21.15.63:0/3704770402 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fee60099b20 con 0x56435df16dc0 2024-09-16T01:23:58.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee74263740 10 client.15246 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:23:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee74263740 10 client.15246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:23:58.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee74263740 20 client.15246 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee74263740 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56435df39850 0x56435df3bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee74263740 4 client.15246 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.568+0000 7fee74263740 1 -- 172.21.15.63:0/3704770402 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56435de89850 con 0x56435df39850 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.569+0000 7fee6b7fe640 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56435df39850 0x56435df3bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.569+0000 7fee4affd640 10 client.15246 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.569+0000 7fee6b7fe640 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56435df39850 0x56435df3bce0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=502a7f436b69acd7 server_cookie=8b07dfb6b7c36868 in_seq=0 out_seq=0 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.570+0000 7fee4affd640 1 -- 172.21.15.63:0/3704770402 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56435de89850 con 0x56435df39850 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.570+0000 7fee4affd640 10 client.15246 handle_command_reply: tid=0 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.570+0000 7fee74263740 1 client.15246 shutdown 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 1 -- 172.21.15.63:0/3704770402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 msgr2=0x56435df1e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df1e270 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fee6009dad0 tx=0x7fee6006cb10 comp rx=0 tx=0).stop 2024-09-16T01:23:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 1 -- 172.21.15.63:0/3704770402 shutdown_connections 2024-09-16T01:23:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df21680 0x56435df1e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56435df39850 0x56435df3bce0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df1e270 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 1 --2- 172.21.15.63:0/3704770402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df164a0 0x56435df20fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 1 -- 172.21.15.63:0/3704770402 >> 172.21.15.63:0/3704770402 conn(0x56435df12a30 msgr2=0x56435df18760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee4affd640 0 client.15246 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 1 -- 172.21.15.63:0/3704770402 shutdown_connections 2024-09-16T01:23:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 1 -- 172.21.15.63:0/3704770402 wait complete. 2024-09-16T01:23:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.571+0000 7fee74263740 20 client.15246 trim_cache size 0 max 16384 2024-09-16T01:23:58.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.588+0000 7fee74263740 1 Processor -- start 2024-09-16T01:23:58.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.588+0000 7fee74263740 1 -- start start 2024-09-16T01:23:58.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee74263740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df164a0 0x56435df1cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee74263740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df41600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee74263740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df21680 0x56435df41b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee74263740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c1adbd0 con 0x56435df16dc0 2024-09-16T01:23:58.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee74263740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c1ab4a0 con 0x56435df21680 2024-09-16T01:23:58.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee74263740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c1a92d0 con 0x56435df164a0 2024-09-16T01:23:58.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee6affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df41600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee6affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df41600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32934/0 (socket says 172.21.15.63:32934) 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee6affd640 1 -- 172.21.15.63:0/1563799402 learned_addr learned my addr 172.21.15.63:0/1563799402 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee6bfff640 1 --2- 172.21.15.63:0/1563799402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df21680 0x56435df41b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee6affd640 1 -- 172.21.15.63:0/1563799402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df164a0 msgr2=0x56435df1cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee6affd640 1 --2- 172.21.15.63:0/1563799402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df164a0 0x56435df1cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee6affd640 1 -- 172.21.15.63:0/1563799402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df21680 msgr2=0x56435df41b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee6affd640 1 --2- 172.21.15.63:0/1563799402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df21680 0x56435df41b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.589+0000 7fee6affd640 1 -- 172.21.15.63:0/1563799402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56435df1d220 con 0x56435df16dc0 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.590+0000 7fee6affd640 1 --2- 172.21.15.63:0/1563799402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df41600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fee6000c6a0 tx=0x7fee600d19c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ff4ab7cb08cbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.590+0000 7fee517fa640 1 -- 172.21.15.63:0/1563799402 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee600a6990 con 0x56435df16dc0 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.590+0000 7fee517fa640 1 -- 172.21.15.63:0/1563799402 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee600a66a0 con 0x56435df16dc0 2024-09-16T01:23:58.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.590+0000 7fee517fa640 1 -- 172.21.15.63:0/1563799402 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6009d910 con 0x56435df16dc0 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.591+0000 7fee74263740 1 -- 172.21.15.63:0/1563799402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 msgr2=0x56435df41600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.591+0000 7fee74263740 1 --2- 172.21.15.63:0/1563799402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df41600 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fee6000c6a0 tx=0x7fee600d19c0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.591+0000 7fee74263740 1 -- 172.21.15.63:0/1563799402 shutdown_connections 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.591+0000 7fee74263740 1 --2- 172.21.15.63:0/1563799402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435df21680 0x56435df41b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.591+0000 7fee74263740 1 --2- 172.21.15.63:0/1563799402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df16dc0 0x56435df41600 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.591+0000 7fee74263740 1 --2- 172.21.15.63:0/1563799402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df164a0 0x56435df1cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.591+0000 7fee74263740 1 -- 172.21.15.63:0/1563799402 >> 172.21.15.63:0/1563799402 conn(0x56435df12a30 msgr2=0x56435df202f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.591+0000 7fee74263740 1 -- 172.21.15.63:0/1563799402 shutdown_connections 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.591+0000 7fee74263740 1 -- 172.21.15.63:0/1563799402 wait complete. 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee74263740 1 -- start start 2024-09-16T01:23:58.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee74263740 1 Processor -- start 2024-09-16T01:23:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee74263740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df164a0 0x56435df30250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee74263740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df21680 0x56435df30790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee74263740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435dfa15d0 0x56435dfa39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee74263740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c1a9960 con 0x56435df21680 2024-09-16T01:23:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee74263740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c1aadd0 con 0x56435dfa15d0 2024-09-16T01:23:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee74263740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c1aa030 con 0x56435df164a0 2024-09-16T01:23:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee74263740 10 client.0 _ll_register_callbacks cb 0x7fee60005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee6affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df21680 0x56435df30790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.592+0000 7fee6affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df21680 0x56435df30790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32948/0 (socket says 172.21.15.63:32948) 2024-09-16T01:23:58.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.593+0000 7fee6affd640 1 -- 172.21.15.63:0/946089106 learned_addr learned my addr 172.21.15.63:0/946089106 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:23:58.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.593+0000 7fee6affd640 1 -- 172.21.15.63:0/946089106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df164a0 msgr2=0x56435df30250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.593+0000 7fee6b7fe640 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df164a0 0x56435df30250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.593+0000 7fee6affd640 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df164a0 0x56435df30250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.593+0000 7fee6affd640 1 -- 172.21.15.63:0/946089106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435dfa15d0 msgr2=0x56435dfa39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.593+0000 7fee6affd640 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435dfa15d0 0x56435dfa39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.593+0000 7fee6affd640 1 -- 172.21.15.63:0/946089106 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56435df21330 con 0x56435df21680 2024-09-16T01:23:58.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.593+0000 7fee6b7fe640 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df164a0 0x56435df30250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:58.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.594+0000 7fee6affd640 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df21680 0x56435df30790 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fee60000c00 tx=0x7fee60005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8055bcc0f8636d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.594+0000 7fee4affd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.594+0000 7fee4affd640 1 -- 172.21.15.63:0/946089106 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6009d910 con 0x56435df21680 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.594+0000 7fee4affd640 1 -- 172.21.15.63:0/946089106 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fee6009cc90 con 0x56435df21680 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.594+0000 7fee74263740 1 -- 172.21.15.63:0/946089106 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee600a66a0 con 0x56435df21680 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.594+0000 7fee4affd640 1 -- 172.21.15.63:0/946089106 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee600a6990 con 0x56435df21680 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.594+0000 7fee74263740 10 client.15252 fetch_fsmap learned FSMap version 25 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.594+0000 7fee74263740 1 -- 172.21.15.63:0/946089106 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56435df21330 con 0x56435df21680 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.595+0000 7fee4affd640 1 -- 172.21.15.63:0/946089106 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee600a66a0 con 0x56435df21680 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.595+0000 7fee4affd640 1 -- 172.21.15.63:0/946089106 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fee60088190 con 0x56435df21680 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.595+0000 7fee74263740 10 client.15252 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.595+0000 7fee74263740 10 client.15252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.595+0000 7fee74263740 20 client.15252 populate_metadata read hostname 'smithi063' 2024-09-16T01:23:58.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.595+0000 7fee74263740 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56435dfa5190 0x56435dfa7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.595+0000 7fee74263740 4 client.15252 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.595+0000 7fee74263740 1 -- 172.21.15.63:0/946089106 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56435de83d60 con 0x56435dfa5190 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.595+0000 7fee6b7fe640 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56435dfa5190 0x56435dfa7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.596+0000 7fee6b7fe640 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56435dfa5190 0x56435dfa7580 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88c9fc5c6688a018 server_cookie=bb010570941732ad in_seq=0 out_seq=0 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.596+0000 7fee4affd640 10 client.15252 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.596+0000 7fee4affd640 1 -- 172.21.15.63:0/946089106 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56435de83d60 con 0x56435dfa5190 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.596+0000 7fee4affd640 10 client.15252 handle_command_reply: tid=0 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.596+0000 7fee74263740 1 client.15252 shutdown 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.596+0000 7fee74263740 1 -- 172.21.15.63:0/946089106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df21680 msgr2=0x56435df30790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.596+0000 7fee74263740 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df21680 0x56435df30790 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fee60000c00 tx=0x7fee60005ab0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee74263740 1 -- 172.21.15.63:0/946089106 shutdown_connections 2024-09-16T01:23:58.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee74263740 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56435dfa15d0 0x56435dfa39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee74263740 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56435dfa5190 0x56435dfa7580 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee74263740 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56435df21680 0x56435df30790 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.602 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:23:58.602 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-16T01:23:58.602 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {} 2024-09-16T01:23:58.602 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:23:58.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee74263740 1 --2- 172.21.15.63:0/946089106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56435df164a0 0x56435df30250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee74263740 1 -- 172.21.15.63:0/946089106 >> 172.21.15.63:0/946089106 conn(0x56435df12a30 msgr2=0x56435df202f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee4affd640 0 client.15252 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:23:58.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee74263740 1 -- 172.21.15.63:0/946089106 shutdown_connections 2024-09-16T01:23:58.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee74263740 1 -- 172.21.15.63:0/946089106 wait complete. 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee74263740 20 client.15252 trim_cache size 0 max 16384 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fee540a3240 msgr2=0x7fee540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee71e8a640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fee540a3240 0x7fee540a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fee64005e30 tx=0x7fee6403e040 comp rx=0 tx=0).stop 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6c102570 msgr2=0x7fee6c197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.597+0000 7fee71e8a640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6c102570 0x7fee6c197890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fee60009e90 tx=0x7fee6000ed90 comp rx=0 tx=0).stop 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.598+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 shutdown_connections 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.598+0000 7fee71e8a640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fee540a3240 0x7fee540a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.598+0000 7fee71e8a640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee6c102ef0 0x7fee6c19bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.598+0000 7fee71e8a640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee6c102570 0x7fee6c197890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.598+0000 7fee71e8a640 1 --2- 172.21.15.63:0/632895156 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fee6c100e20 0x7fee6c197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.598+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 >> 172.21.15.63:0/632895156 conn(0x7fee6c0fc7d0 msgr2=0x7fee6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.598+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 shutdown_connections 2024-09-16T01:23:58.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:23:58.598+0000 7fee71e8a640 1 -- 172.21.15.63:0/632895156 wait complete. 2024-09-16T01:23:59.270 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:23:59 smithi063 ceph-mon[31070]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:59.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:23:59 smithi192 ceph-mon[34775]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:59.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:23:59 smithi162 ceph-mon[34539]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:23:59.465 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-16T01:23:59.466 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:23:59.827 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:00.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.359+0000 7f8d45d15640 1 -- 172.21.15.63:0/888747893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d40103660 msgr2=0x7f8d4010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.359+0000 7f8d45d15640 1 --2- 172.21.15.63:0/888747893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d40103660 0x7f8d4010bb50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009900 tx=0x7f8d3402a480 comp rx=0 tx=0).stop 2024-09-16T01:24:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.359+0000 7f8d45d15640 1 -- 172.21.15.63:0/888747893 shutdown_connections 2024-09-16T01:24:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.359+0000 7f8d45d15640 1 --2- 172.21.15.63:0/888747893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4010c170 0x7f8d4010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.359+0000 7f8d45d15640 1 --2- 172.21.15.63:0/888747893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d40103660 0x7f8d4010bb50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.359+0000 7f8d45d15640 1 --2- 172.21.15.63:0/888747893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d40102d40 0x7f8d40103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.359+0000 7f8d45d15640 1 -- 172.21.15.63:0/888747893 >> 172.21.15.63:0/888747893 conn(0x7f8d400fc7a0 msgr2=0x7f8d400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.359+0000 7f8d45d15640 1 -- 172.21.15.63:0/888747893 shutdown_connections 2024-09-16T01:24:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.359+0000 7f8d45d15640 1 -- 172.21.15.63:0/888747893 wait complete. 2024-09-16T01:24:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.360+0000 7f8d45d15640 1 Processor -- start 2024-09-16T01:24:00.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.360+0000 7f8d45d15640 1 -- start start 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.360+0000 7f8d45d15640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d40102d40 0x7f8d40198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d45d15640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d40103660 0x7f8d40198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d3f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d40102d40 0x7f8d40198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d40103660 0x7f8d40198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d45d15640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4010c170 0x7f8d4019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d3f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d40102d40 0x7f8d40198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:43390/0 (socket says 172.21.15.63:43390) 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d3effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d40103660 0x7f8d40198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32978/0 (socket says 172.21.15.63:32978) 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d3f7fe640 1 -- 172.21.15.63:0/1040173852 learned_addr learned my addr 172.21.15.63:0/1040173852 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40111e70 con 0x7f8d40103660 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40111cf0 con 0x7f8d40102d40 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40111ff0 con 0x7f8d4010c170 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.361+0000 7f8d3ffff640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4010c170 0x7f8d4019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:00.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.362+0000 7f8d3f7fe640 1 -- 172.21.15.63:0/1040173852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4010c170 msgr2=0x7f8d4019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.362+0000 7f8d3f7fe640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4010c170 0x7f8d4019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.362+0000 7f8d3f7fe640 1 -- 172.21.15.63:0/1040173852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d40103660 msgr2=0x7f8d40198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.362+0000 7f8d3f7fe640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d40103660 0x7f8d40198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.362+0000 7f8d3f7fe640 1 -- 172.21.15.63:0/1040173852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4019d2b0 con 0x7f8d40102d40 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.362+0000 7f8d3effd640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d40103660 0x7f8d40198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.362+0000 7f8d3f7fe640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d40102d40 0x7f8d40198300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000c920 tx=0x7f8d3000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.362+0000 7f8d3cff9640 1 -- 172.21.15.63:0/1040173852 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30007c70 con 0x7f8d40102d40 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.362+0000 7f8d3cff9640 1 -- 172.21.15.63:0/1040173852 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d30007e10 con 0x7f8d40102d40 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.362+0000 7f8d3cff9640 1 -- 172.21.15.63:0/1040173852 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30018820 con 0x7f8d40102d40 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.363+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4019d5a0 con 0x7f8d40102d40 2024-09-16T01:24:00.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.363+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d401a4e80 con 0x7f8d40102d40 2024-09-16T01:24:00.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.365+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d40103120 con 0x7f8d40102d40 2024-09-16T01:24:00.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.366+0000 7f8d3cff9640 1 -- 172.21.15.63:0/1040173852 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8d300189c0 con 0x7f8d40102d40 2024-09-16T01:24:00.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.367+0000 7f8d3cff9640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d280a3240 0x7f8d280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:00.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.367+0000 7f8d3effd640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d280a3240 0x7f8d280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.367+0000 7f8d3cff9640 1 -- 172.21.15.63:0/1040173852 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8d300cfa00 con 0x7f8d40102d40 2024-09-16T01:24:00.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.367+0000 7f8d3effd640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d280a3240 0x7f8d280a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8d34005ab0 tx=0x7f8d34005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:00.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.371+0000 7f8d3cff9640 1 -- 172.21.15.63:0/1040173852 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d30014030 con 0x7f8d40102d40 2024-09-16T01:24:00.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.583+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d40107240 con 0x7f8d40102d40 2024-09-16T01:24:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:24:00.586 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"btime":"2024-09-16T01:23:16:355817+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:23:15.890925+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24467,24460,24445]},"id":1}]} 2024-09-16T01:24:00.586 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 25 2024-09-16T01:24:00.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.584+0000 7f8d3cff9640 1 -- 172.21.15.63:0/1040173852 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11909 (secure 0 0 0) 0x7f8d3009c720 con 0x7f8d40102d40 2024-09-16T01:24:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d280a3240 msgr2=0x7f8d280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d280a3240 0x7f8d280a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8d34005ab0 tx=0x7f8d34005a20 comp rx=0 tx=0).stop 2024-09-16T01:24:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d40102d40 msgr2=0x7f8d40198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d40102d40 0x7f8d40198300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000c920 tx=0x7f8d3000cde0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 shutdown_connections 2024-09-16T01:24:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8d280a3240 0x7f8d280a5700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d4010c170 0x7f8d4019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d40103660 0x7f8d40198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 --2- 172.21.15.63:0/1040173852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d40102d40 0x7f8d40198300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 >> 172.21.15.63:0/1040173852 conn(0x7f8d400fc7a0 msgr2=0x7f8d400fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 shutdown_connections 2024-09-16T01:24:00.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:00.587+0000 7f8d45d15640 1 -- 172.21.15.63:0/1040173852 wait complete. 2024-09-16T01:24:01.259 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:01 smithi063 ceph-mon[31070]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:24:01.259 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:01 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1040173852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:24:01.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-16T01:24:01.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:01 smithi192 ceph-mon[34775]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:24:01.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:01 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1040173852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:24:01.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:01 smithi162 ceph-mon[34539]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:24:01.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:01 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1040173852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:24:01.697 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.284+0000 7fcb29470640 1 -- 172.21.15.63:0/78708915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb241027c0 msgr2=0x7fcb24106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.284+0000 7fcb29470640 1 --2- 172.21.15.63:0/78708915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb241027c0 0x7fcb24106810 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009900 tx=0x7fcb0c02a410 comp rx=0 tx=0).stop 2024-09-16T01:24:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.284+0000 7fcb29470640 1 -- 172.21.15.63:0/78708915 shutdown_connections 2024-09-16T01:24:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.285+0000 7fcb29470640 1 --2- 172.21.15.63:0/78708915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb24106f40 0x7fcb2410eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.285+0000 7fcb29470640 1 --2- 172.21.15.63:0/78708915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb241027c0 0x7fcb24106810 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.285+0000 7fcb29470640 1 --2- 172.21.15.63:0/78708915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb24101e10 0x7fcb241021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.285+0000 7fcb29470640 1 -- 172.21.15.63:0/78708915 >> 172.21.15.63:0/78708915 conn(0x7fcb240fd8d0 msgr2=0x7fcb240ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:02.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.285+0000 7fcb29470640 1 -- 172.21.15.63:0/78708915 shutdown_connections 2024-09-16T01:24:02.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.285+0000 7fcb29470640 1 -- 172.21.15.63:0/78708915 wait complete. 2024-09-16T01:24:02.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.286+0000 7fcb29470640 1 Processor -- start 2024-09-16T01:24:02.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.286+0000 7fcb29470640 1 -- start start 2024-09-16T01:24:02.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.286+0000 7fcb29470640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb24101e10 0x7fcb24198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.287+0000 7fcb29470640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb241027c0 0x7fcb24198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.287+0000 7fcb29470640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb24106f40 0x7fcb2419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.287+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb241027c0 0x7fcb24198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.287+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb241027c0 0x7fcb24198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32990/0 (socket says 172.21.15.63:32990) 2024-09-16T01:24:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.287+0000 7fcb1bfff640 1 -- 172.21.15.63:0/2840242906 learned_addr learned my addr 172.21.15.63:0/2840242906 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.287+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24111e50 con 0x7fcb241027c0 2024-09-16T01:24:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.287+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24111cd0 con 0x7fcb24101e10 2024-09-16T01:24:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.287+0000 7fcb22ffd640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb24101e10 0x7fcb24198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.287+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24111fd0 con 0x7fcb24106f40 2024-09-16T01:24:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.287+0000 7fcb237fe640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb24106f40 0x7fcb2419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.288+0000 7fcb1bfff640 1 -- 172.21.15.63:0/2840242906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb24106f40 msgr2=0x7fcb2419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.288+0000 7fcb1bfff640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb24106f40 0x7fcb2419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.288+0000 7fcb1bfff640 1 -- 172.21.15.63:0/2840242906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb24101e10 msgr2=0x7fcb24198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.288+0000 7fcb1bfff640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb24101e10 0x7fcb24198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.288+0000 7fcb1bfff640 1 -- 172.21.15.63:0/2840242906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2419d2c0 con 0x7fcb241027c0 2024-09-16T01:24:02.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.288+0000 7fcb1bfff640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb241027c0 0x7fcb24198850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c005940 tx=0x7fcb0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:02.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.288+0000 7fcb20ff9640 1 -- 172.21.15.63:0/2840242906 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c03f030 con 0x7fcb241027c0 2024-09-16T01:24:02.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.288+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2419d550 con 0x7fcb241027c0 2024-09-16T01:24:02.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.288+0000 7fcb20ff9640 1 -- 172.21.15.63:0/2840242906 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb0c003aa0 con 0x7fcb241027c0 2024-09-16T01:24:02.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.289+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb241a4e90 con 0x7fcb241027c0 2024-09-16T01:24:02.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.289+0000 7fcb20ff9640 1 -- 172.21.15.63:0/2840242906 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c035070 con 0x7fcb241027c0 2024-09-16T01:24:02.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.293+0000 7fcb20ff9640 1 -- 172.21.15.63:0/2840242906 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcb0c042030 con 0x7fcb241027c0 2024-09-16T01:24:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.294+0000 7fcb2b849740 1 Processor -- start 2024-09-16T01:24:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.294+0000 7fcb2b849740 1 -- start start 2024-09-16T01:24:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.294+0000 7fcb2b849740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca46185b40 0x55ca46184090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.294+0000 7fcb2b849740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca461845d0 0x55ca46184a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb2b849740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46191760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb237fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca46185b40 0x55ca46184090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb22ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca461845d0 0x55ca46184a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb237fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca46185b40 0x55ca46184090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:43416/0 (socket says 172.21.15.63:43416) 2024-09-16T01:24:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46191760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb22ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca461845d0 0x55ca46184a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:59554/0 (socket says 172.21.15.63:59554) 2024-09-16T01:24:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46191760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32998/0 (socket says 172.21.15.63:32998) 2024-09-16T01:24:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb237fe640 1 -- 172.21.15.63:0/3918857852 learned_addr learned my addr 172.21.15.63:0/3918857852 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb2b849740 1 -- 172.21.15.63:0/3918857852 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ca460ea2f0 con 0x55ca4618f370 2024-09-16T01:24:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb2b849740 1 -- 172.21.15.63:0/3918857852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ca46091cf0 con 0x55ca46185b40 2024-09-16T01:24:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb2b849740 1 -- 172.21.15.63:0/3918857852 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ca460e62b0 con 0x55ca461845d0 2024-09-16T01:24:02.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb20ff9640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb100a32c0 0x7fcb100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb237fe640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb100a32c0 0x7fcb100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb22ffd640 1 -- 172.21.15.63:0/3918857852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca46185b40 msgr2=0x55ca46184090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:02.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb22ffd640 1 --2- 172.21.15.63:0/3918857852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca46185b40 0x55ca46184090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb22ffd640 1 -- 172.21.15.63:0/3918857852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 msgr2=0x55ca46191760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:02.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.295+0000 7fcb22ffd640 1 --2- 172.21.15.63:0/3918857852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46191760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.296+0000 7fcb22ffd640 1 -- 172.21.15.63:0/3918857852 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca460763a0 con 0x55ca461845d0 2024-09-16T01:24:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.296+0000 7fcb20ff9640 1 -- 172.21.15.63:0/2840242906 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcb0c0effb0 con 0x7fcb241027c0 2024-09-16T01:24:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.296+0000 7fcb22ffd640 1 --2- 172.21.15.63:0/3918857852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca461845d0 0x55ca46184a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400abf0 tx=0x7fcb1400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2886858f8d3bb6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.296+0000 7fcb197fa640 1 -- 172.21.15.63:0/3918857852 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14005220 con 0x55ca461845d0 2024-09-16T01:24:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.296+0000 7fcb237fe640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb100a32c0 0x7fcb100a5780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005c40 tx=0x7fcb1c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.296+0000 7fcb197fa640 1 -- 172.21.15.63:0/3918857852 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb14004c50 con 0x55ca461845d0 2024-09-16T01:24:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.296+0000 7fcb197fa640 1 -- 172.21.15.63:0/3918857852 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb14018800 con 0x55ca461845d0 2024-09-16T01:24:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.297+0000 7fcb2b849740 1 -- 172.21.15.63:0/3918857852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca461845d0 msgr2=0x55ca46184a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.297+0000 7fcb2b849740 1 --2- 172.21.15.63:0/3918857852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca461845d0 0x55ca46184a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400abf0 tx=0x7fcb1400f790 comp rx=0 tx=0).stop 2024-09-16T01:24:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.297+0000 7fcb2b849740 1 -- 172.21.15.63:0/3918857852 shutdown_connections 2024-09-16T01:24:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.297+0000 7fcb2b849740 1 --2- 172.21.15.63:0/3918857852 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46191760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.297+0000 7fcb2b849740 1 --2- 172.21.15.63:0/3918857852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca461845d0 0x55ca46184a10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.297+0000 7fcb2b849740 1 --2- 172.21.15.63:0/3918857852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca46185b40 0x55ca46184090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.297+0000 7fcb2b849740 1 -- 172.21.15.63:0/3918857852 >> 172.21.15.63:0/3918857852 conn(0x55ca4614d310 msgr2=0x55ca46180c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.298+0000 7fcb2b849740 1 -- 172.21.15.63:0/3918857852 shutdown_connections 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.298+0000 7fcb2b849740 1 -- 172.21.15.63:0/3918857852 wait complete. 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.298+0000 7fcb2b849740 1 -- start start 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.298+0000 7fcb2b849740 1 Processor -- start 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb2b849740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 0x55ca4618eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb2b849740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 0x55ca4618c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb2b849740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca4618f370 0x55ca4618c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb2b849740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ca46196480 con 0x55ca461845d0 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb2b849740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ca460a5060 con 0x55ca4618f370 2024-09-16T01:24:02.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb2b849740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ca46196600 con 0x55ca46185b40 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb2b849740 10 client.0 _ll_register_callbacks cb 0x55ca45df88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb22ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 0x55ca4618eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 0x55ca4618c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb1bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 0x55ca4618c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:59566/0 (socket says 172.21.15.63:59566) 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb1bfff640 1 -- 172.21.15.63:0/3452635266 learned_addr learned my addr 172.21.15.63:0/3452635266 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb237fe640 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca4618f370 0x55ca4618c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb1bfff640 1 -- 172.21.15.63:0/3452635266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca4618f370 msgr2=0x55ca4618c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb1bfff640 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca4618f370 0x55ca4618c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb1bfff640 1 -- 172.21.15.63:0/3452635266 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 msgr2=0x55ca4618eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb1bfff640 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 0x55ca4618eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.299+0000 7fcb1bfff640 1 -- 172.21.15.63:0/3452635266 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca45e5b3c0 con 0x55ca46185b40 2024-09-16T01:24:02.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.300+0000 7fcb0a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.300+0000 7fcb1bfff640 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 0x55ca4618c010 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c006010 tx=0x7fcb0c005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=750f5c18b2932a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.300+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/3452635266 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c049070 con 0x55ca46185b40 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.300+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/3452635266 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcb0c0b8ce0 con 0x55ca46185b40 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.300+0000 7fcb2b849740 1 -- 172.21.15.63:0/3452635266 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb14004c50 con 0x55ca46185b40 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.300+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/3452635266 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcb0c0bc1b0 con 0x55ca46185b40 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.300+0000 7fcb2b849740 10 client.24892 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.300+0000 7fcb2b849740 1 -- 172.21.15.63:0/3452635266 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ca461964e0 con 0x55ca46185b40 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.301+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/3452635266 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb14004c50 con 0x55ca46185b40 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.301+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/3452635266 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcb0c0f3cb0 con 0x55ca46185b40 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.301+0000 7fcb2b849740 10 client.24892 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.301+0000 7fcb2b849740 10 client.24892 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-16T01:24:02.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.301+0000 7fcb2b849740 20 client.24892 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.301+0000 7fcb2b849740 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ca461a77d0 0x55ca461a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.301+0000 7fcb2b849740 4 client.24892 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.301+0000 7fcb2b849740 1 -- 172.21.15.63:0/3452635266 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca460f7860 con 0x55ca461a77d0 2024-09-16T01:24:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.301+0000 7fcb22ffd640 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ca461a77d0 0x55ca461a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.302+0000 7fcb22ffd640 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ca461a77d0 0x55ca461a9c00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44aed8b3536f89ca server_cookie=f0002825749d243 in_seq=0 out_seq=0 2024-09-16T01:24:02.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.302+0000 7fcb0a7fc640 10 client.24892 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:24:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.302+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/3452635266 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca460f7860 con 0x55ca461a77d0 2024-09-16T01:24:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.302+0000 7fcb0a7fc640 10 client.24892 handle_command_reply: tid=0 2024-09-16T01:24:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 client.24892 shutdown 2024-09-16T01:24:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 -- 172.21.15.63:0/3452635266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 msgr2=0x55ca4618c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 0x55ca4618c010 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c006010 tx=0x7fcb0c005c90 comp rx=0 tx=0).stop 2024-09-16T01:24:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 -- 172.21.15.63:0/3452635266 shutdown_connections 2024-09-16T01:24:02.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ca461a77d0 0x55ca461a9c00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb0a7fc640 0 client.24892 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:24:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca4618f370 0x55ca4618c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 0x55ca4618c010 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 --2- 172.21.15.63:0/3452635266 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 0x55ca4618eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 -- 172.21.15.63:0/3452635266 >> 172.21.15.63:0/3452635266 conn(0x55ca4614d310 msgr2=0x55ca46186960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:02.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 -- 172.21.15.63:0/3452635266 shutdown_connections 2024-09-16T01:24:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 1 -- 172.21.15.63:0/3452635266 wait complete. 2024-09-16T01:24:02.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.303+0000 7fcb2b849740 20 client.24892 trim_cache size 0 max 16384 2024-09-16T01:24:02.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.328+0000 7fcb2b849740 1 Processor -- start 2024-09-16T01:24:02.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.328+0000 7fcb2b849740 1 -- start start 2024-09-16T01:24:02.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb2b849740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca461845d0 0x55ca46180d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb2b849740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 0x55ca46187120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb2b849740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46187660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb2b849740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcb241adaf0 con 0x55ca4618f370 2024-09-16T01:24:02.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb2b849740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb241ab3c0 con 0x55ca461845d0 2024-09-16T01:24:02.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb2b849740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb241a91f0 con 0x55ca46185b40 2024-09-16T01:24:02.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb237fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46187660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb237fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46187660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33014/0 (socket says 172.21.15.63:33014) 2024-09-16T01:24:02.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb237fe640 1 -- 172.21.15.63:0/164612371 learned_addr learned my addr 172.21.15.63:0/164612371 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:02.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb1bfff640 1 --2- 172.21.15.63:0/164612371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 0x55ca46187120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb22ffd640 1 --2- 172.21.15.63:0/164612371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca461845d0 0x55ca46180d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb237fe640 1 -- 172.21.15.63:0/164612371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 msgr2=0x55ca46187120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:02.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb237fe640 1 --2- 172.21.15.63:0/164612371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 0x55ca46187120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb237fe640 1 -- 172.21.15.63:0/164612371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca461845d0 msgr2=0x55ca46180d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:02.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb237fe640 1 --2- 172.21.15.63:0/164612371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca461845d0 0x55ca46180d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.329+0000 7fcb237fe640 1 -- 172.21.15.63:0/164612371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca46191a90 con 0x55ca4618f370 2024-09-16T01:24:02.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.330+0000 7fcb237fe640 1 --2- 172.21.15.63:0/164612371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46187660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c014610 tx=0x7fcb1c0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547da9c0ba32320e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:02.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.330+0000 7fcb18ff9640 1 -- 172.21.15.63:0/164612371 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c02e070 con 0x55ca4618f370 2024-09-16T01:24:02.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.330+0000 7fcb18ff9640 1 -- 172.21.15.63:0/164612371 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb1c01f440 con 0x55ca4618f370 2024-09-16T01:24:02.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.330+0000 7fcb18ff9640 1 -- 172.21.15.63:0/164612371 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c01a070 con 0x55ca4618f370 2024-09-16T01:24:02.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 -- 172.21.15.63:0/164612371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 msgr2=0x55ca46187660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 --2- 172.21.15.63:0/164612371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46187660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c014610 tx=0x7fcb1c0096c0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 -- 172.21.15.63:0/164612371 shutdown_connections 2024-09-16T01:24:02.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 --2- 172.21.15.63:0/164612371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca4618f370 0x55ca46187660 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 --2- 172.21.15.63:0/164612371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca46185b40 0x55ca46187120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 --2- 172.21.15.63:0/164612371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca461845d0 0x55ca46180d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 -- 172.21.15.63:0/164612371 >> 172.21.15.63:0/164612371 conn(0x55ca4614d310 msgr2=0x55ca4618e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 -- 172.21.15.63:0/164612371 shutdown_connections 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 -- 172.21.15.63:0/164612371 wait complete. 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 -- start start 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.331+0000 7fcb2b849740 1 Processor -- start 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb2b849740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 0x55ca461a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb22ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 0x55ca461a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb22ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 0x55ca461a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33018/0 (socket says 172.21.15.63:33018) 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb22ffd640 1 -- 172.21.15.63:0/199955242 learned_addr learned my addr 172.21.15.63:0/199955242 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb2b849740 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca46185b40 0x55ca46189030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb2b849740 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca4618f370 0x55ca46189690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcb241a9880 con 0x55ca461845d0 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb241aacf0 con 0x55ca46185b40 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb241a9f50 con 0x55ca4618f370 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb2b849740 10 client.0 _ll_register_callbacks cb 0x7fcb0c0f37f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb22ffd640 1 -- 172.21.15.63:0/199955242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca4618f370 msgr2=0x55ca46189690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb22ffd640 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca4618f370 0x55ca46189690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb22ffd640 1 -- 172.21.15.63:0/199955242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca46185b40 msgr2=0x55ca46189030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb22ffd640 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca46185b40 0x55ca46189030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb22ffd640 1 -- 172.21.15.63:0/199955242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca462114b0 con 0x55ca461845d0 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb22ffd640 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 0x55ca461a4b30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55ca46181ac0 tx=0x7fcb1400a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8402e94026357f74 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.332+0000 7fcb0a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.333+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/199955242 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb140188e0 con 0x55ca461845d0 2024-09-16T01:24:02.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.333+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/199955242 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcb14018a80 con 0x55ca461845d0 2024-09-16T01:24:02.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.333+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb1c01f440 con 0x55ca461845d0 2024-09-16T01:24:02.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.333+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/199955242 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcb1403c050 con 0x55ca461845d0 2024-09-16T01:24:02.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.333+0000 7fcb2b849740 10 client.15273 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:02.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.333+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ca462125e0 con 0x55ca461845d0 2024-09-16T01:24:02.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.333+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/199955242 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb1c01f440 con 0x55ca461845d0 2024-09-16T01:24:02.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/199955242 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcb14010c50 con 0x55ca461845d0 2024-09-16T01:24:02.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb2b849740 10 client.15273 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:02.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb2b849740 10 client.15273 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-16T01:24:02.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb2b849740 20 client.15273 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:02.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb2b849740 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ca46212a50 0x55ca46214eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb2b849740 4 client.15273 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:24:02.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca460f1d70 con 0x55ca46212a50 2024-09-16T01:24:02.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb1bfff640 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ca46212a50 0x55ca46214eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb0a7fc640 10 client.15273 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb1bfff640 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ca46212a50 0x55ca46214eb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea97697dcac3798b server_cookie=efacad2b248ad769 in_seq=0 out_seq=0 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb0a7fc640 1 -- 172.21.15.63:0/199955242 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca460f1d70 con 0x55ca46212a50 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb0a7fc640 10 client.15273 handle_command_reply: tid=0 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.334+0000 7fcb2b849740 1 client.15273 shutdown 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 msgr2=0x55ca461a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 0x55ca461a4b30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55ca46181ac0 tx=0x7fcb1400a7a0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 shutdown_connections 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ca46212a50 0x55ca46214eb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ca4618f370 0x55ca46189690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca46185b40 0x55ca46189030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.343 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:24:02.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb0a7fc640 0 client.15273 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:24:02.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 1 --2- 172.21.15.63:0/199955242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ca461845d0 0x55ca461a4b30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 >> 172.21.15.63:0/199955242 conn(0x55ca4614d310 msgr2=0x55ca4617f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:02.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 shutdown_connections 2024-09-16T01:24:02.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 1 -- 172.21.15.63:0/199955242 wait complete. 2024-09-16T01:24:02.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.335+0000 7fcb2b849740 20 client.15273 trim_cache size 0 max 16384 2024-09-16T01:24:02.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb100a32c0 msgr2=0x7fcb100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb100a32c0 0x7fcb100a5780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c005c40 tx=0x7fcb1c004ab0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb241027c0 msgr2=0x7fcb24198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb241027c0 0x7fcb24198850 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c005940 tx=0x7fcb0c004270 comp rx=0 tx=0).stop 2024-09-16T01:24:02.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 shutdown_connections 2024-09-16T01:24:02.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb100a32c0 0x7fcb100a5780 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb24106f40 0x7fcb2419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb241027c0 0x7fcb24198850 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 --2- 172.21.15.63:0/2840242906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb24101e10 0x7fcb24198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 >> 172.21.15.63:0/2840242906 conn(0x7fcb240fd8d0 msgr2=0x7fcb240fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:02.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 shutdown_connections 2024-09-16T01:24:02.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:02.336+0000 7fcb29470640 1 -- 172.21.15.63:0/2840242906 wait complete. 2024-09-16T01:24:03.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-16T01:24:03.148 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:03 smithi063 ceph-mon[31070]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:24:03.391 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:03.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:03 smithi192 ceph-mon[34775]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:24:03.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:03 smithi162 ceph-mon[34539]: pgmap v356: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:24:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.935+0000 7efe0999f640 1 -- 172.21.15.63:0/4170589718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe04100a80 msgr2=0x7efe04100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.935+0000 7efe0999f640 1 --2- 172.21.15.63:0/4170589718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe04100a80 0x7efe04100ee0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009930 tx=0x7efdf802a420 comp rx=0 tx=0).stop 2024-09-16T01:24:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.935+0000 7efe0999f640 1 -- 172.21.15.63:0/4170589718 shutdown_connections 2024-09-16T01:24:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.935+0000 7efe0999f640 1 --2- 172.21.15.63:0/4170589718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe04101420 0x7efe0410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.935+0000 7efe0999f640 1 --2- 172.21.15.63:0/4170589718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe04100a80 0x7efe04100ee0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.935+0000 7efe0999f640 1 --2- 172.21.15.63:0/4170589718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe04106a80 0x7efe04106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.935+0000 7efe0999f640 1 -- 172.21.15.63:0/4170589718 >> 172.21.15.63:0/4170589718 conn(0x7efe040fc7a0 msgr2=0x7efe040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.935+0000 7efe0999f640 1 -- 172.21.15.63:0/4170589718 shutdown_connections 2024-09-16T01:24:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.936+0000 7efe0999f640 1 -- 172.21.15.63:0/4170589718 wait complete. 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.936+0000 7efe0999f640 1 Processor -- start 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe0999f640 1 -- start start 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe0999f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe04100a80 0x7efe041961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe0999f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe04101420 0x7efe041966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe0999f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe04106a80 0x7efe0419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe0999f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efe0410fc20 con 0x7efe04100a80 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe0999f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe0410faa0 con 0x7efe04106a80 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe0999f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efe0410fda0 con 0x7efe04101420 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe027fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe04101420 0x7efe041966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe027fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe04101420 0x7efe041966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:59606/0 (socket says 172.21.15.63:59606) 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe027fc640 1 -- 172.21.15.63:0/2244659509 learned_addr learned my addr 172.21.15.63:0/2244659509 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:03.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe02ffd640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe04100a80 0x7efe041961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.937+0000 7efe037fe640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe04106a80 0x7efe0419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe02ffd640 1 -- 172.21.15.63:0/2244659509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe04101420 msgr2=0x7efe041966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe02ffd640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe04101420 0x7efe041966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe02ffd640 1 -- 172.21.15.63:0/2244659509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe04106a80 msgr2=0x7efe0419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe02ffd640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe04106a80 0x7efe0419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe02ffd640 1 -- 172.21.15.63:0/2244659509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0419b150 con 0x7efe04100a80 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe02ffd640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe04100a80 0x7efe041961a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efdf400d6d0 tx=0x7efdf400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe0899d640 1 -- 172.21.15.63:0/2244659509 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4017070 con 0x7efe04100a80 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe0999f640 1 -- 172.21.15.63:0/2244659509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe0419b440 con 0x7efe04100a80 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe0999f640 1 -- 172.21.15.63:0/2244659509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe041a2d20 con 0x7efe04100a80 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe0899d640 1 -- 172.21.15.63:0/2244659509 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdf4009820 con 0x7efe04100a80 2024-09-16T01:24:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.938+0000 7efe0899d640 1 -- 172.21.15.63:0/2244659509 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4004ba0 con 0x7efe04100a80 2024-09-16T01:24:03.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.942+0000 7efe0bd78740 1 Processor -- start 2024-09-16T01:24:03.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.942+0000 7efe0bd78740 1 -- start start 2024-09-16T01:24:03.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.942+0000 7efe0899d640 1 -- 172.21.15.63:0/2244659509 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efdf4005220 con 0x7efe04100a80 2024-09-16T01:24:03.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.943+0000 7efe0899d640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7efdec0a5450 0x7efdec0a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.943+0000 7efe037fe640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7efdec0a5450 0x7efdec0a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.943+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.944+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23eceea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.944+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecf9370 0x55d23ecfb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.944+0000 7efe0899d640 1 -- 172.21.15.63:0/2244659509 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7efdf4097d90 con 0x7efe04100a80 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.944+0000 7efe0bd78740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d23ec542f0 con 0x55d23ecee5d0 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.944+0000 7efe02ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.944+0000 7efe027fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23eceea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.944+0000 7efe02ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecee090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:43460/0 (socket says 172.21.15.63:43460) 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.944+0000 7efe02ffd640 1 -- 172.21.15.63:0/2128727730 learned_addr learned my addr 172.21.15.63:0/2128727730 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.944+0000 7efe0bd78740 1 -- 172.21.15.63:0/2128727730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d23ebfbcf0 con 0x55d23ecefb40 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.944+0000 7efe0bd78740 1 -- 172.21.15.63:0/2128727730 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d23ec502b0 con 0x55d23ecf9370 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.945+0000 7efe027fc640 1 -- 172.21.15.63:0/2128727730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecf9370 msgr2=0x55d23ecfb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.945+0000 7efe027fc640 1 --2- 172.21.15.63:0/2128727730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecf9370 0x55d23ecfb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.945+0000 7efe027fc640 1 -- 172.21.15.63:0/2128727730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 msgr2=0x55d23ecee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.945+0000 7efe027fc640 1 --2- 172.21.15.63:0/2128727730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.945+0000 7efe027fc640 1 -- 172.21.15.63:0/2128727730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d23ebe03a0 con 0x55d23ecee5d0 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.945+0000 7efe037fe640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7efdec0a5450 0x7efdec0a7910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efdfc005fd0 tx=0x7efdfc009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.945+0000 7efe027fc640 1 --2- 172.21.15.63:0/2128727730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23eceea10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efdf8004770 tx=0x7efdf8031c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be540f2a881233da server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.945+0000 7efde9ffb640 1 -- 172.21.15.63:0/2128727730 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf8040070 con 0x55d23ecee5d0 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.945+0000 7efde9ffb640 1 -- 172.21.15.63:0/2128727730 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdf80316a0 con 0x55d23ecee5d0 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.946+0000 7efde9ffb640 1 -- 172.21.15.63:0/2128727730 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf8035040 con 0x55d23ecee5d0 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.946+0000 7efe0bd78740 1 -- 172.21.15.63:0/2128727730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 msgr2=0x55d23eceea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.946+0000 7efe0bd78740 1 --2- 172.21.15.63:0/2128727730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23eceea10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efdf8004770 tx=0x7efdf8031c20 comp rx=0 tx=0).stop 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.947+0000 7efe0bd78740 1 -- 172.21.15.63:0/2128727730 shutdown_connections 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.947+0000 7efe0bd78740 1 --2- 172.21.15.63:0/2128727730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecf9370 0x55d23ecfb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.947+0000 7efe0bd78740 1 --2- 172.21.15.63:0/2128727730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23eceea10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.947+0000 7efe0bd78740 1 --2- 172.21.15.63:0/2128727730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.947+0000 7efe0bd78740 1 -- 172.21.15.63:0/2128727730 >> 172.21.15.63:0/2128727730 conn(0x55d23ecb7310 msgr2=0x55d23eceac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.947+0000 7efe0bd78740 1 -- 172.21.15.63:0/2128727730 shutdown_connections 2024-09-16T01:24:03.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.947+0000 7efe0bd78740 1 -- 172.21.15.63:0/2128727730 wait complete. 2024-09-16T01:24:03.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.947+0000 7efe0bd78740 1 -- start start 2024-09-16T01:24:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.947+0000 7efe0bd78740 1 Processor -- start 2024-09-16T01:24:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecee5d0 0x55d23ecf8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecf6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecf9370 0x55d23ecf6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe0bd78740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55d23ed00420 con 0x55d23ecf9370 2024-09-16T01:24:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe0bd78740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d23ec0f060 con 0x55d23ecefb40 2024-09-16T01:24:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe0bd78740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d23ed005a0 con 0x55d23ecee5d0 2024-09-16T01:24:03.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe02ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecee5d0 0x55d23ecf8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe02ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecee5d0 0x55d23ecf8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:59610/0 (socket says 172.21.15.63:59610) 2024-09-16T01:24:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe037fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecf9370 0x55d23ecf6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe02ffd640 1 -- 172.21.15.63:0/3408283511 learned_addr learned my addr 172.21.15.63:0/3408283511 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.948+0000 7efe027fc640 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecf6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efe0bd78740 10 client.0 _ll_register_callbacks cb 0x55d23e9628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efe027fc640 1 -- 172.21.15.63:0/3408283511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecee5d0 msgr2=0x55d23ecf8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efe027fc640 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecee5d0 0x55d23ecf8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efe027fc640 1 -- 172.21.15.63:0/3408283511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecf9370 msgr2=0x55d23ecf6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efe027fc640 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecf9370 0x55d23ecf6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efe027fc640 1 -- 172.21.15.63:0/3408283511 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d23e9c53c0 con 0x55d23ecefb40 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efe0bd78740 1 -- 172.21.15.63:0/3408283511 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdf80316a0 con 0x55d23ecefb40 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efe037fe640 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecf9370 0x55d23ecf6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efe027fc640 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecf6010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efdf8005940 tx=0x7efdf8009660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f60774a8eee4eee server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efde2ffd640 10 client.24875 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.949+0000 7efde2ffd640 1 -- 172.21.15.63:0/3408283511 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf8054050 con 0x55d23ecefb40 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.950+0000 7efde2ffd640 1 -- 172.21.15.63:0/3408283511 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7efdf80053e0 con 0x55d23ecefb40 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.950+0000 7efde2ffd640 1 -- 172.21.15.63:0/3408283511 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efdf8040070 con 0x55d23ecefb40 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.950+0000 7efe0bd78740 10 client.24875 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.950+0000 7efe0bd78740 1 -- 172.21.15.63:0/3408283511 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55d23ed0be10 con 0x55d23ecefb40 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.950+0000 7efde2ffd640 1 -- 172.21.15.63:0/3408283511 <== mon.2 v2:172.21.15.162:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efdf8004030 con 0x55d23ecefb40 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.950+0000 7efe0bd78740 10 client.24875 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:03.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.950+0000 7efe0bd78740 10 client.24875 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-16T01:24:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.950+0000 7efe0bd78740 20 client.24875 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.951+0000 7efe0bd78740 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55d23ed0d160 0x55d23ed0f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.951+0000 7efe0bd78740 4 client.24875 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.951+0000 7efe0bd78740 1 -- 172.21.15.63:0/3408283511 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d23ec61860 con 0x55d23ed0d160 2024-09-16T01:24:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.951+0000 7efe02ffd640 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55d23ed0d160 0x55d23ed0f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.951+0000 7efe02ffd640 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55d23ed0d160 0x55d23ed0f550 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=553d09bcdfa1e5aa server_cookie=370ee2c40858946e in_seq=0 out_seq=0 2024-09-16T01:24:03.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.951+0000 7efde2ffd640 10 client.24875 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:24:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.952+0000 7efde2ffd640 1 -- 172.21.15.63:0/3408283511 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d23ec61860 con 0x55d23ed0d160 2024-09-16T01:24:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.952+0000 7efde2ffd640 10 client.24875 handle_command_reply: tid=0 2024-09-16T01:24:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.952+0000 7efe0bd78740 1 client.24875 shutdown 2024-09-16T01:24:03.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.952+0000 7efe0bd78740 1 -- 172.21.15.63:0/3408283511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 msgr2=0x55d23ecf6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.952+0000 7efe0bd78740 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecf6010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efdf8005940 tx=0x7efdf8009660 comp rx=0 tx=0).stop 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.953+0000 7efe0bd78740 1 -- 172.21.15.63:0/3408283511 shutdown_connections 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.953+0000 7efe0bd78740 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55d23ed0d160 0x55d23ed0f550 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.953+0000 7efe0bd78740 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecf9370 0x55d23ecf6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.953+0000 7efe0bd78740 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecf6010 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.953+0000 7efe0bd78740 1 --2- 172.21.15.63:0/3408283511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecee5d0 0x55d23ecf8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.953+0000 7efe0bd78740 1 -- 172.21.15.63:0/3408283511 >> 172.21.15.63:0/3408283511 conn(0x55d23ecb7310 msgr2=0x55d23ecf0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.953+0000 7efde2ffd640 0 client.24875 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.953+0000 7efe0bd78740 1 -- 172.21.15.63:0/3408283511 shutdown_connections 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.953+0000 7efe0bd78740 1 -- 172.21.15.63:0/3408283511 wait complete. 2024-09-16T01:24:03.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.953+0000 7efe0bd78740 20 client.24875 trim_cache size 0 max 16384 2024-09-16T01:24:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.966+0000 7efe0bd78740 1 Processor -- start 2024-09-16T01:24:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.966+0000 7efe0bd78740 1 -- start start 2024-09-16T01:24:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.966+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.966+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecefb40 0x55d23ecf7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.966+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecf9370 0x55d23ecf3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.966+0000 7efe0bd78740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efdf0010cd0 con 0x55d23ecee5d0 2024-09-16T01:24:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.966+0000 7efe0bd78740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efdf000e5a0 con 0x55d23ecf9370 2024-09-16T01:24:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.966+0000 7efe0bd78740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efdf000c3d0 con 0x55d23ecefb40 2024-09-16T01:24:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efe02ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efe02ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33060/0 (socket says 172.21.15.63:33060) 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efe02ffd640 1 -- 172.21.15.63:0/2740866118 learned_addr learned my addr 172.21.15.63:0/2740866118 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efe027fc640 1 --2- 172.21.15.63:0/2740866118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecefb40 0x55d23ecf7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efe02ffd640 1 -- 172.21.15.63:0/2740866118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecefb40 msgr2=0x55d23ecf7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efe02ffd640 1 --2- 172.21.15.63:0/2740866118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecefb40 0x55d23ecf7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efe02ffd640 1 -- 172.21.15.63:0/2740866118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecf9370 msgr2=0x55d23ecf3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efe02ffd640 1 --2- 172.21.15.63:0/2740866118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecf9370 0x55d23ecf3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efe02ffd640 1 -- 172.21.15.63:0/2740866118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d23ecf8910 con 0x55d23ecee5d0 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efe02ffd640 1 --2- 172.21.15.63:0/2740866118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed098a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000c00 tx=0x7efdf401d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8ae28d8617ac39 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.967+0000 7efde97fa640 1 -- 172.21.15.63:0/2740866118 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf40b4070 con 0x55d23ecee5d0 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efde97fa640 1 -- 172.21.15.63:0/2740866118 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdf4005510 con 0x55d23ecee5d0 2024-09-16T01:24:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efde97fa640 1 -- 172.21.15.63:0/2740866118 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4020040 con 0x55d23ecee5d0 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efe0bd78740 1 -- 172.21.15.63:0/2740866118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 msgr2=0x55d23ed098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efe0bd78740 1 --2- 172.21.15.63:0/2740866118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed098a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000c00 tx=0x7efdf401d040 comp rx=0 tx=0).stop 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efe0bd78740 1 -- 172.21.15.63:0/2740866118 shutdown_connections 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efe0bd78740 1 --2- 172.21.15.63:0/2740866118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecf9370 0x55d23ecf3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efe0bd78740 1 --2- 172.21.15.63:0/2740866118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecefb40 0x55d23ecf7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efe0bd78740 1 --2- 172.21.15.63:0/2740866118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed098a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efe0bd78740 1 -- 172.21.15.63:0/2740866118 >> 172.21.15.63:0/2740866118 conn(0x55d23ecb7310 msgr2=0x55d23ecf7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efe0bd78740 1 -- 172.21.15.63:0/2740866118 shutdown_connections 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.968+0000 7efe0bd78740 1 -- 172.21.15.63:0/2740866118 wait complete. 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.969+0000 7efe0bd78740 1 -- start start 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.969+0000 7efe0bd78740 1 Processor -- start 2024-09-16T01:24:03.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.969+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed125d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.969+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecfe930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.969+0000 7efe0bd78740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecf9370 0x55d23ecfee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.969+0000 7efe02ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.969+0000 7efe0bd78740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efdf000ca60 con 0x55d23ecee5d0 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe027fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecfe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe0bd78740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efdf000ded0 con 0x55d23ecefb40 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe02ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed125d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33062/0 (socket says 172.21.15.63:33062) 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe02ffd640 1 -- 172.21.15.63:0/1350309241 learned_addr learned my addr 172.21.15.63:0/1350309241 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe0bd78740 1 -- 172.21.15.63:0/1350309241 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efdf000d130 con 0x55d23ecf9370 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe0bd78740 10 client.0 _ll_register_callbacks cb 0x7efdf4097300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe037fe640 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecf9370 0x55d23ecfee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe02ffd640 1 -- 172.21.15.63:0/1350309241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecf9370 msgr2=0x55d23ecfee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe02ffd640 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecf9370 0x55d23ecfee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe02ffd640 1 -- 172.21.15.63:0/1350309241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 msgr2=0x55d23ecfe930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe02ffd640 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecfe930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe02ffd640 1 -- 172.21.15.63:0/1350309241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d23ecff3b0 con 0x55d23ecee5d0 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe037fe640 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecf9370 0x55d23ecfee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe02ffd640 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed125d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7efdf40afbf0 tx=0x7efdf407a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5733ad30a69413c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efde2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efde2ffd640 1 -- 172.21.15.63:0/1350309241 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4020070 con 0x55d23ecee5d0 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efde2ffd640 1 -- 172.21.15.63:0/1350309241 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7efdf4099a20 con 0x55d23ecee5d0 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.970+0000 7efe0bd78740 1 -- 172.21.15.63:0/1350309241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdf4005510 con 0x55d23ecee5d0 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efde2ffd640 1 -- 172.21.15.63:0/1350309241 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efdf40b4040 con 0x55d23ecee5d0 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efe0bd78740 10 client.15291 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efe0bd78740 1 -- 172.21.15.63:0/1350309241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d23ed11dd0 con 0x55d23ecee5d0 2024-09-16T01:24:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efde2ffd640 1 -- 172.21.15.63:0/1350309241 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdf4005510 con 0x55d23ecee5d0 2024-09-16T01:24:03.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efde2ffd640 1 -- 172.21.15.63:0/1350309241 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efdf40a0bb0 con 0x55d23ecee5d0 2024-09-16T01:24:03.980 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efe0bd78740 10 client.15291 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efe0bd78740 10 client.15291 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efe0bd78740 20 client.15291 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efe0bd78740 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55d23ed84da0 0x55d23ed871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efe0bd78740 4 client.15291 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efe0bd78740 1 -- 172.21.15.63:0/1350309241 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d23ec5bd70 con 0x55d23ed84da0 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.971+0000 7efe027fc640 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55d23ed84da0 0x55d23ed871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.972+0000 7efde2ffd640 10 client.15291 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.972+0000 7efe027fc640 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55d23ed84da0 0x55d23ed871c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11821942a28b38e server_cookie=9067c0add5991bf7 in_seq=0 out_seq=0 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.972+0000 7efde2ffd640 1 -- 172.21.15.63:0/1350309241 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d23ec5bd70 con 0x55d23ed84da0 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.972+0000 7efde2ffd640 10 client.15291 handle_command_reply: tid=0 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.972+0000 7efe0bd78740 1 client.15291 shutdown 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.972+0000 7efe0bd78740 1 -- 172.21.15.63:0/1350309241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 msgr2=0x55d23ed125d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.972+0000 7efe0bd78740 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed125d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7efdf40afbf0 tx=0x7efdf407a150 comp rx=0 tx=0).stop 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.972+0000 7efe0bd78740 1 -- 172.21.15.63:0/1350309241 shutdown_connections 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.972+0000 7efe0bd78740 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55d23ed84da0 0x55d23ed871c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0bd78740 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d23ecf9370 0x55d23ecfee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0bd78740 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d23ecefb40 0x55d23ecfe930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0bd78740 1 --2- 172.21.15.63:0/1350309241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55d23ecee5d0 0x55d23ed125d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0bd78740 1 -- 172.21.15.63:0/1350309241 >> 172.21.15.63:0/1350309241 conn(0x55d23ecb7310 msgr2=0x55d23ecf0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efde2ffd640 0 client.15291 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0bd78740 1 -- 172.21.15.63:0/1350309241 shutdown_connections 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0bd78740 1 -- 172.21.15.63:0/1350309241 wait complete. 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0bd78740 20 client.15291 trim_cache size 0 max 16384 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0999f640 1 -- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7efdec0a5450 msgr2=0x7efdec0a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0999f640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7efdec0a5450 0x7efdec0a7910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efdfc005fd0 tx=0x7efdfc009600 comp rx=0 tx=0).stop 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0999f640 1 -- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe04100a80 msgr2=0x7efe041961a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0999f640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe04100a80 0x7efe041961a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efdf400d6d0 tx=0x7efdf400db90 comp rx=0 tx=0).stop 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0999f640 1 -- 172.21.15.63:0/2244659509 shutdown_connections 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0999f640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7efdec0a5450 0x7efdec0a7910 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0999f640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe04106a80 0x7efe0419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0999f640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe04101420 0x7efe041966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0999f640 1 --2- 172.21.15.63:0/2244659509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe04100a80 0x7efe041961a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.973+0000 7efe0999f640 1 -- 172.21.15.63:0/2244659509 >> 172.21.15.63:0/2244659509 conn(0x7efe040fc7a0 msgr2=0x7efe040fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.974+0000 7efe0999f640 1 -- 172.21.15.63:0/2244659509 shutdown_connections 2024-09-16T01:24:03.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:03.974+0000 7efe0999f640 1 -- 172.21.15.63:0/2244659509 wait complete. 2024-09-16T01:24:04.787 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-16T01:24:05.069 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:05 smithi063 ceph-mon[31070]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:24:05.201 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:05 smithi192 ceph-mon[34775]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:24:05.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:05 smithi162 ceph-mon[34539]: pgmap v357: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:24:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.772+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/2366411018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e14106a80 msgr2=0x7f5e14106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.772+0000 7f5e1bcd9640 1 --2- 172.21.15.63:0/2366411018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e14106a80 0x7f5e14106e60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009930 tx=0x7f5e1002a420 comp rx=0 tx=0).stop 2024-09-16T01:24:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.772+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/2366411018 shutdown_connections 2024-09-16T01:24:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.772+0000 7f5e1bcd9640 1 --2- 172.21.15.63:0/2366411018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e14101420 0x7f5e1410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.772+0000 7f5e1bcd9640 1 --2- 172.21.15.63:0/2366411018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14100a80 0x7f5e14100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.772+0000 7f5e1bcd9640 1 --2- 172.21.15.63:0/2366411018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e14106a80 0x7f5e14106e60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.772+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/2366411018 >> 172.21.15.63:0/2366411018 conn(0x7f5e140fc7a0 msgr2=0x7f5e140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.772+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/2366411018 shutdown_connections 2024-09-16T01:24:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.773+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/2366411018 wait complete. 2024-09-16T01:24:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.774+0000 7f5e1bcd9640 1 Processor -- start 2024-09-16T01:24:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.774+0000 7f5e1bcd9640 1 -- start start 2024-09-16T01:24:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.774+0000 7f5e1bcd9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e14100a80 0x7f5e14196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.774+0000 7f5e1bcd9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14101420 0x7f5e141966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e1bcd9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e14106a80 0x7f5e1419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e1bcd9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1410fc80 con 0x7f5e14100a80 2024-09-16T01:24:05.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e1bcd9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1410fb00 con 0x7f5e14106a80 2024-09-16T01:24:05.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e19a75640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e14100a80 0x7f5e14196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e1bcd9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1410fe00 con 0x7f5e14101420 2024-09-16T01:24:05.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e19a75640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e14100a80 0x7f5e14196180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33090/0 (socket says 172.21.15.63:33090) 2024-09-16T01:24:05.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e19a75640 1 -- 172.21.15.63:0/3558217197 learned_addr learned my addr 172.21.15.63:0/3558217197 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e19274640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14101420 0x7f5e141966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e1a276640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e14106a80 0x7f5e1419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e19274640 1 -- 172.21.15.63:0/3558217197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e14106a80 msgr2=0x7f5e1419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e19274640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e14106a80 0x7f5e1419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e19274640 1 -- 172.21.15.63:0/3558217197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e14100a80 msgr2=0x7f5e14196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e19274640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e14100a80 0x7f5e14196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e19274640 1 -- 172.21.15.63:0/3558217197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1419b130 con 0x7f5e14101420 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.775+0000 7f5e19274640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14101420 0x7f5e141966c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400a870 tx=0x7f5e0400ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.776+0000 7f5e0affd640 1 -- 172.21.15.63:0/3558217197 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e040079b0 con 0x7f5e14101420 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.776+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/3558217197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1419b420 con 0x7f5e14101420 2024-09-16T01:24:05.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.776+0000 7f5e0affd640 1 -- 172.21.15.63:0/3558217197 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e04005020 con 0x7f5e14101420 2024-09-16T01:24:05.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.777+0000 7f5e0affd640 1 -- 172.21.15.63:0/3558217197 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04004cc0 con 0x7f5e14101420 2024-09-16T01:24:05.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.777+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/3558217197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e141a2d00 con 0x7f5e14101420 2024-09-16T01:24:05.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.779+0000 7f5e0affd640 1 -- 172.21.15.63:0/3558217197 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5e040051d0 con 0x7f5e14101420 2024-09-16T01:24:05.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.780+0000 7f5e1e0b2740 1 Processor -- start 2024-09-16T01:24:05.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.780+0000 7f5e1e0b2740 1 -- start start 2024-09-16T01:24:05.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f00b40 0x563955eff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955effa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955f0c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e1e0b2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563955e652f0 con 0x563955eff5d0 2024-09-16T01:24:05.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e1e0b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563955e0ccf0 con 0x563955f0a370 2024-09-16T01:24:05.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e1e0b2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563955e612b0 con 0x563955f00b40 2024-09-16T01:24:05.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e0affd640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e000a32c0 0x7f5e000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e19a75640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955effa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e19a75640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955effa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33094/0 (socket says 172.21.15.63:33094) 2024-09-16T01:24:05.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e19a75640 1 -- 172.21.15.63:0/2016783951 learned_addr learned my addr 172.21.15.63:0/2016783951 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:05.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e19274640 1 --2- 172.21.15.63:0/2016783951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955f0c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e19a75640 1 -- 172.21.15.63:0/2016783951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f00b40 msgr2=0x563955eff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e19a75640 1 --2- 172.21.15.63:0/2016783951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f00b40 0x563955eff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e19a75640 1 -- 172.21.15.63:0/2016783951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 msgr2=0x563955f0c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e19a75640 1 --2- 172.21.15.63:0/2016783951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955f0c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e19a75640 1 -- 172.21.15.63:0/2016783951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563955df13a0 con 0x563955eff5d0 2024-09-16T01:24:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.781+0000 7f5e0affd640 1 -- 172.21.15.63:0/3558217197 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5e040cec20 con 0x7f5e14101420 2024-09-16T01:24:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.782+0000 7f5e19a75640 1 --2- 172.21.15.63:0/2016783951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955effa10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009900 tx=0x7f5e10004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d213a5bac7800108 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.782+0000 7f5e1a276640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e000a32c0 0x7f5e000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.782+0000 7f5dfffff640 1 -- 172.21.15.63:0/2016783951 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10040070 con 0x563955eff5d0 2024-09-16T01:24:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.782+0000 7f5dfffff640 1 -- 172.21.15.63:0/2016783951 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e100054d0 con 0x563955eff5d0 2024-09-16T01:24:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.783+0000 7f5dfffff640 1 -- 172.21.15.63:0/2016783951 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10035040 con 0x563955eff5d0 2024-09-16T01:24:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.783+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2016783951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 msgr2=0x563955effa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.783+0000 7f5e1a276640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e000a32c0 0x7f5e000a5780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c005fd0 tx=0x7f5e0c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.783+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/2016783951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955effa10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009900 tx=0x7f5e10004170 comp rx=0 tx=0).stop 2024-09-16T01:24:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.783+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2016783951 shutdown_connections 2024-09-16T01:24:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.783+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/2016783951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955f0c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.783+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/2016783951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955effa10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.783+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/2016783951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f00b40 0x563955eff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.784+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2016783951 >> 172.21.15.63:0/2016783951 conn(0x563955ec8310 msgr2=0x563955efbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.784+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2016783951 shutdown_connections 2024-09-16T01:24:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.784+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2016783951 wait complete. 2024-09-16T01:24:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.784+0000 7f5e1e0b2740 1 -- start start 2024-09-16T01:24:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.784+0000 7f5e1e0b2740 1 Processor -- start 2024-09-16T01:24:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.785+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f09db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.785+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f00b40 0x563955f07060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.785+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955f077f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.785+0000 7f5e1e0b2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563955f0d010 con 0x563955eff5d0 2024-09-16T01:24:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.785+0000 7f5e19a75640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f09db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e19a75640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f09db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33102/0 (socket says 172.21.15.63:33102) 2024-09-16T01:24:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e19a75640 1 -- 172.21.15.63:0/648752660 learned_addr learned my addr 172.21.15.63:0/648752660 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/648752660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563955e20060 con 0x563955f0a370 2024-09-16T01:24:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/648752660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563955f0d190 con 0x563955f00b40 2024-09-16T01:24:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e1a276640 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955f077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e19274640 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f00b40 0x563955f07060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e1e0b2740 10 client.0 _ll_register_callbacks cb 0x563955b738c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e1a276640 1 -- 172.21.15.63:0/648752660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f00b40 msgr2=0x563955f07060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e1a276640 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f00b40 0x563955f07060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e1a276640 1 -- 172.21.15.63:0/648752660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 msgr2=0x563955f09db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e1a276640 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f09db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e1a276640 1 -- 172.21.15.63:0/648752660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563955bd63c0 con 0x563955f0a370 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5e1a276640 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955f077f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00eec0 tx=0x7f5e0c01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41f7b734d45ce1f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5dfd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.786+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/648752660 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c02b060 con 0x563955f0a370 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.787+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/648752660 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5e0c01bb50 con 0x563955f0a370 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.787+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/648752660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e100054d0 con 0x563955f0a370 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.787+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/648752660 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5e0c01bd50 con 0x563955f0a370 2024-09-16T01:24:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.787+0000 7f5e1e0b2740 10 client.24890 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.787+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/648752660 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563955f18b20 con 0x563955f0a370 2024-09-16T01:24:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.788+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/648752660 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e0c022040 con 0x563955f0a370 2024-09-16T01:24:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.788+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/648752660 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5e0c005810 con 0x563955f0a370 2024-09-16T01:24:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.788+0000 7f5e1e0b2740 10 client.24890 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.788+0000 7f5e1e0b2740 10 client.24890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.788+0000 7f5e1e0b2740 20 client.24890 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.788+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563955f1a3c0 0x563955f1c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.788+0000 7f5e1e0b2740 4 client.24890 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.788+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/648752660 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5e100054d0 con 0x563955f1a3c0 2024-09-16T01:24:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.788+0000 7f5e19a75640 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563955f1a3c0 0x563955f1c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.789+0000 7f5dfd7fa640 10 client.24890 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:05.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.789+0000 7f5e19a75640 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563955f1a3c0 0x563955f1c860 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aafe8a3aae52a0ff server_cookie=f47195c6c87ded66 in_seq=0 out_seq=0 2024-09-16T01:24:05.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.790+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/648752660 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5e100054d0 con 0x563955f1a3c0 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.790+0000 7f5dfd7fa640 10 client.24890 handle_command_reply: tid=0 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.790+0000 7f5e1e0b2740 1 client.24890 shutdown 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.790+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/648752660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 msgr2=0x563955f077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.790+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955f077f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00eec0 tx=0x7f5e0c01a000 comp rx=0 tx=0).stop 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.791+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/648752660 shutdown_connections 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.791+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955f077f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.791+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f00b40 0x563955f07060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.791+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563955f1a3c0 0x563955f1c860 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.791+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/648752660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f09db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.791+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/648752660 >> 172.21.15.63:0/648752660 conn(0x563955ec8310 msgr2=0x563955f01960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.791+0000 7f5dfd7fa640 0 client.24890 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.791+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/648752660 shutdown_connections 2024-09-16T01:24:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.791+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/648752660 wait complete. 2024-09-16T01:24:05.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.791+0000 7f5e1e0b2740 20 client.24890 trim_cache size 0 max 16384 2024-09-16T01:24:05.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.817+0000 7f5e1e0b2740 1 Processor -- start 2024-09-16T01:24:05.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.817+0000 7f5e1e0b2740 1 -- start start 2024-09-16T01:24:05.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.817+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955eff5d0 0x563955eff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.817+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955f00b40 0x563955efb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.817+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955efbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.817+0000 7f5e1e0b2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5e141adc20 con 0x563955f00b40 2024-09-16T01:24:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.817+0000 7f5e1e0b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5e141ab4f0 con 0x563955f0a370 2024-09-16T01:24:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.817+0000 7f5e1e0b2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e141a9320 con 0x563955eff5d0 2024-09-16T01:24:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e19274640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955f00b40 0x563955efb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e19274640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955f00b40 0x563955efb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33110/0 (socket says 172.21.15.63:33110) 2024-09-16T01:24:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e19274640 1 -- 172.21.15.63:0/275160567 learned_addr learned my addr 172.21.15.63:0/275160567 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e1a276640 1 --2- 172.21.15.63:0/275160567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955efbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e19a75640 1 --2- 172.21.15.63:0/275160567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955eff5d0 0x563955eff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e1a276640 1 -- 172.21.15.63:0/275160567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955eff5d0 msgr2=0x563955eff9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e1a276640 1 --2- 172.21.15.63:0/275160567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955eff5d0 0x563955eff9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e1a276640 1 -- 172.21.15.63:0/275160567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955f00b40 msgr2=0x563955efb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e1a276640 1 --2- 172.21.15.63:0/275160567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955f00b40 0x563955efb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e1a276640 1 -- 172.21.15.63:0/275160567 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563955f0d180 con 0x563955f0a370 2024-09-16T01:24:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e19274640 1 --2- 172.21.15.63:0/275160567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955f00b40 0x563955efb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:05.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.818+0000 7f5e1a276640 1 --2- 172.21.15.63:0/275160567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955efbc40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c026670 tx=0x7f5e0c026880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf54e8bc61a72126 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.819+0000 7f5dff7fe640 1 -- 172.21.15.63:0/275160567 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c035040 con 0x563955f0a370 2024-09-16T01:24:05.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.819+0000 7f5dff7fe640 1 -- 172.21.15.63:0/275160567 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e0c026d90 con 0x563955f0a370 2024-09-16T01:24:05.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.819+0000 7f5dff7fe640 1 -- 172.21.15.63:0/275160567 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c005360 con 0x563955f0a370 2024-09-16T01:24:05.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/275160567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 msgr2=0x563955efbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/275160567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955efbc40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c026670 tx=0x7f5e0c026880 comp rx=0 tx=0).stop 2024-09-16T01:24:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/275160567 shutdown_connections 2024-09-16T01:24:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/275160567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f0a370 0x563955efbc40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/275160567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955f00b40 0x563955efb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/275160567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955eff5d0 0x563955eff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/275160567 >> 172.21.15.63:0/275160567 conn(0x563955ec8310 msgr2=0x563955ef6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/275160567 shutdown_connections 2024-09-16T01:24:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/275160567 wait complete. 2024-09-16T01:24:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 -- start start 2024-09-16T01:24:05.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.820+0000 7f5e1e0b2740 1 Processor -- start 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f12c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f00b40 0x563955f0df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e19a75640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f12c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e1e0b2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f0a370 0x563955f0e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e19a75640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f12c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33118/0 (socket says 172.21.15.63:33118) 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e19a75640 1 -- 172.21.15.63:0/2946760706 learned_addr learned my addr 172.21.15.63:0/2946760706 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5e141a99b0 con 0x563955eff5d0 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5e141aae20 con 0x563955f00b40 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e141aa080 con 0x563955f0a370 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e19274640 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f00b40 0x563955f0df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.821+0000 7f5e1e0b2740 10 client.0 _ll_register_callbacks cb 0x7f5e0c009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:05.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5e19a75640 1 -- 172.21.15.63:0/2946760706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f0a370 msgr2=0x563955f0e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5e19a75640 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f0a370 0x563955f0e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5e19a75640 1 -- 172.21.15.63:0/2946760706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f00b40 msgr2=0x563955f0df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5e19a75640 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f00b40 0x563955f0df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5e19a75640 1 -- 172.21.15.63:0/2946760706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563955f0ed00 con 0x563955eff5d0 2024-09-16T01:24:05.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5e19274640 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f00b40 0x563955f0df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:05.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5e19a75640 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f12c20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5e1002a460 tx=0x7f5e10005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f866da1aef5aadbd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5dfd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:24:05.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/2946760706 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10040040 con 0x563955eff5d0 2024-09-16T01:24:05.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e0c026d90 con 0x563955eff5d0 2024-09-16T01:24:05.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/2946760706 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5e10004d40 con 0x563955eff5d0 2024-09-16T01:24:05.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/2946760706 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5e10000e60 con 0x563955eff5d0 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5e1e0b2740 10 client.15309 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.822+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563955f851a0 con 0x563955eff5d0 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.823+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/2946760706 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5e0c026d90 con 0x563955eff5d0 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.823+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/2946760706 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5e1004e070 con 0x563955eff5d0 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.823+0000 7f5e1e0b2740 10 client.15309 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.823+0000 7f5e1e0b2740 10 client.15309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.823+0000 7f5e1e0b2740 20 client.15309 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.823+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563955f85490 0x563955f87880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.823+0000 7f5e1e0b2740 4 client.15309 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.823+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563955e72860 con 0x563955f85490 2024-09-16T01:24:05.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.823+0000 7f5e19274640 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563955f85490 0x563955f87880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e19274640 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563955f85490 0x563955f87880 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba882a0918e1cfc6 server_cookie=94230ad7c0b00def in_seq=0 out_seq=0 2024-09-16T01:24:05.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5dfd7fa640 10 client.15309 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:05.832 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:24:05.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5dfd7fa640 1 -- 172.21.15.63:0/2946760706 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563955e72860 con 0x563955f85490 2024-09-16T01:24:05.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5dfd7fa640 10 client.15309 handle_command_reply: tid=0 2024-09-16T01:24:05.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e1e0b2740 1 client.15309 shutdown 2024-09-16T01:24:05.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 msgr2=0x563955f12c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f12c20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5e1002a460 tx=0x7f5e10005e70 comp rx=0 tx=0).stop 2024-09-16T01:24:05.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 shutdown_connections 2024-09-16T01:24:05.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563955f0a370 0x563955f0e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563955f00b40 0x563955f0df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563955f85490 0x563955f87880 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e1e0b2740 1 --2- 172.21.15.63:0/2946760706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563955eff5d0 0x563955f12c20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5dfd7fa640 0 client.15309 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:05.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 >> 172.21.15.63:0/2946760706 conn(0x563955ec8310 msgr2=0x563955efb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.824+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 shutdown_connections 2024-09-16T01:24:05.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.825+0000 7f5e1e0b2740 1 -- 172.21.15.63:0/2946760706 wait complete. 2024-09-16T01:24:05.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.825+0000 7f5e1e0b2740 20 client.15309 trim_cache size 0 max 16384 2024-09-16T01:24:05.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.825+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/3558217197 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e000a32c0 msgr2=0x7f5e000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.825+0000 7f5e1bcd9640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e000a32c0 0x7f5e000a5780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c005fd0 tx=0x7f5e0c009500 comp rx=0 tx=0).stop 2024-09-16T01:24:05.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.825+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/3558217197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14101420 msgr2=0x7f5e141966c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.825+0000 7f5e1bcd9640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14101420 0x7f5e141966c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400a870 tx=0x7f5e0400ad30 comp rx=0 tx=0).stop 2024-09-16T01:24:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.826+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/3558217197 shutdown_connections 2024-09-16T01:24:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.826+0000 7f5e1bcd9640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5e000a32c0 0x7f5e000a5780 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.826+0000 7f5e1bcd9640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e14106a80 0x7f5e1419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.826+0000 7f5e1bcd9640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e14101420 0x7f5e141966c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.826+0000 7f5e1bcd9640 1 --2- 172.21.15.63:0/3558217197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e14100a80 0x7f5e14196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.826+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/3558217197 >> 172.21.15.63:0/3558217197 conn(0x7f5e140fc7a0 msgr2=0x7f5e140fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.826+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/3558217197 shutdown_connections 2024-09-16T01:24:05.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:05.826+0000 7f5e1bcd9640 1 -- 172.21.15.63:0/3558217197 wait complete. 2024-09-16T01:24:07.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:07 smithi063 ceph-mon[31070]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:24:07.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:07 smithi192 ceph-mon[34775]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:24:07.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:07 smithi162 ceph-mon[34539]: pgmap v358: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:24:07.623 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-16T01:24:07.624 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-16T01:24:07.924 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.506+0000 7f5467d8b640 1 -- 172.21.15.63:0/61501966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5460100e20 msgr2=0x7f5460101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.506+0000 7f5467d8b640 1 --2- 172.21.15.63:0/61501966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5460100e20 0x7f5460101200 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f545c009900 tx=0x7f545c02a480 comp rx=0 tx=0).stop 2024-09-16T01:24:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.506+0000 7f5467d8b640 1 -- 172.21.15.63:0/61501966 shutdown_connections 2024-09-16T01:24:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.506+0000 7f5467d8b640 1 --2- 172.21.15.63:0/61501966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5460102ef0 0x7f546010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.506+0000 7f5467d8b640 1 --2- 172.21.15.63:0/61501966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5460102570 0x7f54601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.506+0000 7f5467d8b640 1 --2- 172.21.15.63:0/61501966 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5460100e20 0x7f5460101200 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.506+0000 7f5467d8b640 1 -- 172.21.15.63:0/61501966 >> 172.21.15.63:0/61501966 conn(0x7f54600fc7d0 msgr2=0x7f54600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:08.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.506+0000 7f5467d8b640 1 -- 172.21.15.63:0/61501966 shutdown_connections 2024-09-16T01:24:08.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.506+0000 7f5467d8b640 1 -- 172.21.15.63:0/61501966 wait complete. 2024-09-16T01:24:08.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.507+0000 7f5467d8b640 1 Processor -- start 2024-09-16T01:24:08.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.507+0000 7f5467d8b640 1 -- start start 2024-09-16T01:24:08.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.507+0000 7f5467d8b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5460100e20 0x7f5460196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.507+0000 7f5467d8b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5460102570 0x7f5460196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5467d8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5460102ef0 0x7f546019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5467d8b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f546010fd70 con 0x7f5460102570 2024-09-16T01:24:08.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5467d8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f546010fbf0 con 0x7f5460102ef0 2024-09-16T01:24:08.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5467d8b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f546010fef0 con 0x7f5460100e20 2024-09-16T01:24:08.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5465b27640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5460100e20 0x7f5460196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5465b27640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5460100e20 0x7f5460196230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:37034/0 (socket says 172.21.15.63:37034) 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5465b27640 1 -- 172.21.15.63:0/2698492453 learned_addr learned my addr 172.21.15.63:0/2698492453 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5465326640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5460102570 0x7f5460196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5466328640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5460102ef0 0x7f546019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5465326640 1 -- 172.21.15.63:0/2698492453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5460100e20 msgr2=0x7f5460196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5465326640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5460100e20 0x7f5460196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5465326640 1 -- 172.21.15.63:0/2698492453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5460102ef0 msgr2=0x7f546019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5465326640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5460102ef0 0x7f546019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.508+0000 7f5465326640 1 -- 172.21.15.63:0/2698492453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546019b1e0 con 0x7f5460102570 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.509+0000 7f5466328640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5460102ef0 0x7f546019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.509+0000 7f5465326640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5460102570 0x7f5460196770 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5450005fd0 tx=0x7f545000ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.509+0000 7f5456ffd640 1 -- 172.21.15.63:0/2698492453 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5450019070 con 0x7f5460102570 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.509+0000 7f5467d8b640 1 -- 172.21.15.63:0/2698492453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f546019b4d0 con 0x7f5460102570 2024-09-16T01:24:08.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.509+0000 7f5456ffd640 1 -- 172.21.15.63:0/2698492453 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54500079b0 con 0x7f5460102570 2024-09-16T01:24:08.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.509+0000 7f5456ffd640 1 -- 172.21.15.63:0/2698492453 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5450003b60 con 0x7f5460102570 2024-09-16T01:24:08.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.509+0000 7f5467d8b640 1 -- 172.21.15.63:0/2698492453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54601a2db0 con 0x7f5460102570 2024-09-16T01:24:08.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.513+0000 7f546a164740 1 Processor -- start 2024-09-16T01:24:08.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.513+0000 7f546a164740 1 -- start start 2024-09-16T01:24:08.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.513+0000 7f5456ffd640 1 -- 172.21.15.63:0/2698492453 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f545001c070 con 0x7f5460102570 2024-09-16T01:24:08.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.513+0000 7f546a164740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110964f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.513+0000 7f546a164740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 0x56311096f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.513+0000 7f546a164740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56311096fd40 0x563110972130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.513+0000 7f546a164740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5631108ca280 con 0x56311096fd40 2024-09-16T01:24:08.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.513+0000 7f546a164740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563110871b10 con 0x563110964b60 2024-09-16T01:24:08.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.513+0000 7f546a164740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5631108c6240 con 0x563110965480 2024-09-16T01:24:08.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.514+0000 7f5466328640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110964f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.514+0000 7f5466328640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110964f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:38846/0 (socket says 172.21.15.63:38846) 2024-09-16T01:24:08.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.514+0000 7f5466328640 1 -- 172.21.15.63:0/1870838638 learned_addr learned my addr 172.21.15.63:0/1870838638 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:08.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.514+0000 7f5465326640 1 --2- 172.21.15.63:0/1870838638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56311096fd40 0x563110972130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.514+0000 7f5465b27640 1 --2- 172.21.15.63:0/1870838638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 0x56311096f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f5466328640 1 -- 172.21.15.63:0/1870838638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 msgr2=0x56311096f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f5466328640 1 --2- 172.21.15.63:0/1870838638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 0x56311096f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f5466328640 1 -- 172.21.15.63:0/1870838638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56311096fd40 msgr2=0x563110972130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f5466328640 1 --2- 172.21.15.63:0/1870838638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56311096fd40 0x563110972130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f5466328640 1 -- 172.21.15.63:0/1870838638 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311087e1f0 con 0x563110964b60 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f5465326640 1 --2- 172.21.15.63:0/1870838638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56311096fd40 0x563110972130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f5466328640 1 --2- 172.21.15.63:0/1870838638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110964f40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5458009f70 tx=0x7f545800f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be471f28e583cd38 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f544bfff640 1 -- 172.21.15.63:0/1870838638 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458003b70 con 0x563110964b60 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f544bfff640 1 -- 172.21.15.63:0/1870838638 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5458003d10 con 0x563110964b60 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f544bfff640 1 -- 172.21.15.63:0/1870838638 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5458016950 con 0x563110964b60 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.515+0000 7f5456ffd640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f544c0a3340 0x7f544c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.516+0000 7f5465b27640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f544c0a3340 0x7f544c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.516+0000 7f5456ffd640 1 -- 172.21.15.63:0/2698492453 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f54500cec30 con 0x7f5460102570 2024-09-16T01:24:08.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.517+0000 7f546a164740 1 -- 172.21.15.63:0/1870838638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 msgr2=0x563110964f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.517+0000 7f5465b27640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f544c0a3340 0x7f544c0a5800 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f545c0096c0 tx=0x7f545c040040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.517+0000 7f546a164740 1 --2- 172.21.15.63:0/1870838638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110964f40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5458009f70 tx=0x7f545800f7f0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.517+0000 7f546a164740 1 -- 172.21.15.63:0/1870838638 shutdown_connections 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.517+0000 7f546a164740 1 --2- 172.21.15.63:0/1870838638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56311096fd40 0x563110972130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.517+0000 7f546a164740 1 --2- 172.21.15.63:0/1870838638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 0x56311096f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.517+0000 7f546a164740 1 --2- 172.21.15.63:0/1870838638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110964f40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.517+0000 7f546a164740 1 -- 172.21.15.63:0/1870838638 >> 172.21.15.63:0/1870838638 conn(0x5631109610f0 msgr2=0x5631109614d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.517+0000 7f546a164740 1 -- 172.21.15.63:0/1870838638 shutdown_connections 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.517+0000 7f546a164740 1 -- 172.21.15.63:0/1870838638 wait complete. 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.518+0000 7f546a164740 1 -- start start 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.518+0000 7f546a164740 1 Processor -- start 2024-09-16T01:24:08.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.518+0000 7f546a164740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.518+0000 7f546a164740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 0x56311096d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465b27640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465b27640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34912/0 (socket says 172.21.15.63:34912) 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465b27640 1 -- 172.21.15.63:0/659868470 learned_addr learned my addr 172.21.15.63:0/659868470 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f546a164740 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56311096fd40 0x56311096d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563110972910 con 0x563110964b60 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563110884f10 con 0x56311096fd40 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563110972a90 con 0x563110965480 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465326640 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 0x56311096d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f546a164740 10 client.0 _ll_register_callbacks cb 0x56311084da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5466328640 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56311096fd40 0x56311096d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465326640 1 -- 172.21.15.63:0/659868470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56311096fd40 msgr2=0x56311096d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465326640 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56311096fd40 0x56311096d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465326640 1 -- 172.21.15.63:0/659868470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 msgr2=0x56311096cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465326640 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465326640 1 -- 172.21.15.63:0/659868470 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311063b6a0 con 0x563110965480 2024-09-16T01:24:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465b27640 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f5465326640 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 0x56311096d140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x563110962470 tx=0x7f545009b0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f33715af7e20f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.519+0000 7f54497fa640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:24:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.520+0000 7f54497fa640 1 -- 172.21.15.63:0/659868470 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545009b910 con 0x563110965480 2024-09-16T01:24:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.520+0000 7f54497fa640 1 -- 172.21.15.63:0/659868470 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f54500bb0d0 con 0x563110965480 2024-09-16T01:24:08.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.520+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5458003d10 con 0x563110965480 2024-09-16T01:24:08.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.520+0000 7f54497fa640 1 -- 172.21.15.63:0/659868470 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f54500bb2d0 con 0x563110965480 2024-09-16T01:24:08.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.520+0000 7f546a164740 10 client.24934 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:08.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.520+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56311097e530 con 0x563110965480 2024-09-16T01:24:08.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.520+0000 7f54497fa640 1 -- 172.21.15.63:0/659868470 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54500b9e50 con 0x563110965480 2024-09-16T01:24:08.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.521+0000 7f54497fa640 1 -- 172.21.15.63:0/659868470 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f545009f150 con 0x563110965480 2024-09-16T01:24:08.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.521+0000 7f546a164740 10 client.24934 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:08.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.521+0000 7f546a164740 10 client.24934 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:08.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.521+0000 7f546a164740 20 client.24934 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:08.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.521+0000 7f546a164740 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56311097f9f0 0x563110981de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.521+0000 7f546a164740 4 client.24934 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:08.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.521+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5458003d10 con 0x56311097f9f0 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.522+0000 7f5465b27640 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56311097f9f0 0x563110981de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.522+0000 7f54497fa640 10 client.24934 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.522+0000 7f5465b27640 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56311097f9f0 0x563110981de0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54397fb1c4fa69b server_cookie=1fd70857bd6dd3c0 in_seq=0 out_seq=0 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f54497fa640 1 -- 172.21.15.63:0/659868470 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5458003d10 con 0x56311097f9f0 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f54497fa640 10 client.24934 handle_command_reply: tid=0 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 client.24934 shutdown 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 msgr2=0x56311096d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 0x56311096d140 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x563110962470 tx=0x7f545009b0a0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 shutdown_connections 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56311096fd40 0x56311096d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563110965480 0x56311096d140 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56311097f9f0 0x563110981de0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 --2- 172.21.15.63:0/659868470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f54497fa640 0 client.24934 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:08.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 >> 172.21.15.63:0/659868470 conn(0x5631109610f0 msgr2=0x563110960270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:08.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 shutdown_connections 2024-09-16T01:24:08.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 1 -- 172.21.15.63:0/659868470 wait complete. 2024-09-16T01:24:08.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.523+0000 7f546a164740 20 client.24934 trim_cache size 0 max 16384 2024-09-16T01:24:08.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.558+0000 7f546a164740 1 Processor -- start 2024-09-16T01:24:08.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.558+0000 7f546a164740 1 -- start start 2024-09-16T01:24:08.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f546a164740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f546a164740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110965480 0x563110987640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f546a164740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 0x563110987b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f546a164740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f54601adcd0 con 0x563110964b60 2024-09-16T01:24:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f546a164740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54601ab5a0 con 0x563110965480 2024-09-16T01:24:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f546a164740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54601a93d0 con 0x56311096fd40 2024-09-16T01:24:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f5465b27640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f5465b27640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34922/0 (socket says 172.21.15.63:34922) 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f5465b27640 1 -- 172.21.15.63:0/1318292229 learned_addr learned my addr 172.21.15.63:0/1318292229 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f5466328640 1 --2- 172.21.15.63:0/1318292229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 0x563110987b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f5465b27640 1 -- 172.21.15.63:0/1318292229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 msgr2=0x563110987b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f5465b27640 1 --2- 172.21.15.63:0/1318292229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 0x563110987b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f5465b27640 1 -- 172.21.15.63:0/1318292229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110965480 msgr2=0x563110987640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f5465b27640 1 --2- 172.21.15.63:0/1318292229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110965480 0x563110987640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f5465b27640 1 -- 172.21.15.63:0/1318292229 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311096f4d0 con 0x563110964b60 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.559+0000 7f5466328640 1 --2- 172.21.15.63:0/1318292229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 0x563110987b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.560+0000 7f5465b27640 1 --2- 172.21.15.63:0/1318292229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096ea60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f545c0045e0 tx=0x7f545c048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf46f8df9be16225 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.560+0000 7f544b7fe640 1 -- 172.21.15.63:0/1318292229 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c035040 con 0x563110964b60 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.560+0000 7f544b7fe640 1 -- 172.21.15.63:0/1318292229 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f545c0046c0 con 0x563110964b60 2024-09-16T01:24:08.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.560+0000 7f544b7fe640 1 -- 172.21.15.63:0/1318292229 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c003830 con 0x563110964b60 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.561+0000 7f546a164740 1 -- 172.21.15.63:0/1318292229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 msgr2=0x56311096ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.561+0000 7f546a164740 1 --2- 172.21.15.63:0/1318292229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096ea60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f545c0045e0 tx=0x7f545c048000 comp rx=0 tx=0).stop 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.561+0000 7f546a164740 1 -- 172.21.15.63:0/1318292229 shutdown_connections 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.561+0000 7f546a164740 1 --2- 172.21.15.63:0/1318292229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 0x563110987b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.561+0000 7f546a164740 1 --2- 172.21.15.63:0/1318292229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110965480 0x563110987640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.561+0000 7f546a164740 1 --2- 172.21.15.63:0/1318292229 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110964b60 0x56311096ea60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.561+0000 7f546a164740 1 -- 172.21.15.63:0/1318292229 >> 172.21.15.63:0/1318292229 conn(0x5631109610f0 msgr2=0x56311096e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.561+0000 7f546a164740 1 -- 172.21.15.63:0/1318292229 shutdown_connections 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.561+0000 7f546a164740 1 -- 172.21.15.63:0/1318292229 wait complete. 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.562+0000 7f546a164740 1 -- start start 2024-09-16T01:24:08.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.562+0000 7f546a164740 1 Processor -- start 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.562+0000 7f546a164740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110977ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.562+0000 7f546a164740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110965480 0x563110978220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f546a164740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 0x563110974cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f546a164740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f54601a9a60 con 0x563110965480 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f546a164740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54601aaed0 con 0x563110964b60 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f546a164740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54601aa130 con 0x56311096fd40 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f5465326640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110965480 0x563110978220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f5465326640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110965480 0x563110978220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34932/0 (socket says 172.21.15.63:34932) 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f5465326640 1 -- 172.21.15.63:0/1326896512 learned_addr learned my addr 172.21.15.63:0/1326896512 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f546a164740 10 client.0 _ll_register_callbacks cb 0x7f5450097560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:08.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f5465b27640 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110977ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f5466328640 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 0x563110974cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f5465b27640 1 -- 172.21.15.63:0/1326896512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 msgr2=0x563110974cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f5465b27640 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 0x563110974cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f5465b27640 1 -- 172.21.15.63:0/1326896512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110965480 msgr2=0x563110978220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f5465b27640 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110965480 0x563110978220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.563+0000 7f5465b27640 1 -- 172.21.15.63:0/1326896512 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631109751f0 con 0x563110964b60 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.564+0000 7f5465b27640 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110977ce0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f545c03ffd0 tx=0x7f545c03fb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c515814ef966287c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.564+0000 7f54497fa640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.564+0000 7f54497fa640 1 -- 172.21.15.63:0/1326896512 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c035040 con 0x563110964b60 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.564+0000 7f546a164740 1 -- 172.21.15.63:0/1326896512 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f545c0046c0 con 0x563110964b60 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.564+0000 7f54497fa640 1 -- 172.21.15.63:0/1326896512 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f545c004d80 con 0x563110964b60 2024-09-16T01:24:08.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.564+0000 7f54497fa640 1 -- 172.21.15.63:0/1326896512 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f545c03e2d0 con 0x563110964b60 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.564+0000 7f546a164740 10 client.24905 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.564+0000 7f546a164740 1 -- 172.21.15.63:0/1326896512 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631109eae10 con 0x563110964b60 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.564+0000 7f54497fa640 1 -- 172.21.15.63:0/1326896512 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f545c0046c0 con 0x563110964b60 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.565+0000 7f54497fa640 1 -- 172.21.15.63:0/1326896512 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f545c003d20 con 0x563110964b60 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.565+0000 7f546a164740 10 client.24905 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.565+0000 7f546a164740 10 client.24905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.565+0000 7f546a164740 20 client.24905 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.565+0000 7f546a164740 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5631109eb4d0 0x5631109ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.565+0000 7f546a164740 4 client.24905 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.565+0000 7f546a164740 1 -- 172.21.15.63:0/1326896512 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5631108d77f0 con 0x5631109eb4d0 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.565+0000 7f5465326640 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5631109eb4d0 0x5631109ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.566+0000 7f54497fa640 10 client.24905 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.566+0000 7f5465326640 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5631109eb4d0 0x5631109ed8f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29446551ed9eed55 server_cookie=4e109ad49008d599 in_seq=0 out_seq=0 2024-09-16T01:24:08.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.567+0000 7f54497fa640 1 -- 172.21.15.63:0/1326896512 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5631108d77f0 con 0x5631109eb4d0 2024-09-16T01:24:08.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.567+0000 7f54497fa640 10 client.24905 handle_command_reply: tid=0 2024-09-16T01:24:08.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.567+0000 7f546a164740 1 client.24905 shutdown 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.567+0000 7f546a164740 1 -- 172.21.15.63:0/1326896512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 msgr2=0x563110977ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.567+0000 7f546a164740 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110977ce0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f545c03ffd0 tx=0x7f545c03fb10 comp rx=0 tx=0).stop 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.568+0000 7f546a164740 1 -- 172.21.15.63:0/1326896512 shutdown_connections 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.568+0000 7f546a164740 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56311096fd40 0x563110974cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.568+0000 7f546a164740 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5631109eb4d0 0x5631109ed8f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.568+0000 7f546a164740 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563110965480 0x563110978220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.568+0000 7f546a164740 1 --2- 172.21.15.63:0/1326896512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563110964b60 0x563110977ce0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.568+0000 7f546a164740 1 -- 172.21.15.63:0/1326896512 >> 172.21.15.63:0/1326896512 conn(0x5631109610f0 msgr2=0x56311096d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.568+0000 7f54497fa640 0 client.24905 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.568+0000 7f546a164740 1 -- 172.21.15.63:0/1326896512 shutdown_connections 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.568+0000 7f546a164740 1 -- 172.21.15.63:0/1326896512 wait complete. 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.568+0000 7f546a164740 20 client.24905 trim_cache size 0 max 16384 2024-09-16T01:24:08.577 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:24:08.577 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-16T01:24:08.577 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "d306b7cd-0d1c-406c-b0a0-4d06646f9fca", 2024-09-16T01:24:08.577 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-16T01:24:08.577 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:24:08.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.569+0000 7f5467d8b640 1 -- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f544c0a3340 msgr2=0x7f544c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.569+0000 7f5467d8b640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f544c0a3340 0x7f544c0a5800 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f545c0096c0 tx=0x7f545c040040 comp rx=0 tx=0).stop 2024-09-16T01:24:08.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.569+0000 7f5467d8b640 1 -- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5460102570 msgr2=0x7f5460196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.569+0000 7f5467d8b640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5460102570 0x7f5460196770 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5450005fd0 tx=0x7f545000ae10 comp rx=0 tx=0).stop 2024-09-16T01:24:08.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.569+0000 7f5467d8b640 1 -- 172.21.15.63:0/2698492453 shutdown_connections 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.569+0000 7f5467d8b640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f544c0a3340 0x7f544c0a5800 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.569+0000 7f5467d8b640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5460102ef0 0x7f546019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.569+0000 7f5467d8b640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5460102570 0x7f5460196770 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.569+0000 7f5467d8b640 1 --2- 172.21.15.63:0/2698492453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5460100e20 0x7f5460196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.569+0000 7f5467d8b640 1 -- 172.21.15.63:0/2698492453 >> 172.21.15.63:0/2698492453 conn(0x7f54600fc7d0 msgr2=0x7f54600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.570+0000 7f5467d8b640 1 -- 172.21.15.63:0/2698492453 shutdown_connections 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:08.570+0000 7f5467d8b640 1 -- 172.21.15.63:0/2698492453 wait complete. 2024-09-16T01:24:09.355 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:09 smithi063 ceph-mon[31070]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:24:09.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:24:09.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:09 smithi192 ceph-mon[34775]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:24:09.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:09 smithi162 ceph-mon[34539]: pgmap v359: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:24:09.675 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:10.081 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:10 smithi063 ceph-mon[31070]: scrub queued for path: / 2024-09-16T01:24:10.081 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:10 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:10.081 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:10 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:24:10.081 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:10 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.203+0000 7f0ff0376640 1 -- 172.21.15.63:0/136514136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fe8100e20 msgr2=0x7f0fe8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.203+0000 7f0ff0376640 1 --2- 172.21.15.63:0/136514136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fe8100e20 0x7f0fe8101200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4009900 tx=0x7f0fe402a480 comp rx=0 tx=0).stop 2024-09-16T01:24:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.203+0000 7f0ff0376640 1 -- 172.21.15.63:0/136514136 shutdown_connections 2024-09-16T01:24:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.203+0000 7f0ff0376640 1 --2- 172.21.15.63:0/136514136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe8102ef0 0x7f0fe810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.203+0000 7f0ff0376640 1 --2- 172.21.15.63:0/136514136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fe8102570 0x7f0fe81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.203+0000 7f0ff0376640 1 --2- 172.21.15.63:0/136514136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fe8100e20 0x7f0fe8101200 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.203+0000 7f0ff0376640 1 -- 172.21.15.63:0/136514136 >> 172.21.15.63:0/136514136 conn(0x7f0fe80fc7d0 msgr2=0x7f0fe80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.203+0000 7f0ff0376640 1 -- 172.21.15.63:0/136514136 shutdown_connections 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.203+0000 7f0ff0376640 1 -- 172.21.15.63:0/136514136 wait complete. 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.204+0000 7f0ff0376640 1 Processor -- start 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.204+0000 7f0ff0376640 1 -- start start 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.204+0000 7f0ff0376640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fe8100e20 0x7f0fe8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.204+0000 7f0ff0376640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fe8102570 0x7f0fe8197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.204+0000 7f0ff0376640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe8102ef0 0x7f0fe819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.204+0000 7f0ff0376640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe8110e30 con 0x7f0fe8100e20 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.204+0000 7f0ff0376640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe8110cb0 con 0x7f0fe8102ef0 2024-09-16T01:24:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.204+0000 7f0ff0376640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe8110fb0 con 0x7f0fe8102570 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.204+0000 7f0fee112640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fe8100e20 0x7f0fe8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fee112640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fe8100e20 0x7f0fe8197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34956/0 (socket says 172.21.15.63:34956) 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fee112640 1 -- 172.21.15.63:0/2063412388 learned_addr learned my addr 172.21.15.63:0/2063412388 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fed911640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fe8102570 0x7f0fe8197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fee913640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe8102ef0 0x7f0fe819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fee112640 1 -- 172.21.15.63:0/2063412388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fe8102570 msgr2=0x7f0fe8197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fee112640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fe8102570 0x7f0fe8197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fee112640 1 -- 172.21.15.63:0/2063412388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe8102ef0 msgr2=0x7f0fe819bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fee112640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe8102ef0 0x7f0fe819bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fee112640 1 -- 172.21.15.63:0/2063412388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe819c2e0 con 0x7f0fe8100e20 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fee913640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe8102ef0 0x7f0fe819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fee112640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fe8100e20 0x7f0fe8197330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4006010 tx=0x7f0fe40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.205+0000 7f0fdf7fe640 1 -- 172.21.15.63:0/2063412388 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe403f030 con 0x7f0fe8100e20 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.206+0000 7f0ff0376640 1 -- 172.21.15.63:0/2063412388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe819c570 con 0x7f0fe8100e20 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.206+0000 7f0fdf7fe640 1 -- 172.21.15.63:0/2063412388 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fe4003cb0 con 0x7f0fe8100e20 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.206+0000 7f0ff0376640 1 -- 172.21.15.63:0/2063412388 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe81a3eb0 con 0x7f0fe8100e20 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.206+0000 7f0fdf7fe640 1 -- 172.21.15.63:0/2063412388 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4035070 con 0x7f0fe8100e20 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.209+0000 7f0ff274f740 1 Processor -- start 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.209+0000 7f0ff274f740 1 -- start start 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.209+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac444a0 0x563ebac44880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.209+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac44dc0 0x563ebac4f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.209+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 0x563ebac51a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.209+0000 7f0ff274f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563ebabaa2e0 con 0x563ebac44dc0 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.209+0000 7f0ff274f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563ebab51ce0 con 0x563ebac444a0 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.209+0000 7f0ff274f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563ebaba62a0 con 0x563ebac4f680 2024-09-16T01:24:10.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fdf7fe640 1 -- 172.21.15.63:0/2063412388 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0fe4042030 con 0x7f0fe8100e20 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fee913640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac444a0 0x563ebac44880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fee913640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac444a0 0x563ebac44880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:38902/0 (socket says 172.21.15.63:38902) 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fee913640 1 -- 172.21.15.63:0/3357769258 learned_addr learned my addr 172.21.15.63:0/3357769258 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fee112640 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac44dc0 0x563ebac4f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fed911640 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 0x563ebac51a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fee112640 1 -- 172.21.15.63:0/3357769258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 msgr2=0x563ebac51a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fee112640 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 0x563ebac51a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fee112640 1 -- 172.21.15.63:0/3357769258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac444a0 msgr2=0x563ebac44880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fee112640 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac444a0 0x563ebac44880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fee112640 1 -- 172.21.15.63:0/3357769258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ebab36440 con 0x563ebac44dc0 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fee913640 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac444a0 0x563ebac44880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:10.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.210+0000 7f0fed911640 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 0x563ebac51a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.211+0000 7f0fee112640 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac44dc0 0x563ebac4f140 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40ed4e0 tx=0x7f0fe40f3b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00ce0d9dacafcbb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.211+0000 7f0fdcdea640 1 -- 172.21.15.63:0/3357769258 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40f88b0 con 0x563ebac44dc0 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.211+0000 7f0fdcdea640 1 -- 172.21.15.63:0/3357769258 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fe4101030 con 0x563ebac44dc0 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.211+0000 7f0fdf7fe640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0fd40a32c0 0x7f0fd40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.211+0000 7f0fdf7fe640 1 -- 172.21.15.63:0/2063412388 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0fe40efa40 con 0x7f0fe8100e20 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.212+0000 7f0fee913640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0fd40a32c0 0x7f0fd40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.212+0000 7f0fdcdea640 1 -- 172.21.15.63:0/3357769258 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe41053d0 con 0x563ebac44dc0 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.212+0000 7f0ff274f740 1 -- 172.21.15.63:0/3357769258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac44dc0 msgr2=0x563ebac4f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.212+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac44dc0 0x563ebac4f140 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40ed4e0 tx=0x7f0fe40f3b90 comp rx=0 tx=0).stop 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.212+0000 7f0fee913640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0fd40a32c0 0x7f0fd40a5780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00126f0 tx=0x7f0fe0009790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.212+0000 7f0ff274f740 1 -- 172.21.15.63:0/3357769258 shutdown_connections 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.212+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 0x563ebac51a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.212+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac44dc0 0x563ebac4f140 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.212+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3357769258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac444a0 0x563ebac44880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.212+0000 7f0ff274f740 1 -- 172.21.15.63:0/3357769258 >> 172.21.15.63:0/3357769258 conn(0x563ebac40a30 msgr2=0x563ebac40e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.213+0000 7f0ff274f740 1 -- 172.21.15.63:0/3357769258 shutdown_connections 2024-09-16T01:24:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.213+0000 7f0ff274f740 1 -- 172.21.15.63:0/3357769258 wait complete. 2024-09-16T01:24:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.213+0000 7f0ff274f740 1 -- start start 2024-09-16T01:24:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.213+0000 7f0ff274f740 1 Processor -- start 2024-09-16T01:24:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac4a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4f680 0x563ebac4ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4b090 0x563ebac5b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0ff274f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563ebac51fb0 con 0x563ebac444a0 2024-09-16T01:24:10.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0ff274f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563ebab65050 con 0x563ebac4f680 2024-09-16T01:24:10.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0ff274f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563ebac52130 con 0x563ebac4b090 2024-09-16T01:24:10.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fee112640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac4a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0ff274f740 10 client.0 _ll_register_callbacks cb 0x563ebaba5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:10.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fee112640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac4a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34974/0 (socket says 172.21.15.63:34974) 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fee112640 1 -- 172.21.15.63:0/3136745027 learned_addr learned my addr 172.21.15.63:0/3136745027 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fee913640 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4b090 0x563ebac5b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fed911640 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4f680 0x563ebac4ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fee913640 1 -- 172.21.15.63:0/3136745027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4f680 msgr2=0x563ebac4ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fee913640 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4f680 0x563ebac4ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fee913640 1 -- 172.21.15.63:0/3136745027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 msgr2=0x563ebac4a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fee913640 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac4a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fee913640 1 -- 172.21.15.63:0/3136745027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563eba91b3c0 con 0x563ebac4b090 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.214+0000 7f0fee112640 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac4a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.215+0000 7f0fee913640 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4b090 0x563ebac5b260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00093c0 tx=0x7f0fe0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49842f7564802a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.215+0000 7f0fd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:24:10.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.215+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3136745027 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0010ea0 con 0x563ebac4b090 2024-09-16T01:24:10.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.215+0000 7f0ff274f740 1 -- 172.21.15.63:0/3136745027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fe4101030 con 0x563ebac4b090 2024-09-16T01:24:10.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.215+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3136745027 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0fe000fd20 con 0x563ebac4b090 2024-09-16T01:24:10.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3136745027 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0fe0028470 con 0x563ebac4b090 2024-09-16T01:24:10.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0ff274f740 10 client.24949 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:10.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0ff274f740 1 -- 172.21.15.63:0/3136745027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563ebac5df50 con 0x563ebac4b090 2024-09-16T01:24:10.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3136745027 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fe4101030 con 0x563ebac4b090 2024-09-16T01:24:10.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3136745027 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0fe001e790 con 0x563ebac4b090 2024-09-16T01:24:10.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0ff274f740 10 client.24949 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:10.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0ff274f740 10 client.24949 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:10.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0ff274f740 20 client.24949 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:10.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563ebac5f410 0x563ebac61820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0ff274f740 4 client.24949 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:10.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.216+0000 7f0ff274f740 1 -- 172.21.15.63:0/3136745027 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ebabb7850 con 0x563ebac5f410 2024-09-16T01:24:10.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.217+0000 7f0fee112640 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563ebac5f410 0x563ebac61820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.217+0000 7f0fee112640 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563ebac5f410 0x563ebac61820 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c796fe19f5bbea9 server_cookie=ae6d57165f2e701d in_seq=0 out_seq=0 2024-09-16T01:24:10.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.217+0000 7f0fd1ffb640 10 client.24949 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:10.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.218+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3136745027 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ebabb7850 con 0x563ebac5f410 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.218+0000 7f0fd1ffb640 10 client.24949 handle_command_reply: tid=0 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.218+0000 7f0ff274f740 1 client.24949 shutdown 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.218+0000 7f0ff274f740 1 -- 172.21.15.63:0/3136745027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4b090 msgr2=0x563ebac5b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.218+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4b090 0x563ebac5b260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00093c0 tx=0x7f0fe0004a40 comp rx=0 tx=0).stop 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.218+0000 7f0ff274f740 1 -- 172.21.15.63:0/3136745027 shutdown_connections 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.218+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4b090 0x563ebac5b260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.218+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4f680 0x563ebac4ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.218+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563ebac5f410 0x563ebac61820 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.219+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3136745027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac4a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.219+0000 7f0ff274f740 1 -- 172.21.15.63:0/3136745027 >> 172.21.15.63:0/3136745027 conn(0x563ebac40a30 msgr2=0x563ebac46760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.219+0000 7f0fd1ffb640 0 client.24949 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.219+0000 7f0ff274f740 1 -- 172.21.15.63:0/3136745027 shutdown_connections 2024-09-16T01:24:10.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.219+0000 7f0ff274f740 1 -- 172.21.15.63:0/3136745027 wait complete. 2024-09-16T01:24:10.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.219+0000 7f0ff274f740 20 client.24949 trim_cache size 0 max 16384 2024-09-16T01:24:10.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.253+0000 7f0ff274f740 1 Processor -- start 2024-09-16T01:24:10.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0ff274f740 1 -- start start 2024-09-16T01:24:10.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac480f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4b090 0x563ebac40e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 0x563ebac50a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0ff274f740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe81adbd0 con 0x563ebac444a0 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0ff274f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe81ab4a0 con 0x563ebac4b090 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0ff274f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe81a92d0 con 0x563ebac4f680 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0fee112640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0fee112640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34976/0 (socket says 172.21.15.63:34976) 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0fee913640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 0x563ebac50a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.254+0000 7f0fee112640 1 -- 172.21.15.63:0/3093283004 learned_addr learned my addr 172.21.15.63:0/3093283004 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.255+0000 7f0fed911640 1 --2- 172.21.15.63:0/3093283004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4b090 0x563ebac40e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.255+0000 7f0fee913640 1 -- 172.21.15.63:0/3093283004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4b090 msgr2=0x563ebac40e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.255+0000 7f0fee913640 1 --2- 172.21.15.63:0/3093283004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4b090 0x563ebac40e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.255+0000 7f0fee913640 1 -- 172.21.15.63:0/3093283004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 msgr2=0x563ebac480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.255+0000 7f0fee913640 1 --2- 172.21.15.63:0/3093283004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.255+0000 7f0fee913640 1 -- 172.21.15.63:0/3093283004 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ebac495e0 con 0x563ebac4f680 2024-09-16T01:24:10.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.255+0000 7f0fee112640 1 --2- 172.21.15.63:0/3093283004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:10.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.255+0000 7f0fee913640 1 --2- 172.21.15.63:0/3093283004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 0x563ebac50a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000f80 tx=0x7f0fe0012520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e96b294b4f3a82a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.256+0000 7f0fd3fff640 1 -- 172.21.15.63:0/3093283004 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0010ea0 con 0x563ebac4f680 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.256+0000 7f0fd3fff640 1 -- 172.21.15.63:0/3093283004 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fe0023070 con 0x563ebac4f680 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.256+0000 7f0fd3fff640 1 -- 172.21.15.63:0/3093283004 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe001e7e0 con 0x563ebac4f680 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 -- 172.21.15.63:0/3093283004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 msgr2=0x563ebac50a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3093283004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 0x563ebac50a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000f80 tx=0x7f0fe0012520 comp rx=0 tx=0).stop 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 -- 172.21.15.63:0/3093283004 shutdown_connections 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3093283004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac4f680 0x563ebac50a70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3093283004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4b090 0x563ebac40e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3093283004 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac444a0 0x563ebac480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 -- 172.21.15.63:0/3093283004 >> 172.21.15.63:0/3093283004 conn(0x563ebac40a30 msgr2=0x563ebac3f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 -- 172.21.15.63:0/3093283004 shutdown_connections 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 -- 172.21.15.63:0/3093283004 wait complete. 2024-09-16T01:24:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 -- start start 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.257+0000 7f0ff274f740 1 Processor -- start 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac444a0 0x563ebac676f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4b090 0x563ebac660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0ff274f740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac4f680 0x563ebac66620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0fee913640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac4f680 0x563ebac66620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0fee112640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac444a0 0x563ebac676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0fee112640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac444a0 0x563ebac676f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:37128/0 (socket says 172.21.15.63:37128) 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0fee112640 1 -- 172.21.15.63:0/3936332553 learned_addr learned my addr 172.21.15.63:0/3936332553 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe81a9960 con 0x563ebac4f680 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe81aadd0 con 0x563ebac4b090 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe81aa030 con 0x563ebac444a0 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0fed911640 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4b090 0x563ebac660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0ff274f740 10 client.0 _ll_register_callbacks cb 0x7f0fe00099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0fee112640 1 -- 172.21.15.63:0/3936332553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4b090 msgr2=0x563ebac660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0fee112640 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4b090 0x563ebac660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0fee112640 1 -- 172.21.15.63:0/3936332553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac4f680 msgr2=0x563ebac66620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0fee112640 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac4f680 0x563ebac66620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.258+0000 7f0fee112640 1 -- 172.21.15.63:0/3936332553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ebac66b60 con 0x563ebac444a0 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.259+0000 7f0fee112640 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac444a0 0x563ebac676f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40c47a0 tx=0x7f0fe40044e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ee0717286ef680a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.259+0000 7f0fd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.259+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3936332553 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40fa020 con 0x563ebac444a0 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.259+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3936332553 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0fe40ba360 con 0x563ebac444a0 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.259+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fe0023070 con 0x563ebac444a0 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.259+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3936332553 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0fe4049040 con 0x563ebac444a0 2024-09-16T01:24:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.259+0000 7f0ff274f740 10 client.24955 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.259+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563ebac5ade0 con 0x563ebac444a0 2024-09-16T01:24:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.259+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3936332553 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fe0023070 con 0x563ebac444a0 2024-09-16T01:24:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.260+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3936332553 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0fe404c060 con 0x563ebac444a0 2024-09-16T01:24:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.260+0000 7f0ff274f740 10 client.24955 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.260+0000 7f0ff274f740 10 client.24955 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.260+0000 7f0ff274f740 20 client.24955 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.260+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563ebacd2a60 0x563ebacd4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.260+0000 7f0ff274f740 4 client.24955 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:24:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.260+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ebabb1d60 con 0x563ebacd2a60 2024-09-16T01:24:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.260+0000 7f0fed911640 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563ebacd2a60 0x563ebacd4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0fed911640 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563ebacd2a60 0x563ebacd4e80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62de29bfc396bd83 server_cookie=8f270a825bad364 in_seq=0 out_seq=0 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0fd1ffb640 10 client.24955 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0fd1ffb640 1 -- 172.21.15.63:0/3936332553 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563ebabb1d60 con 0x563ebacd2a60 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0fd1ffb640 10 client.24955 handle_command_reply: tid=0 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 client.24955 shutdown 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac444a0 msgr2=0x563ebac676f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac444a0 0x563ebac676f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40c47a0 tx=0x7f0fe40044e0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 shutdown_connections 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x563ebacd2a60 0x563ebacd4e80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563ebac4f680 0x563ebac66620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563ebac4b090 0x563ebac660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 --2- 172.21.15.63:0/3936332553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ebac444a0 0x563ebac676f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 >> 172.21.15.63:0/3936332553 conn(0x563ebac40a30 msgr2=0x563ebac3fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0fd1ffb640 0 client.24955 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 shutdown_connections 2024-09-16T01:24:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 1 -- 172.21.15.63:0/3936332553 wait complete. 2024-09-16T01:24:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.261+0000 7f0ff274f740 20 client.24955 trim_cache size 0 max 16384 2024-09-16T01:24:10.268 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:24:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-16T01:24:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-16T01:24:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "d306b7cd-0d1c-406c-b0a0-4d06646f9fca": { 2024-09-16T01:24:10.268 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-16T01:24:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "d306b7cd-0d1c-406c-b0a0-4d06646f9fca", 2024-09-16T01:24:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-16T01:24:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:24:10.269 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:24:10.269 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:24:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.262+0000 7f0ff0376640 1 -- 172.21.15.63:0/2063412388 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0fd40a32c0 msgr2=0x7f0fd40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.262+0000 7f0ff0376640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0fd40a32c0 0x7f0fd40a5780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00126f0 tx=0x7f0fe0009790 comp rx=0 tx=0).stop 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.263+0000 7f0ff0376640 1 -- 172.21.15.63:0/2063412388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fe8100e20 msgr2=0x7f0fe8197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.263+0000 7f0ff0376640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fe8100e20 0x7f0fe8197330 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4006010 tx=0x7f0fe40042f0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.263+0000 7f0ff0376640 1 -- 172.21.15.63:0/2063412388 shutdown_connections 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.263+0000 7f0ff0376640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0fd40a32c0 0x7f0fd40a5780 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.263+0000 7f0ff0376640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0fe8102ef0 0x7f0fe819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.263+0000 7f0ff0376640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fe8102570 0x7f0fe8197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.263+0000 7f0ff0376640 1 --2- 172.21.15.63:0/2063412388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fe8100e20 0x7f0fe8197330 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.263+0000 7f0ff0376640 1 -- 172.21.15.63:0/2063412388 >> 172.21.15.63:0/2063412388 conn(0x7f0fe80fc7d0 msgr2=0x7f0fe80fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.263+0000 7f0ff0376640 1 -- 172.21.15.63:0/2063412388 shutdown_connections 2024-09-16T01:24:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:10.263+0000 7f0ff0376640 1 -- 172.21.15.63:0/2063412388 wait complete. 2024-09-16T01:24:10.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:10 smithi192 ceph-mon[34775]: scrub queued for path: / 2024-09-16T01:24:10.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:10 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:10.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:10 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:24:10.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:10 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:10.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:10 smithi162 ceph-mon[34539]: scrub queued for path: / 2024-09-16T01:24:10.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:10 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:10.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:10 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:24:10.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:10 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:11.021 INFO:tasks.cephfs.filesystem:scrub status for tag:d306b7cd-0d1c-406c-b0a0-4d06646f9fca - {'path': '/', 'tag': 'd306b7cd-0d1c-406c-b0a0-4d06646f9fca', 'options': 'recursive,force'} 2024-09-16T01:24:11.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:11 smithi063 ceph-mon[31070]: pgmap v360: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:24:11.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:11 smithi192 ceph-mon[34775]: pgmap v360: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:24:11.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:11 smithi162 ceph-mon[34539]: pgmap v360: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:24:13.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:13 smithi063 ceph-mon[31070]: pgmap v361: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-16T01:24:13.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:13 smithi192 ceph-mon[34775]: pgmap v361: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-16T01:24:13.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:13 smithi162 ceph-mon[34539]: pgmap v361: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-16T01:24:14.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:14 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:24:14.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:14 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:24:14.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:14 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:24:15.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:15 smithi063 ceph-mon[31070]: pgmap v362: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-16T01:24:15.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:15 smithi192 ceph-mon[34775]: pgmap v362: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-16T01:24:15.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:15 smithi162 ceph-mon[34539]: pgmap v362: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-16T01:24:17.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:17 smithi063 ceph-mon[31070]: pgmap v363: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-16T01:24:17.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:17 smithi192 ceph-mon[34775]: pgmap v363: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-16T01:24:17.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:17 smithi162 ceph-mon[34539]: pgmap v363: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-16T01:24:19.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:19 smithi063 ceph-mon[31070]: pgmap v364: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-16T01:24:19.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:19 smithi192 ceph-mon[34775]: pgmap v364: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-16T01:24:19.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:19 smithi162 ceph-mon[34539]: pgmap v364: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-16T01:24:21.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:21 smithi063 ceph-mon[31070]: pgmap v365: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-16T01:24:21.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:21 smithi192 ceph-mon[34775]: pgmap v365: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-16T01:24:21.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:21 smithi162 ceph-mon[34539]: pgmap v365: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-16T01:24:23.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:23 smithi063 ceph-mon[31070]: pgmap v366: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-16T01:24:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:23 smithi192 ceph-mon[34775]: pgmap v366: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-16T01:24:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:23 smithi162 ceph-mon[34539]: pgmap v366: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-16T01:24:24.117 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 92% (11947/12889) Updating files: 93% (11987/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-16T01:24:24.534 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-16T01:24:24.535 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-16T01:24:24.535 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-16T01:24:24.535 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-16T01:24:24.535 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-16T01:24:24.535 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T01:24:24.535 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-16T01:24:24.535 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-16T01:24:24.539 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T01:24:24.562 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T01:24:24.564 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T01:24:24.564 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T01:24:25.279 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T01:24:25.360 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T01:24:25.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:25 smithi063 ceph-mon[31070]: pgmap v367: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-16T01:24:25.401 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T01:24:25.402 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T01:24:25.403 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T01:24:25.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:25 smithi192 ceph-mon[34775]: pgmap v367: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-16T01:24:25.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:25 smithi162 ceph-mon[34539]: pgmap v367: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-16T01:24:25.444 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T01:24:25.447 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:24:25.447 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T01:24:25.504 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-16T01:24:25.506 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-16T01:24:25.507 DEBUG:teuthology.orchestra.run.smithi063:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-16T01:24:25.570 INFO:tasks.workunit.client.0.smithi063.stderr:+ mkdir -p fsstress 2024-09-16T01:24:25.572 INFO:tasks.workunit.client.0.smithi063.stderr:+ pushd fsstress 2024-09-16T01:24:25.573 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T01:24:25.573 INFO:tasks.workunit.client.0.smithi063.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-16T01:24:26.140 INFO:tasks.workunit.client.0.smithi063.stderr:+ tar xzf ltp-full.tgz 2024-09-16T01:24:27.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:27 smithi192 ceph-mon[34775]: pgmap v368: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:24:27.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:27 smithi162 ceph-mon[34539]: pgmap v368: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:24:27.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:27 smithi063 ceph-mon[31070]: pgmap v368: 97 pgs: 97 active+clean; 656 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-16T01:24:29.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:29 smithi192 ceph-mon[34775]: pgmap v369: 97 pgs: 97 active+clean; 7.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 585 KiB/s wr, 16 op/s 2024-09-16T01:24:29.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:29 smithi162 ceph-mon[34539]: pgmap v369: 97 pgs: 97 active+clean; 7.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 585 KiB/s wr, 16 op/s 2024-09-16T01:24:29.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:29 smithi063 ceph-mon[31070]: pgmap v369: 97 pgs: 97 active+clean; 7.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 585 KiB/s wr, 16 op/s 2024-09-16T01:24:31.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:31 smithi192 ceph-mon[34775]: pgmap v370: 97 pgs: 97 active+clean; 7.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 585 KiB/s wr, 14 op/s 2024-09-16T01:24:31.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:31 smithi162 ceph-mon[34539]: pgmap v370: 97 pgs: 97 active+clean; 7.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 585 KiB/s wr, 14 op/s 2024-09-16T01:24:31.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:31 smithi063 ceph-mon[31070]: pgmap v370: 97 pgs: 97 active+clean; 7.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 585 KiB/s wr, 14 op/s 2024-09-16T01:24:33.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:33 smithi192 ceph-mon[34775]: pgmap v371: 97 pgs: 97 active+clean; 17 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-16T01:24:33.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:33 smithi162 ceph-mon[34539]: pgmap v371: 97 pgs: 97 active+clean; 17 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-16T01:24:33.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:33 smithi063 ceph-mon[31070]: pgmap v371: 97 pgs: 97 active+clean; 17 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 1.5 MiB/s wr, 94 op/s 2024-09-16T01:24:35.411 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:35 smithi063 ceph-mon[31070]: pgmap v372: 97 pgs: 97 active+clean; 19 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 1.7 MiB/s wr, 142 op/s 2024-09-16T01:24:35.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:35 smithi192 ceph-mon[34775]: pgmap v372: 97 pgs: 97 active+clean; 19 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 1.7 MiB/s wr, 142 op/s 2024-09-16T01:24:35.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:35 smithi162 ceph-mon[34539]: pgmap v372: 97 pgs: 97 active+clean; 19 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 1.7 MiB/s wr, 142 op/s 2024-09-16T01:24:37.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:37 smithi063 ceph-mon[31070]: pgmap v373: 97 pgs: 97 active+clean; 24 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 2.1 MiB/s wr, 174 op/s 2024-09-16T01:24:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:37 smithi192 ceph-mon[34775]: pgmap v373: 97 pgs: 97 active+clean; 24 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 2.1 MiB/s wr, 174 op/s 2024-09-16T01:24:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:37 smithi162 ceph-mon[34539]: pgmap v373: 97 pgs: 97 active+clean; 24 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 2.1 MiB/s wr, 174 op/s 2024-09-16T01:24:38.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:24:38.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:24:38.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:38 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:24:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:24:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:24:38.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:38 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:24:38.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:24:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:24:38.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:38 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:24:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:39 smithi192 ceph-mon[34775]: pgmap v374: 97 pgs: 97 active+clean; 33 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 2.9 MiB/s wr, 283 op/s 2024-09-16T01:24:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:24:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:24:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:24:39.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:39 smithi162 ceph-mon[34539]: pgmap v374: 97 pgs: 97 active+clean; 33 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 2.9 MiB/s wr, 283 op/s 2024-09-16T01:24:39.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:24:39.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:24:39.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:24:39.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:39 smithi063 ceph-mon[31070]: pgmap v374: 97 pgs: 97 active+clean; 33 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 2.9 MiB/s wr, 283 op/s 2024-09-16T01:24:39.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:24:39.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:24:39.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:24:41.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:24:41.304 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:41.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:41 smithi063 ceph-mon[31070]: pgmap v375: 97 pgs: 97 active+clean; 33 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 2.4 MiB/s wr, 271 op/s 2024-09-16T01:24:41.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:41 smithi192 ceph-mon[34775]: pgmap v375: 97 pgs: 97 active+clean; 33 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 2.4 MiB/s wr, 271 op/s 2024-09-16T01:24:41.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:41 smithi162 ceph-mon[34539]: pgmap v375: 97 pgs: 97 active+clean; 33 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 2.4 MiB/s wr, 271 op/s 2024-09-16T01:24:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.836+0000 7fe10186b640 1 -- 172.21.15.63:0/2783067956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0fc102780 msgr2=0x7fe0fc1067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.836+0000 7fe10186b640 1 --2- 172.21.15.63:0/2783067956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0fc102780 0x7fe0fc1067d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009900 tx=0x7fe0e402a410 comp rx=0 tx=0).stop 2024-09-16T01:24:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.836+0000 7fe10186b640 1 -- 172.21.15.63:0/2783067956 shutdown_connections 2024-09-16T01:24:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.836+0000 7fe10186b640 1 --2- 172.21.15.63:0/2783067956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0fc106f00 0x7fe0fc10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.836+0000 7fe10186b640 1 --2- 172.21.15.63:0/2783067956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0fc102780 0x7fe0fc1067d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.836+0000 7fe10186b640 1 --2- 172.21.15.63:0/2783067956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc101dd0 0x7fe0fc1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.836+0000 7fe10186b640 1 -- 172.21.15.63:0/2783067956 >> 172.21.15.63:0/2783067956 conn(0x7fe0fc0fd8b0 msgr2=0x7fe0fc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:41.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.836+0000 7fe10186b640 1 -- 172.21.15.63:0/2783067956 shutdown_connections 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.836+0000 7fe10186b640 1 -- 172.21.15.63:0/2783067956 wait complete. 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.836+0000 7fe10186b640 1 Processor -- start 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe10186b640 1 -- start start 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe10186b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc101dd0 0x7fe0fc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe10186b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0fc102780 0x7fe0fc198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe10186b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0fc106f00 0x7fe0fc19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe10186b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc111e10 con 0x7fe0fc102780 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe10186b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc111c90 con 0x7fe0fc106f00 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0faffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc101dd0 0x7fe0fc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe10186b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc111f90 con 0x7fe0fc101dd0 2024-09-16T01:24:41.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0fc102780 0x7fe0fc198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0faffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc101dd0 0x7fe0fc198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:59624/0 (socket says 172.21.15.63:59624) 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0faffd640 1 -- 172.21.15.63:0/2732445346 learned_addr learned my addr 172.21.15.63:0/2732445346 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0fc106f00 0x7fe0fc19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0faffd640 1 -- 172.21.15.63:0/2732445346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0fc106f00 msgr2=0x7fe0fc19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0faffd640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0fc106f00 0x7fe0fc19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0faffd640 1 -- 172.21.15.63:0/2732445346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0fc102780 msgr2=0x7fe0fc198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0faffd640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0fc102780 0x7fe0fc198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0faffd640 1 -- 172.21.15.63:0/2732445346 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc19d2e0 con 0x7fe0fc101dd0 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0fc106f00 0x7fe0fc19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.837+0000 7fe0f3fff640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0fc102780 0x7fe0fc198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.838+0000 7fe0faffd640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc101dd0 0x7fe0fc198330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00e9f0 tx=0x7fe0ec00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:41.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.838+0000 7fe100869640 1 -- 172.21.15.63:0/2732445346 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00cd80 con 0x7fe0fc101dd0 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.838+0000 7fe100869640 1 -- 172.21.15.63:0/2732445346 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0ec0108e0 con 0x7fe0fc101dd0 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.838+0000 7fe10186b640 1 -- 172.21.15.63:0/2732445346 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc19d5d0 con 0x7fe0fc101dd0 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.838+0000 7fe100869640 1 -- 172.21.15.63:0/2732445346 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec018920 con 0x7fe0fc101dd0 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.838+0000 7fe10186b640 1 -- 172.21.15.63:0/2732445346 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc1a4eb0 con 0x7fe0fc101dd0 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.840+0000 7fe100869640 1 -- 172.21.15.63:0/2732445346 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe0ec010a90 con 0x7fe0fc101dd0 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe103c44740 1 Processor -- start 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe103c44740 1 -- start start 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe100869640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0e80a3240 0x7fe0e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe103c44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a43760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe103c44740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a52550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0e80a3240 0x7fe0e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe103c44740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a54e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe103c44740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555af69a92e0 con 0x555af6a43ca0 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe103c44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555af6950ce0 con 0x555af6a43380 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe103c44740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555af69a52a0 con 0x555af6a52a90 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe100869640 1 -- 172.21.15.63:0/2732445346 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe0ec0cfc20 con 0x7fe0fc101dd0 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a52550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a52550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39584/0 (socket says 172.21.15.63:39584) 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.841+0000 7fe0f3fff640 1 -- 172.21.15.63:0/1210029477 learned_addr learned my addr 172.21.15.63:0/1210029477 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0faffd640 1 --2- 172.21.15.63:0/1210029477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a43760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/1210029477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a54e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0f3fff640 1 -- 172.21.15.63:0/1210029477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 msgr2=0x555af6a54e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0f3fff640 1 --2- 172.21.15.63:0/1210029477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a54e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0f3fff640 1 -- 172.21.15.63:0/1210029477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 msgr2=0x555af6a43760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:41.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0f3fff640 1 --2- 172.21.15.63:0/1210029477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a43760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0f3fff640 1 -- 172.21.15.63:0/1210029477 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af6935440 con 0x555af6a43ca0 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0e80a3240 0x7fe0e80a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40099e0 tx=0x7fe0f400fe70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0f3fff640 1 --2- 172.21.15.63:0/1210029477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a52550 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009900 tx=0x7fe0e4005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcdb3af346b912a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0f1ffb640 1 -- 172.21.15.63:0/1210029477 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4040070 con 0x555af6a43ca0 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0f1ffb640 1 -- 172.21.15.63:0/1210029477 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0e4031860 con 0x555af6a43ca0 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.842+0000 7fe0f1ffb640 1 -- 172.21.15.63:0/1210029477 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4035040 con 0x555af6a43ca0 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.843+0000 7fe103c44740 1 -- 172.21.15.63:0/1210029477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 msgr2=0x555af6a52550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.843+0000 7fe103c44740 1 --2- 172.21.15.63:0/1210029477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a52550 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009900 tx=0x7fe0e4005d90 comp rx=0 tx=0).stop 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.843+0000 7fe103c44740 1 -- 172.21.15.63:0/1210029477 shutdown_connections 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.843+0000 7fe103c44740 1 --2- 172.21.15.63:0/1210029477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a54e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.843+0000 7fe103c44740 1 --2- 172.21.15.63:0/1210029477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a52550 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.843+0000 7fe103c44740 1 --2- 172.21.15.63:0/1210029477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a43760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.843+0000 7fe103c44740 1 -- 172.21.15.63:0/1210029477 >> 172.21.15.63:0/1210029477 conn(0x555af6a3fa30 msgr2=0x555af6a3fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.843+0000 7fe103c44740 1 -- 172.21.15.63:0/1210029477 shutdown_connections 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.843+0000 7fe103c44740 1 -- 172.21.15.63:0/1210029477 wait complete. 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe103c44740 1 -- start start 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe103c44740 1 Processor -- start 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe103c44740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a43380 0x555af6a523e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe103c44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43ca0 0x555af6a4f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe103c44740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a52a90 0x555af6a4fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe103c44740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555af6a55660 con 0x555af6a52a90 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe103c44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555af6964050 con 0x555af6a43ca0 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe103c44740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555af6a557e0 con 0x555af6a43380 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe103c44740 10 client.0 _ll_register_callbacks cb 0x555af69a4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe0fb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a52a90 0x555af6a4fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe0faffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a43380 0x555af6a523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43ca0 0x555af6a4f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe0faffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a43380 0x555af6a523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:59652/0 (socket says 172.21.15.63:59652) 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe0fb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a52a90 0x555af6a4fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39598/0 (socket says 172.21.15.63:39598) 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.844+0000 7fe0faffd640 1 -- 172.21.15.63:0/548892611 learned_addr learned my addr 172.21.15.63:0/548892611 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe0fb7fe640 1 -- 172.21.15.63:0/548892611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a43380 msgr2=0x555af6a523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a43380 0x555af6a523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe0fb7fe640 1 -- 172.21.15.63:0/548892611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43ca0 msgr2=0x555af6a4f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43ca0 0x555af6a4f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe0fb7fe640 1 -- 172.21.15.63:0/548892611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af671a3c0 con 0x555af6a52a90 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe0f3fff640 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43ca0 0x555af6a4f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a52a90 0x555af6a4fc80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x555af6a40b20 tx=0x7fe0f4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e832ca8b1c576d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe0daffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:24:41.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe0daffd640 1 -- 172.21.15.63:0/548892611 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4024030 con 0x555af6a52a90 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe0daffd640 1 -- 172.21.15.63:0/548892611 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe0f4004720 con 0x555af6a52a90 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.845+0000 7fe103c44740 1 -- 172.21.15.63:0/548892611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0e4031860 con 0x555af6a52a90 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe0daffd640 1 -- 172.21.15.63:0/548892611 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe0f4020430 con 0x555af6a52a90 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe103c44740 10 client.15357 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe103c44740 1 -- 172.21.15.63:0/548892611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555af6a610e0 con 0x555af6a52a90 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe0daffd640 1 -- 172.21.15.63:0/548892611 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0e4031860 con 0x555af6a52a90 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe0daffd640 1 -- 172.21.15.63:0/548892611 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe0f401f070 con 0x555af6a52a90 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe103c44740 10 client.15357 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe103c44740 10 client.15357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe103c44740 20 client.15357 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe103c44740 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555af6a625a0 0x555af6a649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe103c44740 4 client.15357 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:41.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe103c44740 1 -- 172.21.15.63:0/548892611 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555af69b6850 con 0x555af6a625a0 2024-09-16T01:24:41.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.846+0000 7fe0faffd640 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555af6a625a0 0x555af6a649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.847+0000 7fe0daffd640 10 client.15357 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:41.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.847+0000 7fe0faffd640 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555af6a625a0 0x555af6a649b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3396ce2595157f8e server_cookie=7868e00178f348b0 in_seq=0 out_seq=0 2024-09-16T01:24:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.847+0000 7fe0daffd640 1 -- 172.21.15.63:0/548892611 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555af69b6850 con 0x555af6a625a0 2024-09-16T01:24:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.847+0000 7fe0daffd640 10 client.15357 handle_command_reply: tid=0 2024-09-16T01:24:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 client.15357 shutdown 2024-09-16T01:24:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 -- 172.21.15.63:0/548892611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a52a90 msgr2=0x555af6a4fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a52a90 0x555af6a4fc80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x555af6a40b20 tx=0x7fe0f4004ab0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 -- 172.21.15.63:0/548892611 shutdown_connections 2024-09-16T01:24:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555af6a625a0 0x555af6a649b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a52a90 0x555af6a4fc80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43ca0 0x555af6a4f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe0daffd640 0 client.15357 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 --2- 172.21.15.63:0/548892611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a43380 0x555af6a523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 -- 172.21.15.63:0/548892611 >> 172.21.15.63:0/548892611 conn(0x555af6a3fa30 msgr2=0x555af6a45790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 -- 172.21.15.63:0/548892611 shutdown_connections 2024-09-16T01:24:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.848+0000 7fe103c44740 1 -- 172.21.15.63:0/548892611 wait complete. 2024-09-16T01:24:41.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.849+0000 7fe103c44740 20 client.15357 trim_cache size 0 max 16384 2024-09-16T01:24:41.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe103c44740 1 Processor -- start 2024-09-16T01:24:41.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe103c44740 1 -- start start 2024-09-16T01:24:41.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe103c44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe103c44740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a6a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe103c44740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a6a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe103c44740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc1adc70 con 0x555af6a43ca0 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe103c44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc1ab540 con 0x555af6a43380 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe103c44740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc1a9370 con 0x555af6a52a90 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a6a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a6a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39606/0 (socket says 172.21.15.63:39606) 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe0f3fff640 1 -- 172.21.15.63:0/1721893244 learned_addr learned my addr 172.21.15.63:0/1721893244 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe0faffd640 1 --2- 172.21.15.63:0/1721893244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/1721893244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a6a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe0faffd640 1 -- 172.21.15.63:0/1721893244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 msgr2=0x555af6a6a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:41.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe0faffd640 1 --2- 172.21.15.63:0/1721893244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a6a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe0faffd640 1 -- 172.21.15.63:0/1721893244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 msgr2=0x555af6a6a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:41.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe0faffd640 1 --2- 172.21.15.63:0/1721893244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a6a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.869+0000 7fe0faffd640 1 -- 172.21.15.63:0/1721893244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555af6a65030 con 0x555af6a43380 2024-09-16T01:24:41.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.870+0000 7fe0faffd640 1 --2- 172.21.15.63:0/1721893244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5e930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec098710 tx=0x7fe0ec01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b756070384779ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:41.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.870+0000 7fe0f17fa640 1 -- 172.21.15.63:0/1721893244 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0af070 con 0x555af6a43380 2024-09-16T01:24:41.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.870+0000 7fe0f17fa640 1 -- 172.21.15.63:0/1721893244 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0ec0cd7f0 con 0x555af6a43380 2024-09-16T01:24:41.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.870+0000 7fe0f17fa640 1 -- 172.21.15.63:0/1721893244 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0a0380 con 0x555af6a43380 2024-09-16T01:24:41.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.871+0000 7fe103c44740 1 -- 172.21.15.63:0/1721893244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 msgr2=0x555af6a5e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:41.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.871+0000 7fe103c44740 1 --2- 172.21.15.63:0/1721893244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5e930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec098710 tx=0x7fe0ec01a040 comp rx=0 tx=0).stop 2024-09-16T01:24:41.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.871+0000 7fe103c44740 1 -- 172.21.15.63:0/1721893244 shutdown_connections 2024-09-16T01:24:41.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.871+0000 7fe103c44740 1 --2- 172.21.15.63:0/1721893244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a6a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.871+0000 7fe103c44740 1 --2- 172.21.15.63:0/1721893244 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a6a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.871+0000 7fe103c44740 1 --2- 172.21.15.63:0/1721893244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5e930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.871+0000 7fe103c44740 1 -- 172.21.15.63:0/1721893244 >> 172.21.15.63:0/1721893244 conn(0x555af6a3fa30 msgr2=0x555af6a4ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.871+0000 7fe103c44740 1 -- 172.21.15.63:0/1721893244 shutdown_connections 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.871+0000 7fe103c44740 1 -- 172.21.15.63:0/1721893244 wait complete. 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.871+0000 7fe103c44740 1 -- start start 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe103c44740 1 Processor -- start 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe103c44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe103c44740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a565b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe103c44740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a56b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe103c44740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc1a9a00 con 0x555af6a43ca0 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe103c44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc1aae70 con 0x555af6a43380 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe103c44740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc1aa0d0 con 0x555af6a52a90 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe103c44740 10 client.0 _ll_register_callbacks cb 0x7fe0f4014e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe0faffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe0faffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:50532/0 (socket says 172.21.15.63:50532) 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe0f3fff640 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a56b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.872+0000 7fe0faffd640 1 -- 172.21.15.63:0/1899318359 learned_addr learned my addr 172.21.15.63:0/1899318359 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.873+0000 7fe0fb7fe640 1 -- 172.21.15.63:0/1899318359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 msgr2=0x555af6a5b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.873+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.873+0000 7fe0fb7fe640 1 -- 172.21.15.63:0/1899318359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 msgr2=0x555af6a565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.873+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.873+0000 7fe0fb7fe640 1 -- 172.21.15.63:0/1899318359 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555af6a57340 con 0x555af6a52a90 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.873+0000 7fe0f3fff640 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.873+0000 7fe0faffd640 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.873+0000 7fe0fb7fe640 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a56b10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40138a0 tx=0x7fe0f4005c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=860519435969b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.873+0000 7fe0daffd640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:24:41.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe0daffd640 1 -- 172.21.15.63:0/1899318359 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4041060 con 0x555af6a52a90 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe0daffd640 1 -- 172.21.15.63:0/1899318359 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe0f40205d0 con 0x555af6a52a90 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe103c44740 1 -- 172.21.15.63:0/1899318359 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0ec0cd7f0 con 0x555af6a52a90 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe0daffd640 1 -- 172.21.15.63:0/1899318359 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe0f4024070 con 0x555af6a52a90 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe103c44740 10 client.24973 fetch_fsmap learned FSMap version 25 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe103c44740 1 -- 172.21.15.63:0/1899318359 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555af6a460e0 con 0x555af6a52a90 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe0daffd640 1 -- 172.21.15.63:0/1899318359 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0ec0cd7f0 con 0x555af6a52a90 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe0daffd640 1 -- 172.21.15.63:0/1899318359 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe0f4046070 con 0x555af6a52a90 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe103c44740 10 client.24973 fetch_fsmap finished waiting for FSMap version 25 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe103c44740 10 client.24973 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe103c44740 20 client.24973 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:41.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe103c44740 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555af6a467a0 0x555af6a48bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe103c44740 4 client.24973 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe103c44740 1 -- 172.21.15.63:0/1899318359 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555af69b0d60 con 0x555af6a467a0 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.874+0000 7fe0faffd640 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555af6a467a0 0x555af6a48bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.875+0000 7fe0daffd640 10 client.24973 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.875+0000 7fe0faffd640 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555af6a467a0 0x555af6a48bc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=618383c7fc751c15 server_cookie=c54003eac6857c1a in_seq=0 out_seq=0 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.875+0000 7fe0daffd640 1 -- 172.21.15.63:0/1899318359 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555af69b0d60 con 0x555af6a467a0 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.875+0000 7fe0daffd640 10 client.24973 handle_command_reply: tid=0 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 client.24973 shutdown 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 -- 172.21.15.63:0/1899318359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 msgr2=0x555af6a56b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a56b10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40138a0 tx=0x7fe0f4005c40 comp rx=0 tx=0).stop 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 -- 172.21.15.63:0/1899318359 shutdown_connections 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555af6a52a90 0x555af6a56b10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555af6a467a0 0x555af6a48bc0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555af6a43ca0 0x555af6a565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 --2- 172.21.15.63:0/1899318359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af6a43380 0x555af6a5b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 -- 172.21.15.63:0/1899318359 >> 172.21.15.63:0/1899318359 conn(0x555af6a3fa30 msgr2=0x555af6a50f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:41.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe0daffd640 0 client.24973 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:41.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 -- 172.21.15.63:0/1899318359 shutdown_connections 2024-09-16T01:24:41.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 1 -- 172.21.15.63:0/1899318359 wait complete. 2024-09-16T01:24:41.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.876+0000 7fe103c44740 20 client.24973 trim_cache size 0 max 16384 2024-09-16T01:24:41.883 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:24:41.884 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-16T01:24:41.884 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {} 2024-09-16T01:24:41.884 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:24:41.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 -- 172.21.15.63:0/2732445346 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0e80a3240 msgr2=0x7fe0e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:41.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0e80a3240 0x7fe0e80a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40099e0 tx=0x7fe0f400fe70 comp rx=0 tx=0).stop 2024-09-16T01:24:41.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 -- 172.21.15.63:0/2732445346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc101dd0 msgr2=0x7fe0fc198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:41.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc101dd0 0x7fe0fc198330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00e9f0 tx=0x7fe0ec00eeb0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 -- 172.21.15.63:0/2732445346 shutdown_connections 2024-09-16T01:24:41.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fe0e80a3240 0x7fe0e80a5700 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0fc106f00 0x7fe0fc19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0fc102780 0x7fe0fc198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 --2- 172.21.15.63:0/2732445346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc101dd0 0x7fe0fc198330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:41.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 -- 172.21.15.63:0/2732445346 >> 172.21.15.63:0/2732445346 conn(0x7fe0fc0fd8b0 msgr2=0x7fe0fc0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:41.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 -- 172.21.15.63:0/2732445346 shutdown_connections 2024-09-16T01:24:41.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:41.877+0000 7fe10186b640 1 -- 172.21.15.63:0/2732445346 wait complete. 2024-09-16T01:24:42.743 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-16T01:24:42.744 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:24:43.041 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:43.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:43 smithi192 ceph-mon[34775]: pgmap v376: 97 pgs: 97 active+clean; 42 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 3.1 MiB/s wr, 344 op/s 2024-09-16T01:24:43.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:43 smithi162 ceph-mon[34539]: pgmap v376: 97 pgs: 97 active+clean; 42 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 3.1 MiB/s wr, 344 op/s 2024-09-16T01:24:43.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:43 smithi063 ceph-mon[31070]: pgmap v376: 97 pgs: 97 active+clean; 42 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 3.1 MiB/s wr, 344 op/s 2024-09-16T01:24:44.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:44 smithi063 ceph-mon[31070]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:24:44.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:44 smithi192 ceph-mon[34775]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:24:44.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:44 smithi162 ceph-mon[34539]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:24:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:45 smithi192 ceph-mon[34775]: pgmap v377: 97 pgs: 97 active+clean; 50 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 312 op/s 2024-09-16T01:24:45.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:45 smithi162 ceph-mon[34539]: pgmap v377: 97 pgs: 97 active+clean; 50 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 312 op/s 2024-09-16T01:24:45.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:45 smithi063 ceph-mon[31070]: pgmap v377: 97 pgs: 97 active+clean; 50 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 312 op/s 2024-09-16T01:24:46.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:46 smithi192 ceph-mon[34775]: pgmap v378: 97 pgs: 97 active+clean; 52 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 289 op/s 2024-09-16T01:24:46.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:46 smithi162 ceph-mon[34539]: pgmap v378: 97 pgs: 97 active+clean; 52 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 289 op/s 2024-09-16T01:24:46.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:46 smithi063 ceph-mon[31070]: pgmap v378: 97 pgs: 97 active+clean; 52 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 289 op/s 2024-09-16T01:24:47.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:47 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2370858456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:24:47.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:47 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2370858456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:24:47.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:47 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2370858456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.920+0000 7fba05af8640 1 -- 172.21.15.63:0/2038081357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba001036e0 msgr2=0x7fba00107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.920+0000 7fba05af8640 1 --2- 172.21.15.63:0/2038081357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba001036e0 0x7fba00107b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009930 tx=0x7fb9f402a420 comp rx=0 tx=0).stop 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.920+0000 7fba05af8640 1 -- 172.21.15.63:0/2038081357 shutdown_connections 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.920+0000 7fba05af8640 1 --2- 172.21.15.63:0/2038081357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba001082a0 0x7fba0010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.920+0000 7fba05af8640 1 --2- 172.21.15.63:0/2038081357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba001036e0 0x7fba00107b90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.920+0000 7fba05af8640 1 --2- 172.21.15.63:0/2038081357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00102d30 0x7fba00103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.920+0000 7fba05af8640 1 -- 172.21.15.63:0/2038081357 >> 172.21.15.63:0/2038081357 conn(0x7fba000fc7d0 msgr2=0x7fba000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.920+0000 7fba05af8640 1 -- 172.21.15.63:0/2038081357 shutdown_connections 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.921+0000 7fba05af8640 1 -- 172.21.15.63:0/2038081357 wait complete. 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.921+0000 7fba05af8640 1 Processor -- start 2024-09-16T01:24:47.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.921+0000 7fba05af8640 1 -- start start 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fba05af8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00102d30 0x7fba00198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fba05af8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba001036e0 0x7fba00198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fba05af8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba001082a0 0x7fba0019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fba05af8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fba00111f10 con 0x7fba001036e0 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fba05af8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba00111d90 con 0x7fba00102d30 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fba05af8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fba00112090 con 0x7fba001082a0 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fb9ff7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00102d30 0x7fba00198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fb9ff7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00102d30 0x7fba00198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:50554/0 (socket says 172.21.15.63:50554) 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fb9ff7fe640 1 -- 172.21.15.63:0/2370858456 learned_addr learned my addr 172.21.15.63:0/2370858456 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fb9feffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba001036e0 0x7fba00198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fb9ff7fe640 1 -- 172.21.15.63:0/2370858456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba001082a0 msgr2=0x7fba0019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fb9fffff640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba001082a0 0x7fba0019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:47.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.922+0000 7fb9ff7fe640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba001082a0 0x7fba0019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fb9ff7fe640 1 -- 172.21.15.63:0/2370858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba001036e0 msgr2=0x7fba00198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:47.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fb9ff7fe640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba001036e0 0x7fba00198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fb9ff7fe640 1 -- 172.21.15.63:0/2370858456 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0019d4f0 con 0x7fba00102d30 2024-09-16T01:24:47.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fb9feffd640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba001036e0 0x7fba00198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:47.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fb9fffff640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba001082a0 0x7fba0019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:47.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:24:47.623 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"btime":"2024-09-16T01:24:43:130913+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:24:43.087565+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24445,24460,24467]},"id":1}]} 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fb9ff7fe640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00102d30 0x7fba00198540 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000e9f0 tx=0x7fb9f000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fb9fcff9640 1 -- 172.21.15.63:0/2370858456 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f000cd80 con 0x7fba00102d30 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fb9fcff9640 1 -- 172.21.15.63:0/2370858456 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb9f00108e0 con 0x7fba00102d30 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fba05af8640 1 -- 172.21.15.63:0/2370858456 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0019d7e0 con 0x7fba00102d30 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fb9fcff9640 1 -- 172.21.15.63:0/2370858456 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0018920 con 0x7fba00102d30 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.923+0000 7fba05af8640 1 -- 172.21.15.63:0/2370858456 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba001008c0 con 0x7fba00102d30 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.924+0000 7fba05af8640 1 -- 172.21.15.63:0/2370858456 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba0006a850 con 0x7fba00102d30 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.926+0000 7fb9fcff9640 1 -- 172.21.15.63:0/2370858456 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb9f0010a90 con 0x7fba00102d30 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.927+0000 7fb9fcff9640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb9e80a3240 0x7fb9e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.927+0000 7fb9feffd640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb9e80a3240 0x7fb9e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.927+0000 7fb9fcff9640 1 -- 172.21.15.63:0/2370858456 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb9f00d0170 con 0x7fba00102d30 2024-09-16T01:24:47.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.927+0000 7fb9feffd640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb9e80a3240 0x7fb9e80a5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4031440 tx=0x7fb9f4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:45.933+0000 7fb9fcff9640 1 -- 172.21.15.63:0/2370858456 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9f009ce90 con 0x7fba00102d30 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.183+0000 7fba05af8640 1 -- 172.21.15.63:0/2370858456 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba00103110 con 0x7fba00102d30 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.191+0000 7fb9fcff9640 1 -- 172.21.15.63:0/2370858456 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11912 (secure 0 0 0) 0x7fb9f009c790 con 0x7fba00102d30 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 26 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.193+0000 7fba05af8640 1 -- 172.21.15.63:0/2370858456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb9e80a3240 msgr2=0x7fb9e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.193+0000 7fba05af8640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb9e80a3240 0x7fb9e80a5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4031440 tx=0x7fb9f4000bc0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.193+0000 7fba05af8640 1 -- 172.21.15.63:0/2370858456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00102d30 msgr2=0x7fba00198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.193+0000 7fba05af8640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00102d30 0x7fba00198540 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000e9f0 tx=0x7fb9f000eeb0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.193+0000 7fba05af8640 1 -- 172.21.15.63:0/2370858456 shutdown_connections 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.193+0000 7fba05af8640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fb9e80a3240 0x7fb9e80a5700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.193+0000 7fba05af8640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba001082a0 0x7fba0019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.193+0000 7fba05af8640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba001036e0 0x7fba00198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.193+0000 7fba05af8640 1 --2- 172.21.15.63:0/2370858456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba00102d30 0x7fba00198540 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:47.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.193+0000 7fba05af8640 1 -- 172.21.15.63:0/2370858456 >> 172.21.15.63:0/2370858456 conn(0x7fba000fc7d0 msgr2=0x7fba00105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:47.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.194+0000 7fba05af8640 1 -- 172.21.15.63:0/2370858456 shutdown_connections 2024-09-16T01:24:47.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:46.194+0000 7fba05af8640 1 -- 172.21.15.63:0/2370858456 wait complete. 2024-09-16T01:24:48.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:48 smithi192 ceph-mon[34775]: pgmap v379: 97 pgs: 97 active+clean; 58 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 354 op/s 2024-09-16T01:24:48.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:48 smithi162 ceph-mon[34539]: pgmap v379: 97 pgs: 97 active+clean; 58 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 354 op/s 2024-09-16T01:24:48.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:48 smithi063 ceph-mon[31070]: pgmap v379: 97 pgs: 97 active+clean; 58 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.1 MiB/s wr, 354 op/s 2024-09-16T01:24:48.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-16T01:24:49.009 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.701+0000 7f792a29a640 1 -- 172.21.15.63:0/3397475367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924102570 msgr2=0x7f79241029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.701+0000 7f792a29a640 1 --2- 172.21.15.63:0/3397475367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924102570 0x7f79241029b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7918009900 tx=0x7f791802a480 comp rx=0 tx=0).stop 2024-09-16T01:24:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.701+0000 7f792a29a640 1 -- 172.21.15.63:0/3397475367 shutdown_connections 2024-09-16T01:24:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.701+0000 7f792a29a640 1 --2- 172.21.15.63:0/3397475367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7924102ef0 0x7f792410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.701+0000 7f792a29a640 1 --2- 172.21.15.63:0/3397475367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924102570 0x7f79241029b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.701+0000 7f792a29a640 1 --2- 172.21.15.63:0/3397475367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7924100e20 0x7f7924101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.701+0000 7f792a29a640 1 -- 172.21.15.63:0/3397475367 >> 172.21.15.63:0/3397475367 conn(0x7f79240fc7d0 msgr2=0x7f79240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.701+0000 7f792a29a640 1 -- 172.21.15.63:0/3397475367 shutdown_connections 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.701+0000 7f792a29a640 1 -- 172.21.15.63:0/3397475367 wait complete. 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f792a29a640 1 Processor -- start 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f792a29a640 1 -- start start 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f792a29a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7924100e20 0x7f79240fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f792a29a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924102570 0x7f79240fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f792a29a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7924102ef0 0x7f79240fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f792a29a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7924110e30 con 0x7f7924102570 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f792a29a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7924110cb0 con 0x7f7924100e20 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f792a29a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7924110fb0 con 0x7f7924102ef0 2024-09-16T01:24:49.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f79237fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924102570 0x7f79240fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f7923fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7924100e20 0x7f79240fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f79237fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924102570 0x7f79240fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58870/0 (socket says 172.21.15.63:58870) 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f79237fe640 1 -- 172.21.15.63:0/567923297 learned_addr learned my addr 172.21.15.63:0/567923297 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.702+0000 7f7928837640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7924102ef0 0x7f79240fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f7923fff640 1 -- 172.21.15.63:0/567923297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7924102ef0 msgr2=0x7f79240fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f7923fff640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7924102ef0 0x7f79240fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f7923fff640 1 -- 172.21.15.63:0/567923297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924102570 msgr2=0x7f79240fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f7923fff640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924102570 0x7f79240fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f7923fff640 1 -- 172.21.15.63:0/567923297 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79241a69a0 con 0x7f7924100e20 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f79237fe640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924102570 0x7f79240fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f7923fff640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7924100e20 0x7f79240fcc80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f791400d720 tx=0x7f791400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:49.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f79217fa640 1 -- 172.21.15.63:0/567923297 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914017070 con 0x7f7924100e20 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f792a29a640 1 -- 172.21.15.63:0/567923297 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79241a6c90 con 0x7f7924100e20 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f79217fa640 1 -- 172.21.15.63:0/567923297 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f791400de30 con 0x7f7924100e20 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f79217fa640 1 -- 172.21.15.63:0/567923297 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79140047a0 con 0x7f7924100e20 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.703+0000 7f792a29a640 1 -- 172.21.15.63:0/567923297 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79241a7180 con 0x7f7924100e20 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f79217fa640 1 -- 172.21.15.63:0/567923297 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f79140099d0 con 0x7f7924100e20 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f792c673740 1 Processor -- start 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f792c673740 1 -- start start 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f792c673740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878d9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f792c673740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f792c673740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f792c673740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56198783f2f0 con 0x5619878d95d0 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f792c673740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5619877e6cf0 con 0x5619878dab40 2024-09-16T01:24:49.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f792c673740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56198783b2b0 con 0x5619878e4370 2024-09-16T01:24:49.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f7923fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f7928837640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f7923fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878d9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58882/0 (socket says 172.21.15.63:58882) 2024-09-16T01:24:49.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f7923fff640 1 -- 172.21.15.63:0/1451523748 learned_addr learned my addr 172.21.15.63:0/1451523748 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:49.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f79237fe640 1 --2- 172.21.15.63:0/1451523748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f7928837640 1 -- 172.21.15.63:0/1451523748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 msgr2=0x5619878e6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:49.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f7928837640 1 --2- 172.21.15.63:0/1451523748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878e6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f7928837640 1 -- 172.21.15.63:0/1451523748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 msgr2=0x5619878d9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:49.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f7928837640 1 --2- 172.21.15.63:0/1451523748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878d9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.706+0000 7f7928837640 1 -- 172.21.15.63:0/1451523748 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619877cb3a0 con 0x5619878dab40 2024-09-16T01:24:49.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.707+0000 7f79237fe640 1 --2- 172.21.15.63:0/1451523748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:49.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.707+0000 7f79217fa640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f790c0a3240 0x7f790c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.707+0000 7f7923fff640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f790c0a3240 0x7f790c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.707+0000 7f7928837640 1 --2- 172.21.15.63:0/1451523748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878d9090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f791c009f00 tx=0x7f791c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f6962b901fda389 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:49.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.707+0000 7f79217fa640 1 -- 172.21.15.63:0/567923297 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f79140cf520 con 0x7f7924100e20 2024-09-16T01:24:49.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.707+0000 7f790a7fc640 1 -- 172.21.15.63:0/1451523748 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c004d20 con 0x5619878dab40 2024-09-16T01:24:49.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.707+0000 7f790a7fc640 1 -- 172.21.15.63:0/1451523748 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f791c004050 con 0x5619878dab40 2024-09-16T01:24:49.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.707+0000 7f790a7fc640 1 -- 172.21.15.63:0/1451523748 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c005280 con 0x5619878dab40 2024-09-16T01:24:49.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 -- 172.21.15.63:0/1451523748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 msgr2=0x5619878d9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f7923fff640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f790c0a3240 0x7f790c0a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f791409b840 tx=0x7f7914086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 --2- 172.21.15.63:0/1451523748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878d9090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f791c009f00 tx=0x7f791c011810 comp rx=0 tx=0).stop 2024-09-16T01:24:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 -- 172.21.15.63:0/1451523748 shutdown_connections 2024-09-16T01:24:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 --2- 172.21.15.63:0/1451523748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 --2- 172.21.15.63:0/1451523748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 --2- 172.21.15.63:0/1451523748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878d9090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 -- 172.21.15.63:0/1451523748 >> 172.21.15.63:0/1451523748 conn(0x5619878a2310 msgr2=0x5619878d5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 -- 172.21.15.63:0/1451523748 shutdown_connections 2024-09-16T01:24:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 -- 172.21.15.63:0/1451523748 wait complete. 2024-09-16T01:24:49.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 -- start start 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.708+0000 7f792c673740 1 Processor -- start 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f792c673740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878e3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f792c673740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878dab40 0x5619878e0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f792c673740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878e4370 0x5619878e14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f792c673740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5619878e7070 con 0x5619878d95d0 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f792c673740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5619877fa060 con 0x5619878e4370 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f792c673740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5619878e71f0 con 0x5619878dab40 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f792c673740 10 client.0 _ll_register_callbacks cb 0x56198754d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f7928837640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878e3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f7928837640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878e3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58890/0 (socket says 172.21.15.63:58890) 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f7928837640 1 -- 172.21.15.63:0/4229734632 learned_addr learned my addr 172.21.15.63:0/4229734632 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:49.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f7928837640 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878e4370 0x5619878e14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f79237fe640 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878dab40 0x5619878e0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f7928837640 1 -- 172.21.15.63:0/4229734632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878dab40 msgr2=0x5619878e0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f7928837640 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878dab40 0x5619878e0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f7928837640 1 -- 172.21.15.63:0/4229734632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878e4370 msgr2=0x5619878e14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f7928837640 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878e4370 0x5619878e14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f7928837640 1 -- 172.21.15.63:0/4229734632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619875b03c0 con 0x5619878d95d0 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f7928837640 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878e3cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f791c0049d0 tx=0x7f791c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ec9e13f34d4d65 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.709+0000 7f79037fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f79037fe640 1 -- 172.21.15.63:0/4229734632 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c005240 con 0x5619878d95d0 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f79037fe640 1 -- 172.21.15.63:0/4229734632 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f791c0053e0 con 0x5619878d95d0 2024-09-16T01:24:49.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f792c673740 1 -- 172.21.15.63:0/4229734632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f791c004050 con 0x5619878d95d0 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f79037fe640 1 -- 172.21.15.63:0/4229734632 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f791c0055e0 con 0x5619878d95d0 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f792c673740 10 client.15381 fetch_fsmap learned FSMap version 26 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f792c673740 1 -- 172.21.15.63:0/4229734632 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5619878f2a20 con 0x5619878d95d0 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f79037fe640 1 -- 172.21.15.63:0/4229734632 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f791c004050 con 0x5619878d95d0 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f79037fe640 1 -- 172.21.15.63:0/4229734632 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f791c025070 con 0x5619878d95d0 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f792c673740 10 client.15381 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f792c673740 10 client.15381 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f792c673740 20 client.15381 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f792c673740 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x5619878f3e80 0x5619878f6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f792c673740 4 client.15381 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:49.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.710+0000 7f792c673740 1 -- 172.21.15.63:0/4229734632 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56198784c860 con 0x5619878f3e80 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.711+0000 7f79237fe640 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x5619878f3e80 0x5619878f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.711+0000 7f79037fe640 10 client.15381 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.711+0000 7f79237fe640 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x5619878f3e80 0x5619878f6270 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd96c40333e5e74c server_cookie=e08052810f5394b5 in_seq=0 out_seq=0 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f79037fe640 1 -- 172.21.15.63:0/4229734632 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56198784c860 con 0x5619878f3e80 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f79037fe640 10 client.15381 handle_command_reply: tid=0 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 client.15381 shutdown 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 -- 172.21.15.63:0/4229734632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 msgr2=0x5619878e3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878e3cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f791c0049d0 tx=0x7f791c0047f0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 -- 172.21.15.63:0/4229734632 shutdown_connections 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x5619878f3e80 0x5619878f6270 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878e4370 0x5619878e14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878dab40 0x5619878e0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 --2- 172.21.15.63:0/4229734632 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878e3cd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f79037fe640 0 client.15381 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 -- 172.21.15.63:0/4229734632 >> 172.21.15.63:0/4229734632 conn(0x5619878a2310 msgr2=0x5619878db930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 -- 172.21.15.63:0/4229734632 shutdown_connections 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 1 -- 172.21.15.63:0/4229734632 wait complete. 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.712+0000 7f792c673740 20 client.15381 trim_cache size 0 max 16384 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.725+0000 7f792c673740 1 Processor -- start 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.725+0000 7f792c673740 1 -- start start 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.725+0000 7f792c673740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878f0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.725+0000 7f792c673740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f792c673740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f792c673740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f79241b2030 con 0x5619878d95d0 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f792c673740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79241af900 con 0x5619878dab40 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f792c673740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f79241ad730 con 0x5619878e4370 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7928837640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7928837640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878f0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58894/0 (socket says 172.21.15.63:58894) 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7928837640 1 -- 172.21.15.63:0/2983776095 learned_addr learned my addr 172.21.15.63:0/2983776095 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f79237fe640 1 --2- 172.21.15.63:0/2983776095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7928837640 1 -- 172.21.15.63:0/2983776095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 msgr2=0x5619878fb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7928837640 1 --2- 172.21.15.63:0/2983776095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7928837640 1 -- 172.21.15.63:0/2983776095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 msgr2=0x5619878dfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7928837640 1 --2- 172.21.15.63:0/2983776095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878dfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7928837640 1 -- 172.21.15.63:0/2983776095 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619878e4000 con 0x5619878d95d0 2024-09-16T01:24:49.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f79237fe640 1 --2- 172.21.15.63:0/2983776095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878dfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:49.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7928837640 1 --2- 172.21.15.63:0/2983776095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878f0340 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f791c019cc0 tx=0x7f791c003b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c496056b982bcd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:49.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7909ffb640 1 -- 172.21.15.63:0/2983776095 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c004630 con 0x5619878d95d0 2024-09-16T01:24:49.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7909ffb640 1 -- 172.21.15.63:0/2983776095 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f791c02d070 con 0x5619878d95d0 2024-09-16T01:24:49.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.726+0000 7f7909ffb640 1 -- 172.21.15.63:0/2983776095 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c005430 con 0x5619878d95d0 2024-09-16T01:24:49.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.727+0000 7f792c673740 1 -- 172.21.15.63:0/2983776095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 msgr2=0x5619878f0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:49.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.727+0000 7f792c673740 1 --2- 172.21.15.63:0/2983776095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878f0340 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f791c019cc0 tx=0x7f791c003b40 comp rx=0 tx=0).stop 2024-09-16T01:24:49.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.727+0000 7f792c673740 1 -- 172.21.15.63:0/2983776095 shutdown_connections 2024-09-16T01:24:49.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.727+0000 7f792c673740 1 --2- 172.21.15.63:0/2983776095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.727+0000 7f792c673740 1 --2- 172.21.15.63:0/2983776095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878dfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.885 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:24:49.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.727+0000 7f792c673740 1 --2- 172.21.15.63:0/2983776095 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878f0340 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.727+0000 7f792c673740 1 -- 172.21.15.63:0/2983776095 >> 172.21.15.63:0/2983776095 conn(0x5619878a2310 msgr2=0x5619878df720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.727+0000 7f792c673740 1 -- 172.21.15.63:0/2983776095 shutdown_connections 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.727+0000 7f792c673740 1 -- 172.21.15.63:0/2983776095 wait complete. 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.727+0000 7f792c673740 1 -- start start 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f792c673740 1 Processor -- start 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f792c673740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878ec4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f792c673740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878ec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f792c673740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878dd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f792c673740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f79241addc0 con 0x5619878d95d0 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f792c673740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79241af230 con 0x5619878dab40 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f792c673740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f79241ae490 con 0x5619878e4370 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f792c673740 10 client.0 _ll_register_callbacks cb 0x7f79140d2e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:49.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f7928837640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878ec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f7928837640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878ec4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58904/0 (socket says 172.21.15.63:58904) 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f7928837640 1 -- 172.21.15.63:0/1139514777 learned_addr learned my addr 172.21.15.63:0/1139514777 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f79237fe640 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878ec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f7928837640 1 -- 172.21.15.63:0/1139514777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 msgr2=0x5619878dd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f7928837640 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878dd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f7928837640 1 -- 172.21.15.63:0/1139514777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 msgr2=0x5619878ec9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f7928837640 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878ec9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f7928837640 1 -- 172.21.15.63:0/1139514777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619878ddb60 con 0x5619878d95d0 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.728+0000 7f79237fe640 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878ec9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f7928837640 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878ec4b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f791c000f80 tx=0x7f791c011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9c583544569ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f79037fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f79037fe640 1 -- 172.21.15.63:0/1139514777 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c005780 con 0x5619878d95d0 2024-09-16T01:24:49.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f79037fe640 1 -- 172.21.15.63:0/1139514777 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f791c005920 con 0x5619878d95d0 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f792c673740 1 -- 172.21.15.63:0/1139514777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f791c02d070 con 0x5619878d95d0 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f79037fe640 1 -- 172.21.15.63:0/1139514777 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f791c003ca0 con 0x5619878d95d0 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f792c673740 10 client.15387 fetch_fsmap learned FSMap version 26 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f792c673740 1 -- 172.21.15.63:0/1139514777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56198795e1f0 con 0x5619878d95d0 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f79037fe640 1 -- 172.21.15.63:0/1139514777 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f791c02d070 con 0x5619878d95d0 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f79037fe640 1 -- 172.21.15.63:0/1139514777 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f791c025040 con 0x5619878d95d0 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f792c673740 10 client.15387 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f792c673740 10 client.15387 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f792c673740 20 client.15387 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f792c673740 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x56198795e7f0 0x561987960be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f792c673740 4 client.15387 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.729+0000 7f792c673740 1 -- 172.21.15.63:0/1139514777 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561987846d70 con 0x56198795e7f0 2024-09-16T01:24:49.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.730+0000 7f79237fe640 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x56198795e7f0 0x561987960be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.730+0000 7f79237fe640 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x56198795e7f0 0x561987960be0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=641f462871f2b027 server_cookie=dc003680b3f73672 in_seq=0 out_seq=0 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.730+0000 7f79037fe640 10 client.15387 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.730+0000 7f79037fe640 1 -- 172.21.15.63:0/1139514777 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561987846d70 con 0x56198795e7f0 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.730+0000 7f79037fe640 10 client.15387 handle_command_reply: tid=0 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.730+0000 7f792c673740 1 client.15387 shutdown 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.730+0000 7f792c673740 1 -- 172.21.15.63:0/1139514777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 msgr2=0x5619878ec4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.730+0000 7f792c673740 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878ec4b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f791c000f80 tx=0x7f791c011d80 comp rx=0 tx=0).stop 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.730+0000 7f792c673740 1 -- 172.21.15.63:0/1139514777 shutdown_connections 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.730+0000 7f792c673740 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x56198795e7f0 0x561987960be0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792c673740 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5619878e4370 0x5619878dd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f79037fe640 0 client.15387 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792c673740 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5619878dab40 0x5619878ec9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792c673740 1 --2- 172.21.15.63:0/1139514777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5619878d95d0 0x5619878ec4b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792c673740 1 -- 172.21.15.63:0/1139514777 >> 172.21.15.63:0/1139514777 conn(0x5619878a2310 msgr2=0x5619878d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792c673740 1 -- 172.21.15.63:0/1139514777 shutdown_connections 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792c673740 1 -- 172.21.15.63:0/1139514777 wait complete. 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792c673740 20 client.15387 trim_cache size 0 max 16384 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 -- 172.21.15.63:0/567923297 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f790c0a3240 msgr2=0x7f790c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f790c0a3240 0x7f790c0a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f791409b840 tx=0x7f7914086040 comp rx=0 tx=0).stop 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 -- 172.21.15.63:0/567923297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7924100e20 msgr2=0x7f79240fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7924100e20 0x7f79240fcc80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f791400d720 tx=0x7f791400dbe0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 -- 172.21.15.63:0/567923297 shutdown_connections 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f790c0a3240 0x7f790c0a5700 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7924102ef0 0x7f79240fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7924102570 0x7f79240fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 --2- 172.21.15.63:0/567923297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7924100e20 0x7f79240fcc80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:49.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 -- 172.21.15.63:0/567923297 >> 172.21.15.63:0/567923297 conn(0x7f79240fc7d0 msgr2=0x7f792406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:49.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.731+0000 7f792a29a640 1 -- 172.21.15.63:0/567923297 shutdown_connections 2024-09-16T01:24:49.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:49.732+0000 7f792a29a640 1 -- 172.21.15.63:0/567923297 wait complete. 2024-09-16T01:24:50.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:50 smithi063 ceph-mon[31070]: pgmap v380: 97 pgs: 97 active+clean; 58 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 245 op/s 2024-09-16T01:24:50.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:50 smithi192 ceph-mon[34775]: pgmap v380: 97 pgs: 97 active+clean; 58 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 245 op/s 2024-09-16T01:24:50.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:50 smithi162 ceph-mon[34539]: pgmap v380: 97 pgs: 97 active+clean; 58 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 245 op/s 2024-09-16T01:24:50.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-16T01:24:51.157 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:51.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.654+0000 7f125502d640 1 -- 172.21.15.63:0/1230219054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1250102790 msgr2=0x7f12501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:51.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.654+0000 7f125502d640 1 --2- 172.21.15.63:0/1230219054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1250102790 0x7f12501067e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1238009900 tx=0x7f123802a410 comp rx=0 tx=0).stop 2024-09-16T01:24:51.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.654+0000 7f125502d640 1 -- 172.21.15.63:0/1230219054 shutdown_connections 2024-09-16T01:24:51.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.654+0000 7f125502d640 1 --2- 172.21.15.63:0/1230219054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1250106f10 0x7f125010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.654+0000 7f125502d640 1 --2- 172.21.15.63:0/1230219054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1250102790 0x7f12501067e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.654+0000 7f125502d640 1 --2- 172.21.15.63:0/1230219054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1250101de0 0x7f12501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.654+0000 7f125502d640 1 -- 172.21.15.63:0/1230219054 >> 172.21.15.63:0/1230219054 conn(0x7f12500fd8c0 msgr2=0x7f12500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.654+0000 7f125502d640 1 -- 172.21.15.63:0/1230219054 shutdown_connections 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.654+0000 7f125502d640 1 -- 172.21.15.63:0/1230219054 wait complete. 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f125502d640 1 Processor -- start 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f125502d640 1 -- start start 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f125502d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1250101de0 0x7f12501983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f125502d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1250102790 0x7f1250198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f125502d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1250106f10 0x7f125019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f125502d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1250111de0 con 0x7f1250101de0 2024-09-16T01:24:51.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f125502d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1250111c60 con 0x7f1250106f10 2024-09-16T01:24:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f125502d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1250111f60 con 0x7f1250102790 2024-09-16T01:24:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f124ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1250101de0 0x7f12501983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f124ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1250101de0 0x7f12501983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58922/0 (socket says 172.21.15.63:58922) 2024-09-16T01:24:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f124ed9d640 1 -- 172.21.15.63:0/2464357839 learned_addr learned my addr 172.21.15.63:0/2464357839 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f124f59e640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1250106f10 0x7f125019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f124e59c640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1250102790 0x7f1250198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f124ed9d640 1 -- 172.21.15.63:0/2464357839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1250102790 msgr2=0x7f1250198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:51.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f124ed9d640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1250102790 0x7f1250198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f124ed9d640 1 -- 172.21.15.63:0/2464357839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1250106f10 msgr2=0x7f125019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f124ed9d640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1250106f10 0x7f125019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.655+0000 7f124ed9d640 1 -- 172.21.15.63:0/2464357839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125019d390 con 0x7f1250101de0 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.656+0000 7f124ed9d640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1250101de0 0x7f12501983e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f124000e9f0 tx=0x7f124000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.656+0000 7f1247fff640 1 -- 172.21.15.63:0/2464357839 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124000cd80 con 0x7f1250101de0 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.656+0000 7f125502d640 1 -- 172.21.15.63:0/2464357839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125019d680 con 0x7f1250101de0 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.656+0000 7f1247fff640 1 -- 172.21.15.63:0/2464357839 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f12400108e0 con 0x7f1250101de0 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.656+0000 7f1247fff640 1 -- 172.21.15.63:0/2464357839 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240018920 con 0x7f1250101de0 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.656+0000 7f125502d640 1 -- 172.21.15.63:0/2464357839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12501a4f60 con 0x7f1250101de0 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.658+0000 7f1247fff640 1 -- 172.21.15.63:0/2464357839 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1240010a90 con 0x7f1250101de0 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.658+0000 7f1257406740 1 Processor -- start 2024-09-16T01:24:51.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f1257406740 1 -- start start 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f1257406740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999eb40 0x56419999d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f1257406740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 0x56419999da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f1257406740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641999a8370 0x5641999aa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f1257406740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5641999032f0 con 0x56419999eb40 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f1257406740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5641998aacf0 con 0x56419999d5d0 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f1257406740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5641998ff2b0 con 0x5641999a8370 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999eb40 0x56419999d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999eb40 0x56419999d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58934/0 (socket says 172.21.15.63:58934) 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124f59e640 1 -- 172.21.15.63:0/61220253 learned_addr learned my addr 172.21.15.63:0/61220253 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124ed9d640 1 --2- 172.21.15.63:0/61220253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 0x56419999da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124e59c640 1 --2- 172.21.15.63:0/61220253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641999a8370 0x5641999aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124f59e640 1 -- 172.21.15.63:0/61220253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641999a8370 msgr2=0x5641999aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f1247fff640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f123c0a3240 0x7f123c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124f59e640 1 --2- 172.21.15.63:0/61220253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641999a8370 0x5641999aa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124f59e640 1 -- 172.21.15.63:0/61220253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 msgr2=0x56419999da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124f59e640 1 --2- 172.21.15.63:0/61220253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 0x56419999da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124f59e640 1 -- 172.21.15.63:0/61220253 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56419988f3a0 con 0x56419999eb40 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.659+0000 7f124e59c640 1 --2- 172.21.15.63:0/61220253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641999a8370 0x5641999aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.660+0000 7f1247fff640 1 -- 172.21.15.63:0/2464357839 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f12400cfc90 con 0x7f1250101de0 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.660+0000 7f124f59e640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f123c0a3240 0x7f123c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.660+0000 7f124f59e640 1 --2- 172.21.15.63:0/61220253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999eb40 0x56419999d090 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1248009f50 tx=0x7f12480118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89f6121ecc94465 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.660+0000 7f12457fa640 1 -- 172.21.15.63:0/61220253 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248004250 con 0x56419999eb40 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.660+0000 7f12457fa640 1 -- 172.21.15.63:0/61220253 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f124800fe50 con 0x56419999eb40 2024-09-16T01:24:51.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.660+0000 7f12457fa640 1 -- 172.21.15.63:0/61220253 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124801ba80 con 0x56419999eb40 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 -- 172.21.15.63:0/61220253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999eb40 msgr2=0x56419999d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f124f59e640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f123c0a3240 0x7f123c0a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1248012fd0 tx=0x7f1248021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 --2- 172.21.15.63:0/61220253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999eb40 0x56419999d090 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1248009f50 tx=0x7f12480118d0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 -- 172.21.15.63:0/61220253 shutdown_connections 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 --2- 172.21.15.63:0/61220253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641999a8370 0x5641999aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 --2- 172.21.15.63:0/61220253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 0x56419999da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 --2- 172.21.15.63:0/61220253 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999eb40 0x56419999d090 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 -- 172.21.15.63:0/61220253 >> 172.21.15.63:0/61220253 conn(0x564199966310 msgr2=0x564199999c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 -- 172.21.15.63:0/61220253 shutdown_connections 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 -- 172.21.15.63:0/61220253 wait complete. 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 -- start start 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.661+0000 7f1257406740 1 Processor -- start 2024-09-16T01:24:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f1257406740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999d5d0 0x5641999a7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f1257406740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999eb40 0x5641999a5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f1257406740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f1257406740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5641999ab070 con 0x5641999a8370 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f1257406740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5641998be060 con 0x56419999eb40 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f1257406740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5641999ab1f0 con 0x56419999d5d0 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f1257406740 10 client.0 _ll_register_callbacks cb 0x5641996118c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999eb40 0x5641999a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58950/0 (socket says 172.21.15.63:58950) 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999eb40 0x5641999a5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:56360/0 (socket says 172.21.15.63:56360) 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124f59e640 1 -- 172.21.15.63:0/3181960471 learned_addr learned my addr 172.21.15.63:0/3181960471 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124ed9d640 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999d5d0 0x5641999a7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124f59e640 1 -- 172.21.15.63:0/3181960471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999d5d0 msgr2=0x5641999a7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124f59e640 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999d5d0 0x5641999a7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124f59e640 1 -- 172.21.15.63:0/3181960471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999eb40 msgr2=0x5641999a5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124f59e640 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999eb40 0x5641999a5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124f59e640 1 -- 172.21.15.63:0/3181960471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641996743c0 con 0x5641999a8370 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124e59c640 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999eb40 0x5641999a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f124f59e640 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a5600 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1248003a60 tx=0x7f124801b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f01f84f5909de server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.662+0000 7f12367fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f12367fc640 1 -- 172.21.15.63:0/3181960471 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248009be0 con 0x5641999a8370 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f12367fc640 1 -- 172.21.15.63:0/3181960471 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f124800f920 con 0x5641999a8370 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f1257406740 1 -- 172.21.15.63:0/3181960471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f124800fe50 con 0x5641999a8370 2024-09-16T01:24:51.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f12367fc640 1 -- 172.21.15.63:0/3181960471 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f124800fb20 con 0x5641999a8370 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f1257406740 10 client.15399 fetch_fsmap learned FSMap version 26 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f1257406740 1 -- 172.21.15.63:0/3181960471 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5641999baf20 con 0x5641999a8370 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f12367fc640 1 -- 172.21.15.63:0/3181960471 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f124800fe50 con 0x5641999a8370 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f12367fc640 1 -- 172.21.15.63:0/3181960471 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f1248025430 con 0x5641999a8370 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f1257406740 10 client.15399 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f1257406740 10 client.15399 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f1257406740 20 client.15399 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f1257406740 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5641999bc2d0 0x5641999be6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f1257406740 4 client.15399 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f1257406740 1 -- 172.21.15.63:0/3181960471 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564199910860 con 0x5641999bc2d0 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.663+0000 7f124ed9d640 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5641999bc2d0 0x5641999be6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.664+0000 7f12367fc640 10 client.15399 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:24:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.664+0000 7f124ed9d640 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5641999bc2d0 0x5641999be6c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a903a681b945207d server_cookie=d969204a23ece489 in_seq=0 out_seq=0 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f12367fc640 1 -- 172.21.15.63:0/3181960471 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564199910860 con 0x5641999bc2d0 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f12367fc640 10 client.15399 handle_command_reply: tid=0 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 client.15399 shutdown 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 -- 172.21.15.63:0/3181960471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 msgr2=0x5641999a5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a5600 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1248003a60 tx=0x7f124801b6c0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 -- 172.21.15.63:0/3181960471 shutdown_connections 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5641999bc2d0 0x5641999be6c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a5600 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999eb40 0x5641999a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 --2- 172.21.15.63:0/3181960471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999d5d0 0x5641999a7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f12367fc640 0 client.15399 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 -- 172.21.15.63:0/3181960471 >> 172.21.15.63:0/3181960471 conn(0x564199966310 msgr2=0x56419999f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 -- 172.21.15.63:0/3181960471 shutdown_connections 2024-09-16T01:24:51.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 1 -- 172.21.15.63:0/3181960471 wait complete. 2024-09-16T01:24:51.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.665+0000 7f1257406740 20 client.15399 trim_cache size 0 max 16384 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f1257406740 1 Processor -- start 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f1257406740 1 -- start start 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f1257406740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999d5d0 0x564199999e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f1257406740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 0x5641999b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f1257406740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641999a8370 0x5641999c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f1257406740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f12501adb60 con 0x56419999d5d0 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f1257406740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12501ab430 con 0x5641999a8370 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f1257406740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f12501a9260 con 0x56419999eb40 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f124ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999d5d0 0x564199999e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f124ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999d5d0 0x564199999e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58966/0 (socket says 172.21.15.63:58966) 2024-09-16T01:24:51.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f124ed9d640 1 -- 172.21.15.63:0/742517082 learned_addr learned my addr 172.21.15.63:0/742517082 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f124f59e640 1 --2- 172.21.15.63:0/742517082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641999a8370 0x5641999c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.679+0000 7f124e59c640 1 --2- 172.21.15.63:0/742517082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 0x5641999b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.680+0000 7f124ed9d640 1 -- 172.21.15.63:0/742517082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 msgr2=0x5641999b87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.680+0000 7f124ed9d640 1 --2- 172.21.15.63:0/742517082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 0x5641999b87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.680+0000 7f124ed9d640 1 -- 172.21.15.63:0/742517082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641999a8370 msgr2=0x5641999c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.680+0000 7f124ed9d640 1 --2- 172.21.15.63:0/742517082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641999a8370 0x5641999c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.680+0000 7f124ed9d640 1 -- 172.21.15.63:0/742517082 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641999a57f0 con 0x56419999d5d0 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.680+0000 7f124f59e640 1 --2- 172.21.15.63:0/742517082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641999a8370 0x5641999c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.680+0000 7f124ed9d640 1 --2- 172.21.15.63:0/742517082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999d5d0 0x564199999e10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1240098710 tx=0x7f12400cd660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccaa0c2e2d89d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.680+0000 7f1244ff9640 1 -- 172.21.15.63:0/742517082 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12400abe80 con 0x56419999d5d0 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.680+0000 7f1244ff9640 1 -- 172.21.15.63:0/742517082 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1240010de0 con 0x56419999d5d0 2024-09-16T01:24:51.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.680+0000 7f1244ff9640 1 -- 172.21.15.63:0/742517082 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124009a640 con 0x56419999d5d0 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 -- 172.21.15.63:0/742517082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999d5d0 msgr2=0x564199999e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 --2- 172.21.15.63:0/742517082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999d5d0 0x564199999e10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1240098710 tx=0x7f12400cd660 comp rx=0 tx=0).stop 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 -- 172.21.15.63:0/742517082 shutdown_connections 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 --2- 172.21.15.63:0/742517082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5641999a8370 0x5641999c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 --2- 172.21.15.63:0/742517082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 0x5641999b87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 --2- 172.21.15.63:0/742517082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56419999d5d0 0x564199999e10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 -- 172.21.15.63:0/742517082 >> 172.21.15.63:0/742517082 conn(0x564199966310 msgr2=0x564199999700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 -- 172.21.15.63:0/742517082 shutdown_connections 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 -- 172.21.15.63:0/742517082 wait complete. 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 -- start start 2024-09-16T01:24:51.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.681+0000 7f1257406740 1 Processor -- start 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f1257406740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 0x5641999b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f1257406740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 0x5641999b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f1257406740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f1257406740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f12501a98f0 con 0x5641999a8370 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f1257406740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12501aad60 con 0x56419999d5d0 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f1257406740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f12501a9fc0 con 0x56419999eb40 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f1257406740 10 client.0 _ll_register_callbacks cb 0x7f12400d35e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124ed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 0x5641999b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124f59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58976/0 (socket says 172.21.15.63:58976) 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124ed9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 0x5641999b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:56372/0 (socket says 172.21.15.63:56372) 2024-09-16T01:24:51.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124f59e640 1 -- 172.21.15.63:0/1006558370 learned_addr learned my addr 172.21.15.63:0/1006558370 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124e59c640 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 0x5641999b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124ed9d640 1 -- 172.21.15.63:0/1006558370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 msgr2=0x5641999b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124ed9d640 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 0x5641999b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124ed9d640 1 -- 172.21.15.63:0/1006558370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 msgr2=0x5641999a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124ed9d640 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124ed9d640 1 -- 172.21.15.63:0/1006558370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641999a1c40 con 0x56419999d5d0 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124f59e640 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124e59c640 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 0x5641999b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f124ed9d640 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 0x5641999b4910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f124000e9c0 tx=0x7f12400a5030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4b1815ef085b896 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.682+0000 7f12367fc640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f12367fc640 1 -- 172.21.15.63:0/1006558370 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12400b4020 con 0x56419999d5d0 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f12367fc640 1 -- 172.21.15.63:0/1006558370 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f12400cd8a0 con 0x56419999d5d0 2024-09-16T01:24:51.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f1257406740 1 -- 172.21.15.63:0/1006558370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56419990ad70 con 0x56419999d5d0 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f12367fc640 1 -- 172.21.15.63:0/1006558370 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f12400a6020 con 0x56419999d5d0 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f1257406740 10 client.24980 fetch_fsmap learned FSMap version 26 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f1257406740 1 -- 172.21.15.63:0/1006558370 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564199a26790 con 0x56419999d5d0 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f12367fc640 1 -- 172.21.15.63:0/1006558370 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x56419990ad70 con 0x56419999d5d0 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f12367fc640 1 -- 172.21.15.63:0/1006558370 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f12400bc0b0 con 0x56419999d5d0 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f1257406740 10 client.24980 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f1257406740 10 client.24980 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f1257406740 20 client.24980 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f1257406740 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x564199a26da0 0x564199a29190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f1257406740 4 client.24980 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.683+0000 7f1257406740 1 -- 172.21.15.63:0/1006558370 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564199887170 con 0x564199a26da0 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f124e59c640 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x564199a26da0 0x564199a29190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:51.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f124e59c640 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x564199a26da0 0x564199a29190 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ded2f5285c720c42 server_cookie=78ed1f7ecbaadbff in_seq=0 out_seq=0 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f12367fc640 10 client.24980 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f12367fc640 1 -- 172.21.15.63:0/1006558370 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564199887170 con 0x564199a26da0 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f12367fc640 10 client.24980 handle_command_reply: tid=0 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f1257406740 1 client.24980 shutdown 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f1257406740 1 -- 172.21.15.63:0/1006558370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 msgr2=0x5641999b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f1257406740 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 0x5641999b4910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f124000e9c0 tx=0x7f12400a5030 comp rx=0 tx=0).stop 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f1257406740 1 -- 172.21.15.63:0/1006558370 shutdown_connections 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f1257406740 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x564199a26da0 0x564199a29190 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f1257406740 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5641999a8370 0x5641999a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f1257406740 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56419999eb40 0x5641999b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f12367fc640 0 client.24980 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f1257406740 1 --2- 172.21.15.63:0/1006558370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56419999d5d0 0x5641999b4910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.684+0000 7f1257406740 1 -- 172.21.15.63:0/1006558370 >> 172.21.15.63:0/1006558370 conn(0x564199966310 msgr2=0x5641999a6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:51.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f1257406740 1 -- 172.21.15.63:0/1006558370 shutdown_connections 2024-09-16T01:24:51.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f1257406740 1 -- 172.21.15.63:0/1006558370 wait complete. 2024-09-16T01:24:51.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f1257406740 20 client.24980 trim_cache size 0 max 16384 2024-09-16T01:24:51.694 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:24:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 -- 172.21.15.63:0/2464357839 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f123c0a3240 msgr2=0x7f123c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f123c0a3240 0x7f123c0a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1248012fd0 tx=0x7f1248021000 comp rx=0 tx=0).stop 2024-09-16T01:24:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 -- 172.21.15.63:0/2464357839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1250101de0 msgr2=0x7f12501983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1250101de0 0x7f12501983e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f124000e9f0 tx=0x7f124000eeb0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 -- 172.21.15.63:0/2464357839 shutdown_connections 2024-09-16T01:24:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f123c0a3240 0x7f123c0a5700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1250106f10 0x7f125019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1250102790 0x7f1250198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 --2- 172.21.15.63:0/2464357839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1250101de0 0x7f12501983e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 -- 172.21.15.63:0/2464357839 >> 172.21.15.63:0/2464357839 conn(0x7f12500fd8c0 msgr2=0x7f12500fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 -- 172.21.15.63:0/2464357839 shutdown_connections 2024-09-16T01:24:51.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:51.685+0000 7f125502d640 1 -- 172.21.15.63:0/2464357839 wait complete. 2024-09-16T01:24:52.423 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-16T01:24:52.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:52 smithi063 ceph-mon[31070]: pgmap v381: 97 pgs: 97 active+clean; 61 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 313 op/s 2024-09-16T01:24:52.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:52 smithi192 ceph-mon[34775]: pgmap v381: 97 pgs: 97 active+clean; 61 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 313 op/s 2024-09-16T01:24:52.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:52 smithi162 ceph-mon[34539]: pgmap v381: 97 pgs: 97 active+clean; 61 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 313 op/s 2024-09-16T01:24:52.703 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.196+0000 7f5b132a9640 1 -- 172.21.15.63:0/4046343303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b0c106f10 msgr2=0x7f5b0c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.196+0000 7f5b132a9640 1 --2- 172.21.15.63:0/4046343303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b0c106f10 0x7f5b0c10ea90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009ca0 tx=0x7f5b0402a8c0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.197+0000 7f5b132a9640 1 -- 172.21.15.63:0/4046343303 shutdown_connections 2024-09-16T01:24:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.197+0000 7f5b132a9640 1 --2- 172.21.15.63:0/4046343303 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b0c106f10 0x7f5b0c10ea90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.197+0000 7f5b132a9640 1 --2- 172.21.15.63:0/4046343303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b0c102790 0x7f5b0c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.197+0000 7f5b132a9640 1 --2- 172.21.15.63:0/4046343303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b0c101de0 0x7f5b0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.197+0000 7f5b132a9640 1 -- 172.21.15.63:0/4046343303 >> 172.21.15.63:0/4046343303 conn(0x7f5b0c0fd8e0 msgr2=0x7f5b0c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:53.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.197+0000 7f5b132a9640 1 -- 172.21.15.63:0/4046343303 shutdown_connections 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.197+0000 7f5b132a9640 1 -- 172.21.15.63:0/4046343303 wait complete. 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.197+0000 7f5b132a9640 1 Processor -- start 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.197+0000 7f5b132a9640 1 -- start start 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b132a9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b0c101de0 0x7f5b0c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b132a9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b0c102790 0x7f5b0c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b132a9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b0c106f10 0x7f5b0c19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b132a9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c111e20 con 0x7f5b0c106f10 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b132a9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c111ca0 con 0x7f5b0c101de0 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b132a9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c111fa0 con 0x7f5b0c102790 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b11846640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b0c106f10 0x7f5b0c19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b11846640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b0c106f10 0x7f5b0c19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58996/0 (socket says 172.21.15.63:58996) 2024-09-16T01:24:53.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b11846640 1 -- 172.21.15.63:0/2330760224 learned_addr learned my addr 172.21.15.63:0/2330760224 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b11045640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b0c101de0 0x7f5b0c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b10844640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b0c102790 0x7f5b0c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b11045640 1 -- 172.21.15.63:0/2330760224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b0c102790 msgr2=0x7f5b0c198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b11045640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b0c102790 0x7f5b0c198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b11045640 1 -- 172.21.15.63:0/2330760224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b0c106f10 msgr2=0x7f5b0c19cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b11045640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b0c106f10 0x7f5b0c19cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b11045640 1 -- 172.21.15.63:0/2330760224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c19d2b0 con 0x7f5b0c101de0 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.198+0000 7f5b11846640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b0c106f10 0x7f5b0c19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.199+0000 7f5b11045640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b0c101de0 0x7f5b0c198300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800e9f0 tx=0x7f5b0800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.199+0000 7f5b027fc640 1 -- 172.21.15.63:0/2330760224 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800ccc0 con 0x7f5b0c101de0 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.199+0000 7f5b132a9640 1 -- 172.21.15.63:0/2330760224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0c19d5a0 con 0x7f5b0c101de0 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.199+0000 7f5b027fc640 1 -- 172.21.15.63:0/2330760224 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b080108e0 con 0x7f5b0c101de0 2024-09-16T01:24:53.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.199+0000 7f5b027fc640 1 -- 172.21.15.63:0/2330760224 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08018880 con 0x7f5b0c101de0 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.199+0000 7f5b132a9640 1 -- 172.21.15.63:0/2330760224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0c1a4e80 con 0x7f5b0c101de0 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.201+0000 7f5b027fc640 1 -- 172.21.15.63:0/2330760224 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5b08010a90 con 0x7f5b0c101de0 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b15682740 1 Processor -- start 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b15682740 1 -- start start 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b15682740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 0x55b0d2d42090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b15682740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d42a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b15682740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d51780 0x55b0d2d53b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b15682740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b0d2ca82f0 con 0x55b0d2d43b40 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b15682740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b0d2c4fcf0 con 0x55b0d2d425d0 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b15682740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b0d2ca42b0 con 0x55b0d2d51780 2024-09-16T01:24:53.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b11846640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 0x55b0d2d42090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b11045640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d42a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b11846640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 0x55b0d2d42090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59004/0 (socket says 172.21.15.63:59004) 2024-09-16T01:24:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.202+0000 7f5b11846640 1 -- 172.21.15.63:0/4010013366 learned_addr learned my addr 172.21.15.63:0/4010013366 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5b10844640 1 --2- 172.21.15.63:0/4010013366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d51780 0x55b0d2d53b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5b027fc640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5af80a3240 0x7f5af80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5b11846640 1 -- 172.21.15.63:0/4010013366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d51780 msgr2=0x55b0d2d53b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:53.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5b11846640 1 --2- 172.21.15.63:0/4010013366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d51780 0x55b0d2d53b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5b11846640 1 -- 172.21.15.63:0/4010013366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 msgr2=0x55b0d2d42a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:53.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5b11846640 1 --2- 172.21.15.63:0/4010013366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d42a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5b11846640 1 -- 172.21.15.63:0/4010013366 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0d2c343a0 con 0x55b0d2d43b40 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5b11846640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5af80a3240 0x7f5af80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5b027fc640 1 -- 172.21.15.63:0/2330760224 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5b080cfca0 con 0x7f5b0c101de0 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5b11846640 1 --2- 172.21.15.63:0/4010013366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 0x55b0d2d42090 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009900 tx=0x7f5b04009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2fcb5064dd638c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.203+0000 7f5af77fe640 1 -- 172.21.15.63:0/4010013366 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04042040 con 0x55b0d2d43b40 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5b11846640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5af80a3240 0x7f5af80a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b0404d000 tx=0x7f5b0404e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5af77fe640 1 -- 172.21.15.63:0/4010013366 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b04036070 con 0x55b0d2d43b40 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5af77fe640 1 -- 172.21.15.63:0/4010013366 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b040309e0 con 0x55b0d2d43b40 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5b15682740 1 -- 172.21.15.63:0/4010013366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 msgr2=0x55b0d2d42090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5b15682740 1 --2- 172.21.15.63:0/4010013366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 0x55b0d2d42090 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009900 tx=0x7f5b04009930 comp rx=0 tx=0).stop 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5b15682740 1 -- 172.21.15.63:0/4010013366 shutdown_connections 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5b15682740 1 --2- 172.21.15.63:0/4010013366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d51780 0x55b0d2d53b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5b15682740 1 --2- 172.21.15.63:0/4010013366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d42a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5b15682740 1 --2- 172.21.15.63:0/4010013366 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 0x55b0d2d42090 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5b15682740 1 -- 172.21.15.63:0/4010013366 >> 172.21.15.63:0/4010013366 conn(0x55b0d2d0b310 msgr2=0x55b0d2d3ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5b15682740 1 -- 172.21.15.63:0/4010013366 shutdown_connections 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.204+0000 7f5b15682740 1 -- 172.21.15.63:0/4010013366 wait complete. 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.205+0000 7f5b15682740 1 -- start start 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.205+0000 7f5b15682740 1 Processor -- start 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.205+0000 7f5b15682740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d51170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.205+0000 7f5b15682740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 0x55b0d2d4e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.205+0000 7f5b15682740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d4ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.205+0000 7f5b15682740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55b0d2d54480 con 0x55b0d2d51780 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.205+0000 7f5b15682740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b0d2c63060 con 0x55b0d2d425d0 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.205+0000 7f5b15682740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b0d2d54600 con 0x55b0d2d43b40 2024-09-16T01:24:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.205+0000 7f5b15682740 10 client.0 _ll_register_callbacks cb 0x55b0d29b68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11846640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d4ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11045640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d51170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b10844640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 0x55b0d2d4e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b10844640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 0x55b0d2d4e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:57202/0 (socket says 172.21.15.63:57202) 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11846640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d4ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59020/0 (socket says 172.21.15.63:59020) 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11846640 1 -- 172.21.15.63:0/1843882883 learned_addr learned my addr 172.21.15.63:0/1843882883 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11045640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d51170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:56410/0 (socket says 172.21.15.63:56410) 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11846640 1 -- 172.21.15.63:0/1843882883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 msgr2=0x55b0d2d4e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11846640 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 0x55b0d2d4e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11846640 1 -- 172.21.15.63:0/1843882883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 msgr2=0x55b0d2d51170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11846640 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d51170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11846640 1 -- 172.21.15.63:0/1843882883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0d2a193c0 con 0x55b0d2d51780 2024-09-16T01:24:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b10844640 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 0x55b0d2d4e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b11846640 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d4ea10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5b04031d70 tx=0x7f5b040095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16df41025acd6b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5af4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5af4ff9640 1 -- 172.21.15.63:0/1843882883 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04058070 con 0x55b0d2d51780 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5af4ff9640 1 -- 172.21.15.63:0/1843882883 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5b04004040 con 0x55b0d2d51780 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.206+0000 7f5b15682740 1 -- 172.21.15.63:0/1843882883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b04036070 con 0x55b0d2d51780 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5af4ff9640 1 -- 172.21.15.63:0/1843882883 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5b04064050 con 0x55b0d2d51780 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5b15682740 10 client.15417 fetch_fsmap learned FSMap version 26 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5b15682740 1 -- 172.21.15.63:0/1843882883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b0d2d54480 con 0x55b0d2d51780 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5af4ff9640 1 -- 172.21.15.63:0/1843882883 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b04036070 con 0x55b0d2d51780 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5af4ff9640 1 -- 172.21.15.63:0/1843882883 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5b0402f9b0 con 0x55b0d2d51780 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5b15682740 10 client.15417 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:24:53.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5b15682740 10 client.15417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5b15682740 20 client.15417 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5b15682740 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55b0d2d610d0 0x55b0d2d634c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5b15682740 4 client.15417 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5b15682740 1 -- 172.21.15.63:0/1843882883 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0d2cb5860 con 0x55b0d2d610d0 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.207+0000 7f5b11045640 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55b0d2d610d0 0x55b0d2d634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.208+0000 7f5b11045640 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55b0d2d610d0 0x55b0d2d634c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82041d1b30178bb6 server_cookie=6b27ced6d85b854f in_seq=0 out_seq=0 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.208+0000 7f5af4ff9640 10 client.15417 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5af4ff9640 1 -- 172.21.15.63:0/1843882883 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0d2cb5860 con 0x55b0d2d610d0 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5af4ff9640 10 client.15417 handle_command_reply: tid=0 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 client.15417 shutdown 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 -- 172.21.15.63:0/1843882883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 msgr2=0x55b0d2d4ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d4ea10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5b04031d70 tx=0x7f5b040095c0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 -- 172.21.15.63:0/1843882883 shutdown_connections 2024-09-16T01:24:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55b0d2d610d0 0x55b0d2d634c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d4ea10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 0x55b0d2d4e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5af4ff9640 0 client.15417 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 --2- 172.21.15.63:0/1843882883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d51170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 -- 172.21.15.63:0/1843882883 >> 172.21.15.63:0/1843882883 conn(0x55b0d2d0b310 msgr2=0x55b0d2d44930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 -- 172.21.15.63:0/1843882883 shutdown_connections 2024-09-16T01:24:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 1 -- 172.21.15.63:0/1843882883 wait complete. 2024-09-16T01:24:53.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.209+0000 7f5b15682740 20 client.15417 trim_cache size 0 max 16384 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.223+0000 7f5b15682740 1 Processor -- start 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.223+0000 7f5b15682740 1 -- start start 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b15682740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d5d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b15682740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 0x55b0d2d3e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b15682740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d3ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b15682740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c1ada90 con 0x55b0d2d51780 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b15682740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c1ab360 con 0x55b0d2d425d0 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b15682740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c1a9190 con 0x55b0d2d43b40 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11846640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d3ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11045640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d5d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11045640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d5d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:56424/0 (socket says 172.21.15.63:56424) 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11846640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d3ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59026/0 (socket says 172.21.15.63:59026) 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11045640 1 -- 172.21.15.63:0/1357866351 learned_addr learned my addr 172.21.15.63:0/1357866351 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b10844640 1 --2- 172.21.15.63:0/1357866351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 0x55b0d2d3e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11045640 1 -- 172.21.15.63:0/1357866351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 msgr2=0x55b0d2d3e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11045640 1 --2- 172.21.15.63:0/1357866351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 0x55b0d2d3e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11045640 1 -- 172.21.15.63:0/1357866351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 msgr2=0x55b0d2d3ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11045640 1 --2- 172.21.15.63:0/1357866351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d3ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11045640 1 -- 172.21.15.63:0/1357866351 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0d2d514e0 con 0x55b0d2d425d0 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11846640 1 --2- 172.21.15.63:0/1357866351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d3ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.224+0000 7f5b11045640 1 --2- 172.21.15.63:0/1357866351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d5d750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b0809c2c0 tx=0x7f5b0801a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5319596bfe5504b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5af6ffd640 1 -- 172.21.15.63:0/1357866351 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b080b5280 con 0x55b0d2d425d0 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5af6ffd640 1 -- 172.21.15.63:0/1357866351 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b0809c330 con 0x55b0d2d425d0 2024-09-16T01:24:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5af6ffd640 1 -- 172.21.15.63:0/1357866351 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b080a4a60 con 0x55b0d2d425d0 2024-09-16T01:24:53.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5b15682740 1 -- 172.21.15.63:0/1357866351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 msgr2=0x55b0d2d5d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:53.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5b15682740 1 --2- 172.21.15.63:0/1357866351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d5d750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b0809c2c0 tx=0x7f5b0801a040 comp rx=0 tx=0).stop 2024-09-16T01:24:53.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5b15682740 1 -- 172.21.15.63:0/1357866351 shutdown_connections 2024-09-16T01:24:53.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5b15682740 1 --2- 172.21.15.63:0/1357866351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d51780 0x55b0d2d3ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5b15682740 1 --2- 172.21.15.63:0/1357866351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d43b40 0x55b0d2d3e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5b15682740 1 --2- 172.21.15.63:0/1357866351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d425d0 0x55b0d2d5d750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5b15682740 1 -- 172.21.15.63:0/1357866351 >> 172.21.15.63:0/1357866351 conn(0x55b0d2d0b310 msgr2=0x55b0d2d4e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:53.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5b15682740 1 -- 172.21.15.63:0/1357866351 shutdown_connections 2024-09-16T01:24:53.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.225+0000 7f5b15682740 1 -- 172.21.15.63:0/1357866351 wait complete. 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b15682740 1 -- start start 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b15682740 1 Processor -- start 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b15682740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d425d0 0x55b0d2d59b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b15682740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 0x55b0d2d5a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b15682740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d51780 0x55b0d2d46300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b15682740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c1a9820 con 0x55b0d2d43b40 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b15682740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c1aac90 con 0x55b0d2d51780 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b15682740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c1a9ef0 con 0x55b0d2d425d0 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b15682740 10 client.0 _ll_register_callbacks cb 0x7f5b080985d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b10844640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 0x55b0d2d5a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.226+0000 7f5b11045640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d425d0 0x55b0d2d59b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b11045640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d425d0 0x55b0d2d59b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:57222/0 (socket says 172.21.15.63:57222) 2024-09-16T01:24:53.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b11045640 1 -- 172.21.15.63:0/191331905 learned_addr learned my addr 172.21.15.63:0/191331905 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:53.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b11846640 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d51780 0x55b0d2d46300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b11846640 1 -- 172.21.15.63:0/191331905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d425d0 msgr2=0x55b0d2d59b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:53.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b11846640 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d425d0 0x55b0d2d59b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b11846640 1 -- 172.21.15.63:0/191331905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 msgr2=0x55b0d2d5a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:53.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b11846640 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 0x55b0d2d5a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b11846640 1 -- 172.21.15.63:0/191331905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0d2d46b00 con 0x55b0d2d51780 2024-09-16T01:24:53.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b11045640 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d425d0 0x55b0d2d59b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:53.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b11846640 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d51780 0x55b0d2d46300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b0402fe00 tx=0x7f5b04031ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccaef91fb412840c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:53.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5af4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:24:53.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5af4ff9640 1 -- 172.21.15.63:0/191331905 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b04058070 con 0x55b0d2d51780 2024-09-16T01:24:53.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5af4ff9640 1 -- 172.21.15.63:0/191331905 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f5b0402f6c0 con 0x55b0d2d51780 2024-09-16T01:24:53.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b15682740 1 -- 172.21.15.63:0/191331905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b0809c330 con 0x55b0d2d51780 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5af4ff9640 1 -- 172.21.15.63:0/191331905 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5b04042040 con 0x55b0d2d51780 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b15682740 10 client.24998 fetch_fsmap learned FSMap version 26 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.227+0000 7f5b15682740 1 -- 172.21.15.63:0/191331905 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b0d2d49370 con 0x55b0d2d51780 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.228+0000 7f5af4ff9640 1 -- 172.21.15.63:0/191331905 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b0809c330 con 0x55b0d2d51780 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.228+0000 7f5af4ff9640 1 -- 172.21.15.63:0/191331905 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5b04051440 con 0x55b0d2d51780 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.228+0000 7f5b15682740 10 client.24998 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.228+0000 7f5b15682740 10 client.24998 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.228+0000 7f5b15682740 20 client.24998 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.228+0000 7f5b15682740 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55b0d2d610d0 0x55b0d2dd2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.228+0000 7f5b15682740 4 client.24998 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.228+0000 7f5b15682740 1 -- 172.21.15.63:0/191331905 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b0d2cafd70 con 0x55b0d2d610d0 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.228+0000 7f5b11045640 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55b0d2d610d0 0x55b0d2dd2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:53.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5af4ff9640 10 client.24998 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5b11045640 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55b0d2d610d0 0x55b0d2dd2880 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd7f216214d881aa server_cookie=f5ccc9ac58695fa1 in_seq=0 out_seq=0 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5af4ff9640 1 -- 172.21.15.63:0/191331905 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b0d2cafd70 con 0x55b0d2d610d0 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5af4ff9640 10 client.24998 handle_command_reply: tid=0 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5b15682740 1 client.24998 shutdown 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5b15682740 1 -- 172.21.15.63:0/191331905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d51780 msgr2=0x55b0d2d46300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5b15682740 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d51780 0x55b0d2d46300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b0402fe00 tx=0x7f5b04031ca0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5b15682740 1 -- 172.21.15.63:0/191331905 shutdown_connections 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5b15682740 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b0d2d51780 0x55b0d2d46300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5b15682740 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55b0d2d610d0 0x55b0d2dd2880 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5b15682740 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55b0d2d43b40 0x55b0d2d5a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5b15682740 1 --2- 172.21.15.63:0/191331905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0d2d425d0 0x55b0d2d59b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5af4ff9640 0 client.24998 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:53.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.229+0000 7f5b15682740 1 -- 172.21.15.63:0/191331905 >> 172.21.15.63:0/191331905 conn(0x55b0d2d0b310 msgr2=0x55b0d2d3e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:53.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b15682740 1 -- 172.21.15.63:0/191331905 shutdown_connections 2024-09-16T01:24:53.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b15682740 1 -- 172.21.15.63:0/191331905 wait complete. 2024-09-16T01:24:53.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b15682740 20 client.24998 trim_cache size 0 max 16384 2024-09-16T01:24:53.237 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:24:53.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 -- 172.21.15.63:0/2330760224 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5af80a3240 msgr2=0x7f5af80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:53.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5af80a3240 0x7f5af80a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b0404d000 tx=0x7f5b0404e000 comp rx=0 tx=0).stop 2024-09-16T01:24:53.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 -- 172.21.15.63:0/2330760224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b0c101de0 msgr2=0x7f5b0c198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:53.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b0c101de0 0x7f5b0c198300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800e9f0 tx=0x7f5b0800eeb0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 -- 172.21.15.63:0/2330760224 shutdown_connections 2024-09-16T01:24:53.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f5af80a3240 0x7f5af80a5700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b0c106f10 0x7f5b0c19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b0c102790 0x7f5b0c198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 --2- 172.21.15.63:0/2330760224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b0c101de0 0x7f5b0c198300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:53.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 -- 172.21.15.63:0/2330760224 >> 172.21.15.63:0/2330760224 conn(0x7f5b0c0fd8e0 msgr2=0x7f5b0c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:53.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 -- 172.21.15.63:0/2330760224 shutdown_connections 2024-09-16T01:24:53.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:53.230+0000 7f5b132a9640 1 -- 172.21.15.63:0/2330760224 wait complete. 2024-09-16T01:24:54.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:54 smithi063 ceph-mon[31070]: pgmap v382: 97 pgs: 97 active+clean; 68 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 287 op/s 2024-09-16T01:24:54.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:54 smithi192 ceph-mon[34775]: pgmap v382: 97 pgs: 97 active+clean; 68 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 287 op/s 2024-09-16T01:24:54.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:54 smithi162 ceph-mon[34539]: pgmap v382: 97 pgs: 97 active+clean; 68 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 287 op/s 2024-09-16T01:24:55.090 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-16T01:24:55.090 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-16T01:24:55.379 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.940+0000 7f0d3559d640 1 -- 172.21.15.63:0/3007858916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d301008d0 msgr2=0x7f0d30100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.940+0000 7f0d3559d640 1 --2- 172.21.15.63:0/3007858916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d301008d0 0x7f0d30100d30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009890 tx=0x7f0d2402a380 comp rx=0 tx=0).stop 2024-09-16T01:24:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.940+0000 7f0d3559d640 1 -- 172.21.15.63:0/3007858916 shutdown_connections 2024-09-16T01:24:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.940+0000 7f0d3559d640 1 --2- 172.21.15.63:0/3007858916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d30101270 0x7f0d3010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.940+0000 7f0d3559d640 1 --2- 172.21.15.63:0/3007858916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d301008d0 0x7f0d30100d30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.940+0000 7f0d3559d640 1 --2- 172.21.15.63:0/3007858916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d301068d0 0x7f0d30106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.940+0000 7f0d3559d640 1 -- 172.21.15.63:0/3007858916 >> 172.21.15.63:0/3007858916 conn(0x7f0d300fc610 msgr2=0x7f0d300fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.940+0000 7f0d3559d640 1 -- 172.21.15.63:0/3007858916 shutdown_connections 2024-09-16T01:24:55.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.941+0000 7f0d3559d640 1 -- 172.21.15.63:0/3007858916 wait complete. 2024-09-16T01:24:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.941+0000 7f0d3559d640 1 Processor -- start 2024-09-16T01:24:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.941+0000 7f0d3559d640 1 -- start start 2024-09-16T01:24:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d3559d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d301008d0 0x7f0d30198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d3559d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d30101270 0x7f0d301986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d3559d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d301068d0 0x7f0d3019ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d3559d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30110b80 con 0x7f0d301008d0 2024-09-16T01:24:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d3559d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30110a00 con 0x7f0d30101270 2024-09-16T01:24:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d3559d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30110d00 con 0x7f0d301068d0 2024-09-16T01:24:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d301008d0 0x7f0d30198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d301008d0 0x7f0d30198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59052/0 (socket says 172.21.15.63:59052) 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d2f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d30101270 0x7f0d301986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d2ffff640 1 -- 172.21.15.63:0/111982962 learned_addr learned my addr 172.21.15.63:0/111982962 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d34d9c640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d301068d0 0x7f0d3019ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d2ffff640 1 -- 172.21.15.63:0/111982962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d301068d0 msgr2=0x7f0d3019ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d301068d0 0x7f0d3019ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d2ffff640 1 -- 172.21.15.63:0/111982962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d30101270 msgr2=0x7f0d301986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d30101270 0x7f0d301986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d2ffff640 1 -- 172.21.15.63:0/111982962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3019d140 con 0x7f0d301008d0 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.942+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d30101270 0x7f0d301986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.943+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d301008d0 0x7f0d30198190 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000e9f0 tx=0x7f0d2000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:55.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.943+0000 7f0d2d7fa640 1 -- 172.21.15.63:0/111982962 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000ccc0 con 0x7f0d301008d0 2024-09-16T01:24:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.943+0000 7f0d3559d640 1 -- 172.21.15.63:0/111982962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3019d430 con 0x7f0d301008d0 2024-09-16T01:24:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.943+0000 7f0d2d7fa640 1 -- 172.21.15.63:0/111982962 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d200054d0 con 0x7f0d301008d0 2024-09-16T01:24:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.943+0000 7f0d2d7fa640 1 -- 172.21.15.63:0/111982962 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20010430 con 0x7f0d301008d0 2024-09-16T01:24:55.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.943+0000 7f0d3559d640 1 -- 172.21.15.63:0/111982962 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d300fcba0 con 0x7f0d301008d0 2024-09-16T01:24:55.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.946+0000 7f0d2d7fa640 1 -- 172.21.15.63:0/111982962 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0d200046c0 con 0x7f0d301008d0 2024-09-16T01:24:55.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.946+0000 7f0d38bd8740 1 Processor -- start 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.946+0000 7f0d38bd8740 1 -- start start 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.946+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc59d70 0x55bb8dc5a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.946+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc64a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.946+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 0x55bb8dc67340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.946+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bb8dbbf280 con 0x55bb8dc59d70 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.946+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bb8db66b10 con 0x55bb8dc64f50 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.946+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bb8dbbb240 con 0x55bb8dc5a690 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d34d9c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc59d70 0x55bb8dc5a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc64a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc64a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:57246/0 (socket says 172.21.15.63:57246) 2024-09-16T01:24:55.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2ffff640 1 -- 172.21.15.63:0/3080986990 learned_addr learned my addr 172.21.15.63:0/3080986990 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/3080986990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 0x55bb8dc67340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2ffff640 1 -- 172.21.15.63:0/3080986990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 msgr2=0x55bb8dc67340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/3080986990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 0x55bb8dc67340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2ffff640 1 -- 172.21.15.63:0/3080986990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc59d70 msgr2=0x55bb8dc5a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/3080986990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc59d70 0x55bb8dc5a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2ffff640 1 -- 172.21.15.63:0/3080986990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb8db731f0 con 0x55bb8dc5a690 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2d7fa640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d180a7650 0x7f0d180a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.947+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/3080986990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc64a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d200d3b10 tx=0x7f0d200d3c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad94ce065273a09f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.948+0000 7f0d34d9c640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d180a7650 0x7f0d180a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.948+0000 7f0d167fc640 1 -- 172.21.15.63:0/3080986990 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200d7040 con 0x55bb8dc5a690 2024-09-16T01:24:55.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.948+0000 7f0d2d7fa640 1 -- 172.21.15.63:0/111982962 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0d200cfb30 con 0x7f0d301008d0 2024-09-16T01:24:55.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.948+0000 7f0d167fc640 1 -- 172.21.15.63:0/3080986990 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d200d3e50 con 0x55bb8dc5a690 2024-09-16T01:24:55.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.948+0000 7f0d167fc640 1 -- 172.21.15.63:0/3080986990 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2009bf20 con 0x55bb8dc5a690 2024-09-16T01:24:55.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.948+0000 7f0d38bd8740 1 -- 172.21.15.63:0/3080986990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 msgr2=0x55bb8dc64a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:55.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.948+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/3080986990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc64a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d200d3b10 tx=0x7f0d200d3c00 comp rx=0 tx=0).stop 2024-09-16T01:24:55.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.948+0000 7f0d34d9c640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d180a7650 0x7f0d180a9b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0d28005fd0 tx=0x7f0d28009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:55.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 -- 172.21.15.63:0/3080986990 shutdown_connections 2024-09-16T01:24:55.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/3080986990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 0x55bb8dc67340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/3080986990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc64a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/3080986990 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc59d70 0x55bb8dc5a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 -- 172.21.15.63:0/3080986990 >> 172.21.15.63:0/3080986990 conn(0x55bb8dc56300 msgr2=0x55bb8dc566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 -- 172.21.15.63:0/3080986990 shutdown_connections 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 -- 172.21.15.63:0/3080986990 wait complete. 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 -- start start 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 Processor -- start 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc59d70 0x55bb8dc61e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.949+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc62340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 0x55bb8dc62880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bb8dc67bc0 con 0x55bb8dc5a690 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bb8db79f10 con 0x55bb8dc64f50 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bb8dc67d40 con 0x55bb8dc59d70 2024-09-16T01:24:55.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d38bd8740 10 client.0 _ll_register_callbacks cb 0x55bb8db42a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc62340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc59d70 0x55bb8dc61e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc59d70 0x55bb8dc61e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:57254/0 (socket says 172.21.15.63:57254) 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2ffff640 1 -- 172.21.15.63:0/2520342815 learned_addr learned my addr 172.21.15.63:0/2520342815 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d34d9c640 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 0x55bb8dc62880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2ffff640 1 -- 172.21.15.63:0/2520342815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 msgr2=0x55bb8dc62880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 0x55bb8dc62880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2ffff640 1 -- 172.21.15.63:0/2520342815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 msgr2=0x55bb8dc62340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc62340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2ffff640 1 -- 172.21.15.63:0/2520342815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb8d9306a0 con 0x55bb8dc59d70 2024-09-16T01:24:55.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d34d9c640 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 0x55bb8dc62880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:55.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc62340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:55.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc59d70 0x55bb8dc61e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009230 tx=0x7f0d200984d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3f6c1eb4a92565d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:55.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:24:55.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.950+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/2520342815 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2009bab0 con 0x55bb8dc59d70 2024-09-16T01:24:55.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d38bd8740 1 -- 172.21.15.63:0/2520342815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d200d3e50 con 0x55bb8dc59d70 2024-09-16T01:24:55.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/2520342815 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0d2009a450 con 0x55bb8dc59d70 2024-09-16T01:24:55.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/2520342815 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0d2009bc90 con 0x55bb8dc59d70 2024-09-16T01:24:55.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d38bd8740 10 client.25033 fetch_fsmap learned FSMap version 26 2024-09-16T01:24:55.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d38bd8740 1 -- 172.21.15.63:0/2520342815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bb8dc67bc0 con 0x55bb8dc59d70 2024-09-16T01:24:55.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/2520342815 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d200d3e50 con 0x55bb8dc59d70 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/2520342815 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0d200bc0b0 con 0x55bb8dc59d70 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d38bd8740 10 client.25033 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d38bd8740 10 client.25033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d38bd8740 20 client.25033 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55bb8dc7d170 0x55bb8dc7f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d38bd8740 4 client.25033 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.951+0000 7f0d38bd8740 1 -- 172.21.15.63:0/2520342815 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb8dbcc7f0 con 0x55bb8dc7d170 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.952+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55bb8dc7d170 0x55bb8dc7f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.952+0000 7f0d0f7fe640 10 client.25033 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.952+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55bb8dc7d170 0x55bb8dc7f560 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ca41af8413d545d server_cookie=da12ddd630fc53af in_seq=0 out_seq=0 2024-09-16T01:24:55.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.953+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/2520342815 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb8dbcc7f0 con 0x55bb8dc7d170 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.953+0000 7f0d0f7fe640 10 client.25033 handle_command_reply: tid=0 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.953+0000 7f0d38bd8740 1 client.25033 shutdown 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.953+0000 7f0d38bd8740 1 -- 172.21.15.63:0/2520342815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc59d70 msgr2=0x55bb8dc61e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.953+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc59d70 0x55bb8dc61e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009230 tx=0x7f0d200984d0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.953+0000 7f0d38bd8740 1 -- 172.21.15.63:0/2520342815 shutdown_connections 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.953+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc64f50 0x55bb8dc62880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.953+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55bb8dc7d170 0x55bb8dc7f560 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.954+0000 7f0d0f7fe640 0 client.25033 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.954+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc62340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.954+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/2520342815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc59d70 0x55bb8dc61e00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.954+0000 7f0d38bd8740 1 -- 172.21.15.63:0/2520342815 >> 172.21.15.63:0/2520342815 conn(0x55bb8dc56300 msgr2=0x55bb8dc5c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:55.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.954+0000 7f0d38bd8740 1 -- 172.21.15.63:0/2520342815 shutdown_connections 2024-09-16T01:24:55.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.954+0000 7f0d38bd8740 1 -- 172.21.15.63:0/2520342815 wait complete. 2024-09-16T01:24:55.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.954+0000 7f0d38bd8740 20 client.25033 trim_cache size 0 max 16384 2024-09-16T01:24:55.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d38bd8740 1 Processor -- start 2024-09-16T01:24:55.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d38bd8740 1 -- start start 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 0x55bb8dc63c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc84bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc64f50 0x55bb8dc85130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301ad9c0 con 0x55bb8dc5a690 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301ab290 con 0x55bb8dc59d70 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301a90c0 con 0x55bb8dc64f50 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d2f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc84bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d34d9c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc64f50 0x55bb8dc85130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d2f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc84bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59076/0 (socket says 172.21.15.63:59076) 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d2f7fe640 1 -- 172.21.15.63:0/984306606 learned_addr learned my addr 172.21.15.63:0/984306606 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.976+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/984306606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 0x55bb8dc63c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.977+0000 7f0d2f7fe640 1 -- 172.21.15.63:0/984306606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc64f50 msgr2=0x55bb8dc85130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:55.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.977+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/984306606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc64f50 0x55bb8dc85130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.977+0000 7f0d2f7fe640 1 -- 172.21.15.63:0/984306606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 msgr2=0x55bb8dc63c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.977+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/984306606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 0x55bb8dc63c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.977+0000 7f0d2f7fe640 1 -- 172.21.15.63:0/984306606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb8dc56130 con 0x55bb8dc5a690 2024-09-16T01:24:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.977+0000 7f0d34d9c640 1 --2- 172.21.15.63:0/984306606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc64f50 0x55bb8dc85130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.977+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/984306606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc84bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0d240303f0 tx=0x7f0d24009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f405ffbf9ccccf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.977+0000 7f0d15ffb640 1 -- 172.21.15.63:0/984306606 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24047070 con 0x55bb8dc5a690 2024-09-16T01:24:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.977+0000 7f0d15ffb640 1 -- 172.21.15.63:0/984306606 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d24038040 con 0x55bb8dc5a690 2024-09-16T01:24:55.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.977+0000 7f0d15ffb640 1 -- 172.21.15.63:0/984306606 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24037040 con 0x55bb8dc5a690 2024-09-16T01:24:55.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.978+0000 7f0d38bd8740 1 -- 172.21.15.63:0/984306606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 msgr2=0x55bb8dc84bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:55.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.978+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/984306606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc84bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0d240303f0 tx=0x7f0d24009470 comp rx=0 tx=0).stop 2024-09-16T01:24:55.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.978+0000 7f0d38bd8740 1 -- 172.21.15.63:0/984306606 shutdown_connections 2024-09-16T01:24:55.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.978+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/984306606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc64f50 0x55bb8dc85130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.978+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/984306606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc5a690 0x55bb8dc84bf0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.978+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/984306606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 0x55bb8dc63c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.978+0000 7f0d38bd8740 1 -- 172.21.15.63:0/984306606 >> 172.21.15.63:0/984306606 conn(0x55bb8dc56300 msgr2=0x55bb8dc63550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:55.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.978+0000 7f0d38bd8740 1 -- 172.21.15.63:0/984306606 shutdown_connections 2024-09-16T01:24:55.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.978+0000 7f0d38bd8740 1 -- 172.21.15.63:0/984306606 wait complete. 2024-09-16T01:24:55.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.978+0000 7f0d38bd8740 1 -- start start 2024-09-16T01:24:55.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d38bd8740 1 Processor -- start 2024-09-16T01:24:55.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 0x55bb8dc76000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc5ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d38bd8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc64f50 0x55bb8dc5f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301a9750 con 0x55bb8dc64f50 2024-09-16T01:24:55.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301aabc0 con 0x55bb8dc59d70 2024-09-16T01:24:55.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d38bd8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301a9e20 con 0x55bb8dc5a690 2024-09-16T01:24:55.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 0x55bb8dc76000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d38bd8740 10 client.0 _ll_register_callbacks cb 0x7f0d200a0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:55.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d2ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 0x55bb8dc76000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:56482/0 (socket says 172.21.15.63:56482) 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d2ffff640 1 -- 172.21.15.63:0/1356560466 learned_addr learned my addr 172.21.15.63:0/1356560466 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d34d9c640 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc64f50 0x55bb8dc5f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d2ffff640 1 -- 172.21.15.63:0/1356560466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 msgr2=0x55bb8dc5ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.979+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc5ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc5ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d2ffff640 1 -- 172.21.15.63:0/1356560466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc64f50 msgr2=0x55bb8dc5f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc64f50 0x55bb8dc5f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d2ffff640 1 -- 172.21.15.63:0/1356560466 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb8dc55a80 con 0x55bb8dc59d70 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc5ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d2ffff640 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 0x55bb8dc76000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0d200a4dc0 tx=0x7f0d20098460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc5ed5e39b07595 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/1356560466 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2009bab0 con 0x55bb8dc59d70 2024-09-16T01:24:55.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d38bd8740 1 -- 172.21.15.63:0/1356560466 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d24038040 con 0x55bb8dc59d70 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/1356560466 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0d200a4930 con 0x55bb8dc59d70 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/1356560466 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0d2009bf20 con 0x55bb8dc59d70 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d38bd8740 10 client.25016 fetch_fsmap learned FSMap version 26 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.980+0000 7f0d38bd8740 1 -- 172.21.15.63:0/1356560466 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bb8dce7a90 con 0x55bb8dc59d70 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.981+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/1356560466 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d24038040 con 0x55bb8dc59d70 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.981+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/1356560466 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0d2009c3b0 con 0x55bb8dc59d70 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.981+0000 7f0d38bd8740 10 client.25016 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.981+0000 7f0d38bd8740 10 client.25016 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.981+0000 7f0d38bd8740 20 client.25016 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.981+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55bb8dce7f50 0x55bb8dcea370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.981+0000 7f0d38bd8740 4 client.25016 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.981+0000 7f0d38bd8740 1 -- 172.21.15.63:0/1356560466 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bb8dbc6d00 con 0x55bb8dce7f50 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.981+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55bb8dce7f50 0x55bb8dcea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:55.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.982+0000 7f0d2f7fe640 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55bb8dce7f50 0x55bb8dcea370 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76d5bc8139408413 server_cookie=93bd1ce4fa75ec48 in_seq=0 out_seq=0 2024-09-16T01:24:55.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.982+0000 7f0d0f7fe640 10 client.25016 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:55.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d0f7fe640 1 -- 172.21.15.63:0/1356560466 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bb8dbc6d00 con 0x55bb8dce7f50 2024-09-16T01:24:55.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d0f7fe640 10 client.25016 handle_command_reply: tid=0 2024-09-16T01:24:55.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d38bd8740 1 client.25016 shutdown 2024-09-16T01:24:55.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d38bd8740 1 -- 172.21.15.63:0/1356560466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 msgr2=0x55bb8dc76000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:55.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 0x55bb8dc76000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0d200a4dc0 tx=0x7f0d20098460 comp rx=0 tx=0).stop 2024-09-16T01:24:55.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d38bd8740 1 -- 172.21.15.63:0/1356560466 shutdown_connections 2024-09-16T01:24:55.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55bb8dce7f50 0x55bb8dcea370 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb8dc64f50 0x55bb8dc5f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bb8dc5a690 0x55bb8dc5ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d38bd8740 1 --2- 172.21.15.63:0/1356560466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bb8dc59d70 0x55bb8dc76000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d38bd8740 1 -- 172.21.15.63:0/1356560466 >> 172.21.15.63:0/1356560466 conn(0x55bb8dc56300 msgr2=0x55bb8dc5bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:55.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d0f7fe640 0 client.25016 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:55.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.983+0000 7f0d38bd8740 1 -- 172.21.15.63:0/1356560466 shutdown_connections 2024-09-16T01:24:55.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.984+0000 7f0d38bd8740 1 -- 172.21.15.63:0/1356560466 wait complete. 2024-09-16T01:24:55.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.984+0000 7f0d38bd8740 20 client.25016 trim_cache size 0 max 16384 2024-09-16T01:24:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:24:55.990 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-16T01:24:55.990 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "b8fb5a19-9cc7-4c8e-be66-db1a27910138", 2024-09-16T01:24:55.990 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-16T01:24:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:24:55.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 -- 172.21.15.63:0/111982962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d180a7650 msgr2=0x7f0d180a9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:55.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d180a7650 0x7f0d180a9b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0d28005fd0 tx=0x7f0d28009500 comp rx=0 tx=0).stop 2024-09-16T01:24:55.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 -- 172.21.15.63:0/111982962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d301008d0 msgr2=0x7f0d30198190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:55.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d301008d0 0x7f0d30198190 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000e9f0 tx=0x7f0d2000eeb0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 -- 172.21.15.63:0/111982962 shutdown_connections 2024-09-16T01:24:55.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0d180a7650 0x7f0d180a9b10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d301068d0 0x7f0d3019ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d30101270 0x7f0d301986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 --2- 172.21.15.63:0/111982962 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d301008d0 0x7f0d30198190 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:55.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 -- 172.21.15.63:0/111982962 >> 172.21.15.63:0/111982962 conn(0x7f0d300fc610 msgr2=0x7f0d3006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:55.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 -- 172.21.15.63:0/111982962 shutdown_connections 2024-09-16T01:24:55.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:55.985+0000 7f0d3559d640 1 -- 172.21.15.63:0/111982962 wait complete. 2024-09-16T01:24:56.545 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:56 smithi063 ceph-mon[31070]: pgmap v383: 97 pgs: 97 active+clean; 70 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.9 MiB/s wr, 261 op/s 2024-09-16T01:24:56.545 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:56 smithi063 ceph-mon[31070]: scrub queued for path: / 2024-09-16T01:24:56.545 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:56 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:56.545 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:56 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:24:56.545 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:56 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:24:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:56 smithi192 ceph-mon[34775]: pgmap v383: 97 pgs: 97 active+clean; 70 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.9 MiB/s wr, 261 op/s 2024-09-16T01:24:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:56 smithi192 ceph-mon[34775]: scrub queued for path: / 2024-09-16T01:24:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:56 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:56 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:24:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:56 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:24:56.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:56 smithi162 ceph-mon[34539]: pgmap v383: 97 pgs: 97 active+clean; 70 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 1.9 MiB/s wr, 261 op/s 2024-09-16T01:24:56.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:56 smithi162 ceph-mon[34539]: scrub queued for path: / 2024-09-16T01:24:56.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:56 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:56.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:56 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:24:56.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:56 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:24:56.818 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:24:57.121 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:24:57.556 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:57 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:24:57.556 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:57 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:57.557 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:57 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:57.557 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:57 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:57.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.652+0000 7fae1f5d9640 1 -- 172.21.15.63:0/3748790246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18105de0 msgr2=0x7fae1810d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:57.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.652+0000 7fae1f5d9640 1 --2- 172.21.15.63:0/3748790246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18105de0 0x7fae1810d960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae10009be0 tx=0x7fae1002a6c0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.652+0000 7fae1f5d9640 1 -- 172.21.15.63:0/3748790246 shutdown_connections 2024-09-16T01:24:57.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.652+0000 7fae1f5d9640 1 --2- 172.21.15.63:0/3748790246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18105de0 0x7fae1810d960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.652+0000 7fae1f5d9640 1 --2- 172.21.15.63:0/3748790246 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18101e20 0x7fae181056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.652+0000 7fae1f5d9640 1 --2- 172.21.15.63:0/3748790246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101470 0x7fae18101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.652+0000 7fae1f5d9640 1 -- 172.21.15.63:0/3748790246 >> 172.21.15.63:0/3748790246 conn(0x7fae18077230 msgr2=0x7fae180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.652+0000 7fae1f5d9640 1 -- 172.21.15.63:0/3748790246 shutdown_connections 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.652+0000 7fae1f5d9640 1 -- 172.21.15.63:0/3748790246 wait complete. 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.653+0000 7fae1f5d9640 1 Processor -- start 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.653+0000 7fae1f5d9640 1 -- start start 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.653+0000 7fae1f5d9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18101470 0x7fae180fc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.653+0000 7fae1f5d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101e20 0x7fae180fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.653+0000 7fae1f5d9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18105de0 0x7fae180fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.653+0000 7fae1f5d9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fae18110cf0 con 0x7fae18101470 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.653+0000 7fae1f5d9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae18110b70 con 0x7fae18101e20 2024-09-16T01:24:57.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.653+0000 7fae1f5d9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae18110e70 con 0x7fae18105de0 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1d375640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18101470 0x7fae180fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1db76640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18105de0 0x7fae180fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1d375640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18101470 0x7fae180fc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59102/0 (socket says 172.21.15.63:59102) 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1d375640 1 -- 172.21.15.63:0/818600625 learned_addr learned my addr 172.21.15.63:0/818600625 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1cb74640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101e20 0x7fae180fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1d375640 1 -- 172.21.15.63:0/818600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18105de0 msgr2=0x7fae180fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1d375640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18105de0 0x7fae180fd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1d375640 1 -- 172.21.15.63:0/818600625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101e20 msgr2=0x7fae180fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1d375640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101e20 0x7fae180fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1d375640 1 -- 172.21.15.63:0/818600625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae181a67c0 con 0x7fae18101470 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1d375640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18101470 0x7fae180fc700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fae1400e9f0 tx=0x7fae1400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:57.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae0e7fc640 1 -- 172.21.15.63:0/818600625 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1400cd80 con 0x7fae18101470 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae0e7fc640 1 -- 172.21.15.63:0/818600625 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae140054d0 con 0x7fae18101470 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.654+0000 7fae1f5d9640 1 -- 172.21.15.63:0/818600625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae181a6ab0 con 0x7fae18101470 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.655+0000 7fae0e7fc640 1 -- 172.21.15.63:0/818600625 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14010490 con 0x7fae18101470 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.655+0000 7fae1f5d9640 1 -- 172.21.15.63:0/818600625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae181a6ff0 con 0x7fae18101470 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.657+0000 7fae0e7fc640 1 -- 172.21.15.63:0/818600625 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fae140106b0 con 0x7fae18101470 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.657+0000 7fae219b2740 1 Processor -- start 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae219b2740 1 -- start start 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae219b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 0x55a34734f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae219b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a34735a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae219b2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a34735ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae0e7fc640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a32c0 0x7fae040a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae219b2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a3472b52e0 con 0x55a34734fdc0 2024-09-16T01:24:57.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae219b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a34725cce0 con 0x55a34734f4a0 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae219b2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a3472b12a0 con 0x55a34735a680 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae1d375640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a34735a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae1db76640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a34735ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae1cb74640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a32c0 0x7fae040a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae1db76640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a34735ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:57306/0 (socket says 172.21.15.63:57306) 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae1db76640 1 -- 172.21.15.63:0/2845789428 learned_addr learned my addr 172.21.15.63:0/2845789428 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae1db76640 1 --2- 172.21.15.63:0/2845789428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 0x55a34734f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.658+0000 7fae0e7fc640 1 -- 172.21.15.63:0/818600625 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fae140cfc10 con 0x7fae18101470 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae1db76640 1 -- 172.21.15.63:0/2845789428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 msgr2=0x55a34734f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae1db76640 1 --2- 172.21.15.63:0/2845789428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 0x55a34734f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae1db76640 1 -- 172.21.15.63:0/2845789428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 msgr2=0x55a34735a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae1db76640 1 --2- 172.21.15.63:0/2845789428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a34735a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae1db76640 1 -- 172.21.15.63:0/2845789428 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a347241440 con 0x55a34735a680 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae1d375640 1 --2- 172.21.15.63:0/2845789428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a34735a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae1db76640 1 --2- 172.21.15.63:0/2845789428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a34735ca70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fae10005c60 tx=0x7fae10005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61fe4ba174393b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae1cb74640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a32c0 0x7fae040a5780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fae080096c0 tx=0x7fae08009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae037fe640 1 -- 172.21.15.63:0/2845789428 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10047070 con 0x55a34735a680 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae037fe640 1 -- 172.21.15.63:0/2845789428 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae10037040 con 0x55a34735a680 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.659+0000 7fae037fe640 1 -- 172.21.15.63:0/2845789428 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10036030 con 0x55a34735a680 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.660+0000 7fae219b2740 1 -- 172.21.15.63:0/2845789428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 msgr2=0x55a34735ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.660+0000 7fae219b2740 1 --2- 172.21.15.63:0/2845789428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a34735ca70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fae10005c60 tx=0x7fae10005bd0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.660+0000 7fae219b2740 1 -- 172.21.15.63:0/2845789428 shutdown_connections 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.660+0000 7fae219b2740 1 --2- 172.21.15.63:0/2845789428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a34735ca70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.660+0000 7fae219b2740 1 --2- 172.21.15.63:0/2845789428 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a34735a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.660+0000 7fae219b2740 1 --2- 172.21.15.63:0/2845789428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 0x55a34734f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.660+0000 7fae219b2740 1 -- 172.21.15.63:0/2845789428 >> 172.21.15.63:0/2845789428 conn(0x55a34734ba30 msgr2=0x55a34734be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:57.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.660+0000 7fae219b2740 1 -- 172.21.15.63:0/2845789428 shutdown_connections 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.660+0000 7fae219b2740 1 -- 172.21.15.63:0/2845789428 wait complete. 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.661+0000 7fae219b2740 1 -- start start 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.661+0000 7fae219b2740 1 Processor -- start 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae219b2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34734f4a0 0x55a347359f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae219b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae1d375640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34734f4a0 0x55a347359f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae1cb74640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae1d375640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34734f4a0 0x55a347359f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:57318/0 (socket says 172.21.15.63:57318) 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae1d375640 1 -- 172.21.15.63:0/2907525483 learned_addr learned my addr 172.21.15.63:0/2907525483 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae219b2740 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34735a680 0x55a347357730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a34735d250 con 0x55a34734fdc0 2024-09-16T01:24:57.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a347270050 con 0x55a34735a680 2024-09-16T01:24:57.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a34735d3d0 con 0x55a34734f4a0 2024-09-16T01:24:57.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.662+0000 7fae1db76640 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34735a680 0x55a347357730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae1d375640 1 -- 172.21.15.63:0/2907525483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34735a680 msgr2=0x55a347357730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:57.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae1d375640 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34735a680 0x55a347357730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae1d375640 1 -- 172.21.15.63:0/2907525483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 msgr2=0x55a3473571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:57.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae219b2740 10 client.0 _ll_register_callbacks cb 0x55a3472b0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:57.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae1d375640 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae1d375640 1 -- 172.21.15.63:0/2907525483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3470263c0 con 0x55a34734f4a0 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae10037040 con 0x55a34734f4a0 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae1cb74640 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae1d375640 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34734f4a0 0x55a347359f40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fae14098c00 tx=0x7fae140671d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4d4adacfa5c7146 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae00ff9640 10 client.25048 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae00ff9640 1 -- 172.21.15.63:0/2907525483 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1409c930 con 0x55a34734f4a0 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae00ff9640 1 -- 172.21.15.63:0/2907525483 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fae140cd820 con 0x55a34734f4a0 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.663+0000 7fae00ff9640 1 -- 172.21.15.63:0/2907525483 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fae1409c230 con 0x55a34734f4a0 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.664+0000 7fae219b2740 10 client.25048 fetch_fsmap learned FSMap version 26 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.664+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a347368a20 con 0x55a34734f4a0 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.664+0000 7fae00ff9640 1 -- 172.21.15.63:0/2907525483 <== mon.1 v2:172.21.15.192:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fae140a0160 con 0x55a34734f4a0 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.664+0000 7fae219b2740 10 client.25048 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.664+0000 7fae219b2740 10 client.25048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:57.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.664+0000 7fae219b2740 20 client.25048 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.664+0000 7fae219b2740 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a347369dd0 0x55a34736c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.664+0000 7fae219b2740 4 client.25048 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.664+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3472c2850 con 0x55a347369dd0 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.664+0000 7fae1cb74640 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a347369dd0 0x55a34736c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.665+0000 7fae00ff9640 10 client.25048 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.665+0000 7fae1cb74640 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a347369dd0 0x55a34736c290 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a3d372ba8ef3c5a server_cookie=d81722c24d7d01de in_seq=0 out_seq=0 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.666+0000 7fae00ff9640 1 -- 172.21.15.63:0/2907525483 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3472c2850 con 0x55a347369dd0 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.666+0000 7fae00ff9640 10 client.25048 handle_command_reply: tid=0 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.666+0000 7fae219b2740 1 client.25048 shutdown 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.666+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34734f4a0 msgr2=0x55a347359f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.666+0000 7fae219b2740 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34734f4a0 0x55a347359f40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fae14098c00 tx=0x7fae140671d0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.667+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 shutdown_connections 2024-09-16T01:24:57.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.667+0000 7fae219b2740 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34735a680 0x55a347357730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.667+0000 7fae219b2740 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a347369dd0 0x55a34736c290 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.667+0000 7fae219b2740 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.667+0000 7fae219b2740 1 --2- 172.21.15.63:0/2907525483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34734f4a0 0x55a347359f40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.667+0000 7fae00ff9640 0 client.25048 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:57.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.667+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 >> 172.21.15.63:0/2907525483 conn(0x55a34734ba30 msgr2=0x55a347351760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:57.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.667+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 shutdown_connections 2024-09-16T01:24:57.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.667+0000 7fae219b2740 1 -- 172.21.15.63:0/2907525483 wait complete. 2024-09-16T01:24:57.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.667+0000 7fae219b2740 20 client.25048 trim_cache size 0 max 16384 2024-09-16T01:24:57.677 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:57 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:24:57.678 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:57 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:57.678 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:57 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:57.678 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:57 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:57.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:57 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:24:57.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:57 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:57.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:57 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:57.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:57 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:24:57.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.686+0000 7fae219b2740 1 Processor -- start 2024-09-16T01:24:57.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae219b2740 1 -- start start 2024-09-16T01:24:57.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae219b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 0x55a3473664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae219b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473527a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae219b2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a347371bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae219b2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fae181b1e70 con 0x55a34734fdc0 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae219b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae181af740 con 0x55a34734f4a0 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae219b2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae181ad570 con 0x55a34735a680 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae1cb74640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae1d375640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 0x55a3473664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae1d375640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 0x55a3473664b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:56514/0 (socket says 172.21.15.63:56514) 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae1d375640 1 -- 172.21.15.63:0/2326255982 learned_addr learned my addr 172.21.15.63:0/2326255982 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae1cb74640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59128/0 (socket says 172.21.15.63:59128) 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae1db76640 1 --2- 172.21.15.63:0/2326255982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a347371bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae1cb74640 1 -- 172.21.15.63:0/2326255982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 msgr2=0x55a347371bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae1cb74640 1 --2- 172.21.15.63:0/2326255982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a347371bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae1cb74640 1 -- 172.21.15.63:0/2326255982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 msgr2=0x55a3473664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.687+0000 7fae1cb74640 1 --2- 172.21.15.63:0/2326255982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 0x55a3473664b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.688+0000 7fae1cb74640 1 -- 172.21.15.63:0/2326255982 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a347355740 con 0x55a34734fdc0 2024-09-16T01:24:57.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.688+0000 7fae1d375640 1 --2- 172.21.15.63:0/2326255982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 0x55a3473664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:57.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.688+0000 7fae1cb74640 1 --2- 172.21.15.63:0/2326255982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473527a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55a347358830 tx=0x7fae08014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1caba5331f277a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:57.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.688+0000 7fae02ffd640 1 -- 172.21.15.63:0/2326255982 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0801ee50 con 0x55a34734fdc0 2024-09-16T01:24:57.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.688+0000 7fae02ffd640 1 -- 172.21.15.63:0/2326255982 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae080054d0 con 0x55a34734fdc0 2024-09-16T01:24:57.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.688+0000 7fae02ffd640 1 -- 172.21.15.63:0/2326255982 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08004be0 con 0x55a34734fdc0 2024-09-16T01:24:57.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.689+0000 7fae219b2740 1 -- 172.21.15.63:0/2326255982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 msgr2=0x55a3473527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:57.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.689+0000 7fae219b2740 1 --2- 172.21.15.63:0/2326255982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473527a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55a347358830 tx=0x7fae08014000 comp rx=0 tx=0).stop 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.689+0000 7fae219b2740 1 -- 172.21.15.63:0/2326255982 shutdown_connections 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.689+0000 7fae219b2740 1 --2- 172.21.15.63:0/2326255982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a347371bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.689+0000 7fae219b2740 1 --2- 172.21.15.63:0/2326255982 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734fdc0 0x55a3473527a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.689+0000 7fae219b2740 1 --2- 172.21.15.63:0/2326255982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734f4a0 0x55a3473664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.689+0000 7fae219b2740 1 -- 172.21.15.63:0/2326255982 >> 172.21.15.63:0/2326255982 conn(0x55a34734ba30 msgr2=0x55a347352090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.689+0000 7fae219b2740 1 -- 172.21.15.63:0/2326255982 shutdown_connections 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.689+0000 7fae219b2740 1 -- 172.21.15.63:0/2326255982 wait complete. 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.689+0000 7fae219b2740 1 -- start start 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae219b2740 1 Processor -- start 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae219b2740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734f4a0 0x55a347362dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae219b2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734fdc0 0x55a347353f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae219b2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a347354460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae219b2740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fae181adc00 con 0x55a34734f4a0 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae219b2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae181af070 con 0x55a34734fdc0 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae219b2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae181ae2d0 con 0x55a34735a680 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae219b2740 10 client.0 _ll_register_callbacks cb 0x7fae140bae70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae1d375640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734f4a0 0x55a347362dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae1d375640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734f4a0 0x55a347362dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59136/0 (socket says 172.21.15.63:59136) 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae1d375640 1 -- 172.21.15.63:0/3120623561 learned_addr learned my addr 172.21.15.63:0/3120623561 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae1cb74640 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734fdc0 0x55a347353f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.690+0000 7fae1db76640 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a347354460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.691+0000 7fae1d375640 1 -- 172.21.15.63:0/3120623561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 msgr2=0x55a347354460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.691+0000 7fae1d375640 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a347354460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.691+0000 7fae1d375640 1 -- 172.21.15.63:0/3120623561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734fdc0 msgr2=0x55a347353f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.691+0000 7fae1d375640 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734fdc0 0x55a347353f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.691+0000 7fae1d375640 1 -- 172.21.15.63:0/3120623561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a347354c90 con 0x55a34734f4a0 2024-09-16T01:24:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.691+0000 7fae1d375640 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734f4a0 0x55a347362dc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fae14098c00 tx=0x7fae14091710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaccd06d6e19dee server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.691+0000 7fae00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.691+0000 7fae00ff9640 1 -- 172.21.15.63:0/3120623561 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae140b5060 con 0x55a34734f4a0 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.691+0000 7fae00ff9640 1 -- 172.21.15.63:0/3120623561 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fae140a4a10 con 0x55a34734f4a0 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.691+0000 7fae219b2740 1 -- 172.21.15.63:0/3120623561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae080054d0 con 0x55a34734f4a0 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae00ff9640 1 -- 172.21.15.63:0/3120623561 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fae140984d0 con 0x55a34734f4a0 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae219b2740 10 client.15459 fetch_fsmap learned FSMap version 26 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae219b2740 1 -- 172.21.15.63:0/3120623561 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a3473d4b60 con 0x55a34734f4a0 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae00ff9640 1 -- 172.21.15.63:0/3120623561 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fae080054d0 con 0x55a34734f4a0 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae00ff9640 1 -- 172.21.15.63:0/3120623561 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fae140cdbd0 con 0x55a34734f4a0 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae219b2740 10 client.15459 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae219b2740 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:24:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae219b2740 20 client.15459 populate_metadata read hostname 'smithi063' 2024-09-16T01:24:57.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae219b2740 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3473d50f0 0x55a3473d74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:57.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae219b2740 4 client.15459 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:24:57.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.692+0000 7fae219b2740 1 -- 172.21.15.63:0/3120623561 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a3472bcd60 con 0x55a3473d50f0 2024-09-16T01:24:57.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.693+0000 7fae1cb74640 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3473d50f0 0x55a3473d74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.693+0000 7fae1cb74640 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3473d50f0 0x55a3473d74e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e175de507cfb07d server_cookie=46de741151b38f34 in_seq=0 out_seq=0 2024-09-16T01:24:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.693+0000 7fae00ff9640 10 client.15459 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae00ff9640 1 -- 172.21.15.63:0/3120623561 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a3472bcd60 con 0x55a3473d50f0 2024-09-16T01:24:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae00ff9640 10 client.15459 handle_command_reply: tid=0 2024-09-16T01:24:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae219b2740 1 client.15459 shutdown 2024-09-16T01:24:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae219b2740 1 -- 172.21.15.63:0/3120623561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734f4a0 msgr2=0x55a347362dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae219b2740 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734f4a0 0x55a347362dc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fae14098c00 tx=0x7fae14091710 comp rx=0 tx=0).stop 2024-09-16T01:24:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae219b2740 1 -- 172.21.15.63:0/3120623561 shutdown_connections 2024-09-16T01:24:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae219b2740 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a34735a680 0x55a347354460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae219b2740 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34734fdc0 0x55a347353f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae219b2740 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3473d50f0 0x55a3473d74e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae219b2740 1 --2- 172.21.15.63:0/3120623561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a34734f4a0 0x55a347362dc0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae00ff9640 0 client.15459 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:24:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.694+0000 7fae219b2740 1 -- 172.21.15.63:0/3120623561 >> 172.21.15.63:0/3120623561 conn(0x55a34734ba30 msgr2=0x55a347352890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae219b2740 1 -- 172.21.15.63:0/3120623561 shutdown_connections 2024-09-16T01:24:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae219b2740 1 -- 172.21.15.63:0/3120623561 wait complete. 2024-09-16T01:24:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae219b2740 20 client.15459 trim_cache size 0 max 16384 2024-09-16T01:24:57.699 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:24:57.699 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-16T01:24:57.700 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-16T01:24:57.700 INFO:teuthology.orchestra.run.smithi063.stdout: "b8fb5a19-9cc7-4c8e-be66-db1a27910138": { 2024-09-16T01:24:57.700 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-16T01:24:57.700 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "b8fb5a19-9cc7-4c8e-be66-db1a27910138", 2024-09-16T01:24:57.700 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-16T01:24:57.700 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:24:57.700 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:24:57.700 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:24:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae1f5d9640 1 -- 172.21.15.63:0/818600625 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a32c0 msgr2=0x7fae040a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae1f5d9640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a32c0 0x7fae040a5780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fae080096c0 tx=0x7fae08009260 comp rx=0 tx=0).stop 2024-09-16T01:24:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae1f5d9640 1 -- 172.21.15.63:0/818600625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18101470 msgr2=0x7fae180fc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae1f5d9640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18101470 0x7fae180fc700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fae1400e9f0 tx=0x7fae1400edf0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae1f5d9640 1 -- 172.21.15.63:0/818600625 shutdown_connections 2024-09-16T01:24:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae1f5d9640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fae040a32c0 0x7fae040a5780 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae1f5d9640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae18105de0 0x7fae180fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae1f5d9640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae18101e20 0x7fae180fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae1f5d9640 1 --2- 172.21.15.63:0/818600625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae18101470 0x7fae180fc700 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:57.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.695+0000 7fae1f5d9640 1 -- 172.21.15.63:0/818600625 >> 172.21.15.63:0/818600625 conn(0x7fae18077230 msgr2=0x7fae18100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:57.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.696+0000 7fae1f5d9640 1 -- 172.21.15.63:0/818600625 shutdown_connections 2024-09-16T01:24:57.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:24:57.696+0000 7fae1f5d9640 1 -- 172.21.15.63:0/818600625 wait complete. 2024-09-16T01:24:58.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:24:58 smithi063 ceph-mon[31070]: pgmap v384: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 323 op/s 2024-09-16T01:24:58.434 INFO:tasks.cephfs.filesystem:scrub status for tag:b8fb5a19-9cc7-4c8e-be66-db1a27910138 - {'path': '/', 'tag': 'b8fb5a19-9cc7-4c8e-be66-db1a27910138', 'options': 'recursive,force'} 2024-09-16T01:24:58.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:24:58 smithi192 ceph-mon[34775]: pgmap v384: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 323 op/s 2024-09-16T01:24:58.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:24:58 smithi162 ceph-mon[34539]: pgmap v384: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 323 op/s 2024-09-16T01:25:00.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:00 smithi063 ceph-mon[31070]: pgmap v385: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 226 op/s 2024-09-16T01:25:00.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:00 smithi192 ceph-mon[34775]: pgmap v385: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 226 op/s 2024-09-16T01:25:00.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:00 smithi162 ceph-mon[34539]: pgmap v385: 97 pgs: 97 active+clean; 82 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 226 op/s 2024-09-16T01:25:02.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:02 smithi063 ceph-mon[31070]: pgmap v386: 97 pgs: 97 active+clean; 90 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 299 op/s 2024-09-16T01:25:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:02 smithi192 ceph-mon[34775]: pgmap v386: 97 pgs: 97 active+clean; 90 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 299 op/s 2024-09-16T01:25:02.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:02 smithi162 ceph-mon[34539]: pgmap v386: 97 pgs: 97 active+clean; 90 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 299 op/s 2024-09-16T01:25:04.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:04 smithi063 ceph-mon[31070]: pgmap v387: 97 pgs: 97 active+clean; 93 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 271 op/s 2024-09-16T01:25:04.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:04 smithi192 ceph-mon[34775]: pgmap v387: 97 pgs: 97 active+clean; 93 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 271 op/s 2024-09-16T01:25:04.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:04 smithi162 ceph-mon[34539]: pgmap v387: 97 pgs: 97 active+clean; 93 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 271 op/s 2024-09-16T01:25:04.814 INFO:tasks.workunit.client.0.smithi063.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-16T01:25:04.887 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T01:25:04.888 INFO:tasks.workunit.client.0.smithi063.stderr:+ make 2024-09-16T01:25:04.969 INFO:tasks.workunit.client.0.smithi063.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-16T01:25:05.551 INFO:tasks.workunit.client.0.smithi063.stderr:++ readlink -f fsstress 2024-09-16T01:25:05.552 INFO:tasks.workunit.client.0.smithi063.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-16T01:25:05.552 INFO:tasks.workunit.client.0.smithi063.stderr:+ popd 2024-09-16T01:25:05.553 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T01:25:05.553 INFO:tasks.workunit.client.0.smithi063.stderr:+ popd 2024-09-16T01:25:05.554 INFO:tasks.workunit.client.0.smithi063.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-16T01:25:05.554 INFO:tasks.workunit.client.0.smithi063.stderr:++ mktemp -d -p . 2024-09-16T01:25:05.557 INFO:tasks.workunit.client.0.smithi063.stderr:+ T=./tmp.82pyWvR6Li 2024-09-16T01:25:05.557 INFO:tasks.workunit.client.0.smithi063.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.82pyWvR6Li -l 1 -n 1000 -p 10 -v 2024-09-16T01:25:05.560 INFO:tasks.workunit.client.0.smithi063.stdout:seed = 1726940561 2024-09-16T01:25:05.563 INFO:tasks.workunit.client.0.smithi063.stdout:0/0: dread - no filename 2024-09-16T01:25:05.563 INFO:tasks.workunit.client.0.smithi063.stdout:0/1: unlink - no file 2024-09-16T01:25:05.565 INFO:tasks.workunit.client.0.smithi063.stdout:1/0: dwrite - no filename 2024-09-16T01:25:05.565 INFO:tasks.workunit.client.0.smithi063.stdout:1/1: fsync - no filename 2024-09-16T01:25:05.565 INFO:tasks.workunit.client.0.smithi063.stdout:0/2: symlink l0 0 2024-09-16T01:25:05.567 INFO:tasks.workunit.client.0.smithi063.stdout:0/3: mkdir d1 0 2024-09-16T01:25:05.567 INFO:tasks.workunit.client.0.smithi063.stdout:0/4: readlink l0 0 2024-09-16T01:25:05.567 INFO:tasks.workunit.client.0.smithi063.stdout:0/5: stat l0 0 2024-09-16T01:25:05.567 INFO:tasks.workunit.client.0.smithi063.stdout:1/2: creat f0 x:0 0 0 2024-09-16T01:25:05.568 INFO:tasks.workunit.client.0.smithi063.stdout:1/3: stat f0 0 2024-09-16T01:25:05.568 INFO:tasks.workunit.client.0.smithi063.stdout:1/4: dread - f0 zero size 2024-09-16T01:25:05.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/0: link - no file 2024-09-16T01:25:05.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/1: dwrite - no filename 2024-09-16T01:25:05.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/2: truncate - no filename 2024-09-16T01:25:05.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/3: dread - no filename 2024-09-16T01:25:05.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/4: fsync - no filename 2024-09-16T01:25:05.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/5: write - no filename 2024-09-16T01:25:05.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/6: chown . 650119251 1 2024-09-16T01:25:05.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/7: chown . 62360 1 2024-09-16T01:25:05.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/8: write - no filename 2024-09-16T01:25:05.569 INFO:tasks.workunit.client.0.smithi063.stdout:1/5: dread - f0 zero size 2024-09-16T01:25:05.570 INFO:tasks.workunit.client.0.smithi063.stdout:0/6: rename l0 to d1/l2 0 2024-09-16T01:25:05.570 INFO:tasks.workunit.client.0.smithi063.stdout:1/6: write f0 [543304,12275] 0 2024-09-16T01:25:05.570 INFO:tasks.workunit.client.0.smithi063.stdout:2/0: creat f0 x:0 0 0 2024-09-16T01:25:05.571 INFO:tasks.workunit.client.0.smithi063.stdout:4/0: dread - no filename 2024-09-16T01:25:05.571 INFO:tasks.workunit.client.0.smithi063.stdout:4/1: write - no filename 2024-09-16T01:25:05.571 INFO:tasks.workunit.client.0.smithi063.stdout:4/2: truncate - no filename 2024-09-16T01:25:05.573 INFO:tasks.workunit.client.0.smithi063.stdout:5/0: fdatasync - no filename 2024-09-16T01:25:05.573 INFO:tasks.workunit.client.0.smithi063.stdout:4/3: symlink l0 0 2024-09-16T01:25:05.574 INFO:tasks.workunit.client.0.smithi063.stdout:4/4: readlink l0 0 2024-09-16T01:25:05.575 INFO:tasks.workunit.client.0.smithi063.stdout:4/5: truncate - no filename 2024-09-16T01:25:05.575 INFO:tasks.workunit.client.0.smithi063.stdout:4/6: write - no filename 2024-09-16T01:25:05.576 INFO:tasks.workunit.client.0.smithi063.stdout:6/0: dwrite - no filename 2024-09-16T01:25:05.576 INFO:tasks.workunit.client.0.smithi063.stdout:5/1: creat f0 x:0 0 0 2024-09-16T01:25:05.578 INFO:tasks.workunit.client.0.smithi063.stdout:2/1: dwrite f0 [0,4194304] 0 2024-09-16T01:25:05.579 INFO:tasks.workunit.client.0.smithi063.stdout:2/2: chown f0 1545194 1 2024-09-16T01:25:05.581 INFO:tasks.workunit.client.0.smithi063.stdout:6/1: creat f0 x:0 0 0 2024-09-16T01:25:05.581 INFO:tasks.workunit.client.0.smithi063.stdout:6/2: truncate f0 378338 0 2024-09-16T01:25:05.584 INFO:tasks.workunit.client.0.smithi063.stdout:6/3: chown f0 5456454 1 2024-09-16T01:25:05.585 INFO:tasks.workunit.client.0.smithi063.stdout:8/0: write - no filename 2024-09-16T01:25:05.585 INFO:tasks.workunit.client.0.smithi063.stdout:8/1: dread - no filename 2024-09-16T01:25:05.585 INFO:tasks.workunit.client.0.smithi063.stdout:8/2: write - no filename 2024-09-16T01:25:05.585 INFO:tasks.workunit.client.0.smithi063.stdout:8/3: write - no filename 2024-09-16T01:25:05.585 INFO:tasks.workunit.client.0.smithi063.stdout:8/4: link - no file 2024-09-16T01:25:05.585 INFO:tasks.workunit.client.0.smithi063.stdout:1/7: fsync f0 0 2024-09-16T01:25:05.585 INFO:tasks.workunit.client.0.smithi063.stdout:6/4: write f0 [928618,98175] 0 2024-09-16T01:25:05.586 INFO:tasks.workunit.client.0.smithi063.stdout:7/0: getdents . 0 2024-09-16T01:25:05.586 INFO:tasks.workunit.client.0.smithi063.stdout:9/0: rename - no filename 2024-09-16T01:25:05.589 INFO:tasks.workunit.client.0.smithi063.stdout:4/7: getdents . 0 2024-09-16T01:25:05.590 INFO:tasks.workunit.client.0.smithi063.stdout:4/8: readlink l0 0 2024-09-16T01:25:05.590 INFO:tasks.workunit.client.0.smithi063.stdout:4/9: chown l0 1614137 1 2024-09-16T01:25:05.591 INFO:tasks.workunit.client.0.smithi063.stdout:1/8: mkdir d1 0 2024-09-16T01:25:05.594 INFO:tasks.workunit.client.0.smithi063.stdout:6/5: creat f1 x:0 0 0 2024-09-16T01:25:05.595 INFO:tasks.workunit.client.0.smithi063.stdout:6/6: dread - f1 zero size 2024-09-16T01:25:05.597 INFO:tasks.workunit.client.0.smithi063.stdout:0/7: rename d1/l2 to d1/l3 0 2024-09-16T01:25:05.598 INFO:tasks.workunit.client.0.smithi063.stdout:8/5: symlink l0 0 2024-09-16T01:25:05.599 INFO:tasks.workunit.client.0.smithi063.stdout:4/10: mknod c1 0 2024-09-16T01:25:05.599 INFO:tasks.workunit.client.0.smithi063.stdout:4/11: chown c1 0 1 2024-09-16T01:25:05.600 INFO:tasks.workunit.client.0.smithi063.stdout:4/12: dwrite - no filename 2024-09-16T01:25:05.600 INFO:tasks.workunit.client.0.smithi063.stdout:4/13: write - no filename 2024-09-16T01:25:05.600 INFO:tasks.workunit.client.0.smithi063.stdout:7/1: creat f0 x:0 0 0 2024-09-16T01:25:05.601 INFO:tasks.workunit.client.0.smithi063.stdout:7/2: readlink - no filename 2024-09-16T01:25:05.602 INFO:tasks.workunit.client.0.smithi063.stdout:6/7: creat f2 x:0 0 0 2024-09-16T01:25:05.602 INFO:tasks.workunit.client.0.smithi063.stdout:6/8: dread - f1 zero size 2024-09-16T01:25:05.603 INFO:tasks.workunit.client.0.smithi063.stdout:9/1: creat f0 x:0 0 0 2024-09-16T01:25:05.603 INFO:tasks.workunit.client.0.smithi063.stdout:1/9: mkdir d1/d2 0 2024-09-16T01:25:05.604 INFO:tasks.workunit.client.0.smithi063.stdout:4/14: mknod c2 0 2024-09-16T01:25:05.606 INFO:tasks.workunit.client.0.smithi063.stdout:7/3: creat f1 x:0 0 0 2024-09-16T01:25:05.608 INFO:tasks.workunit.client.0.smithi063.stdout:6/9: mkdir d3 0 2024-09-16T01:25:05.609 INFO:tasks.workunit.client.0.smithi063.stdout:9/2: mknod c1 0 2024-09-16T01:25:05.610 INFO:tasks.workunit.client.0.smithi063.stdout:9/3: dread - f0 zero size 2024-09-16T01:25:05.611 INFO:tasks.workunit.client.0.smithi063.stdout:1/10: creat d1/f3 x:0 0 0 2024-09-16T01:25:05.612 INFO:tasks.workunit.client.0.smithi063.stdout:0/8: stat d1/l3 0 2024-09-16T01:25:05.613 INFO:tasks.workunit.client.0.smithi063.stdout:9/4: fdatasync f0 0 2024-09-16T01:25:05.613 INFO:tasks.workunit.client.0.smithi063.stdout:4/15: mknod c3 0 2024-09-16T01:25:05.613 INFO:tasks.workunit.client.0.smithi063.stdout:4/16: dread - no filename 2024-09-16T01:25:05.616 INFO:tasks.workunit.client.0.smithi063.stdout:4/17: mknod c4 0 2024-09-16T01:25:05.617 INFO:tasks.workunit.client.0.smithi063.stdout:0/9: mknod d1/c4 0 2024-09-16T01:25:05.617 INFO:tasks.workunit.client.0.smithi063.stdout:7/4: dwrite f1 [0,4194304] 0 2024-09-16T01:25:05.618 INFO:tasks.workunit.client.0.smithi063.stdout:9/5: creat f2 x:0 0 0 2024-09-16T01:25:05.620 INFO:tasks.workunit.client.0.smithi063.stdout:4/18: mkdir d5 0 2024-09-16T01:25:05.621 INFO:tasks.workunit.client.0.smithi063.stdout:6/10: dwrite f0 [0,4194304] 0 2024-09-16T01:25:05.621 INFO:tasks.workunit.client.0.smithi063.stdout:7/5: creat f2 x:0 0 0 2024-09-16T01:25:05.622 INFO:tasks.workunit.client.0.smithi063.stdout:0/10: creat d1/f5 x:0 0 0 2024-09-16T01:25:05.623 INFO:tasks.workunit.client.0.smithi063.stdout:1/11: symlink d1/d2/l4 0 2024-09-16T01:25:05.624 INFO:tasks.workunit.client.0.smithi063.stdout:9/6: rename f0 to f3 0 2024-09-16T01:25:05.626 INFO:tasks.workunit.client.0.smithi063.stdout:4/19: unlink l0 0 2024-09-16T01:25:05.626 INFO:tasks.workunit.client.0.smithi063.stdout:4/20: write - no filename 2024-09-16T01:25:05.628 INFO:tasks.workunit.client.0.smithi063.stdout:0/11: creat d1/f6 x:0 0 0 2024-09-16T01:25:05.629 INFO:tasks.workunit.client.0.smithi063.stdout:1/12: mkdir d1/d5 0 2024-09-16T01:25:05.630 INFO:tasks.workunit.client.0.smithi063.stdout:6/11: mknod d3/c4 0 2024-09-16T01:25:05.630 INFO:tasks.workunit.client.0.smithi063.stdout:6/12: chown d3 1 1 2024-09-16T01:25:05.632 INFO:tasks.workunit.client.0.smithi063.stdout:7/6: link f1 f3 0 2024-09-16T01:25:05.633 INFO:tasks.workunit.client.0.smithi063.stdout:0/12: creat d1/f7 x:0 0 0 2024-09-16T01:25:05.635 INFO:tasks.workunit.client.0.smithi063.stdout:9/7: link f3 f4 0 2024-09-16T01:25:05.636 INFO:tasks.workunit.client.0.smithi063.stdout:4/21: creat d5/f6 x:0 0 0 2024-09-16T01:25:05.637 INFO:tasks.workunit.client.0.smithi063.stdout:6/13: symlink d3/l5 0 2024-09-16T01:25:05.639 INFO:tasks.workunit.client.0.smithi063.stdout:6/14: write f2 [379014,88471] 0 2024-09-16T01:25:05.639 INFO:tasks.workunit.client.0.smithi063.stdout:7/7: mknod c4 0 2024-09-16T01:25:05.640 INFO:tasks.workunit.client.0.smithi063.stdout:1/13: creat d1/d5/f6 x:0 0 0 2024-09-16T01:25:05.640 INFO:tasks.workunit.client.0.smithi063.stdout:6/15: chown f0 698930 1 2024-09-16T01:25:05.641 INFO:tasks.workunit.client.0.smithi063.stdout:0/13: symlink d1/l8 0 2024-09-16T01:25:05.642 INFO:tasks.workunit.client.0.smithi063.stdout:0/14: readlink d1/l3 0 2024-09-16T01:25:05.644 INFO:tasks.workunit.client.0.smithi063.stdout:1/14: write d1/d5/f6 [820985,72536] 0 2024-09-16T01:25:05.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/8: write f4 [557379,112673] 0 2024-09-16T01:25:05.645 INFO:tasks.workunit.client.0.smithi063.stdout:7/8: creat f5 x:0 0 0 2024-09-16T01:25:05.648 INFO:tasks.workunit.client.0.smithi063.stdout:0/15: write d1/f5 [926967,34977] 0 2024-09-16T01:25:05.648 INFO:tasks.workunit.client.0.smithi063.stdout:4/22: dwrite d5/f6 [0,4194304] 0 2024-09-16T01:25:05.649 INFO:tasks.workunit.client.0.smithi063.stdout:7/9: symlink l6 0 2024-09-16T01:25:05.651 INFO:tasks.workunit.client.0.smithi063.stdout:9/9: rename f2 to f5 0 2024-09-16T01:25:05.651 INFO:tasks.workunit.client.0.smithi063.stdout:0/16: rename d1 to d1/d9 22 2024-09-16T01:25:05.652 INFO:tasks.workunit.client.0.smithi063.stdout:4/23: creat d5/f7 x:0 0 0 2024-09-16T01:25:05.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/10: chown l6 42 1 2024-09-16T01:25:05.653 INFO:tasks.workunit.client.0.smithi063.stdout:1/15: dread f0 [0,4194304] 0 2024-09-16T01:25:05.654 INFO:tasks.workunit.client.0.smithi063.stdout:0/17: creat d1/fa x:0 0 0 2024-09-16T01:25:05.656 INFO:tasks.workunit.client.0.smithi063.stdout:6/16: dwrite f1 [0,4194304] 0 2024-09-16T01:25:05.656 INFO:tasks.workunit.client.0.smithi063.stdout:7/11: mkdir d7 0 2024-09-16T01:25:05.658 INFO:tasks.workunit.client.0.smithi063.stdout:9/10: link c1 c6 0 2024-09-16T01:25:05.662 INFO:tasks.workunit.client.0.smithi063.stdout:0/18: link d1/f6 d1/fb 0 2024-09-16T01:25:05.663 INFO:tasks.workunit.client.0.smithi063.stdout:4/24: link c1 d5/c8 0 2024-09-16T01:25:05.664 INFO:tasks.workunit.client.0.smithi063.stdout:6/17: link f1 d3/f6 0 2024-09-16T01:25:05.665 INFO:tasks.workunit.client.0.smithi063.stdout:7/12: mknod d7/c8 0 2024-09-16T01:25:05.666 INFO:tasks.workunit.client.0.smithi063.stdout:0/19: truncate d1/fb 875315 0 2024-09-16T01:25:05.666 INFO:tasks.workunit.client.0.smithi063.stdout:4/25: mkdir d5/d9 0 2024-09-16T01:25:05.667 INFO:tasks.workunit.client.0.smithi063.stdout:7/13: chown f1 128 1 2024-09-16T01:25:05.667 INFO:tasks.workunit.client.0.smithi063.stdout:1/16: dwrite d1/f3 [0,4194304] 0 2024-09-16T01:25:05.669 INFO:tasks.workunit.client.0.smithi063.stdout:6/18: mknod d3/c7 0 2024-09-16T01:25:05.669 INFO:tasks.workunit.client.0.smithi063.stdout:7/14: write f0 [511727,26856] 0 2024-09-16T01:25:05.669 INFO:tasks.workunit.client.0.smithi063.stdout:0/20: creat d1/fc x:0 0 0 2024-09-16T01:25:05.670 INFO:tasks.workunit.client.0.smithi063.stdout:0/21: dread - d1/fa zero size 2024-09-16T01:25:05.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/17: creat d1/d5/f7 x:0 0 0 2024-09-16T01:25:05.673 INFO:tasks.workunit.client.0.smithi063.stdout:1/18: write d1/f3 [460625,31717] 0 2024-09-16T01:25:05.674 INFO:tasks.workunit.client.0.smithi063.stdout:9/11: getdents . 0 2024-09-16T01:25:05.675 INFO:tasks.workunit.client.0.smithi063.stdout:6/19: write f1 [179474,8818] 0 2024-09-16T01:25:05.675 INFO:tasks.workunit.client.0.smithi063.stdout:7/15: unlink f1 0 2024-09-16T01:25:05.676 INFO:tasks.workunit.client.0.smithi063.stdout:4/26: getdents d5/d9 0 2024-09-16T01:25:05.677 INFO:tasks.workunit.client.0.smithi063.stdout:0/22: creat d1/fd x:0 0 0 2024-09-16T01:25:05.678 INFO:tasks.workunit.client.0.smithi063.stdout:4/27: read - d5/f7 zero size 2024-09-16T01:25:05.680 INFO:tasks.workunit.client.0.smithi063.stdout:9/12: write f5 [780351,17342] 0 2024-09-16T01:25:05.680 INFO:tasks.workunit.client.0.smithi063.stdout:7/16: creat d7/f9 x:0 0 0 2024-09-16T01:25:05.680 INFO:tasks.workunit.client.0.smithi063.stdout:4/28: fdatasync d5/f7 0 2024-09-16T01:25:05.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/17: dread - f5 zero size 2024-09-16T01:25:05.686 INFO:tasks.workunit.client.0.smithi063.stdout:4/29: creat d5/fa x:0 0 0 2024-09-16T01:25:05.690 INFO:tasks.workunit.client.0.smithi063.stdout:1/19: dwrite d1/d5/f6 [0,4194304] 0 2024-09-16T01:25:05.695 INFO:tasks.workunit.client.0.smithi063.stdout:7/18: read f3 [3179817,76550] 0 2024-09-16T01:25:05.696 INFO:tasks.workunit.client.0.smithi063.stdout:6/20: dwrite d3/f6 [4194304,4194304] 0 2024-09-16T01:25:05.697 INFO:tasks.workunit.client.0.smithi063.stdout:1/20: readlink d1/d2/l4 0 2024-09-16T01:25:05.699 INFO:tasks.workunit.client.0.smithi063.stdout:6/21: chown d3 8 1 2024-09-16T01:25:05.701 INFO:tasks.workunit.client.0.smithi063.stdout:0/23: dwrite d1/fa [0,4194304] 0 2024-09-16T01:25:05.704 INFO:tasks.workunit.client.0.smithi063.stdout:7/19: write f2 [798981,120295] 0 2024-09-16T01:25:05.706 INFO:tasks.workunit.client.0.smithi063.stdout:6/22: mknod d3/c8 0 2024-09-16T01:25:05.707 INFO:tasks.workunit.client.0.smithi063.stdout:0/24: mknod d1/ce 0 2024-09-16T01:25:05.707 INFO:tasks.workunit.client.0.smithi063.stdout:9/13: dwrite f5 [0,4194304] 0 2024-09-16T01:25:05.708 INFO:tasks.workunit.client.0.smithi063.stdout:1/21: rename d1/d5/f6 to d1/f8 0 2024-09-16T01:25:05.711 INFO:tasks.workunit.client.0.smithi063.stdout:9/14: unlink c1 0 2024-09-16T01:25:05.712 INFO:tasks.workunit.client.0.smithi063.stdout:1/22: write f0 [898716,49801] 0 2024-09-16T01:25:05.712 INFO:tasks.workunit.client.0.smithi063.stdout:4/30: dwrite d5/f7 [0,4194304] 0 2024-09-16T01:25:05.713 INFO:tasks.workunit.client.0.smithi063.stdout:6/23: rename d3/f6 to d3/f9 0 2024-09-16T01:25:05.715 INFO:tasks.workunit.client.0.smithi063.stdout:9/15: mkdir d7 0 2024-09-16T01:25:05.715 INFO:tasks.workunit.client.0.smithi063.stdout:7/20: symlink d7/la 0 2024-09-16T01:25:05.718 INFO:tasks.workunit.client.0.smithi063.stdout:1/23: symlink d1/d2/l9 0 2024-09-16T01:25:05.719 INFO:tasks.workunit.client.0.smithi063.stdout:0/25: write d1/fb [32768,72286] 0 2024-09-16T01:25:05.722 INFO:tasks.workunit.client.0.smithi063.stdout:1/24: mknod d1/d2/ca 0 2024-09-16T01:25:05.722 INFO:tasks.workunit.client.0.smithi063.stdout:4/31: creat d5/d9/fb x:0 0 0 2024-09-16T01:25:05.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/26: mkdir d1/df 0 2024-09-16T01:25:05.725 INFO:tasks.workunit.client.0.smithi063.stdout:1/25: dread d1/f8 [0,4194304] 0 2024-09-16T01:25:05.725 INFO:tasks.workunit.client.0.smithi063.stdout:1/26: stat f0 0 2024-09-16T01:25:05.726 INFO:tasks.workunit.client.0.smithi063.stdout:9/16: symlink d7/l8 0 2024-09-16T01:25:05.727 INFO:tasks.workunit.client.0.smithi063.stdout:7/21: rename c4 to d7/cb 0 2024-09-16T01:25:05.729 INFO:tasks.workunit.client.0.smithi063.stdout:1/27: dread d1/f3 [0,4194304] 0 2024-09-16T01:25:05.730 INFO:tasks.workunit.client.0.smithi063.stdout:1/28: read f0 [790136,8489] 0 2024-09-16T01:25:05.730 INFO:tasks.workunit.client.0.smithi063.stdout:0/27: symlink d1/l10 0 2024-09-16T01:25:05.731 INFO:tasks.workunit.client.0.smithi063.stdout:0/28: dread - d1/fd zero size 2024-09-16T01:25:05.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/24: link d3/c7 d3/ca 0 2024-09-16T01:25:05.734 INFO:tasks.workunit.client.0.smithi063.stdout:6/25: chown f2 13224 1 2024-09-16T01:25:05.736 INFO:tasks.workunit.client.0.smithi063.stdout:4/32: link c4 d5/d9/cc 0 2024-09-16T01:25:05.736 INFO:tasks.workunit.client.0.smithi063.stdout:9/17: rmdir d7 39 2024-09-16T01:25:05.738 INFO:tasks.workunit.client.0.smithi063.stdout:6/26: creat d3/fb x:0 0 0 2024-09-16T01:25:05.740 INFO:tasks.workunit.client.0.smithi063.stdout:1/29: dwrite d1/d5/f7 [0,4194304] 0 2024-09-16T01:25:05.742 INFO:tasks.workunit.client.0.smithi063.stdout:4/33: chown c4 18100305 1 2024-09-16T01:25:05.742 INFO:tasks.workunit.client.0.smithi063.stdout:9/18: mkdir d7/d9 0 2024-09-16T01:25:05.743 INFO:tasks.workunit.client.0.smithi063.stdout:6/27: creat d3/fc x:0 0 0 2024-09-16T01:25:05.744 INFO:tasks.workunit.client.0.smithi063.stdout:1/30: unlink d1/d2/ca 0 2024-09-16T01:25:05.744 INFO:tasks.workunit.client.0.smithi063.stdout:7/22: dwrite f5 [0,4194304] 0 2024-09-16T01:25:05.745 INFO:tasks.workunit.client.0.smithi063.stdout:4/34: write d5/d9/fb [531601,46268] 0 2024-09-16T01:25:05.747 INFO:tasks.workunit.client.0.smithi063.stdout:7/23: write f5 [2788079,55182] 0 2024-09-16T01:25:05.747 INFO:tasks.workunit.client.0.smithi063.stdout:4/35: dread - d5/fa zero size 2024-09-16T01:25:05.748 INFO:tasks.workunit.client.0.smithi063.stdout:1/31: rename d1/d2/l9 to d1/lb 0 2024-09-16T01:25:05.756 INFO:tasks.workunit.client.0.smithi063.stdout:7/24: getdents d7 0 2024-09-16T01:25:05.758 INFO:tasks.workunit.client.0.smithi063.stdout:6/28: dwrite f1 [0,4194304] 0 2024-09-16T01:25:05.759 INFO:tasks.workunit.client.0.smithi063.stdout:9/19: dwrite f4 [0,4194304] 0 2024-09-16T01:25:05.762 INFO:tasks.workunit.client.0.smithi063.stdout:7/25: creat d7/fc x:0 0 0 2024-09-16T01:25:05.764 INFO:tasks.workunit.client.0.smithi063.stdout:4/36: dread d5/f6 [0,4194304] 0 2024-09-16T01:25:05.768 INFO:tasks.workunit.client.0.smithi063.stdout:1/32: dwrite d1/f3 [0,4194304] 0 2024-09-16T01:25:05.769 INFO:tasks.workunit.client.0.smithi063.stdout:6/29: dread f0 [0,4194304] 0 2024-09-16T01:25:05.770 INFO:tasks.workunit.client.0.smithi063.stdout:1/33: mknod d1/d5/cc 0 2024-09-16T01:25:05.771 INFO:tasks.workunit.client.0.smithi063.stdout:6/30: mkdir d3/dd 0 2024-09-16T01:25:05.771 INFO:tasks.workunit.client.0.smithi063.stdout:4/37: dread d5/f7 [0,4194304] 0 2024-09-16T01:25:05.772 INFO:tasks.workunit.client.0.smithi063.stdout:1/34: chown d1/lb 3598746 1 2024-09-16T01:25:05.773 INFO:tasks.workunit.client.0.smithi063.stdout:6/31: symlink d3/le 0 2024-09-16T01:25:05.774 INFO:tasks.workunit.client.0.smithi063.stdout:1/35: mkdir d1/dd 0 2024-09-16T01:25:05.776 INFO:tasks.workunit.client.0.smithi063.stdout:4/38: rename d5/f7 to d5/d9/fd 0 2024-09-16T01:25:05.777 INFO:tasks.workunit.client.0.smithi063.stdout:1/36: symlink d1/d5/le 0 2024-09-16T01:25:05.779 INFO:tasks.workunit.client.0.smithi063.stdout:4/39: creat d5/d9/fe x:0 0 0 2024-09-16T01:25:05.780 INFO:tasks.workunit.client.0.smithi063.stdout:1/37: creat d1/d5/ff x:0 0 0 2024-09-16T01:25:05.781 INFO:tasks.workunit.client.0.smithi063.stdout:6/32: dwrite d3/f9 [8388608,4194304] 0 2024-09-16T01:25:05.781 INFO:tasks.workunit.client.0.smithi063.stdout:4/40: chown d5/fa 656125 1 2024-09-16T01:25:05.781 INFO:tasks.workunit.client.0.smithi063.stdout:6/33: chown d3/f9 7 1 2024-09-16T01:25:05.783 INFO:tasks.workunit.client.0.smithi063.stdout:1/38: creat d1/d5/f10 x:0 0 0 2024-09-16T01:25:05.784 INFO:tasks.workunit.client.0.smithi063.stdout:4/41: write d5/f6 [4129642,85718] 0 2024-09-16T01:25:05.786 INFO:tasks.workunit.client.0.smithi063.stdout:6/34: rename f1 to d3/dd/ff 0 2024-09-16T01:25:05.788 INFO:tasks.workunit.client.0.smithi063.stdout:1/39: creat d1/d5/f11 x:0 0 0 2024-09-16T01:25:05.788 INFO:tasks.workunit.client.0.smithi063.stdout:4/42: fdatasync d5/d9/fd 0 2024-09-16T01:25:05.789 INFO:tasks.workunit.client.0.smithi063.stdout:4/43: fsync d5/fa 0 2024-09-16T01:25:05.789 INFO:tasks.workunit.client.0.smithi063.stdout:4/44: write d5/d9/fd [497660,42374] 0 2024-09-16T01:25:05.790 INFO:tasks.workunit.client.0.smithi063.stdout:1/40: mkdir d1/d12 0 2024-09-16T01:25:05.790 INFO:tasks.workunit.client.0.smithi063.stdout:4/45: chown d5/d9 154010454 1 2024-09-16T01:25:05.791 INFO:tasks.workunit.client.0.smithi063.stdout:1/41: chown d1/d5/le 29955026 1 2024-09-16T01:25:05.793 INFO:tasks.workunit.client.0.smithi063.stdout:4/46: mkdir d5/d9/df 0 2024-09-16T01:25:05.794 INFO:tasks.workunit.client.0.smithi063.stdout:1/42: creat d1/d5/f13 x:0 0 0 2024-09-16T01:25:05.796 INFO:tasks.workunit.client.0.smithi063.stdout:1/43: write d1/d5/f7 [5146450,58312] 0 2024-09-16T01:25:05.797 INFO:tasks.workunit.client.0.smithi063.stdout:1/44: chown d1 85335128 1 2024-09-16T01:25:05.801 INFO:tasks.workunit.client.0.smithi063.stdout:4/47: dwrite d5/d9/fb [0,4194304] 0 2024-09-16T01:25:05.801 INFO:tasks.workunit.client.0.smithi063.stdout:1/45: getdents d1/d2 0 2024-09-16T01:25:05.803 INFO:tasks.workunit.client.0.smithi063.stdout:4/48: unlink d5/fa 0 2024-09-16T01:25:05.804 INFO:tasks.workunit.client.0.smithi063.stdout:1/46: symlink d1/d5/l14 0 2024-09-16T01:25:05.806 INFO:tasks.workunit.client.0.smithi063.stdout:1/47: mkdir d1/d5/d15 0 2024-09-16T01:25:05.807 INFO:tasks.workunit.client.0.smithi063.stdout:1/48: fdatasync d1/d5/f13 0 2024-09-16T01:25:05.809 INFO:tasks.workunit.client.0.smithi063.stdout:1/49: mkdir d1/d12/d16 0 2024-09-16T01:25:05.810 INFO:tasks.workunit.client.0.smithi063.stdout:4/49: dwrite d5/d9/fd [0,4194304] 0 2024-09-16T01:25:05.811 INFO:tasks.workunit.client.0.smithi063.stdout:1/50: mknod d1/d2/c17 0 2024-09-16T01:25:05.811 INFO:tasks.workunit.client.0.smithi063.stdout:4/50: rmdir d5 39 2024-09-16T01:25:05.832 INFO:tasks.workunit.client.0.smithi063.stdout:4/51: fsync d5/d9/fe 0 2024-09-16T01:25:05.833 INFO:tasks.workunit.client.0.smithi063.stdout:1/51: mkdir d1/d5/d15/d18 0 2024-09-16T01:25:05.833 INFO:tasks.workunit.client.0.smithi063.stdout:4/52: chown d5/f6 404304 1 2024-09-16T01:25:05.835 INFO:tasks.workunit.client.0.smithi063.stdout:4/53: fdatasync d5/d9/fb 0 2024-09-16T01:25:05.835 INFO:tasks.workunit.client.0.smithi063.stdout:1/52: write d1/d5/f11 [892894,127281] 0 2024-09-16T01:25:05.835 INFO:tasks.workunit.client.0.smithi063.stdout:4/54: write d5/f6 [2408782,66596] 0 2024-09-16T01:25:05.836 INFO:tasks.workunit.client.0.smithi063.stdout:4/55: symlink d5/l10 0 2024-09-16T01:25:05.839 INFO:tasks.workunit.client.0.smithi063.stdout:4/56: creat d5/f11 x:0 0 0 2024-09-16T01:25:05.841 INFO:tasks.workunit.client.0.smithi063.stdout:1/53: dwrite d1/d5/f7 [4194304,4194304] 0 2024-09-16T01:25:05.842 INFO:tasks.workunit.client.0.smithi063.stdout:4/57: getdents d5/d9 0 2024-09-16T01:25:05.842 INFO:tasks.workunit.client.0.smithi063.stdout:1/54: read d1/f8 [192010,94236] 0 2024-09-16T01:25:05.843 INFO:tasks.workunit.client.0.smithi063.stdout:1/55: read - d1/d5/ff zero size 2024-09-16T01:25:05.844 INFO:tasks.workunit.client.0.smithi063.stdout:4/58: mknod d5/d9/c12 0 2024-09-16T01:25:05.845 INFO:tasks.workunit.client.0.smithi063.stdout:4/59: getdents d5/d9/df 0 2024-09-16T01:25:05.846 INFO:tasks.workunit.client.0.smithi063.stdout:4/60: chown d5/d9/c12 213265068 1 2024-09-16T01:25:05.847 INFO:tasks.workunit.client.0.smithi063.stdout:4/61: truncate d5/d9/fe 1047018 0 2024-09-16T01:25:05.849 INFO:tasks.workunit.client.0.smithi063.stdout:4/62: mknod d5/c13 0 2024-09-16T01:25:05.852 INFO:tasks.workunit.client.0.smithi063.stdout:4/63: rename c3 to d5/c14 0 2024-09-16T01:25:05.854 INFO:tasks.workunit.client.0.smithi063.stdout:4/64: symlink d5/d9/l15 0 2024-09-16T01:25:05.855 INFO:tasks.workunit.client.0.smithi063.stdout:1/56: dwrite f0 [0,4194304] 0 2024-09-16T01:25:05.863 INFO:tasks.workunit.client.0.smithi063.stdout:1/57: dwrite d1/d5/ff [0,4194304] 0 2024-09-16T01:25:05.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/58: dread - d1/d5/f13 zero size 2024-09-16T01:25:05.865 INFO:tasks.workunit.client.0.smithi063.stdout:1/59: read - d1/d5/f10 zero size 2024-09-16T01:25:05.868 INFO:tasks.workunit.client.0.smithi063.stdout:1/60: creat d1/d5/d15/f19 x:0 0 0 2024-09-16T01:25:05.872 INFO:tasks.workunit.client.0.smithi063.stdout:1/61: dread d1/d5/f7 [4194304,4194304] 0 2024-09-16T01:25:05.873 INFO:tasks.workunit.client.0.smithi063.stdout:1/62: chown d1/d5/d15/f19 1076 1 2024-09-16T01:25:05.875 INFO:tasks.workunit.client.0.smithi063.stdout:1/63: getdents d1/d5/d15 0 2024-09-16T01:25:05.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/64: write f0 [1630735,89672] 0 2024-09-16T01:25:05.877 INFO:tasks.workunit.client.0.smithi063.stdout:1/65: write d1/d5/ff [2115888,129298] 0 2024-09-16T01:25:05.879 INFO:tasks.workunit.client.0.smithi063.stdout:1/66: truncate d1/d5/d15/f19 999443 0 2024-09-16T01:25:05.881 INFO:tasks.workunit.client.0.smithi063.stdout:1/67: dread f0 [0,4194304] 0 2024-09-16T01:25:05.883 INFO:tasks.workunit.client.0.smithi063.stdout:1/68: creat d1/d5/f1a x:0 0 0 2024-09-16T01:25:05.886 INFO:tasks.workunit.client.0.smithi063.stdout:1/69: dread d1/f3 [0,4194304] 0 2024-09-16T01:25:05.891 INFO:tasks.workunit.client.0.smithi063.stdout:1/70: dwrite d1/d5/ff [0,4194304] 0 2024-09-16T01:25:05.892 INFO:tasks.workunit.client.0.smithi063.stdout:1/71: chown d1/d5/d15/f19 1763 1 2024-09-16T01:25:05.892 INFO:tasks.workunit.client.0.smithi063.stdout:1/72: chown d1/d5/f10 1204 1 2024-09-16T01:25:05.894 INFO:tasks.workunit.client.0.smithi063.stdout:1/73: mkdir d1/d5/d15/d1b 0 2024-09-16T01:25:05.896 INFO:tasks.workunit.client.0.smithi063.stdout:1/74: mknod d1/d5/c1c 0 2024-09-16T01:25:05.898 INFO:tasks.workunit.client.0.smithi063.stdout:1/75: mknod d1/d12/d16/c1d 0 2024-09-16T01:25:05.901 INFO:tasks.workunit.client.0.smithi063.stdout:1/76: dread d1/d5/f7 [4194304,4194304] 0 2024-09-16T01:25:05.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/77: dwrite d1/d5/f10 [0,4194304] 0 2024-09-16T01:25:05.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/78: write d1/d5/f1a [898380,113486] 0 2024-09-16T01:25:05.912 INFO:tasks.workunit.client.0.smithi063.stdout:1/79: creat d1/d5/d15/d18/f1e x:0 0 0 2024-09-16T01:25:05.914 INFO:tasks.workunit.client.0.smithi063.stdout:1/80: unlink d1/d2/l4 0 2024-09-16T01:25:05.916 INFO:tasks.workunit.client.0.smithi063.stdout:1/81: creat d1/d5/d15/d18/f1f x:0 0 0 2024-09-16T01:25:05.917 INFO:tasks.workunit.client.0.smithi063.stdout:1/82: read d1/d5/f10 [2611486,51227] 0 2024-09-16T01:25:05.920 INFO:tasks.workunit.client.0.smithi063.stdout:1/83: fsync d1/d5/d15/d18/f1e 0 2024-09-16T01:25:05.920 INFO:tasks.workunit.client.0.smithi063.stdout:1/84: stat d1/d5/cc 0 2024-09-16T01:25:05.923 INFO:tasks.workunit.client.0.smithi063.stdout:1/85: creat d1/dd/f20 x:0 0 0 2024-09-16T01:25:05.936 INFO:tasks.workunit.client.0.smithi063.stdout:1/86: rename d1/d2 to d1/d12/d21 0 2024-09-16T01:25:05.936 INFO:tasks.workunit.client.0.smithi063.stdout:1/87: truncate f0 4673629 0 2024-09-16T01:25:05.940 INFO:tasks.workunit.client.0.smithi063.stdout:1/88: rename d1/d5/ff to d1/d5/d15/f22 0 2024-09-16T01:25:05.940 INFO:tasks.workunit.client.0.smithi063.stdout:1/89: stat d1/d5/f7 0 2024-09-16T01:25:05.943 INFO:tasks.workunit.client.0.smithi063.stdout:1/90: mknod d1/d12/d21/c23 0 2024-09-16T01:25:05.943 INFO:tasks.workunit.client.0.smithi063.stdout:1/91: chown d1/d12/d21/c17 184645677 1 2024-09-16T01:25:05.951 INFO:tasks.workunit.client.0.smithi063.stdout:1/92: truncate d1/d5/f7 3299579 0 2024-09-16T01:25:05.952 INFO:tasks.workunit.client.0.smithi063.stdout:1/93: fsync d1/d5/f11 0 2024-09-16T01:25:05.953 INFO:tasks.workunit.client.0.smithi063.stdout:1/94: mkdir d1/d24 0 2024-09-16T01:25:05.959 INFO:tasks.workunit.client.0.smithi063.stdout:1/95: dwrite d1/d5/d15/d18/f1e [0,4194304] 0 2024-09-16T01:25:05.961 INFO:tasks.workunit.client.0.smithi063.stdout:1/96: write d1/d5/d15/f19 [924271,55442] 0 2024-09-16T01:25:05.963 INFO:tasks.workunit.client.0.smithi063.stdout:1/97: mkdir d1/d5/d25 0 2024-09-16T01:25:05.964 INFO:tasks.workunit.client.0.smithi063.stdout:1/98: read - d1/d5/d15/d18/f1f zero size 2024-09-16T01:25:05.967 INFO:tasks.workunit.client.0.smithi063.stdout:1/99: dread d1/f3 [0,4194304] 0 2024-09-16T01:25:05.969 INFO:tasks.workunit.client.0.smithi063.stdout:1/100: creat d1/d5/d15/f26 x:0 0 0 2024-09-16T01:25:05.971 INFO:tasks.workunit.client.0.smithi063.stdout:1/101: mknod d1/d12/d21/c27 0 2024-09-16T01:25:05.971 INFO:tasks.workunit.client.0.smithi063.stdout:1/102: chown d1/dd/f20 1619348870 1 2024-09-16T01:25:05.973 INFO:tasks.workunit.client.0.smithi063.stdout:1/103: creat d1/d5/d15/d1b/f28 x:0 0 0 2024-09-16T01:25:05.976 INFO:tasks.workunit.client.0.smithi063.stdout:1/104: dread d1/f3 [0,4194304] 0 2024-09-16T01:25:05.978 INFO:tasks.workunit.client.0.smithi063.stdout:1/105: rename d1/d5/d15/f22 to d1/d5/d15/f29 0 2024-09-16T01:25:05.979 INFO:tasks.workunit.client.0.smithi063.stdout:1/106: dread - d1/d5/d15/d18/f1f zero size 2024-09-16T01:25:05.980 INFO:tasks.workunit.client.0.smithi063.stdout:1/107: chown d1/d5/d15/d18/f1f 0 1 2024-09-16T01:25:05.983 INFO:tasks.workunit.client.0.smithi063.stdout:1/108: link d1/d12/d21/c27 d1/d5/d15/c2a 0 2024-09-16T01:25:05.984 INFO:tasks.workunit.client.0.smithi063.stdout:1/109: mkdir d1/d5/d2b 0 2024-09-16T01:25:05.985 INFO:tasks.workunit.client.0.smithi063.stdout:1/110: write d1/d5/f1a [468621,36033] 0 2024-09-16T01:25:06.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:06 smithi063 ceph-mon[31070]: pgmap v388: 97 pgs: 97 active+clean; 100 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 255 op/s 2024-09-16T01:25:06.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:06 smithi192 ceph-mon[34775]: pgmap v388: 97 pgs: 97 active+clean; 100 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 255 op/s 2024-09-16T01:25:06.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:06 smithi162 ceph-mon[34539]: pgmap v388: 97 pgs: 97 active+clean; 100 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 255 op/s 2024-09-16T01:25:08.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:08 smithi063 ceph-mon[31070]: pgmap v389: 97 pgs: 97 active+clean; 193 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 318 op/s 2024-09-16T01:25:08.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:08 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:25:08.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:08 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:25:08.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:08 smithi192 ceph-mon[34775]: pgmap v389: 97 pgs: 97 active+clean; 193 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 318 op/s 2024-09-16T01:25:08.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:08 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:25:08.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:08 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:25:08.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:08 smithi162 ceph-mon[34539]: pgmap v389: 97 pgs: 97 active+clean; 193 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 318 op/s 2024-09-16T01:25:08.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:08 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:25:08.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:08 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:25:08.803 INFO:tasks.workunit.client.0.smithi063.stdout:3/9: sync 2024-09-16T01:25:08.803 INFO:tasks.workunit.client.0.smithi063.stdout:3/10: link - no file 2024-09-16T01:25:08.804 INFO:tasks.workunit.client.0.smithi063.stdout:3/11: rmdir - no directory 2024-09-16T01:25:08.806 INFO:tasks.workunit.client.0.smithi063.stdout:3/12: creat f0 x:0 0 0 2024-09-16T01:25:08.806 INFO:tasks.workunit.client.0.smithi063.stdout:3/13: stat f0 0 2024-09-16T01:25:08.807 INFO:tasks.workunit.client.0.smithi063.stdout:3/14: mknod c1 0 2024-09-16T01:25:08.809 INFO:tasks.workunit.client.0.smithi063.stdout:3/15: mkdir d2 0 2024-09-16T01:25:08.809 INFO:tasks.workunit.client.0.smithi063.stdout:3/16: readlink - no filename 2024-09-16T01:25:08.861 INFO:tasks.workunit.client.0.smithi063.stdout:5/2: sync 2024-09-16T01:25:08.861 INFO:tasks.workunit.client.0.smithi063.stdout:0/29: sync 2024-09-16T01:25:08.861 INFO:tasks.workunit.client.0.smithi063.stdout:2/3: sync 2024-09-16T01:25:08.861 INFO:tasks.workunit.client.0.smithi063.stdout:1/111: sync 2024-09-16T01:25:08.861 INFO:tasks.workunit.client.0.smithi063.stdout:6/35: sync 2024-09-16T01:25:08.861 INFO:tasks.workunit.client.0.smithi063.stdout:4/65: sync 2024-09-16T01:25:08.861 INFO:tasks.workunit.client.0.smithi063.stdout:7/26: sync 2024-09-16T01:25:08.862 INFO:tasks.workunit.client.0.smithi063.stdout:9/20: sync 2024-09-16T01:25:08.862 INFO:tasks.workunit.client.0.smithi063.stdout:8/6: sync 2024-09-16T01:25:08.894 INFO:tasks.workunit.client.0.smithi063.stdout:9/21: chown d7 10 1 2024-09-16T01:25:08.895 INFO:tasks.workunit.client.0.smithi063.stdout:9/22: readlink d7/l8 0 2024-09-16T01:25:08.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/27: dread f5 [0,4194304] 0 2024-09-16T01:25:08.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/28: chown d7 31788283 1 2024-09-16T01:25:08.902 INFO:tasks.workunit.client.0.smithi063.stdout:0/30: dwrite d1/fa [0,4194304] 0 2024-09-16T01:25:08.911 INFO:tasks.workunit.client.0.smithi063.stdout:0/31: dwrite d1/fd [0,4194304] 0 2024-09-16T01:25:08.920 INFO:tasks.workunit.client.0.smithi063.stdout:0/32: dwrite d1/f5 [0,4194304] 0 2024-09-16T01:25:08.928 INFO:tasks.workunit.client.0.smithi063.stdout:0/33: dwrite d1/f6 [0,4194304] 0 2024-09-16T01:25:08.929 INFO:tasks.workunit.client.0.smithi063.stdout:0/34: chown d1/df 1 1 2024-09-16T01:25:08.935 INFO:tasks.workunit.client.0.smithi063.stdout:3/17: sync 2024-09-16T01:25:09.059 INFO:tasks.workunit.client.0.smithi063.stdout:5/3: creat f1 x:0 0 0 2024-09-16T01:25:09.059 INFO:tasks.workunit.client.0.smithi063.stdout:8/7: creat f1 x:0 0 0 2024-09-16T01:25:09.060 INFO:tasks.workunit.client.0.smithi063.stdout:8/8: write f1 [512226,48592] 0 2024-09-16T01:25:09.060 INFO:tasks.workunit.client.0.smithi063.stdout:6/36: unlink f0 0 2024-09-16T01:25:09.061 INFO:tasks.workunit.client.0.smithi063.stdout:2/4: mknod c1 0 2024-09-16T01:25:09.062 INFO:tasks.workunit.client.0.smithi063.stdout:8/9: write f1 [195110,30362] 0 2024-09-16T01:25:09.063 INFO:tasks.workunit.client.0.smithi063.stdout:6/37: write d3/fb [31662,39665] 0 2024-09-16T01:25:09.063 INFO:tasks.workunit.client.0.smithi063.stdout:2/5: chown c1 23643660 1 2024-09-16T01:25:09.063 INFO:tasks.workunit.client.0.smithi063.stdout:4/66: creat d5/d9/f16 x:0 0 0 2024-09-16T01:25:09.065 INFO:tasks.workunit.client.0.smithi063.stdout:7/29: symlink d7/ld 0 2024-09-16T01:25:09.067 INFO:tasks.workunit.client.0.smithi063.stdout:0/35: rename d1/f5 to d1/f11 0 2024-09-16T01:25:09.069 INFO:tasks.workunit.client.0.smithi063.stdout:5/4: dwrite f0 [0,4194304] 0 2024-09-16T01:25:09.070 INFO:tasks.workunit.client.0.smithi063.stdout:2/6: dread f0 [0,4194304] 0 2024-09-16T01:25:09.070 INFO:tasks.workunit.client.0.smithi063.stdout:2/7: fdatasync f0 0 2024-09-16T01:25:09.072 INFO:tasks.workunit.client.0.smithi063.stdout:1/112: symlink d1/d5/d25/l2c 0 2024-09-16T01:25:09.073 INFO:tasks.workunit.client.0.smithi063.stdout:9/23: symlink d7/d9/la 0 2024-09-16T01:25:09.075 INFO:tasks.workunit.client.0.smithi063.stdout:6/38: write d3/f9 [2765852,64450] 0 2024-09-16T01:25:09.076 INFO:tasks.workunit.client.0.smithi063.stdout:6/39: write d3/fc [903336,73889] 0 2024-09-16T01:25:09.077 INFO:tasks.workunit.client.0.smithi063.stdout:7/30: creat d7/fe x:0 0 0 2024-09-16T01:25:09.080 INFO:tasks.workunit.client.0.smithi063.stdout:3/18: mkdir d2/d3 0 2024-09-16T01:25:09.080 INFO:tasks.workunit.client.0.smithi063.stdout:3/19: chown d2 41582 1 2024-09-16T01:25:09.081 INFO:tasks.workunit.client.0.smithi063.stdout:3/20: chown d2 10 1 2024-09-16T01:25:09.081 INFO:tasks.workunit.client.0.smithi063.stdout:0/36: unlink d1/fd 0 2024-09-16T01:25:09.083 INFO:tasks.workunit.client.0.smithi063.stdout:0/37: rename d1 to d1/d12 22 2024-09-16T01:25:09.084 INFO:tasks.workunit.client.0.smithi063.stdout:7/31: dwrite f2 [0,4194304] 0 2024-09-16T01:25:09.084 INFO:tasks.workunit.client.0.smithi063.stdout:2/8: creat f2 x:0 0 0 2024-09-16T01:25:09.085 INFO:tasks.workunit.client.0.smithi063.stdout:7/32: chown f3 1614707 1 2024-09-16T01:25:09.086 INFO:tasks.workunit.client.0.smithi063.stdout:1/113: mknod d1/d5/c2d 0 2024-09-16T01:25:09.087 INFO:tasks.workunit.client.0.smithi063.stdout:9/24: mknod d7/d9/cb 0 2024-09-16T01:25:09.088 INFO:tasks.workunit.client.0.smithi063.stdout:4/67: getdents d5/d9/df 0 2024-09-16T01:25:09.089 INFO:tasks.workunit.client.0.smithi063.stdout:6/40: rename d3/dd to d3/d10 0 2024-09-16T01:25:09.091 INFO:tasks.workunit.client.0.smithi063.stdout:1/114: dread - d1/d5/f13 zero size 2024-09-16T01:25:09.091 INFO:tasks.workunit.client.0.smithi063.stdout:3/21: creat d2/f4 x:0 0 0 2024-09-16T01:25:09.091 INFO:tasks.workunit.client.0.smithi063.stdout:5/5: link f0 f2 0 2024-09-16T01:25:09.092 INFO:tasks.workunit.client.0.smithi063.stdout:1/115: chown d1/d5/d15 51029855 1 2024-09-16T01:25:09.093 INFO:tasks.workunit.client.0.smithi063.stdout:4/68: write d5/d9/fe [1750091,31813] 0 2024-09-16T01:25:09.094 INFO:tasks.workunit.client.0.smithi063.stdout:6/41: write d3/fc [95019,122639] 0 2024-09-16T01:25:09.095 INFO:tasks.workunit.client.0.smithi063.stdout:5/6: write f1 [1426,23865] 0 2024-09-16T01:25:09.098 INFO:tasks.workunit.client.0.smithi063.stdout:3/22: creat d2/f5 x:0 0 0 2024-09-16T01:25:09.099 INFO:tasks.workunit.client.0.smithi063.stdout:2/9: dwrite f2 [0,4194304] 0 2024-09-16T01:25:09.099 INFO:tasks.workunit.client.0.smithi063.stdout:0/38: mkdir d1/df/d13 0 2024-09-16T01:25:09.100 INFO:tasks.workunit.client.0.smithi063.stdout:3/23: write d2/f5 [259076,66692] 0 2024-09-16T01:25:09.100 INFO:tasks.workunit.client.0.smithi063.stdout:2/10: truncate f2 4564378 0 2024-09-16T01:25:09.101 INFO:tasks.workunit.client.0.smithi063.stdout:3/24: dread - d2/f4 zero size 2024-09-16T01:25:09.101 INFO:tasks.workunit.client.0.smithi063.stdout:6/42: symlink d3/d10/l11 0 2024-09-16T01:25:09.105 INFO:tasks.workunit.client.0.smithi063.stdout:0/39: mkdir d1/df/d14 0 2024-09-16T01:25:09.106 INFO:tasks.workunit.client.0.smithi063.stdout:4/69: creat d5/d9/df/f17 x:0 0 0 2024-09-16T01:25:09.107 INFO:tasks.workunit.client.0.smithi063.stdout:2/11: write f0 [839554,96005] 0 2024-09-16T01:25:09.109 INFO:tasks.workunit.client.0.smithi063.stdout:5/7: link f2 f3 0 2024-09-16T01:25:09.112 INFO:tasks.workunit.client.0.smithi063.stdout:1/116: rmdir d1/d5/d2b 0 2024-09-16T01:25:09.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/25: getdents d7 0 2024-09-16T01:25:09.114 INFO:tasks.workunit.client.0.smithi063.stdout:1/117: readlink d1/d5/l14 0 2024-09-16T01:25:09.117 INFO:tasks.workunit.client.0.smithi063.stdout:4/70: dwrite d5/f11 [0,4194304] 0 2024-09-16T01:25:09.118 INFO:tasks.workunit.client.0.smithi063.stdout:5/8: dread f2 [0,4194304] 0 2024-09-16T01:25:09.119 INFO:tasks.workunit.client.0.smithi063.stdout:0/40: mknod d1/df/d14/c15 0 2024-09-16T01:25:09.123 INFO:tasks.workunit.client.0.smithi063.stdout:3/25: link c1 d2/c6 0 2024-09-16T01:25:09.123 INFO:tasks.workunit.client.0.smithi063.stdout:9/26: write f3 [228430,114401] 0 2024-09-16T01:25:09.148 INFO:tasks.workunit.client.0.smithi063.stdout:3/26: write d2/f5 [241513,25525] 0 2024-09-16T01:25:09.149 INFO:tasks.workunit.client.0.smithi063.stdout:3/27: stat d2 0 2024-09-16T01:25:09.150 INFO:tasks.workunit.client.0.smithi063.stdout:6/43: link d3/ca d3/d10/c12 0 2024-09-16T01:25:09.151 INFO:tasks.workunit.client.0.smithi063.stdout:3/28: stat d2 0 2024-09-16T01:25:09.152 INFO:tasks.workunit.client.0.smithi063.stdout:4/71: dwrite d5/d9/df/f17 [0,4194304] 0 2024-09-16T01:25:09.153 INFO:tasks.workunit.client.0.smithi063.stdout:5/9: dwrite f1 [0,4194304] 0 2024-09-16T01:25:09.153 INFO:tasks.workunit.client.0.smithi063.stdout:5/10: readlink - no filename 2024-09-16T01:25:09.156 INFO:tasks.workunit.client.0.smithi063.stdout:9/27: dread f3 [0,4194304] 0 2024-09-16T01:25:09.159 INFO:tasks.workunit.client.0.smithi063.stdout:5/11: dread f1 [0,4194304] 0 2024-09-16T01:25:09.160 INFO:tasks.workunit.client.0.smithi063.stdout:5/12: chown f0 105 1 2024-09-16T01:25:09.161 INFO:tasks.workunit.client.0.smithi063.stdout:4/72: rmdir d5 39 2024-09-16T01:25:09.161 INFO:tasks.workunit.client.0.smithi063.stdout:9/28: mknod d7/cc 0 2024-09-16T01:25:09.163 INFO:tasks.workunit.client.0.smithi063.stdout:6/44: chown d3/d10/c12 11858 1 2024-09-16T01:25:09.163 INFO:tasks.workunit.client.0.smithi063.stdout:6/45: fsync d3/fc 0 2024-09-16T01:25:09.165 INFO:tasks.workunit.client.0.smithi063.stdout:5/13: rename f1 to f4 0 2024-09-16T01:25:09.166 INFO:tasks.workunit.client.0.smithi063.stdout:3/29: rmdir d2/d3 0 2024-09-16T01:25:09.166 INFO:tasks.workunit.client.0.smithi063.stdout:9/29: dread f4 [0,4194304] 0 2024-09-16T01:25:09.167 INFO:tasks.workunit.client.0.smithi063.stdout:6/46: creat d3/f13 x:0 0 0 2024-09-16T01:25:09.169 INFO:tasks.workunit.client.0.smithi063.stdout:5/14: mkdir d5 0 2024-09-16T01:25:09.175 INFO:tasks.workunit.client.0.smithi063.stdout:5/15: write f3 [1626237,130896] 0 2024-09-16T01:25:09.178 INFO:tasks.workunit.client.0.smithi063.stdout:6/47: rename d3/d10/c12 to d3/c14 0 2024-09-16T01:25:09.181 INFO:tasks.workunit.client.0.smithi063.stdout:6/48: mknod d3/d10/c15 0 2024-09-16T01:25:09.183 INFO:tasks.workunit.client.0.smithi063.stdout:6/49: creat d3/f16 x:0 0 0 2024-09-16T01:25:09.185 INFO:tasks.workunit.client.0.smithi063.stdout:6/50: symlink d3/d10/l17 0 2024-09-16T01:25:09.185 INFO:tasks.workunit.client.0.smithi063.stdout:5/16: dwrite f4 [0,4194304] 0 2024-09-16T01:25:09.186 INFO:tasks.workunit.client.0.smithi063.stdout:6/51: truncate d3/f13 381461 0 2024-09-16T01:25:09.188 INFO:tasks.workunit.client.0.smithi063.stdout:5/17: symlink d5/l6 0 2024-09-16T01:25:09.189 INFO:tasks.workunit.client.0.smithi063.stdout:8/10: getdents . 0 2024-09-16T01:25:09.190 INFO:tasks.workunit.client.0.smithi063.stdout:5/18: mknod d5/c7 0 2024-09-16T01:25:09.193 INFO:tasks.workunit.client.0.smithi063.stdout:5/19: write f4 [500582,107780] 0 2024-09-16T01:25:09.198 INFO:tasks.workunit.client.0.smithi063.stdout:6/52: dwrite d3/fc [0,4194304] 0 2024-09-16T01:25:09.200 INFO:tasks.workunit.client.0.smithi063.stdout:6/53: readlink d3/d10/l17 0 2024-09-16T01:25:09.202 INFO:tasks.workunit.client.0.smithi063.stdout:8/11: dwrite f1 [0,4194304] 0 2024-09-16T01:25:09.202 INFO:tasks.workunit.client.0.smithi063.stdout:3/30: fsync d2/f5 0 2024-09-16T01:25:09.203 INFO:tasks.workunit.client.0.smithi063.stdout:6/54: mknod d3/c18 0 2024-09-16T01:25:09.203 INFO:tasks.workunit.client.0.smithi063.stdout:8/12: chown f1 374 1 2024-09-16T01:25:09.204 INFO:tasks.workunit.client.0.smithi063.stdout:3/31: write f0 [981743,92824] 0 2024-09-16T01:25:09.204 INFO:tasks.workunit.client.0.smithi063.stdout:5/20: dread f2 [0,4194304] 0 2024-09-16T01:25:09.204 INFO:tasks.workunit.client.0.smithi063.stdout:8/13: readlink l0 0 2024-09-16T01:25:09.205 INFO:tasks.workunit.client.0.smithi063.stdout:3/32: write d2/f4 [1032521,93982] 0 2024-09-16T01:25:09.206 INFO:tasks.workunit.client.0.smithi063.stdout:6/55: creat d3/f19 x:0 0 0 2024-09-16T01:25:09.206 INFO:tasks.workunit.client.0.smithi063.stdout:7/33: truncate f0 56791 0 2024-09-16T01:25:09.208 INFO:tasks.workunit.client.0.smithi063.stdout:8/14: rename l0 to l2 0 2024-09-16T01:25:09.214 INFO:tasks.workunit.client.0.smithi063.stdout:2/12: truncate f2 1864614 0 2024-09-16T01:25:09.216 INFO:tasks.workunit.client.0.smithi063.stdout:3/33: dwrite f0 [0,4194304] 0 2024-09-16T01:25:09.217 INFO:tasks.workunit.client.0.smithi063.stdout:3/34: truncate d2/f5 1216353 0 2024-09-16T01:25:09.218 INFO:tasks.workunit.client.0.smithi063.stdout:6/56: dwrite d3/f13 [0,4194304] 0 2024-09-16T01:25:09.218 INFO:tasks.workunit.client.0.smithi063.stdout:2/13: mkdir d3 0 2024-09-16T01:25:09.219 INFO:tasks.workunit.client.0.smithi063.stdout:1/118: fsync f0 0 2024-09-16T01:25:09.220 INFO:tasks.workunit.client.0.smithi063.stdout:3/35: mkdir d2/d7 0 2024-09-16T01:25:09.221 INFO:tasks.workunit.client.0.smithi063.stdout:6/57: symlink d3/l1a 0 2024-09-16T01:25:09.225 INFO:tasks.workunit.client.0.smithi063.stdout:9/30: getdents d7 0 2024-09-16T01:25:09.227 INFO:tasks.workunit.client.0.smithi063.stdout:6/58: symlink d3/l1b 0 2024-09-16T01:25:09.228 INFO:tasks.workunit.client.0.smithi063.stdout:0/41: sync 2024-09-16T01:25:09.230 INFO:tasks.workunit.client.0.smithi063.stdout:2/14: symlink d3/l4 0 2024-09-16T01:25:09.232 INFO:tasks.workunit.client.0.smithi063.stdout:1/119: link d1/f3 d1/d5/d15/d1b/f2e 0 2024-09-16T01:25:09.232 INFO:tasks.workunit.client.0.smithi063.stdout:3/36: fdatasync f0 0 2024-09-16T01:25:09.233 INFO:tasks.workunit.client.0.smithi063.stdout:4/73: truncate d5/f6 3035611 0 2024-09-16T01:25:09.235 INFO:tasks.workunit.client.0.smithi063.stdout:4/74: stat d5/d9/c12 0 2024-09-16T01:25:09.236 INFO:tasks.workunit.client.0.smithi063.stdout:2/15: symlink d3/l5 0 2024-09-16T01:25:09.238 INFO:tasks.workunit.client.0.smithi063.stdout:1/120: dread d1/d5/f11 [0,4194304] 0 2024-09-16T01:25:09.240 INFO:tasks.workunit.client.0.smithi063.stdout:1/121: chown d1/d24 1 1 2024-09-16T01:25:09.241 INFO:tasks.workunit.client.0.smithi063.stdout:0/42: link d1/fa d1/df/d13/f16 0 2024-09-16T01:25:09.241 INFO:tasks.workunit.client.0.smithi063.stdout:9/31: dwrite f4 [0,4194304] 0 2024-09-16T01:25:09.242 INFO:tasks.workunit.client.0.smithi063.stdout:0/43: chown d1/df/d14 10079054 1 2024-09-16T01:25:09.244 INFO:tasks.workunit.client.0.smithi063.stdout:5/21: truncate f3 3257099 0 2024-09-16T01:25:09.246 INFO:tasks.workunit.client.0.smithi063.stdout:2/16: dwrite f0 [0,4194304] 0 2024-09-16T01:25:09.246 INFO:tasks.workunit.client.0.smithi063.stdout:9/32: read f5 [509155,106904] 0 2024-09-16T01:25:09.247 INFO:tasks.workunit.client.0.smithi063.stdout:1/122: symlink d1/d12/d21/l2f 0 2024-09-16T01:25:09.248 INFO:tasks.workunit.client.0.smithi063.stdout:2/17: read f0 [3030239,112567] 0 2024-09-16T01:25:09.248 INFO:tasks.workunit.client.0.smithi063.stdout:0/44: fdatasync d1/f11 0 2024-09-16T01:25:09.253 INFO:tasks.workunit.client.0.smithi063.stdout:1/123: write d1/d5/d15/d1b/f28 [98795,20764] 0 2024-09-16T01:25:09.253 INFO:tasks.workunit.client.0.smithi063.stdout:4/75: getdents d5/d9/df 0 2024-09-16T01:25:09.254 INFO:tasks.workunit.client.0.smithi063.stdout:8/15: truncate f1 1102673 0 2024-09-16T01:25:09.254 INFO:tasks.workunit.client.0.smithi063.stdout:1/124: chown d1/d12/d16 961 1 2024-09-16T01:25:09.254 INFO:tasks.workunit.client.0.smithi063.stdout:2/18: creat d3/f6 x:0 0 0 2024-09-16T01:25:09.255 INFO:tasks.workunit.client.0.smithi063.stdout:8/16: chown f1 198558873 1 2024-09-16T01:25:09.256 INFO:tasks.workunit.client.0.smithi063.stdout:2/19: dread - d3/f6 zero size 2024-09-16T01:25:09.257 INFO:tasks.workunit.client.0.smithi063.stdout:7/34: dwrite f5 [0,4194304] 0 2024-09-16T01:25:09.260 INFO:tasks.workunit.client.0.smithi063.stdout:0/45: rename d1/df/d14 to d1/df/d17 0 2024-09-16T01:25:09.260 INFO:tasks.workunit.client.0.smithi063.stdout:0/46: read - d1/f7 zero size 2024-09-16T01:25:09.263 INFO:tasks.workunit.client.0.smithi063.stdout:8/17: symlink l3 0 2024-09-16T01:25:09.264 INFO:tasks.workunit.client.0.smithi063.stdout:1/125: mknod d1/d5/d15/c30 0 2024-09-16T01:25:09.265 INFO:tasks.workunit.client.0.smithi063.stdout:6/59: truncate d3/f9 144986 0 2024-09-16T01:25:09.269 INFO:tasks.workunit.client.0.smithi063.stdout:2/20: mkdir d3/d7 0 2024-09-16T01:25:09.269 INFO:tasks.workunit.client.0.smithi063.stdout:7/35: write f3 [10266,95389] 0 2024-09-16T01:25:09.269 INFO:tasks.workunit.client.0.smithi063.stdout:2/21: write d3/f6 [744391,53887] 0 2024-09-16T01:25:09.270 INFO:tasks.workunit.client.0.smithi063.stdout:0/47: symlink d1/df/l18 0 2024-09-16T01:25:09.270 INFO:tasks.workunit.client.0.smithi063.stdout:4/76: unlink c1 0 2024-09-16T01:25:09.270 INFO:tasks.workunit.client.0.smithi063.stdout:7/36: truncate d7/fe 472154 0 2024-09-16T01:25:09.272 INFO:tasks.workunit.client.0.smithi063.stdout:3/37: truncate d2/f4 108999 0 2024-09-16T01:25:09.272 INFO:tasks.workunit.client.0.smithi063.stdout:0/48: read d1/f6 [88772,55896] 0 2024-09-16T01:25:09.272 INFO:tasks.workunit.client.0.smithi063.stdout:8/18: creat f4 x:0 0 0 2024-09-16T01:25:09.272 INFO:tasks.workunit.client.0.smithi063.stdout:1/126: dread d1/f8 [0,4194304] 0 2024-09-16T01:25:09.272 INFO:tasks.workunit.client.0.smithi063.stdout:7/37: read f2 [1935604,59274] 0 2024-09-16T01:25:09.273 INFO:tasks.workunit.client.0.smithi063.stdout:3/38: fsync f0 0 2024-09-16T01:25:09.273 INFO:tasks.workunit.client.0.smithi063.stdout:6/60: rename d3/l5 to d3/l1c 0 2024-09-16T01:25:09.274 INFO:tasks.workunit.client.0.smithi063.stdout:6/61: readlink d3/le 0 2024-09-16T01:25:09.274 INFO:tasks.workunit.client.0.smithi063.stdout:3/39: truncate d2/f5 1972324 0 2024-09-16T01:25:09.274 INFO:tasks.workunit.client.0.smithi063.stdout:3/40: chown d2 4 1 2024-09-16T01:25:09.275 INFO:tasks.workunit.client.0.smithi063.stdout:4/77: unlink d5/d9/fd 0 2024-09-16T01:25:09.276 INFO:tasks.workunit.client.0.smithi063.stdout:8/19: mkdir d5 0 2024-09-16T01:25:09.278 INFO:tasks.workunit.client.0.smithi063.stdout:1/127: dwrite d1/d5/d15/f26 [0,4194304] 0 2024-09-16T01:25:09.278 INFO:tasks.workunit.client.0.smithi063.stdout:2/22: mkdir d3/d7/d8 0 2024-09-16T01:25:09.282 INFO:tasks.workunit.client.0.smithi063.stdout:5/22: truncate f4 1348616 0 2024-09-16T01:25:09.283 INFO:tasks.workunit.client.0.smithi063.stdout:6/62: unlink d3/d10/c15 0 2024-09-16T01:25:09.286 INFO:tasks.workunit.client.0.smithi063.stdout:8/20: dwrite f4 [0,4194304] 0 2024-09-16T01:25:09.287 INFO:tasks.workunit.client.0.smithi063.stdout:3/41: chown c1 158642030 1 2024-09-16T01:25:09.293 INFO:tasks.workunit.client.0.smithi063.stdout:7/38: unlink f0 0 2024-09-16T01:25:09.293 INFO:tasks.workunit.client.0.smithi063.stdout:7/39: fsync d7/fc 0 2024-09-16T01:25:09.295 INFO:tasks.workunit.client.0.smithi063.stdout:7/40: write f3 [3188329,63683] 0 2024-09-16T01:25:09.299 INFO:tasks.workunit.client.0.smithi063.stdout:6/63: creat d3/d10/f1d x:0 0 0 2024-09-16T01:25:09.299 INFO:tasks.workunit.client.0.smithi063.stdout:6/64: write f2 [278166,55378] 0 2024-09-16T01:25:09.308 INFO:tasks.workunit.client.0.smithi063.stdout:2/23: dread f2 [0,4194304] 0 2024-09-16T01:25:09.309 INFO:tasks.workunit.client.0.smithi063.stdout:7/41: creat d7/ff x:0 0 0 2024-09-16T01:25:09.312 INFO:tasks.workunit.client.0.smithi063.stdout:3/42: getdents d2/d7 0 2024-09-16T01:25:09.316 INFO:tasks.workunit.client.0.smithi063.stdout:4/78: write d5/f6 [841608,72337] 0 2024-09-16T01:25:09.317 INFO:tasks.workunit.client.0.smithi063.stdout:7/42: dwrite d7/fe [0,4194304] 0 2024-09-16T01:25:09.317 INFO:tasks.workunit.client.0.smithi063.stdout:0/49: getdents d1/df/d17 0 2024-09-16T01:25:09.319 INFO:tasks.workunit.client.0.smithi063.stdout:0/50: dread - d1/fc zero size 2024-09-16T01:25:09.320 INFO:tasks.workunit.client.0.smithi063.stdout:3/43: dread d2/f5 [0,4194304] 0 2024-09-16T01:25:09.322 INFO:tasks.workunit.client.0.smithi063.stdout:2/24: write f2 [1941050,58992] 0 2024-09-16T01:25:09.328 INFO:tasks.workunit.client.0.smithi063.stdout:5/23: getdents d5 0 2024-09-16T01:25:09.328 INFO:tasks.workunit.client.0.smithi063.stdout:6/65: write d3/d10/ff [141530,3341] 0 2024-09-16T01:25:09.328 INFO:tasks.workunit.client.0.smithi063.stdout:1/128: getdents d1/d12 0 2024-09-16T01:25:09.328 INFO:tasks.workunit.client.0.smithi063.stdout:7/43: truncate f2 2337709 0 2024-09-16T01:25:09.329 INFO:tasks.workunit.client.0.smithi063.stdout:3/44: creat d2/f8 x:0 0 0 2024-09-16T01:25:09.330 INFO:tasks.workunit.client.0.smithi063.stdout:2/25: mknod d3/d7/c9 0 2024-09-16T01:25:09.331 INFO:tasks.workunit.client.0.smithi063.stdout:0/51: write d1/fb [2004581,30768] 0 2024-09-16T01:25:09.333 INFO:tasks.workunit.client.0.smithi063.stdout:5/24: creat d5/f8 x:0 0 0 2024-09-16T01:25:09.334 INFO:tasks.workunit.client.0.smithi063.stdout:1/129: fsync d1/f8 0 2024-09-16T01:25:09.335 INFO:tasks.workunit.client.0.smithi063.stdout:6/66: creat d3/d10/f1e x:0 0 0 2024-09-16T01:25:09.335 INFO:tasks.workunit.client.0.smithi063.stdout:6/67: readlink d3/l1b 0 2024-09-16T01:25:09.336 INFO:tasks.workunit.client.0.smithi063.stdout:4/79: dread d5/f11 [0,4194304] 0 2024-09-16T01:25:09.336 INFO:tasks.workunit.client.0.smithi063.stdout:7/44: creat d7/f10 x:0 0 0 2024-09-16T01:25:09.336 INFO:tasks.workunit.client.0.smithi063.stdout:6/68: readlink d3/l1b 0 2024-09-16T01:25:09.337 INFO:tasks.workunit.client.0.smithi063.stdout:3/45: rename d2/d7 to d2/d9 0 2024-09-16T01:25:09.337 INFO:tasks.workunit.client.0.smithi063.stdout:3/46: truncate d2/f8 658484 0 2024-09-16T01:25:09.337 INFO:tasks.workunit.client.0.smithi063.stdout:2/26: creat d3/fa x:0 0 0 2024-09-16T01:25:09.339 INFO:tasks.workunit.client.0.smithi063.stdout:0/52: rename d1/f6 to d1/df/d13/f19 0 2024-09-16T01:25:09.339 INFO:tasks.workunit.client.0.smithi063.stdout:0/53: rename d1 to d1/d1a 22 2024-09-16T01:25:09.343 INFO:tasks.workunit.client.0.smithi063.stdout:7/45: chown l6 66 1 2024-09-16T01:25:09.345 INFO:tasks.workunit.client.0.smithi063.stdout:6/69: mknod d3/c1f 0 2024-09-16T01:25:09.346 INFO:tasks.workunit.client.0.smithi063.stdout:2/27: rmdir d3 39 2024-09-16T01:25:09.347 INFO:tasks.workunit.client.0.smithi063.stdout:3/47: mknod d2/d9/ca 0 2024-09-16T01:25:09.347 INFO:tasks.workunit.client.0.smithi063.stdout:0/54: symlink d1/df/d17/l1b 0 2024-09-16T01:25:09.348 INFO:tasks.workunit.client.0.smithi063.stdout:5/25: truncate f4 2286498 0 2024-09-16T01:25:09.349 INFO:tasks.workunit.client.0.smithi063.stdout:5/26: chown d5/c7 1497797 1 2024-09-16T01:25:09.349 INFO:tasks.workunit.client.0.smithi063.stdout:7/46: dwrite d7/f9 [0,4194304] 0 2024-09-16T01:25:09.350 INFO:tasks.workunit.client.0.smithi063.stdout:4/80: creat d5/d9/df/f18 x:0 0 0 2024-09-16T01:25:09.350 INFO:tasks.workunit.client.0.smithi063.stdout:5/27: stat d5/l6 0 2024-09-16T01:25:09.351 INFO:tasks.workunit.client.0.smithi063.stdout:7/47: read - d7/fc zero size 2024-09-16T01:25:09.351 INFO:tasks.workunit.client.0.smithi063.stdout:6/70: rename d3/f19 to d3/d10/f20 0 2024-09-16T01:25:09.353 INFO:tasks.workunit.client.0.smithi063.stdout:1/130: rmdir d1/d24 0 2024-09-16T01:25:09.354 INFO:tasks.workunit.client.0.smithi063.stdout:1/131: write d1/d5/d15/f26 [2516655,81818] 0 2024-09-16T01:25:09.355 INFO:tasks.workunit.client.0.smithi063.stdout:1/132: write d1/f8 [334512,65663] 0 2024-09-16T01:25:09.355 INFO:tasks.workunit.client.0.smithi063.stdout:2/28: mknod d3/d7/cb 0 2024-09-16T01:25:09.357 INFO:tasks.workunit.client.0.smithi063.stdout:4/81: creat d5/d9/f19 x:0 0 0 2024-09-16T01:25:09.359 INFO:tasks.workunit.client.0.smithi063.stdout:6/71: creat d3/f21 x:0 0 0 2024-09-16T01:25:09.360 INFO:tasks.workunit.client.0.smithi063.stdout:3/48: unlink d2/f4 0 2024-09-16T01:25:09.362 INFO:tasks.workunit.client.0.smithi063.stdout:7/48: rmdir d7 39 2024-09-16T01:25:09.363 INFO:tasks.workunit.client.0.smithi063.stdout:1/133: rename d1/d5/d25 to d1/d5/d15/d1b/d31 0 2024-09-16T01:25:09.364 INFO:tasks.workunit.client.0.smithi063.stdout:5/28: dread f2 [0,4194304] 0 2024-09-16T01:25:09.365 INFO:tasks.workunit.client.0.smithi063.stdout:2/29: dwrite f2 [0,4194304] 0 2024-09-16T01:25:09.366 INFO:tasks.workunit.client.0.smithi063.stdout:6/72: mkdir d3/d10/d22 0 2024-09-16T01:25:09.366 INFO:tasks.workunit.client.0.smithi063.stdout:2/30: chown d3/d7 4273 1 2024-09-16T01:25:09.367 INFO:tasks.workunit.client.0.smithi063.stdout:1/134: dread d1/d5/f11 [0,4194304] 0 2024-09-16T01:25:09.368 INFO:tasks.workunit.client.0.smithi063.stdout:3/49: mknod d2/d9/cb 0 2024-09-16T01:25:09.368 INFO:tasks.workunit.client.0.smithi063.stdout:6/73: write d3/f13 [3576142,114081] 0 2024-09-16T01:25:09.369 INFO:tasks.workunit.client.0.smithi063.stdout:6/74: readlink d3/d10/l17 0 2024-09-16T01:25:09.370 INFO:tasks.workunit.client.0.smithi063.stdout:1/135: chown d1/d5/f11 0 1 2024-09-16T01:25:09.373 INFO:tasks.workunit.client.0.smithi063.stdout:0/55: getdents d1/df 0 2024-09-16T01:25:09.373 INFO:tasks.workunit.client.0.smithi063.stdout:3/50: creat d2/d9/fc x:0 0 0 2024-09-16T01:25:09.374 INFO:tasks.workunit.client.0.smithi063.stdout:7/49: rename l6 to d7/l11 0 2024-09-16T01:25:09.375 INFO:tasks.workunit.client.0.smithi063.stdout:5/29: write f0 [894012,30722] 0 2024-09-16T01:25:09.375 INFO:tasks.workunit.client.0.smithi063.stdout:3/51: write d2/f8 [959208,31497] 0 2024-09-16T01:25:09.376 INFO:tasks.workunit.client.0.smithi063.stdout:1/136: symlink d1/d5/d15/d1b/l32 0 2024-09-16T01:25:09.378 INFO:tasks.workunit.client.0.smithi063.stdout:2/31: dwrite d3/fa [0,4194304] 0 2024-09-16T01:25:09.379 INFO:tasks.workunit.client.0.smithi063.stdout:1/137: write d1/d5/f11 [1946598,87686] 0 2024-09-16T01:25:09.381 INFO:tasks.workunit.client.0.smithi063.stdout:4/82: getdents d5/d9/df 0 2024-09-16T01:25:09.382 INFO:tasks.workunit.client.0.smithi063.stdout:3/52: creat d2/d9/fd x:0 0 0 2024-09-16T01:25:09.383 INFO:tasks.workunit.client.0.smithi063.stdout:2/32: fsync f0 0 2024-09-16T01:25:09.383 INFO:tasks.workunit.client.0.smithi063.stdout:7/50: link d7/fc d7/f12 0 2024-09-16T01:25:09.384 INFO:tasks.workunit.client.0.smithi063.stdout:1/138: rmdir d1/dd 39 2024-09-16T01:25:09.384 INFO:tasks.workunit.client.0.smithi063.stdout:3/53: chown c1 59350 1 2024-09-16T01:25:09.385 INFO:tasks.workunit.client.0.smithi063.stdout:4/83: chown d5/d9/fe 192602 1 2024-09-16T01:25:09.389 INFO:tasks.workunit.client.0.smithi063.stdout:5/30: dwrite f2 [0,4194304] 0 2024-09-16T01:25:09.389 INFO:tasks.workunit.client.0.smithi063.stdout:7/51: truncate f2 1288398 0 2024-09-16T01:25:09.389 INFO:tasks.workunit.client.0.smithi063.stdout:0/56: dwrite d1/fb [4194304,4194304] 0 2024-09-16T01:25:09.390 INFO:tasks.workunit.client.0.smithi063.stdout:3/54: truncate d2/d9/fc 9950 0 2024-09-16T01:25:09.391 INFO:tasks.workunit.client.0.smithi063.stdout:7/52: stat d7/fe 0 2024-09-16T01:25:09.392 INFO:tasks.workunit.client.0.smithi063.stdout:3/55: chown c1 8 1 2024-09-16T01:25:09.392 INFO:tasks.workunit.client.0.smithi063.stdout:2/33: link d3/l4 d3/lc 0 2024-09-16T01:25:09.393 INFO:tasks.workunit.client.0.smithi063.stdout:7/53: chown d7/ld 16409 1 2024-09-16T01:25:09.393 INFO:tasks.workunit.client.0.smithi063.stdout:2/34: fsync d3/fa 0 2024-09-16T01:25:09.393 INFO:tasks.workunit.client.0.smithi063.stdout:0/57: mkdir d1/d1c 0 2024-09-16T01:25:09.395 INFO:tasks.workunit.client.0.smithi063.stdout:5/31: rmdir d5 39 2024-09-16T01:25:09.398 INFO:tasks.workunit.client.0.smithi063.stdout:5/32: write f0 [5213052,69249] 0 2024-09-16T01:25:09.399 INFO:tasks.workunit.client.0.smithi063.stdout:4/84: dwrite d5/d9/fe [0,4194304] 0 2024-09-16T01:25:09.400 INFO:tasks.workunit.client.0.smithi063.stdout:3/56: symlink d2/d9/le 0 2024-09-16T01:25:09.401 INFO:tasks.workunit.client.0.smithi063.stdout:4/85: fdatasync d5/d9/fb 0 2024-09-16T01:25:09.402 INFO:tasks.workunit.client.0.smithi063.stdout:7/54: mknod d7/c13 0 2024-09-16T01:25:09.404 INFO:tasks.workunit.client.0.smithi063.stdout:2/35: dwrite d3/f6 [0,4194304] 0 2024-09-16T01:25:09.406 INFO:tasks.workunit.client.0.smithi063.stdout:2/36: write d3/f6 [1737650,102882] 0 2024-09-16T01:25:09.406 INFO:tasks.workunit.client.0.smithi063.stdout:2/37: fdatasync d3/fa 0 2024-09-16T01:25:09.407 INFO:tasks.workunit.client.0.smithi063.stdout:3/57: mkdir d2/df 0 2024-09-16T01:25:09.407 INFO:tasks.workunit.client.0.smithi063.stdout:2/38: chown c1 437 1 2024-09-16T01:25:09.408 INFO:tasks.workunit.client.0.smithi063.stdout:1/139: link d1/d5/d15/d1b/d31/l2c d1/l33 0 2024-09-16T01:25:09.409 INFO:tasks.workunit.client.0.smithi063.stdout:7/55: dread d7/f9 [0,4194304] 0 2024-09-16T01:25:09.409 INFO:tasks.workunit.client.0.smithi063.stdout:4/86: symlink d5/d9/df/l1a 0 2024-09-16T01:25:09.410 INFO:tasks.workunit.client.0.smithi063.stdout:0/58: symlink d1/d1c/l1d 0 2024-09-16T01:25:09.411 INFO:tasks.workunit.client.0.smithi063.stdout:4/87: chown d5/d9/df/f18 6372 1 2024-09-16T01:25:09.415 INFO:tasks.workunit.client.0.smithi063.stdout:3/58: creat d2/f10 x:0 0 0 2024-09-16T01:25:09.416 INFO:tasks.workunit.client.0.smithi063.stdout:1/140: mknod d1/d5/c34 0 2024-09-16T01:25:09.417 INFO:tasks.workunit.client.0.smithi063.stdout:0/59: fsync d1/fa 0 2024-09-16T01:25:09.421 INFO:tasks.workunit.client.0.smithi063.stdout:0/60: mknod d1/d1c/c1e 0 2024-09-16T01:25:09.422 INFO:tasks.workunit.client.0.smithi063.stdout:5/33: dread f0 [4194304,4194304] 0 2024-09-16T01:25:09.422 INFO:tasks.workunit.client.0.smithi063.stdout:4/88: symlink d5/l1b 0 2024-09-16T01:25:09.426 INFO:tasks.workunit.client.0.smithi063.stdout:0/61: readlink d1/df/l18 0 2024-09-16T01:25:09.426 INFO:tasks.workunit.client.0.smithi063.stdout:7/56: getdents d7 0 2024-09-16T01:25:09.428 INFO:tasks.workunit.client.0.smithi063.stdout:2/39: fsync d3/f6 0 2024-09-16T01:25:09.430 INFO:tasks.workunit.client.0.smithi063.stdout:7/57: chown d7/f12 155 1 2024-09-16T01:25:09.431 INFO:tasks.workunit.client.0.smithi063.stdout:1/141: dread f0 [0,4194304] 0 2024-09-16T01:25:09.431 INFO:tasks.workunit.client.0.smithi063.stdout:4/89: mkdir d5/d9/df/d1c 0 2024-09-16T01:25:09.431 INFO:tasks.workunit.client.0.smithi063.stdout:2/40: write d3/f6 [2131346,36712] 0 2024-09-16T01:25:09.432 INFO:tasks.workunit.client.0.smithi063.stdout:0/62: creat d1/df/d13/f1f x:0 0 0 2024-09-16T01:25:09.433 INFO:tasks.workunit.client.0.smithi063.stdout:5/34: rename d5/f8 to d5/f9 0 2024-09-16T01:25:09.434 INFO:tasks.workunit.client.0.smithi063.stdout:3/59: dwrite d2/d9/fc [0,4194304] 0 2024-09-16T01:25:09.434 INFO:tasks.workunit.client.0.smithi063.stdout:1/142: read - d1/d5/f13 zero size 2024-09-16T01:25:09.435 INFO:tasks.workunit.client.0.smithi063.stdout:0/63: chown d1/fb 377 1 2024-09-16T01:25:09.435 INFO:tasks.workunit.client.0.smithi063.stdout:7/58: getdents d7 0 2024-09-16T01:25:09.437 INFO:tasks.workunit.client.0.smithi063.stdout:3/60: mkdir d2/d11 0 2024-09-16T01:25:09.438 INFO:tasks.workunit.client.0.smithi063.stdout:7/59: chown d7/c13 1 1 2024-09-16T01:25:09.438 INFO:tasks.workunit.client.0.smithi063.stdout:4/90: link d5/d9/fb d5/d9/f1d 0 2024-09-16T01:25:09.441 INFO:tasks.workunit.client.0.smithi063.stdout:2/41: truncate d3/fa 3108538 0 2024-09-16T01:25:09.443 INFO:tasks.workunit.client.0.smithi063.stdout:5/35: dread f0 [0,4194304] 0 2024-09-16T01:25:09.443 INFO:tasks.workunit.client.0.smithi063.stdout:4/91: symlink d5/d9/l1e 0 2024-09-16T01:25:09.444 INFO:tasks.workunit.client.0.smithi063.stdout:0/64: link d1/df/d17/l1b d1/l20 0 2024-09-16T01:25:09.445 INFO:tasks.workunit.client.0.smithi063.stdout:5/36: fsync f3 0 2024-09-16T01:25:09.446 INFO:tasks.workunit.client.0.smithi063.stdout:0/65: chown d1/df 27 1 2024-09-16T01:25:09.446 INFO:tasks.workunit.client.0.smithi063.stdout:1/143: getdents d1/d5/d15/d1b 0 2024-09-16T01:25:09.449 INFO:tasks.workunit.client.0.smithi063.stdout:5/37: mknod d5/ca 0 2024-09-16T01:25:09.450 INFO:tasks.workunit.client.0.smithi063.stdout:7/60: dwrite d7/fe [4194304,4194304] 0 2024-09-16T01:25:09.450 INFO:tasks.workunit.client.0.smithi063.stdout:3/61: dwrite f0 [0,4194304] 0 2024-09-16T01:25:09.450 INFO:tasks.workunit.client.0.smithi063.stdout:0/66: mknod d1/df/d17/c21 0 2024-09-16T01:25:09.451 INFO:tasks.workunit.client.0.smithi063.stdout:7/61: read f3 [122183,85595] 0 2024-09-16T01:25:09.452 INFO:tasks.workunit.client.0.smithi063.stdout:3/62: chown d2/d9/fd 4044 1 2024-09-16T01:25:09.452 INFO:tasks.workunit.client.0.smithi063.stdout:2/42: rename d3/fa to d3/d7/d8/fd 0 2024-09-16T01:25:09.453 INFO:tasks.workunit.client.0.smithi063.stdout:3/63: read - d2/d9/fd zero size 2024-09-16T01:25:09.454 INFO:tasks.workunit.client.0.smithi063.stdout:4/92: write d5/d9/fb [2788190,48969] 0 2024-09-16T01:25:09.457 INFO:tasks.workunit.client.0.smithi063.stdout:1/144: dread d1/d5/d15/d18/f1e [0,4194304] 0 2024-09-16T01:25:09.457 INFO:tasks.workunit.client.0.smithi063.stdout:2/43: mkdir d3/d7/de 0 2024-09-16T01:25:09.464 INFO:tasks.workunit.client.0.smithi063.stdout:9/33: sync 2024-09-16T01:25:09.485 INFO:tasks.workunit.client.0.smithi063.stdout:4/93: mkdir d5/d9/df/d1f 0 2024-09-16T01:25:09.487 INFO:tasks.workunit.client.0.smithi063.stdout:1/145: chown d1/dd 28694070 1 2024-09-16T01:25:09.488 INFO:tasks.workunit.client.0.smithi063.stdout:4/94: write d5/d9/df/f17 [422667,48399] 0 2024-09-16T01:25:09.489 INFO:tasks.workunit.client.0.smithi063.stdout:2/44: creat d3/ff x:0 0 0 2024-09-16T01:25:09.491 INFO:tasks.workunit.client.0.smithi063.stdout:5/38: getdents d5 0 2024-09-16T01:25:09.492 INFO:tasks.workunit.client.0.smithi063.stdout:9/34: write f5 [1263284,63885] 0 2024-09-16T01:25:09.492 INFO:tasks.workunit.client.0.smithi063.stdout:5/39: stat d5/f9 0 2024-09-16T01:25:09.493 INFO:tasks.workunit.client.0.smithi063.stdout:7/62: dwrite d7/f9 [4194304,4194304] 0 2024-09-16T01:25:09.494 INFO:tasks.workunit.client.0.smithi063.stdout:9/35: rename d7/d9 to d7/d9/dd 22 2024-09-16T01:25:09.495 INFO:tasks.workunit.client.0.smithi063.stdout:4/95: mkdir d5/d9/df/d1f/d20 0 2024-09-16T01:25:09.496 INFO:tasks.workunit.client.0.smithi063.stdout:5/40: write f0 [4431779,557] 0 2024-09-16T01:25:09.497 INFO:tasks.workunit.client.0.smithi063.stdout:2/45: write d3/d7/d8/fd [3799107,117993] 0 2024-09-16T01:25:09.498 INFO:tasks.workunit.client.0.smithi063.stdout:9/36: mknod d7/d9/ce 0 2024-09-16T01:25:09.499 INFO:tasks.workunit.client.0.smithi063.stdout:5/41: stat f4 0 2024-09-16T01:25:09.499 INFO:tasks.workunit.client.0.smithi063.stdout:4/96: stat d5/d9/df/d1f/d20 0 2024-09-16T01:25:09.502 INFO:tasks.workunit.client.0.smithi063.stdout:5/42: write f2 [5801154,38725] 0 2024-09-16T01:25:09.503 INFO:tasks.workunit.client.0.smithi063.stdout:4/97: chown d5/d9/f16 1775278 1 2024-09-16T01:25:09.503 INFO:tasks.workunit.client.0.smithi063.stdout:1/146: dread d1/d5/d15/d18/f1e [0,4194304] 0 2024-09-16T01:25:09.508 INFO:tasks.workunit.client.0.smithi063.stdout:5/43: creat d5/fb x:0 0 0 2024-09-16T01:25:09.510 INFO:tasks.workunit.client.0.smithi063.stdout:4/98: dread - d5/d9/df/f18 zero size 2024-09-16T01:25:09.512 INFO:tasks.workunit.client.0.smithi063.stdout:7/63: dwrite d7/ff [0,4194304] 0 2024-09-16T01:25:09.513 INFO:tasks.workunit.client.0.smithi063.stdout:1/147: write d1/d5/d15/d18/f1e [706536,106801] 0 2024-09-16T01:25:09.573 INFO:tasks.workunit.client.0.smithi063.stdout:2/46: dwrite d3/ff [0,4194304] 0 2024-09-16T01:25:09.573 INFO:tasks.workunit.client.0.smithi063.stdout:4/99: write d5/f6 [2781990,49876] 0 2024-09-16T01:25:09.573 INFO:tasks.workunit.client.0.smithi063.stdout:9/37: dwrite f5 [0,4194304] 0 2024-09-16T01:25:09.573 INFO:tasks.workunit.client.0.smithi063.stdout:7/64: creat d7/f14 x:0 0 0 2024-09-16T01:25:09.575 INFO:tasks.workunit.client.0.smithi063.stdout:2/47: fsync f0 0 2024-09-16T01:25:09.575 INFO:tasks.workunit.client.0.smithi063.stdout:9/38: chown d7/l8 31611592 1 2024-09-16T01:25:09.576 INFO:tasks.workunit.client.0.smithi063.stdout:1/148: creat d1/d12/d16/f35 x:0 0 0 2024-09-16T01:25:09.580 INFO:tasks.workunit.client.0.smithi063.stdout:4/100: unlink d5/d9/df/f17 0 2024-09-16T01:25:09.580 INFO:tasks.workunit.client.0.smithi063.stdout:1/149: write d1/d5/f1a [332212,26187] 0 2024-09-16T01:25:09.583 INFO:tasks.workunit.client.0.smithi063.stdout:4/101: write d5/d9/fb [124794,80752] 0 2024-09-16T01:25:09.583 INFO:tasks.workunit.client.0.smithi063.stdout:1/150: chown d1/d12/d21/c17 449 1 2024-09-16T01:25:09.585 INFO:tasks.workunit.client.0.smithi063.stdout:1/151: write f0 [3428673,25432] 0 2024-09-16T01:25:09.586 INFO:tasks.workunit.client.0.smithi063.stdout:2/48: link d3/ff d3/d7/d8/f10 0 2024-09-16T01:25:09.587 INFO:tasks.workunit.client.0.smithi063.stdout:2/49: fsync f0 0 2024-09-16T01:25:09.588 INFO:tasks.workunit.client.0.smithi063.stdout:9/39: dwrite f3 [0,4194304] 0 2024-09-16T01:25:09.589 INFO:tasks.workunit.client.0.smithi063.stdout:4/102: write d5/d9/fe [2893557,48918] 0 2024-09-16T01:25:09.589 INFO:tasks.workunit.client.0.smithi063.stdout:1/152: stat d1/d5/f10 0 2024-09-16T01:25:09.593 INFO:tasks.workunit.client.0.smithi063.stdout:2/50: write f2 [561743,27825] 0 2024-09-16T01:25:09.594 INFO:tasks.workunit.client.0.smithi063.stdout:9/40: creat d7/ff x:0 0 0 2024-09-16T01:25:09.595 INFO:tasks.workunit.client.0.smithi063.stdout:1/153: rmdir d1/d12/d21 39 2024-09-16T01:25:09.597 INFO:tasks.workunit.client.0.smithi063.stdout:7/65: dwrite f3 [0,4194304] 0 2024-09-16T01:25:09.597 INFO:tasks.workunit.client.0.smithi063.stdout:2/51: unlink d3/l4 0 2024-09-16T01:25:09.599 INFO:tasks.workunit.client.0.smithi063.stdout:2/52: fsync d3/f6 0 2024-09-16T01:25:09.599 INFO:tasks.workunit.client.0.smithi063.stdout:9/41: creat d7/f10 x:0 0 0 2024-09-16T01:25:09.600 INFO:tasks.workunit.client.0.smithi063.stdout:1/154: symlink d1/d12/l36 0 2024-09-16T01:25:09.600 INFO:tasks.workunit.client.0.smithi063.stdout:7/66: chown f2 1646 1 2024-09-16T01:25:09.602 INFO:tasks.workunit.client.0.smithi063.stdout:1/155: stat d1/d5/c2d 0 2024-09-16T01:25:09.604 INFO:tasks.workunit.client.0.smithi063.stdout:7/67: mknod d7/c15 0 2024-09-16T01:25:09.605 INFO:tasks.workunit.client.0.smithi063.stdout:9/42: fsync d7/f10 0 2024-09-16T01:25:09.607 INFO:tasks.workunit.client.0.smithi063.stdout:4/103: dwrite d5/d9/f19 [0,4194304] 0 2024-09-16T01:25:09.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:09 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:25:09.609 INFO:tasks.workunit.client.0.smithi063.stdout:7/68: rename d7/c13 to d7/c16 0 2024-09-16T01:25:09.610 INFO:tasks.workunit.client.0.smithi063.stdout:9/43: truncate d7/ff 722381 0 2024-09-16T01:25:09.611 INFO:tasks.workunit.client.0.smithi063.stdout:7/69: write d7/f14 [393993,39610] 0 2024-09-16T01:25:09.611 INFO:tasks.workunit.client.0.smithi063.stdout:2/53: dwrite f0 [0,4194304] 0 2024-09-16T01:25:09.611 INFO:tasks.workunit.client.0.smithi063.stdout:1/156: rename d1/d5/d15/d18/f1f to d1/d12/d16/f37 0 2024-09-16T01:25:09.614 INFO:tasks.workunit.client.0.smithi063.stdout:4/104: unlink d5/l1b 0 2024-09-16T01:25:09.615 INFO:tasks.workunit.client.0.smithi063.stdout:4/105: dread - d5/d9/f16 zero size 2024-09-16T01:25:09.616 INFO:tasks.workunit.client.0.smithi063.stdout:9/44: creat d7/d9/f11 x:0 0 0 2024-09-16T01:25:09.617 INFO:tasks.workunit.client.0.smithi063.stdout:9/45: dread - d7/d9/f11 zero size 2024-09-16T01:25:09.619 INFO:tasks.workunit.client.0.smithi063.stdout:1/157: symlink d1/l38 0 2024-09-16T01:25:09.621 INFO:tasks.workunit.client.0.smithi063.stdout:1/158: write d1/d5/d15/f19 [852531,115235] 0 2024-09-16T01:25:09.623 INFO:tasks.workunit.client.0.smithi063.stdout:2/54: rename d3/d7/d8/fd to d3/d7/de/f11 0 2024-09-16T01:25:09.624 INFO:tasks.workunit.client.0.smithi063.stdout:4/106: creat d5/d9/df/d1c/f21 x:0 0 0 2024-09-16T01:25:09.625 INFO:tasks.workunit.client.0.smithi063.stdout:4/107: readlink d5/d9/l1e 0 2024-09-16T01:25:09.626 INFO:tasks.workunit.client.0.smithi063.stdout:9/46: fsync d7/d9/f11 0 2024-09-16T01:25:09.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/21: sync 2024-09-16T01:25:09.627 INFO:tasks.workunit.client.0.smithi063.stdout:6/75: sync 2024-09-16T01:25:09.629 INFO:tasks.workunit.client.0.smithi063.stdout:7/70: truncate d7/f14 345162 0 2024-09-16T01:25:09.630 INFO:tasks.workunit.client.0.smithi063.stdout:4/108: rename c2 to d5/d9/df/d1f/c22 0 2024-09-16T01:25:09.630 INFO:tasks.workunit.client.0.smithi063.stdout:6/76: stat d3/f13 0 2024-09-16T01:25:09.631 INFO:tasks.workunit.client.0.smithi063.stdout:9/47: mkdir d7/d9/d12 0 2024-09-16T01:25:09.632 INFO:tasks.workunit.client.0.smithi063.stdout:2/55: mknod d3/c12 0 2024-09-16T01:25:09.632 INFO:tasks.workunit.client.0.smithi063.stdout:4/109: dread - d5/d9/f16 zero size 2024-09-16T01:25:09.633 INFO:tasks.workunit.client.0.smithi063.stdout:7/71: truncate d7/f12 803474 0 2024-09-16T01:25:09.633 INFO:tasks.workunit.client.0.smithi063.stdout:8/22: creat d5/f6 x:0 0 0 2024-09-16T01:25:09.634 INFO:tasks.workunit.client.0.smithi063.stdout:8/23: stat f4 0 2024-09-16T01:25:09.637 INFO:tasks.workunit.client.0.smithi063.stdout:1/159: dwrite d1/d5/d15/f29 [0,4194304] 0 2024-09-16T01:25:09.640 INFO:tasks.workunit.client.0.smithi063.stdout:8/24: fsync d5/f6 0 2024-09-16T01:25:09.641 INFO:tasks.workunit.client.0.smithi063.stdout:6/77: dread d3/fc [0,4194304] 0 2024-09-16T01:25:09.642 INFO:tasks.workunit.client.0.smithi063.stdout:4/110: getdents d5/d9/df/d1c 0 2024-09-16T01:25:09.642 INFO:tasks.workunit.client.0.smithi063.stdout:8/25: read f4 [976101,44507] 0 2024-09-16T01:25:09.643 INFO:tasks.workunit.client.0.smithi063.stdout:9/48: truncate f3 13754 0 2024-09-16T01:25:09.645 INFO:tasks.workunit.client.0.smithi063.stdout:2/56: dwrite f0 [0,4194304] 0 2024-09-16T01:25:09.645 INFO:tasks.workunit.client.0.smithi063.stdout:1/160: dread d1/d5/d15/d1b/f28 [0,4194304] 0 2024-09-16T01:25:09.645 INFO:tasks.workunit.client.0.smithi063.stdout:8/26: chown f4 628262 1 2024-09-16T01:25:09.649 INFO:tasks.workunit.client.0.smithi063.stdout:2/57: read d3/d7/d8/f10 [190007,5264] 0 2024-09-16T01:25:09.650 INFO:tasks.workunit.client.0.smithi063.stdout:4/111: creat d5/d9/df/d1f/d20/f23 x:0 0 0 2024-09-16T01:25:09.651 INFO:tasks.workunit.client.0.smithi063.stdout:6/78: truncate d3/f9 109986 0 2024-09-16T01:25:09.653 INFO:tasks.workunit.client.0.smithi063.stdout:4/112: mkdir d5/d9/df/d24 0 2024-09-16T01:25:09.654 INFO:tasks.workunit.client.0.smithi063.stdout:6/79: rmdir d3 39 2024-09-16T01:25:09.655 INFO:tasks.workunit.client.0.smithi063.stdout:4/113: readlink d5/l10 0 2024-09-16T01:25:09.655 INFO:tasks.workunit.client.0.smithi063.stdout:8/27: dwrite f1 [0,4194304] 0 2024-09-16T01:25:09.656 INFO:tasks.workunit.client.0.smithi063.stdout:4/114: chown d5/d9/cc 47 1 2024-09-16T01:25:09.657 INFO:tasks.workunit.client.0.smithi063.stdout:6/80: write d3/f21 [500464,22014] 0 2024-09-16T01:25:09.658 INFO:tasks.workunit.client.0.smithi063.stdout:6/81: readlink d3/d10/l17 0 2024-09-16T01:25:09.660 INFO:tasks.workunit.client.0.smithi063.stdout:2/58: truncate d3/d7/d8/f10 2269750 0 2024-09-16T01:25:09.661 INFO:tasks.workunit.client.0.smithi063.stdout:6/82: getdents d3/d10/d22 0 2024-09-16T01:25:09.662 INFO:tasks.workunit.client.0.smithi063.stdout:6/83: creat d3/d10/f23 x:0 0 0 2024-09-16T01:25:09.663 INFO:tasks.workunit.client.0.smithi063.stdout:2/59: dread f2 [0,4194304] 0 2024-09-16T01:25:09.665 INFO:tasks.workunit.client.0.smithi063.stdout:2/60: symlink d3/d7/d8/l13 0 2024-09-16T01:25:09.668 INFO:tasks.workunit.client.0.smithi063.stdout:6/84: fsync d3/d10/f23 0 2024-09-16T01:25:09.668 INFO:tasks.workunit.client.0.smithi063.stdout:6/85: fdatasync d3/d10/f23 0 2024-09-16T01:25:09.671 INFO:tasks.workunit.client.0.smithi063.stdout:2/61: fsync d3/d7/d8/f10 0 2024-09-16T01:25:09.677 INFO:tasks.workunit.client.0.smithi063.stdout:6/86: rename d3/d10/ff to d3/d10/d22/f24 0 2024-09-16T01:25:09.678 INFO:tasks.workunit.client.0.smithi063.stdout:2/62: rename d3/d7/cb to d3/d7/c14 0 2024-09-16T01:25:09.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/87: creat d3/d10/f25 x:0 0 0 2024-09-16T01:25:09.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/88: dread - d3/d10/f23 zero size 2024-09-16T01:25:09.678 INFO:tasks.workunit.client.0.smithi063.stdout:2/63: mknod d3/d7/d8/c15 0 2024-09-16T01:25:09.678 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:09 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:25:09.679 INFO:tasks.workunit.client.0.smithi063.stdout:6/89: dread d3/f21 [0,4194304] 0 2024-09-16T01:25:09.679 INFO:tasks.workunit.client.0.smithi063.stdout:2/64: creat d3/d7/f16 x:0 0 0 2024-09-16T01:25:09.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:09 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:25:09.685 INFO:tasks.workunit.client.0.smithi063.stdout:6/90: truncate d3/f9 805243 0 2024-09-16T01:25:09.687 INFO:tasks.workunit.client.0.smithi063.stdout:6/91: creat d3/d10/d22/f26 x:0 0 0 2024-09-16T01:25:09.689 INFO:tasks.workunit.client.0.smithi063.stdout:6/92: mknod d3/d10/d22/c27 0 2024-09-16T01:25:09.689 INFO:tasks.workunit.client.0.smithi063.stdout:6/93: fdatasync d3/f13 0 2024-09-16T01:25:09.690 INFO:tasks.workunit.client.0.smithi063.stdout:6/94: truncate d3/d10/f1d 719220 0 2024-09-16T01:25:09.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/65: truncate f0 1686790 0 2024-09-16T01:25:09.693 INFO:tasks.workunit.client.0.smithi063.stdout:6/95: dread d3/f13 [0,4194304] 0 2024-09-16T01:25:09.694 INFO:tasks.workunit.client.0.smithi063.stdout:2/66: rename d3/d7/c9 to d3/d7/de/c17 0 2024-09-16T01:25:09.694 INFO:tasks.workunit.client.0.smithi063.stdout:6/96: write d3/d10/f23 [732276,112158] 0 2024-09-16T01:25:09.695 INFO:tasks.workunit.client.0.smithi063.stdout:6/97: read - d3/d10/f1e zero size 2024-09-16T01:25:09.696 INFO:tasks.workunit.client.0.smithi063.stdout:2/67: creat d3/d7/d8/f18 x:0 0 0 2024-09-16T01:25:09.697 INFO:tasks.workunit.client.0.smithi063.stdout:6/98: unlink d3/fc 0 2024-09-16T01:25:09.698 INFO:tasks.workunit.client.0.smithi063.stdout:2/68: readlink d3/lc 0 2024-09-16T01:25:09.699 INFO:tasks.workunit.client.0.smithi063.stdout:6/99: mkdir d3/d10/d22/d28 0 2024-09-16T01:25:09.699 INFO:tasks.workunit.client.0.smithi063.stdout:2/69: fsync d3/f6 0 2024-09-16T01:25:09.700 INFO:tasks.workunit.client.0.smithi063.stdout:6/100: read d3/d10/f23 [746031,114204] 0 2024-09-16T01:25:09.701 INFO:tasks.workunit.client.0.smithi063.stdout:2/70: write d3/d7/d8/f18 [313509,33482] 0 2024-09-16T01:25:09.701 INFO:tasks.workunit.client.0.smithi063.stdout:6/101: creat d3/d10/f29 x:0 0 0 2024-09-16T01:25:09.702 INFO:tasks.workunit.client.0.smithi063.stdout:2/71: write d3/d7/d8/f18 [438755,80297] 0 2024-09-16T01:25:09.704 INFO:tasks.workunit.client.0.smithi063.stdout:2/72: write d3/ff [452036,63758] 0 2024-09-16T01:25:09.706 INFO:tasks.workunit.client.0.smithi063.stdout:2/73: mkdir d3/d7/d8/d19 0 2024-09-16T01:25:09.707 INFO:tasks.workunit.client.0.smithi063.stdout:2/74: dread - d3/d7/f16 zero size 2024-09-16T01:25:09.707 INFO:tasks.workunit.client.0.smithi063.stdout:6/102: dwrite d3/d10/f1d [0,4194304] 0 2024-09-16T01:25:09.710 INFO:tasks.workunit.client.0.smithi063.stdout:6/103: creat d3/d10/f2a x:0 0 0 2024-09-16T01:25:09.711 INFO:tasks.workunit.client.0.smithi063.stdout:2/75: creat d3/d7/d8/f1a x:0 0 0 2024-09-16T01:25:09.712 INFO:tasks.workunit.client.0.smithi063.stdout:2/76: chown d3/d7/d8/d19 32 1 2024-09-16T01:25:09.714 INFO:tasks.workunit.client.0.smithi063.stdout:6/104: rename d3/d10/f25 to d3/d10/d22/d28/f2b 0 2024-09-16T01:25:09.717 INFO:tasks.workunit.client.0.smithi063.stdout:6/105: write d3/d10/d22/f26 [798882,102978] 0 2024-09-16T01:25:09.719 INFO:tasks.workunit.client.0.smithi063.stdout:6/106: unlink d3/l1b 0 2024-09-16T01:25:09.720 INFO:tasks.workunit.client.0.smithi063.stdout:2/77: dwrite d3/d7/d8/f10 [0,4194304] 0 2024-09-16T01:25:09.722 INFO:tasks.workunit.client.0.smithi063.stdout:2/78: mknod d3/d7/c1b 0 2024-09-16T01:25:09.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/107: dread d3/f13 [0,4194304] 0 2024-09-16T01:25:09.727 INFO:tasks.workunit.client.0.smithi063.stdout:6/108: mknod d3/d10/d22/d28/c2c 0 2024-09-16T01:25:09.728 INFO:tasks.workunit.client.0.smithi063.stdout:2/79: dwrite d3/d7/d8/f18 [0,4194304] 0 2024-09-16T01:25:09.732 INFO:tasks.workunit.client.0.smithi063.stdout:2/80: rename d3/lc to d3/d7/l1c 0 2024-09-16T01:25:09.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/109: getdents d3/d10/d22 0 2024-09-16T01:25:09.734 INFO:tasks.workunit.client.0.smithi063.stdout:2/81: mknod d3/d7/d8/d19/c1d 0 2024-09-16T01:25:09.736 INFO:tasks.workunit.client.0.smithi063.stdout:6/110: symlink d3/d10/d22/d28/l2d 0 2024-09-16T01:25:09.736 INFO:tasks.workunit.client.0.smithi063.stdout:2/82: write d3/d7/d8/f1a [204286,56060] 0 2024-09-16T01:25:09.737 INFO:tasks.workunit.client.0.smithi063.stdout:2/83: write f2 [355496,1347] 0 2024-09-16T01:25:09.739 INFO:tasks.workunit.client.0.smithi063.stdout:6/111: rename d3/fb to d3/d10/d22/d28/f2e 0 2024-09-16T01:25:09.741 INFO:tasks.workunit.client.0.smithi063.stdout:6/112: unlink d3/d10/f1e 0 2024-09-16T01:25:09.744 INFO:tasks.workunit.client.0.smithi063.stdout:6/113: write d3/d10/f20 [27448,6869] 0 2024-09-16T01:25:09.746 INFO:tasks.workunit.client.0.smithi063.stdout:6/114: rename d3/d10 to d3/d10/d22/d28/d2f 22 2024-09-16T01:25:09.746 INFO:tasks.workunit.client.0.smithi063.stdout:2/84: dread f0 [0,4194304] 0 2024-09-16T01:25:09.747 INFO:tasks.workunit.client.0.smithi063.stdout:6/115: rmdir d3/d10/d22/d28 39 2024-09-16T01:25:09.748 INFO:tasks.workunit.client.0.smithi063.stdout:6/116: mkdir d3/d30 0 2024-09-16T01:25:09.749 INFO:tasks.workunit.client.0.smithi063.stdout:2/85: symlink d3/l1e 0 2024-09-16T01:25:09.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/117: mknod d3/d30/c31 0 2024-09-16T01:25:09.750 INFO:tasks.workunit.client.0.smithi063.stdout:2/86: mkdir d3/d7/d8/d1f 0 2024-09-16T01:25:09.751 INFO:tasks.workunit.client.0.smithi063.stdout:6/118: unlink d3/f9 0 2024-09-16T01:25:09.753 INFO:tasks.workunit.client.0.smithi063.stdout:6/119: mknod d3/d10/d22/c32 0 2024-09-16T01:25:09.756 INFO:tasks.workunit.client.0.smithi063.stdout:2/87: write f0 [35254,28007] 0 2024-09-16T01:25:09.757 INFO:tasks.workunit.client.0.smithi063.stdout:2/88: fsync d3/f6 0 2024-09-16T01:25:09.760 INFO:tasks.workunit.client.0.smithi063.stdout:2/89: creat d3/d7/d8/f20 x:0 0 0 2024-09-16T01:25:09.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/120: dwrite d3/f16 [0,4194304] 0 2024-09-16T01:25:09.761 INFO:tasks.workunit.client.0.smithi063.stdout:6/121: write d3/d10/d22/f26 [1537643,111393] 0 2024-09-16T01:25:09.762 INFO:tasks.workunit.client.0.smithi063.stdout:2/90: mkdir d3/d7/de/d21 0 2024-09-16T01:25:09.762 INFO:tasks.workunit.client.0.smithi063.stdout:6/122: truncate d3/f16 4362987 0 2024-09-16T01:25:09.763 INFO:tasks.workunit.client.0.smithi063.stdout:2/91: dread - d3/d7/d8/f20 zero size 2024-09-16T01:25:09.764 INFO:tasks.workunit.client.0.smithi063.stdout:2/92: creat d3/d7/f22 x:0 0 0 2024-09-16T01:25:09.765 INFO:tasks.workunit.client.0.smithi063.stdout:2/93: dread - d3/d7/f16 zero size 2024-09-16T01:25:09.767 INFO:tasks.workunit.client.0.smithi063.stdout:6/123: truncate d3/f13 4074310 0 2024-09-16T01:25:09.769 INFO:tasks.workunit.client.0.smithi063.stdout:2/94: creat d3/d7/d8/d1f/f23 x:0 0 0 2024-09-16T01:25:09.771 INFO:tasks.workunit.client.0.smithi063.stdout:6/124: creat d3/d10/d22/d28/f33 x:0 0 0 2024-09-16T01:25:09.773 INFO:tasks.workunit.client.0.smithi063.stdout:2/95: rename d3/d7/de/f11 to d3/d7/d8/d19/f24 0 2024-09-16T01:25:09.774 INFO:tasks.workunit.client.0.smithi063.stdout:6/125: unlink d3/d10/l11 0 2024-09-16T01:25:09.775 INFO:tasks.workunit.client.0.smithi063.stdout:6/126: fsync d3/d10/f2a 0 2024-09-16T01:25:09.775 INFO:tasks.workunit.client.0.smithi063.stdout:2/96: symlink d3/d7/l25 0 2024-09-16T01:25:09.778 INFO:tasks.workunit.client.0.smithi063.stdout:6/127: link d3/d10/f1d d3/d10/f34 0 2024-09-16T01:25:09.779 INFO:tasks.workunit.client.0.smithi063.stdout:6/128: chown d3/f21 2377807 1 2024-09-16T01:25:09.780 INFO:tasks.workunit.client.0.smithi063.stdout:2/97: dread d3/d7/d8/f18 [0,4194304] 0 2024-09-16T01:25:09.781 INFO:tasks.workunit.client.0.smithi063.stdout:2/98: write d3/d7/d8/d1f/f23 [596638,44819] 0 2024-09-16T01:25:09.782 INFO:tasks.workunit.client.0.smithi063.stdout:2/99: truncate d3/d7/f22 603328 0 2024-09-16T01:25:09.782 INFO:tasks.workunit.client.0.smithi063.stdout:6/129: mkdir d3/d10/d35 0 2024-09-16T01:25:09.786 INFO:tasks.workunit.client.0.smithi063.stdout:6/130: unlink d3/c14 0 2024-09-16T01:25:09.788 INFO:tasks.workunit.client.0.smithi063.stdout:2/100: link d3/d7/f22 d3/d7/f26 0 2024-09-16T01:25:09.791 INFO:tasks.workunit.client.0.smithi063.stdout:6/131: truncate d3/f13 5065381 0 2024-09-16T01:25:09.793 INFO:tasks.workunit.client.0.smithi063.stdout:2/101: link d3/d7/d8/d1f/f23 d3/d7/d8/f27 0 2024-09-16T01:25:09.795 INFO:tasks.workunit.client.0.smithi063.stdout:2/102: mkdir d3/d7/de/d21/d28 0 2024-09-16T01:25:09.798 INFO:tasks.workunit.client.0.smithi063.stdout:2/103: dread f2 [0,4194304] 0 2024-09-16T01:25:09.799 INFO:tasks.workunit.client.0.smithi063.stdout:2/104: write d3/d7/d8/f1a [949357,49323] 0 2024-09-16T01:25:09.800 INFO:tasks.workunit.client.0.smithi063.stdout:2/105: write d3/d7/d8/f1a [144161,33885] 0 2024-09-16T01:25:09.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/106: chown d3/d7/d8/d19 58 1 2024-09-16T01:25:09.802 INFO:tasks.workunit.client.0.smithi063.stdout:2/107: chown d3/d7/c14 22840111 1 2024-09-16T01:25:09.805 INFO:tasks.workunit.client.0.smithi063.stdout:2/108: link d3/d7/d8/f27 d3/d7/de/d21/f29 0 2024-09-16T01:25:09.808 INFO:tasks.workunit.client.0.smithi063.stdout:2/109: rename d3/l1e to d3/l2a 0 2024-09-16T01:25:09.810 INFO:tasks.workunit.client.0.smithi063.stdout:2/110: creat d3/d7/d8/f2b x:0 0 0 2024-09-16T01:25:09.812 INFO:tasks.workunit.client.0.smithi063.stdout:2/111: mknod d3/c2c 0 2024-09-16T01:25:09.815 INFO:tasks.workunit.client.0.smithi063.stdout:2/112: unlink d3/d7/d8/f2b 0 2024-09-16T01:25:09.819 INFO:tasks.workunit.client.0.smithi063.stdout:2/113: dread d3/d7/d8/f1a [0,4194304] 0 2024-09-16T01:25:09.820 INFO:tasks.workunit.client.0.smithi063.stdout:2/114: fsync d3/d7/f16 0 2024-09-16T01:25:09.820 INFO:tasks.workunit.client.0.smithi063.stdout:0/67: sync 2024-09-16T01:25:09.824 INFO:tasks.workunit.client.0.smithi063.stdout:0/68: link d1/fb d1/df/d17/f22 0 2024-09-16T01:25:09.826 INFO:tasks.workunit.client.0.smithi063.stdout:0/69: rename d1/l10 to d1/df/d13/l23 0 2024-09-16T01:25:09.872 INFO:tasks.workunit.client.0.smithi063.stdout:3/64: sync 2024-09-16T01:25:09.872 INFO:tasks.workunit.client.0.smithi063.stdout:5/44: sync 2024-09-16T01:25:09.906 INFO:tasks.workunit.client.0.smithi063.stdout:2/115: dwrite d3/d7/f26 [0,4194304] 0 2024-09-16T01:25:09.966 INFO:tasks.workunit.client.0.smithi063.stdout:7/72: sync 2024-09-16T01:25:10.012 INFO:tasks.workunit.client.0.smithi063.stdout:0/70: link d1/df/d13/l23 d1/df/d13/l24 0 2024-09-16T01:25:10.012 INFO:tasks.workunit.client.0.smithi063.stdout:0/71: fsync d1/fc 0 2024-09-16T01:25:10.014 INFO:tasks.workunit.client.0.smithi063.stdout:2/116: creat d3/d7/de/d21/f2d x:0 0 0 2024-09-16T01:25:10.016 INFO:tasks.workunit.client.0.smithi063.stdout:0/72: symlink d1/l25 0 2024-09-16T01:25:10.017 INFO:tasks.workunit.client.0.smithi063.stdout:2/117: creat d3/d7/f2e x:0 0 0 2024-09-16T01:25:10.019 INFO:tasks.workunit.client.0.smithi063.stdout:0/73: mknod d1/df/d13/c26 0 2024-09-16T01:25:10.019 INFO:tasks.workunit.client.0.smithi063.stdout:0/74: stat d1/f11 0 2024-09-16T01:25:10.020 INFO:tasks.workunit.client.0.smithi063.stdout:2/118: mknod d3/d7/d8/d19/c2f 0 2024-09-16T01:25:10.020 INFO:tasks.workunit.client.0.smithi063.stdout:0/75: truncate d1/f7 74243 0 2024-09-16T01:25:10.055 INFO:tasks.workunit.client.0.smithi063.stdout:9/49: sync 2024-09-16T01:25:10.056 INFO:tasks.workunit.client.0.smithi063.stdout:9/50: creat d7/d9/f13 x:0 0 0 2024-09-16T01:25:10.058 INFO:tasks.workunit.client.0.smithi063.stdout:9/51: mkdir d7/d9/d12/d14 0 2024-09-16T01:25:10.104 INFO:tasks.workunit.client.0.smithi063.stdout:3/65: write d2/f5 [364401,21164] 0 2024-09-16T01:25:10.106 INFO:tasks.workunit.client.0.smithi063.stdout:3/66: rename d2/df to d2/d12 0 2024-09-16T01:25:10.106 INFO:tasks.workunit.client.0.smithi063.stdout:7/73: fsync d7/fc 0 2024-09-16T01:25:10.106 INFO:tasks.workunit.client.0.smithi063.stdout:7/74: fsync d7/fe 0 2024-09-16T01:25:10.107 INFO:tasks.workunit.client.0.smithi063.stdout:0/76: getdents d1/df/d13 0 2024-09-16T01:25:10.109 INFO:tasks.workunit.client.0.smithi063.stdout:3/67: mknod d2/d9/c13 0 2024-09-16T01:25:10.110 INFO:tasks.workunit.client.0.smithi063.stdout:7/75: symlink d7/l17 0 2024-09-16T01:25:10.112 INFO:tasks.workunit.client.0.smithi063.stdout:3/68: creat d2/d12/f14 x:0 0 0 2024-09-16T01:25:10.112 INFO:tasks.workunit.client.0.smithi063.stdout:2/119: dwrite d3/d7/d8/d1f/f23 [0,4194304] 0 2024-09-16T01:25:10.113 INFO:tasks.workunit.client.0.smithi063.stdout:2/120: stat d3/d7/d8/d19/c2f 0 2024-09-16T01:25:10.113 INFO:tasks.workunit.client.0.smithi063.stdout:3/69: truncate d2/f8 1769972 0 2024-09-16T01:25:10.114 INFO:tasks.workunit.client.0.smithi063.stdout:6/132: sync 2024-09-16T01:25:10.114 INFO:tasks.workunit.client.0.smithi063.stdout:5/45: sync 2024-09-16T01:25:10.114 INFO:tasks.workunit.client.0.smithi063.stdout:1/161: sync 2024-09-16T01:25:10.114 INFO:tasks.workunit.client.0.smithi063.stdout:4/115: sync 2024-09-16T01:25:10.114 INFO:tasks.workunit.client.0.smithi063.stdout:8/28: sync 2024-09-16T01:25:10.114 INFO:tasks.workunit.client.0.smithi063.stdout:7/76: mkdir d7/d18 0 2024-09-16T01:25:10.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/29: stat f4 0 2024-09-16T01:25:10.115 INFO:tasks.workunit.client.0.smithi063.stdout:0/77: write d1/df/d13/f19 [2044920,2771] 0 2024-09-16T01:25:10.117 INFO:tasks.workunit.client.0.smithi063.stdout:6/133: dread - d3/d10/f29 zero size 2024-09-16T01:25:10.118 INFO:tasks.workunit.client.0.smithi063.stdout:2/121: mknod d3/d7/de/d21/d28/c30 0 2024-09-16T01:25:10.118 INFO:tasks.workunit.client.0.smithi063.stdout:4/116: rename d5 to d5/d9/df/d1f/d20/d25 22 2024-09-16T01:25:10.118 INFO:tasks.workunit.client.0.smithi063.stdout:5/46: rmdir d5 39 2024-09-16T01:25:10.119 INFO:tasks.workunit.client.0.smithi063.stdout:0/78: chown d1/df/d13/f1f 60 1 2024-09-16T01:25:10.122 INFO:tasks.workunit.client.0.smithi063.stdout:3/70: dread d2/f8 [0,4194304] 0 2024-09-16T01:25:10.122 INFO:tasks.workunit.client.0.smithi063.stdout:7/77: creat d7/f19 x:0 0 0 2024-09-16T01:25:10.124 INFO:tasks.workunit.client.0.smithi063.stdout:6/134: chown d3/c7 391 1 2024-09-16T01:25:10.125 INFO:tasks.workunit.client.0.smithi063.stdout:2/122: dread d3/f6 [0,4194304] 0 2024-09-16T01:25:10.125 INFO:tasks.workunit.client.0.smithi063.stdout:1/162: creat d1/d5/d15/d1b/f39 x:0 0 0 2024-09-16T01:25:10.126 INFO:tasks.workunit.client.0.smithi063.stdout:2/123: fsync d3/f6 0 2024-09-16T01:25:10.127 INFO:tasks.workunit.client.0.smithi063.stdout:8/30: write f4 [3881269,105895] 0 2024-09-16T01:25:10.127 INFO:tasks.workunit.client.0.smithi063.stdout:4/117: dwrite d5/d9/f1d [0,4194304] 0 2024-09-16T01:25:10.128 INFO:tasks.workunit.client.0.smithi063.stdout:3/71: rmdir d2/d9 39 2024-09-16T01:25:10.129 INFO:tasks.workunit.client.0.smithi063.stdout:2/124: chown d3/ff 13066 1 2024-09-16T01:25:10.130 INFO:tasks.workunit.client.0.smithi063.stdout:3/72: chown d2/f10 6045 1 2024-09-16T01:25:10.130 INFO:tasks.workunit.client.0.smithi063.stdout:6/135: chown d3/d10/d22/f24 1662971 1 2024-09-16T01:25:10.131 INFO:tasks.workunit.client.0.smithi063.stdout:6/136: chown d3/d10/d22/f24 7 1 2024-09-16T01:25:10.131 INFO:tasks.workunit.client.0.smithi063.stdout:8/31: unlink l3 0 2024-09-16T01:25:10.132 INFO:tasks.workunit.client.0.smithi063.stdout:6/137: chown d3/d10/f20 47733 1 2024-09-16T01:25:10.132 INFO:tasks.workunit.client.0.smithi063.stdout:7/78: creat d7/d18/f1a x:0 0 0 2024-09-16T01:25:10.134 INFO:tasks.workunit.client.0.smithi063.stdout:2/125: mknod d3/d7/d8/d1f/c31 0 2024-09-16T01:25:10.135 INFO:tasks.workunit.client.0.smithi063.stdout:3/73: symlink d2/d12/l15 0 2024-09-16T01:25:10.136 INFO:tasks.workunit.client.0.smithi063.stdout:5/47: truncate f0 5543467 0 2024-09-16T01:25:10.137 INFO:tasks.workunit.client.0.smithi063.stdout:8/32: dwrite f4 [0,4194304] 0 2024-09-16T01:25:10.139 INFO:tasks.workunit.client.0.smithi063.stdout:0/79: link d1/df/d17/l1b d1/l27 0 2024-09-16T01:25:10.141 INFO:tasks.workunit.client.0.smithi063.stdout:8/33: rename f1 to d5/f7 0 2024-09-16T01:25:10.142 INFO:tasks.workunit.client.0.smithi063.stdout:5/48: mknod d5/cc 0 2024-09-16T01:25:10.145 INFO:tasks.workunit.client.0.smithi063.stdout:7/79: getdents d7/d18 0 2024-09-16T01:25:10.145 INFO:tasks.workunit.client.0.smithi063.stdout:8/34: dread d5/f7 [0,4194304] 0 2024-09-16T01:25:10.148 INFO:tasks.workunit.client.0.smithi063.stdout:5/49: rename d5/fb to d5/fd 0 2024-09-16T01:25:10.148 INFO:tasks.workunit.client.0.smithi063.stdout:1/163: truncate d1/d5/f1a 258478 0 2024-09-16T01:25:10.152 INFO:tasks.workunit.client.0.smithi063.stdout:7/80: creat d7/d18/f1b x:0 0 0 2024-09-16T01:25:10.153 INFO:tasks.workunit.client.0.smithi063.stdout:7/81: fsync d7/f12 0 2024-09-16T01:25:10.154 INFO:tasks.workunit.client.0.smithi063.stdout:1/164: dwrite d1/d5/f13 [0,4194304] 0 2024-09-16T01:25:10.155 INFO:tasks.workunit.client.0.smithi063.stdout:8/35: rename f4 to d5/f8 0 2024-09-16T01:25:10.156 INFO:tasks.workunit.client.0.smithi063.stdout:0/80: link d1/df/d17/l1b d1/d1c/l28 0 2024-09-16T01:25:10.157 INFO:tasks.workunit.client.0.smithi063.stdout:0/81: read d1/df/d13/f19 [4394541,113394] 0 2024-09-16T01:25:10.160 INFO:tasks.workunit.client.0.smithi063.stdout:7/82: mkdir d7/d1c 0 2024-09-16T01:25:10.163 INFO:tasks.workunit.client.0.smithi063.stdout:8/36: fsync d5/f7 0 2024-09-16T01:25:10.163 INFO:tasks.workunit.client.0.smithi063.stdout:5/50: dwrite d5/fd [0,4194304] 0 2024-09-16T01:25:10.165 INFO:tasks.workunit.client.0.smithi063.stdout:0/82: dread d1/df/d13/f19 [4194304,4194304] 0 2024-09-16T01:25:10.165 INFO:tasks.workunit.client.0.smithi063.stdout:1/165: rmdir d1/d5/d15 39 2024-09-16T01:25:10.166 INFO:tasks.workunit.client.0.smithi063.stdout:0/83: chown d1/fc 14421087 1 2024-09-16T01:25:10.168 INFO:tasks.workunit.client.0.smithi063.stdout:8/37: mkdir d5/d9 0 2024-09-16T01:25:10.169 INFO:tasks.workunit.client.0.smithi063.stdout:7/83: creat d7/d1c/f1d x:0 0 0 2024-09-16T01:25:10.171 INFO:tasks.workunit.client.0.smithi063.stdout:7/84: write d7/d18/f1b [918716,120271] 0 2024-09-16T01:25:10.173 INFO:tasks.workunit.client.0.smithi063.stdout:8/38: symlink d5/d9/la 0 2024-09-16T01:25:10.173 INFO:tasks.workunit.client.0.smithi063.stdout:7/85: chown d7/f12 2560546 1 2024-09-16T01:25:10.174 INFO:tasks.workunit.client.0.smithi063.stdout:8/39: fdatasync d5/f6 0 2024-09-16T01:25:10.174 INFO:tasks.workunit.client.0.smithi063.stdout:0/84: rename d1/l27 to d1/d1c/l29 0 2024-09-16T01:25:10.174 INFO:tasks.workunit.client.0.smithi063.stdout:5/51: dread f3 [0,4194304] 0 2024-09-16T01:25:10.175 INFO:tasks.workunit.client.0.smithi063.stdout:7/86: chown d7/ff 3 1 2024-09-16T01:25:10.176 INFO:tasks.workunit.client.0.smithi063.stdout:1/166: dread d1/d5/d15/f26 [0,4194304] 0 2024-09-16T01:25:10.176 INFO:tasks.workunit.client.0.smithi063.stdout:0/85: write d1/f7 [692771,95913] 0 2024-09-16T01:25:10.177 INFO:tasks.workunit.client.0.smithi063.stdout:5/52: rename f0 to d5/fe 0 2024-09-16T01:25:10.177 INFO:tasks.workunit.client.0.smithi063.stdout:1/167: write d1/f8 [4470648,64955] 0 2024-09-16T01:25:10.178 INFO:tasks.workunit.client.0.smithi063.stdout:7/87: mknod d7/d18/c1e 0 2024-09-16T01:25:10.179 INFO:tasks.workunit.client.0.smithi063.stdout:1/168: chown d1/d5/l14 1971 1 2024-09-16T01:25:10.180 INFO:tasks.workunit.client.0.smithi063.stdout:5/53: rename d5/l6 to d5/lf 0 2024-09-16T01:25:10.181 INFO:tasks.workunit.client.0.smithi063.stdout:1/169: symlink d1/d5/d15/l3a 0 2024-09-16T01:25:10.184 INFO:tasks.workunit.client.0.smithi063.stdout:1/170: fdatasync d1/f3 0 2024-09-16T01:25:10.189 INFO:tasks.workunit.client.0.smithi063.stdout:7/88: dwrite d7/d1c/f1d [0,4194304] 0 2024-09-16T01:25:10.189 INFO:tasks.workunit.client.0.smithi063.stdout:0/86: dwrite d1/df/d17/f22 [8388608,4194304] 0 2024-09-16T01:25:10.189 INFO:tasks.workunit.client.0.smithi063.stdout:5/54: getdents d5 0 2024-09-16T01:25:10.190 INFO:tasks.workunit.client.0.smithi063.stdout:8/40: truncate d5/f8 1124340 0 2024-09-16T01:25:10.191 INFO:tasks.workunit.client.0.smithi063.stdout:5/55: unlink f4 0 2024-09-16T01:25:10.194 INFO:tasks.workunit.client.0.smithi063.stdout:0/87: truncate d1/df/d13/f1f 233766 0 2024-09-16T01:25:10.194 INFO:tasks.workunit.client.0.smithi063.stdout:5/56: read f3 [4328408,106216] 0 2024-09-16T01:25:10.195 INFO:tasks.workunit.client.0.smithi063.stdout:5/57: write d5/fd [691751,89390] 0 2024-09-16T01:25:10.196 INFO:tasks.workunit.client.0.smithi063.stdout:0/88: mknod d1/df/d13/c2a 0 2024-09-16T01:25:10.198 INFO:tasks.workunit.client.0.smithi063.stdout:7/89: dread d7/fe [4194304,4194304] 0 2024-09-16T01:25:10.199 INFO:tasks.workunit.client.0.smithi063.stdout:5/58: fsync d5/fd 0 2024-09-16T01:25:10.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/90: write d7/fe [7227617,17388] 0 2024-09-16T01:25:10.201 INFO:tasks.workunit.client.0.smithi063.stdout:5/59: readlink d5/lf 0 2024-09-16T01:25:10.204 INFO:tasks.workunit.client.0.smithi063.stdout:0/89: truncate d1/f11 3305266 0 2024-09-16T01:25:10.205 INFO:tasks.workunit.client.0.smithi063.stdout:7/91: mkdir d7/d1c/d1f 0 2024-09-16T01:25:10.206 INFO:tasks.workunit.client.0.smithi063.stdout:5/60: creat d5/f10 x:0 0 0 2024-09-16T01:25:10.207 INFO:tasks.workunit.client.0.smithi063.stdout:8/41: dwrite d5/f8 [0,4194304] 0 2024-09-16T01:25:10.210 INFO:tasks.workunit.client.0.smithi063.stdout:8/42: write d5/f6 [793638,101595] 0 2024-09-16T01:25:10.211 INFO:tasks.workunit.client.0.smithi063.stdout:8/43: write d5/f6 [1782030,71894] 0 2024-09-16T01:25:10.212 INFO:tasks.workunit.client.0.smithi063.stdout:5/61: dread d5/fd [0,4194304] 0 2024-09-16T01:25:10.213 INFO:tasks.workunit.client.0.smithi063.stdout:5/62: dread - d5/f9 zero size 2024-09-16T01:25:10.214 INFO:tasks.workunit.client.0.smithi063.stdout:9/52: sync 2024-09-16T01:25:10.215 INFO:tasks.workunit.client.0.smithi063.stdout:5/63: fdatasync d5/fe 0 2024-09-16T01:25:10.216 INFO:tasks.workunit.client.0.smithi063.stdout:5/64: dread - d5/f9 zero size 2024-09-16T01:25:10.218 INFO:tasks.workunit.client.0.smithi063.stdout:0/90: dread d1/df/d13/f1f [0,4194304] 0 2024-09-16T01:25:10.218 INFO:tasks.workunit.client.0.smithi063.stdout:5/65: stat d5/f10 0 2024-09-16T01:25:10.218 INFO:tasks.workunit.client.0.smithi063.stdout:9/53: dread f5 [0,4194304] 0 2024-09-16T01:25:10.219 INFO:tasks.workunit.client.0.smithi063.stdout:7/92: dread d7/f14 [0,4194304] 0 2024-09-16T01:25:10.221 INFO:tasks.workunit.client.0.smithi063.stdout:7/93: rmdir d7/d1c 39 2024-09-16T01:25:10.223 INFO:tasks.workunit.client.0.smithi063.stdout:9/54: fdatasync f4 0 2024-09-16T01:25:10.227 INFO:tasks.workunit.client.0.smithi063.stdout:9/55: symlink d7/d9/d12/l15 0 2024-09-16T01:25:10.231 INFO:tasks.workunit.client.0.smithi063.stdout:0/91: dwrite d1/f7 [0,4194304] 0 2024-09-16T01:25:10.233 INFO:tasks.workunit.client.0.smithi063.stdout:5/66: dwrite d5/fe [4194304,4194304] 0 2024-09-16T01:25:10.235 INFO:tasks.workunit.client.0.smithi063.stdout:0/92: mknod d1/d1c/c2b 0 2024-09-16T01:25:10.237 INFO:tasks.workunit.client.0.smithi063.stdout:7/94: dwrite f2 [0,4194304] 0 2024-09-16T01:25:10.239 INFO:tasks.workunit.client.0.smithi063.stdout:0/93: write d1/df/d13/f19 [3321625,27380] 0 2024-09-16T01:25:10.240 INFO:tasks.workunit.client.0.smithi063.stdout:9/56: dwrite f5 [0,4194304] 0 2024-09-16T01:25:10.242 INFO:tasks.workunit.client.0.smithi063.stdout:5/67: link d5/fe d5/f11 0 2024-09-16T01:25:10.243 INFO:tasks.workunit.client.0.smithi063.stdout:0/94: mkdir d1/df/d2c 0 2024-09-16T01:25:10.246 INFO:tasks.workunit.client.0.smithi063.stdout:5/68: mkdir d5/d12 0 2024-09-16T01:25:10.246 INFO:tasks.workunit.client.0.smithi063.stdout:9/57: dread d7/ff [0,4194304] 0 2024-09-16T01:25:10.247 INFO:tasks.workunit.client.0.smithi063.stdout:9/58: chown d7/ff 112 1 2024-09-16T01:25:10.248 INFO:tasks.workunit.client.0.smithi063.stdout:0/95: creat d1/d1c/f2d x:0 0 0 2024-09-16T01:25:10.249 INFO:tasks.workunit.client.0.smithi063.stdout:5/69: creat d5/d12/f13 x:0 0 0 2024-09-16T01:25:10.250 INFO:tasks.workunit.client.0.smithi063.stdout:9/59: creat d7/d9/d12/d14/f16 x:0 0 0 2024-09-16T01:25:10.251 INFO:tasks.workunit.client.0.smithi063.stdout:5/70: write d5/f10 [632163,9237] 0 2024-09-16T01:25:10.251 INFO:tasks.workunit.client.0.smithi063.stdout:9/60: truncate d7/f10 659400 0 2024-09-16T01:25:10.253 INFO:tasks.workunit.client.0.smithi063.stdout:5/71: mknod d5/d12/c14 0 2024-09-16T01:25:10.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/61: dread d7/f10 [0,4194304] 0 2024-09-16T01:25:10.254 INFO:tasks.workunit.client.0.smithi063.stdout:9/62: write d7/d9/f11 [580708,102113] 0 2024-09-16T01:25:10.255 INFO:tasks.workunit.client.0.smithi063.stdout:9/63: chown d7/d9/ce 7482027 1 2024-09-16T01:25:10.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/72: dread d5/f10 [0,4194304] 0 2024-09-16T01:25:10.258 INFO:tasks.workunit.client.0.smithi063.stdout:9/64: creat d7/d9/d12/d14/f17 x:0 0 0 2024-09-16T01:25:10.259 INFO:tasks.workunit.client.0.smithi063.stdout:5/73: creat d5/f15 x:0 0 0 2024-09-16T01:25:10.259 INFO:tasks.workunit.client.0.smithi063.stdout:9/65: symlink d7/d9/l18 0 2024-09-16T01:25:10.260 INFO:tasks.workunit.client.0.smithi063.stdout:5/74: mknod d5/c16 0 2024-09-16T01:25:10.261 INFO:tasks.workunit.client.0.smithi063.stdout:5/75: creat d5/f17 x:0 0 0 2024-09-16T01:25:10.263 INFO:tasks.workunit.client.0.smithi063.stdout:5/76: mkdir d5/d18 0 2024-09-16T01:25:10.263 INFO:tasks.workunit.client.0.smithi063.stdout:5/77: readlink d5/lf 0 2024-09-16T01:25:10.264 INFO:tasks.workunit.client.0.smithi063.stdout:5/78: truncate d5/f15 247429 0 2024-09-16T01:25:10.266 INFO:tasks.workunit.client.0.smithi063.stdout:9/66: dwrite f5 [0,4194304] 0 2024-09-16T01:25:10.267 INFO:tasks.workunit.client.0.smithi063.stdout:9/67: read d7/d9/f11 [24246,24597] 0 2024-09-16T01:25:10.268 INFO:tasks.workunit.client.0.smithi063.stdout:5/79: link d5/c16 d5/d18/c19 0 2024-09-16T01:25:10.269 INFO:tasks.workunit.client.0.smithi063.stdout:9/68: dread - d7/d9/d12/d14/f17 zero size 2024-09-16T01:25:10.270 INFO:tasks.workunit.client.0.smithi063.stdout:9/69: read d7/f10 [492849,63060] 0 2024-09-16T01:25:10.273 INFO:tasks.workunit.client.0.smithi063.stdout:9/70: write d7/f10 [1293259,38544] 0 2024-09-16T01:25:10.274 INFO:tasks.workunit.client.0.smithi063.stdout:5/80: dwrite d5/f15 [0,4194304] 0 2024-09-16T01:25:10.276 INFO:tasks.workunit.client.0.smithi063.stdout:5/81: dread d5/f10 [0,4194304] 0 2024-09-16T01:25:10.278 INFO:tasks.workunit.client.0.smithi063.stdout:9/71: rename d7/d9/la to d7/d9/d12/l19 0 2024-09-16T01:25:10.279 INFO:tasks.workunit.client.0.smithi063.stdout:9/72: dread - d7/d9/f13 zero size 2024-09-16T01:25:10.280 INFO:tasks.workunit.client.0.smithi063.stdout:5/82: creat d5/f1a x:0 0 0 2024-09-16T01:25:10.282 INFO:tasks.workunit.client.0.smithi063.stdout:9/73: write d7/ff [564562,63712] 0 2024-09-16T01:25:10.285 INFO:tasks.workunit.client.0.smithi063.stdout:9/74: dread d7/f10 [0,4194304] 0 2024-09-16T01:25:10.289 INFO:tasks.workunit.client.0.smithi063.stdout:5/83: dwrite f2 [0,4194304] 0 2024-09-16T01:25:10.290 INFO:tasks.workunit.client.0.smithi063.stdout:5/84: write f3 [7129830,57852] 0 2024-09-16T01:25:10.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/75: chown d7/d9/d12/l19 24 1 2024-09-16T01:25:10.293 INFO:tasks.workunit.client.0.smithi063.stdout:5/85: rename d5/cc to d5/c1b 0 2024-09-16T01:25:10.353 INFO:tasks.workunit.client.0.smithi063.stdout:9/76: dwrite d7/d9/d12/d14/f16 [0,4194304] 0 2024-09-16T01:25:10.355 INFO:tasks.workunit.client.0.smithi063.stdout:9/77: mknod d7/c1a 0 2024-09-16T01:25:10.357 INFO:tasks.workunit.client.0.smithi063.stdout:5/86: dwrite d5/fd [0,4194304] 0 2024-09-16T01:25:10.357 INFO:tasks.workunit.client.0.smithi063.stdout:9/78: unlink d7/f10 0 2024-09-16T01:25:10.357 INFO:tasks.workunit.client.0.smithi063.stdout:5/87: read f3 [7150889,130357] 0 2024-09-16T01:25:10.358 INFO:tasks.workunit.client.0.smithi063.stdout:5/88: truncate d5/d12/f13 362366 0 2024-09-16T01:25:10.360 INFO:tasks.workunit.client.0.smithi063.stdout:9/79: mknod d7/d9/c1b 0 2024-09-16T01:25:10.361 INFO:tasks.workunit.client.0.smithi063.stdout:9/80: dread f4 [0,4194304] 0 2024-09-16T01:25:10.362 INFO:tasks.workunit.client.0.smithi063.stdout:5/89: rmdir d5 39 2024-09-16T01:25:10.363 INFO:tasks.workunit.client.0.smithi063.stdout:5/90: readlink d5/lf 0 2024-09-16T01:25:10.364 INFO:tasks.workunit.client.0.smithi063.stdout:9/81: creat d7/d9/d12/d14/f1c x:0 0 0 2024-09-16T01:25:10.366 INFO:tasks.workunit.client.0.smithi063.stdout:9/82: chown d7/d9/d12/d14/f17 2115623 1 2024-09-16T01:25:10.368 INFO:tasks.workunit.client.0.smithi063.stdout:9/83: symlink d7/l1d 0 2024-09-16T01:25:10.371 INFO:tasks.workunit.client.0.smithi063.stdout:9/84: creat d7/d9/f1e x:0 0 0 2024-09-16T01:25:10.372 INFO:tasks.workunit.client.0.smithi063.stdout:5/91: dwrite d5/f9 [0,4194304] 0 2024-09-16T01:25:10.373 INFO:tasks.workunit.client.0.smithi063.stdout:9/85: mkdir d7/d1f 0 2024-09-16T01:25:10.377 INFO:tasks.workunit.client.0.smithi063.stdout:9/86: mkdir d7/d9/d20 0 2024-09-16T01:25:10.378 INFO:tasks.workunit.client.0.smithi063.stdout:9/87: read - d7/d9/d12/d14/f17 zero size 2024-09-16T01:25:10.380 INFO:tasks.workunit.client.0.smithi063.stdout:9/88: fsync f3 0 2024-09-16T01:25:10.387 INFO:tasks.workunit.client.0.smithi063.stdout:9/89: dwrite f5 [4194304,4194304] 0 2024-09-16T01:25:10.388 INFO:tasks.workunit.client.0.smithi063.stdout:5/92: dwrite f3 [8388608,4194304] 0 2024-09-16T01:25:10.388 INFO:tasks.workunit.client.0.smithi063.stdout:9/90: read f3 [2641,43239] 0 2024-09-16T01:25:10.388 INFO:tasks.workunit.client.0.smithi063.stdout:5/93: readlink d5/lf 0 2024-09-16T01:25:10.389 INFO:tasks.workunit.client.0.smithi063.stdout:5/94: read - d5/f17 zero size 2024-09-16T01:25:10.393 INFO:tasks.workunit.client.0.smithi063.stdout:9/91: link f5 d7/d9/d20/f21 0 2024-09-16T01:25:10.395 INFO:tasks.workunit.client.0.smithi063.stdout:9/92: chown d7/d9/d12/d14/f16 5495 1 2024-09-16T01:25:10.395 INFO:tasks.workunit.client.0.smithi063.stdout:5/95: dwrite d5/f11 [0,4194304] 0 2024-09-16T01:25:10.396 INFO:tasks.workunit.client.0.smithi063.stdout:9/93: dread - d7/d9/f13 zero size 2024-09-16T01:25:10.398 INFO:tasks.workunit.client.0.smithi063.stdout:5/96: creat d5/d12/f1c x:0 0 0 2024-09-16T01:25:10.400 INFO:tasks.workunit.client.0.smithi063.stdout:9/94: rename d7/d9/f1e to d7/f22 0 2024-09-16T01:25:10.402 INFO:tasks.workunit.client.0.smithi063.stdout:5/97: mkdir d5/d12/d1d 0 2024-09-16T01:25:10.403 INFO:tasks.workunit.client.0.smithi063.stdout:9/95: mkdir d7/d9/d12/d14/d23 0 2024-09-16T01:25:10.407 INFO:tasks.workunit.client.0.smithi063.stdout:5/98: dwrite d5/f9 [0,4194304] 0 2024-09-16T01:25:10.408 INFO:tasks.workunit.client.0.smithi063.stdout:9/96: rename f3 to d7/d9/d12/f24 0 2024-09-16T01:25:10.411 INFO:tasks.workunit.client.0.smithi063.stdout:9/97: write d7/d9/d12/d14/f1c [700616,12377] 0 2024-09-16T01:25:10.412 INFO:tasks.workunit.client.0.smithi063.stdout:5/99: creat d5/d12/f1e x:0 0 0 2024-09-16T01:25:10.413 INFO:tasks.workunit.client.0.smithi063.stdout:9/98: chown d7/d9/d12 550 1 2024-09-16T01:25:10.414 INFO:tasks.workunit.client.0.smithi063.stdout:9/99: dread - d7/f22 zero size 2024-09-16T01:25:10.417 INFO:tasks.workunit.client.0.smithi063.stdout:5/100: rename d5/d18/c19 to d5/d18/c1f 0 2024-09-16T01:25:10.417 INFO:tasks.workunit.client.0.smithi063.stdout:5/101: chown d5/d12/f1c 847732793 1 2024-09-16T01:25:10.420 INFO:tasks.workunit.client.0.smithi063.stdout:5/102: rmdir d5/d12/d1d 0 2024-09-16T01:25:10.421 INFO:tasks.workunit.client.0.smithi063.stdout:5/103: readlink d5/lf 0 2024-09-16T01:25:10.422 INFO:tasks.workunit.client.0.smithi063.stdout:5/104: unlink d5/f11 0 2024-09-16T01:25:10.422 INFO:tasks.workunit.client.0.smithi063.stdout:9/100: write d7/d9/f11 [1483932,112357] 0 2024-09-16T01:25:10.425 INFO:tasks.workunit.client.0.smithi063.stdout:5/105: truncate d5/d12/f1e 429880 0 2024-09-16T01:25:10.425 INFO:tasks.workunit.client.0.smithi063.stdout:5/106: truncate d5/f10 1101515 0 2024-09-16T01:25:10.425 INFO:tasks.workunit.client.0.smithi063.stdout:9/101: fdatasync d7/d9/f11 0 2024-09-16T01:25:10.429 INFO:tasks.workunit.client.0.smithi063.stdout:5/107: write f2 [11436491,122023] 0 2024-09-16T01:25:10.430 INFO:tasks.workunit.client.0.smithi063.stdout:9/102: dwrite f5 [0,4194304] 0 2024-09-16T01:25:10.432 INFO:tasks.workunit.client.0.smithi063.stdout:9/103: symlink d7/d1f/l25 0 2024-09-16T01:25:10.437 INFO:tasks.workunit.client.0.smithi063.stdout:5/108: dwrite d5/f9 [4194304,4194304] 0 2024-09-16T01:25:10.441 INFO:tasks.workunit.client.0.smithi063.stdout:9/104: dwrite d7/d9/f11 [0,4194304] 0 2024-09-16T01:25:10.442 INFO:tasks.workunit.client.0.smithi063.stdout:9/105: readlink d7/d9/l18 0 2024-09-16T01:25:10.442 INFO:tasks.workunit.client.0.smithi063.stdout:5/109: getdents d5/d18 0 2024-09-16T01:25:10.444 INFO:tasks.workunit.client.0.smithi063.stdout:9/106: mknod d7/d9/d12/c26 0 2024-09-16T01:25:10.445 INFO:tasks.workunit.client.0.smithi063.stdout:9/107: chown d7/l1d 59 1 2024-09-16T01:25:10.447 INFO:tasks.workunit.client.0.smithi063.stdout:9/108: write d7/d9/d12/d14/f16 [1558665,345] 0 2024-09-16T01:25:10.449 INFO:tasks.workunit.client.0.smithi063.stdout:5/110: dwrite d5/f1a [0,4194304] 0 2024-09-16T01:25:10.450 INFO:tasks.workunit.client.0.smithi063.stdout:9/109: truncate d7/d9/d12/d14/f17 176269 0 2024-09-16T01:25:10.452 INFO:tasks.workunit.client.0.smithi063.stdout:9/110: mknod d7/c27 0 2024-09-16T01:25:10.453 INFO:tasks.workunit.client.0.smithi063.stdout:5/111: symlink d5/d18/l20 0 2024-09-16T01:25:10.454 INFO:tasks.workunit.client.0.smithi063.stdout:5/112: stat d5/ca 0 2024-09-16T01:25:10.454 INFO:tasks.workunit.client.0.smithi063.stdout:9/111: write d7/ff [1650952,113477] 0 2024-09-16T01:25:10.455 INFO:tasks.workunit.client.0.smithi063.stdout:4/118: sync 2024-09-16T01:25:10.457 INFO:tasks.workunit.client.0.smithi063.stdout:5/113: rename d5/f1a to d5/d12/f21 0 2024-09-16T01:25:10.458 INFO:tasks.workunit.client.0.smithi063.stdout:9/112: creat d7/d9/f28 x:0 0 0 2024-09-16T01:25:10.459 INFO:tasks.workunit.client.0.smithi063.stdout:4/119: creat d5/d9/df/d1f/f26 x:0 0 0 2024-09-16T01:25:10.460 INFO:tasks.workunit.client.0.smithi063.stdout:9/113: creat d7/d9/d12/d14/f29 x:0 0 0 2024-09-16T01:25:10.461 INFO:tasks.workunit.client.0.smithi063.stdout:5/114: rmdir d5/d18 39 2024-09-16T01:25:10.461 INFO:tasks.workunit.client.0.smithi063.stdout:9/114: write d7/d9/d20/f21 [3885290,123587] 0 2024-09-16T01:25:10.462 INFO:tasks.workunit.client.0.smithi063.stdout:9/115: dread - d7/d9/f28 zero size 2024-09-16T01:25:10.463 INFO:tasks.workunit.client.0.smithi063.stdout:4/120: unlink d5/d9/fb 0 2024-09-16T01:25:10.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/116: truncate d7/d9/f11 5238760 0 2024-09-16T01:25:10.466 INFO:tasks.workunit.client.0.smithi063.stdout:9/117: creat d7/d9/f2a x:0 0 0 2024-09-16T01:25:10.467 INFO:tasks.workunit.client.0.smithi063.stdout:5/115: creat d5/f22 x:0 0 0 2024-09-16T01:25:10.469 INFO:tasks.workunit.client.0.smithi063.stdout:9/118: rename d7/ff to d7/d9/d20/f2b 0 2024-09-16T01:25:10.472 INFO:tasks.workunit.client.0.smithi063.stdout:4/121: chown d5/d9/f1d 125129164 1 2024-09-16T01:25:10.473 INFO:tasks.workunit.client.0.smithi063.stdout:5/116: dwrite f3 [0,4194304] 0 2024-09-16T01:25:10.475 INFO:tasks.workunit.client.0.smithi063.stdout:9/119: dread d7/d9/d12/d14/f16 [0,4194304] 0 2024-09-16T01:25:10.476 INFO:tasks.workunit.client.0.smithi063.stdout:4/122: unlink d5/c8 0 2024-09-16T01:25:10.477 INFO:tasks.workunit.client.0.smithi063.stdout:5/117: unlink d5/d18/c1f 0 2024-09-16T01:25:10.478 INFO:tasks.workunit.client.0.smithi063.stdout:5/118: truncate d5/d12/f1e 680091 0 2024-09-16T01:25:10.483 INFO:tasks.workunit.client.0.smithi063.stdout:5/119: chown d5/c16 3204 1 2024-09-16T01:25:10.483 INFO:tasks.workunit.client.0.smithi063.stdout:5/120: write d5/d12/f13 [103963,116032] 0 2024-09-16T01:25:10.487 INFO:tasks.workunit.client.0.smithi063.stdout:9/120: truncate d7/d9/d20/f2b 922546 0 2024-09-16T01:25:10.488 INFO:tasks.workunit.client.0.smithi063.stdout:5/121: creat d5/d12/f23 x:0 0 0 2024-09-16T01:25:10.489 INFO:tasks.workunit.client.0.smithi063.stdout:9/121: creat d7/d1f/f2c x:0 0 0 2024-09-16T01:25:10.490 INFO:tasks.workunit.client.0.smithi063.stdout:4/123: dread d5/d9/fe [0,4194304] 0 2024-09-16T01:25:10.491 INFO:tasks.workunit.client.0.smithi063.stdout:5/122: link f3 d5/d18/f24 0 2024-09-16T01:25:10.493 INFO:tasks.workunit.client.0.smithi063.stdout:9/122: symlink d7/d9/d12/d14/d23/l2d 0 2024-09-16T01:25:10.494 INFO:tasks.workunit.client.0.smithi063.stdout:5/123: symlink d5/l25 0 2024-09-16T01:25:10.494 INFO:tasks.workunit.client.0.smithi063.stdout:9/123: write d7/d9/d12/d14/f1c [1091132,2063] 0 2024-09-16T01:25:10.495 INFO:tasks.workunit.client.0.smithi063.stdout:5/124: creat d5/d12/f26 x:0 0 0 2024-09-16T01:25:10.496 INFO:tasks.workunit.client.0.smithi063.stdout:5/125: chown d5/fe 10578944 1 2024-09-16T01:25:10.502 INFO:tasks.workunit.client.0.smithi063.stdout:4/124: dread d5/f6 [0,4194304] 0 2024-09-16T01:25:10.502 INFO:tasks.workunit.client.0.smithi063.stdout:5/126: dwrite d5/f17 [0,4194304] 0 2024-09-16T01:25:10.506 INFO:tasks.workunit.client.0.smithi063.stdout:4/125: creat d5/d9/df/d24/f27 x:0 0 0 2024-09-16T01:25:10.508 INFO:tasks.workunit.client.0.smithi063.stdout:4/126: dread - d5/d9/df/d1c/f21 zero size 2024-09-16T01:25:10.510 INFO:tasks.workunit.client.0.smithi063.stdout:5/127: dwrite d5/d12/f21 [0,4194304] 0 2024-09-16T01:25:10.510 INFO:tasks.workunit.client.0.smithi063.stdout:4/127: unlink d5/d9/fe 0 2024-09-16T01:25:10.513 INFO:tasks.workunit.client.0.smithi063.stdout:4/128: write d5/d9/df/d24/f27 [198231,128913] 0 2024-09-16T01:25:10.513 INFO:tasks.workunit.client.0.smithi063.stdout:5/128: rename d5/l25 to d5/d18/l27 0 2024-09-16T01:25:10.514 INFO:tasks.workunit.client.0.smithi063.stdout:4/129: dread - d5/d9/df/f18 zero size 2024-09-16T01:25:10.515 INFO:tasks.workunit.client.0.smithi063.stdout:5/129: write d5/f10 [1457170,38169] 0 2024-09-16T01:25:10.516 INFO:tasks.workunit.client.0.smithi063.stdout:4/130: chown d5/f11 340 1 2024-09-16T01:25:10.517 INFO:tasks.workunit.client.0.smithi063.stdout:5/130: symlink d5/d18/l28 0 2024-09-16T01:25:10.519 INFO:tasks.workunit.client.0.smithi063.stdout:5/131: mkdir d5/d18/d29 0 2024-09-16T01:25:10.520 INFO:tasks.workunit.client.0.smithi063.stdout:5/132: chown d5/d18/f24 644785 1 2024-09-16T01:25:10.523 INFO:tasks.workunit.client.0.smithi063.stdout:4/131: dwrite d5/f11 [0,4194304] 0 2024-09-16T01:25:10.525 INFO:tasks.workunit.client.0.smithi063.stdout:4/132: mknod d5/c28 0 2024-09-16T01:25:10.527 INFO:tasks.workunit.client.0.smithi063.stdout:4/133: rmdir d5 39 2024-09-16T01:25:10.528 INFO:tasks.workunit.client.0.smithi063.stdout:5/133: getdents d5/d18 0 2024-09-16T01:25:10.529 INFO:tasks.workunit.client.0.smithi063.stdout:4/134: chown d5/d9/df/f18 3946 1 2024-09-16T01:25:10.530 INFO:tasks.workunit.client.0.smithi063.stdout:5/134: link d5/f9 d5/d18/f2a 0 2024-09-16T01:25:10.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/135: write d5/f6 [51698,112023] 0 2024-09-16T01:25:10.532 INFO:tasks.workunit.client.0.smithi063.stdout:5/135: chown d5/d18/f24 1028625737 1 2024-09-16T01:25:10.533 INFO:tasks.workunit.client.0.smithi063.stdout:5/136: symlink d5/d12/l2b 0 2024-09-16T01:25:10.535 INFO:tasks.workunit.client.0.smithi063.stdout:4/136: rename d5/d9/df/d1f to d5/d9/df/d1c/d29 0 2024-09-16T01:25:10.536 INFO:tasks.workunit.client.0.smithi063.stdout:5/137: symlink d5/d18/l2c 0 2024-09-16T01:25:10.536 INFO:tasks.workunit.client.0.smithi063.stdout:4/137: mknod d5/d9/df/c2a 0 2024-09-16T01:25:10.537 INFO:tasks.workunit.client.0.smithi063.stdout:5/138: unlink d5/c7 0 2024-09-16T01:25:10.538 INFO:tasks.workunit.client.0.smithi063.stdout:4/138: rename c4 to d5/d9/df/d24/c2b 0 2024-09-16T01:25:10.540 INFO:tasks.workunit.client.0.smithi063.stdout:4/139: mknod d5/c2c 0 2024-09-16T01:25:10.543 INFO:tasks.workunit.client.0.smithi063.stdout:4/140: unlink d5/c14 0 2024-09-16T01:25:10.545 INFO:tasks.workunit.client.0.smithi063.stdout:4/141: dread d5/f11 [0,4194304] 0 2024-09-16T01:25:10.546 INFO:tasks.workunit.client.0.smithi063.stdout:5/139: getdents d5 0 2024-09-16T01:25:10.549 INFO:tasks.workunit.client.0.smithi063.stdout:4/142: dread d5/f11 [0,4194304] 0 2024-09-16T01:25:10.550 INFO:tasks.workunit.client.0.smithi063.stdout:5/140: dread d5/f15 [0,4194304] 0 2024-09-16T01:25:10.552 INFO:tasks.workunit.client.0.smithi063.stdout:5/141: creat d5/d12/f2d x:0 0 0 2024-09-16T01:25:10.555 INFO:tasks.workunit.client.0.smithi063.stdout:4/143: dwrite d5/f11 [0,4194304] 0 2024-09-16T01:25:10.557 INFO:tasks.workunit.client.0.smithi063.stdout:4/144: dread - d5/d9/df/f18 zero size 2024-09-16T01:25:10.557 INFO:tasks.workunit.client.0.smithi063.stdout:5/142: dread d5/f9 [0,4194304] 0 2024-09-16T01:25:10.559 INFO:tasks.workunit.client.0.smithi063.stdout:5/143: mkdir d5/d18/d2e 0 2024-09-16T01:25:10.560 INFO:tasks.workunit.client.0.smithi063.stdout:4/145: creat d5/d9/f2d x:0 0 0 2024-09-16T01:25:10.560 INFO:tasks.workunit.client.0.smithi063.stdout:4/146: chown d5/d9/df/c2a 2326 1 2024-09-16T01:25:10.562 INFO:tasks.workunit.client.0.smithi063.stdout:5/144: rmdir d5/d18/d2e 0 2024-09-16T01:25:10.563 INFO:tasks.workunit.client.0.smithi063.stdout:4/147: creat d5/f2e x:0 0 0 2024-09-16T01:25:10.564 INFO:tasks.workunit.client.0.smithi063.stdout:4/148: dread - d5/d9/df/d1c/d29/d20/f23 zero size 2024-09-16T01:25:10.565 INFO:tasks.workunit.client.0.smithi063.stdout:4/149: stat d5/d9/df/d24/f27 0 2024-09-16T01:25:10.566 INFO:tasks.workunit.client.0.smithi063.stdout:5/145: link d5/f22 d5/d18/d29/f2f 0 2024-09-16T01:25:10.567 INFO:tasks.workunit.client.0.smithi063.stdout:4/150: symlink d5/l2f 0 2024-09-16T01:25:10.568 INFO:tasks.workunit.client.0.smithi063.stdout:5/146: symlink d5/d18/l30 0 2024-09-16T01:25:10.569 INFO:tasks.workunit.client.0.smithi063.stdout:4/151: readlink d5/d9/l1e 0 2024-09-16T01:25:10.569 INFO:tasks.workunit.client.0.smithi063.stdout:4/152: readlink d5/l10 0 2024-09-16T01:25:10.570 INFO:tasks.workunit.client.0.smithi063.stdout:5/147: creat d5/f31 x:0 0 0 2024-09-16T01:25:10.570 INFO:tasks.workunit.client.0.smithi063.stdout:4/153: write d5/d9/f16 [908349,67941] 0 2024-09-16T01:25:10.571 INFO:tasks.workunit.client.0.smithi063.stdout:5/148: write d5/f17 [1171821,19685] 0 2024-09-16T01:25:10.572 INFO:tasks.workunit.client.0.smithi063.stdout:4/154: read d5/d9/f1d [2908278,78120] 0 2024-09-16T01:25:10.573 INFO:tasks.workunit.client.0.smithi063.stdout:4/155: readlink d5/d9/l1e 0 2024-09-16T01:25:10.574 INFO:tasks.workunit.client.0.smithi063.stdout:5/149: truncate d5/d12/f2d 467747 0 2024-09-16T01:25:10.574 INFO:tasks.workunit.client.0.smithi063.stdout:4/156: fsync d5/d9/df/d1c/f21 0 2024-09-16T01:25:10.577 INFO:tasks.workunit.client.0.smithi063.stdout:4/157: dread d5/f6 [0,4194304] 0 2024-09-16T01:25:10.577 INFO:tasks.workunit.client.0.smithi063.stdout:4/158: readlink d5/d9/df/l1a 0 2024-09-16T01:25:10.579 INFO:tasks.workunit.client.0.smithi063.stdout:5/150: link d5/d12/f2d d5/d18/d29/f32 0 2024-09-16T01:25:10.580 INFO:tasks.workunit.client.0.smithi063.stdout:3/74: sync 2024-09-16T01:25:10.580 INFO:tasks.workunit.client.0.smithi063.stdout:1/171: sync 2024-09-16T01:25:10.580 INFO:tasks.workunit.client.0.smithi063.stdout:6/138: sync 2024-09-16T01:25:10.581 INFO:tasks.workunit.client.0.smithi063.stdout:2/126: sync 2024-09-16T01:25:10.581 INFO:tasks.workunit.client.0.smithi063.stdout:8/44: sync 2024-09-16T01:25:10.581 INFO:tasks.workunit.client.0.smithi063.stdout:0/96: sync 2024-09-16T01:25:10.581 INFO:tasks.workunit.client.0.smithi063.stdout:7/95: sync 2024-09-16T01:25:10.581 INFO:tasks.workunit.client.0.smithi063.stdout:5/151: mknod d5/c33 0 2024-09-16T01:25:10.583 INFO:tasks.workunit.client.0.smithi063.stdout:0/97: mkdir d1/d2e 0 2024-09-16T01:25:10.584 INFO:tasks.workunit.client.0.smithi063.stdout:8/45: mkdir d5/db 0 2024-09-16T01:25:10.584 INFO:tasks.workunit.client.0.smithi063.stdout:1/172: mkdir d1/dd/d3b 0 2024-09-16T01:25:10.585 INFO:tasks.workunit.client.0.smithi063.stdout:2/127: write d3/d7/f26 [2602777,80442] 0 2024-09-16T01:25:10.585 INFO:tasks.workunit.client.0.smithi063.stdout:3/75: symlink d2/d9/l16 0 2024-09-16T01:25:10.588 INFO:tasks.workunit.client.0.smithi063.stdout:4/159: dwrite d5/d9/df/d1c/f21 [0,4194304] 0 2024-09-16T01:25:10.588 INFO:tasks.workunit.client.0.smithi063.stdout:5/152: unlink d5/d12/f26 0 2024-09-16T01:25:10.590 INFO:tasks.workunit.client.0.smithi063.stdout:3/76: chown d2/d9/fc 103043 1 2024-09-16T01:25:10.592 INFO:tasks.workunit.client.0.smithi063.stdout:6/139: mknod d3/d10/d35/c36 0 2024-09-16T01:25:10.592 INFO:tasks.workunit.client.0.smithi063.stdout:4/160: fsync d5/d9/df/f18 0 2024-09-16T01:25:10.594 INFO:tasks.workunit.client.0.smithi063.stdout:1/173: mkdir d1/d12/d3c 0 2024-09-16T01:25:10.594 INFO:tasks.workunit.client.0.smithi063.stdout:5/153: fsync d5/d12/f2d 0 2024-09-16T01:25:10.598 INFO:tasks.workunit.client.0.smithi063.stdout:5/154: readlink d5/d12/l2b 0 2024-09-16T01:25:10.598 INFO:tasks.workunit.client.0.smithi063.stdout:8/46: truncate d5/f7 2383484 0 2024-09-16T01:25:10.599 INFO:tasks.workunit.client.0.smithi063.stdout:7/96: dwrite d7/d18/f1b [0,4194304] 0 2024-09-16T01:25:10.599 INFO:tasks.workunit.client.0.smithi063.stdout:6/140: symlink d3/d10/d35/l37 0 2024-09-16T01:25:10.600 INFO:tasks.workunit.client.0.smithi063.stdout:3/77: mkdir d2/d17 0 2024-09-16T01:25:10.601 INFO:tasks.workunit.client.0.smithi063.stdout:0/98: dwrite d1/f7 [0,4194304] 0 2024-09-16T01:25:10.602 INFO:tasks.workunit.client.0.smithi063.stdout:4/161: mkdir d5/d9/df/d1c/d29/d20/d30 0 2024-09-16T01:25:10.604 INFO:tasks.workunit.client.0.smithi063.stdout:1/174: mknod d1/d5/d15/d18/c3d 0 2024-09-16T01:25:10.605 INFO:tasks.workunit.client.0.smithi063.stdout:8/47: creat d5/fc x:0 0 0 2024-09-16T01:25:10.605 INFO:tasks.workunit.client.0.smithi063.stdout:7/97: unlink f3 0 2024-09-16T01:25:10.606 INFO:tasks.workunit.client.0.smithi063.stdout:8/48: stat d5 0 2024-09-16T01:25:10.608 INFO:tasks.workunit.client.0.smithi063.stdout:3/78: rename d2/d9 to d2/d11/d18 0 2024-09-16T01:25:10.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:10 smithi063 ceph-mon[31070]: pgmap v390: 97 pgs: 97 active+clean; 193 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 11 MiB/s wr, 229 op/s 2024-09-16T01:25:10.609 INFO:tasks.workunit.client.0.smithi063.stdout:0/99: fdatasync d1/df/d13/f16 0 2024-09-16T01:25:10.610 INFO:tasks.workunit.client.0.smithi063.stdout:8/49: write d5/f8 [1518179,84999] 0 2024-09-16T01:25:10.612 INFO:tasks.workunit.client.0.smithi063.stdout:3/79: fsync d2/d11/d18/fd 0 2024-09-16T01:25:10.613 INFO:tasks.workunit.client.0.smithi063.stdout:4/162: dread d5/d9/df/d24/f27 [0,4194304] 0 2024-09-16T01:25:10.615 INFO:tasks.workunit.client.0.smithi063.stdout:5/155: dwrite d5/d12/f13 [0,4194304] 0 2024-09-16T01:25:10.615 INFO:tasks.workunit.client.0.smithi063.stdout:8/50: write d5/f6 [1056839,14341] 0 2024-09-16T01:25:10.618 INFO:tasks.workunit.client.0.smithi063.stdout:0/100: unlink d1/c4 0 2024-09-16T01:25:10.619 INFO:tasks.workunit.client.0.smithi063.stdout:8/51: read - d5/fc zero size 2024-09-16T01:25:10.621 INFO:tasks.workunit.client.0.smithi063.stdout:1/175: dwrite d1/d12/d16/f35 [0,4194304] 0 2024-09-16T01:25:10.623 INFO:tasks.workunit.client.0.smithi063.stdout:1/176: write f0 [3129787,66833] 0 2024-09-16T01:25:10.624 INFO:tasks.workunit.client.0.smithi063.stdout:4/163: rename d5/d9/df/d1c/f21 to d5/d9/df/d1c/f31 0 2024-09-16T01:25:10.627 INFO:tasks.workunit.client.0.smithi063.stdout:7/98: mknod d7/d1c/d1f/c20 0 2024-09-16T01:25:10.627 INFO:tasks.workunit.client.0.smithi063.stdout:1/177: read - d1/d5/d15/d1b/f39 zero size 2024-09-16T01:25:10.628 INFO:tasks.workunit.client.0.smithi063.stdout:6/141: dwrite d3/d10/f34 [0,4194304] 0 2024-09-16T01:25:10.628 INFO:tasks.workunit.client.0.smithi063.stdout:4/164: chown d5/d9/df/d24/f27 106179690 1 2024-09-16T01:25:10.633 INFO:tasks.workunit.client.0.smithi063.stdout:0/101: creat d1/d2e/f2f x:0 0 0 2024-09-16T01:25:10.635 INFO:tasks.workunit.client.0.smithi063.stdout:4/165: truncate d5/d9/df/d1c/d29/d20/f23 279705 0 2024-09-16T01:25:10.636 INFO:tasks.workunit.client.0.smithi063.stdout:0/102: write d1/fb [251682,27326] 0 2024-09-16T01:25:10.637 INFO:tasks.workunit.client.0.smithi063.stdout:3/80: link d2/f5 d2/f19 0 2024-09-16T01:25:10.637 INFO:tasks.workunit.client.0.smithi063.stdout:1/178: dread d1/d5/f11 [0,4194304] 0 2024-09-16T01:25:10.638 INFO:tasks.workunit.client.0.smithi063.stdout:5/156: creat d5/d18/f34 x:0 0 0 2024-09-16T01:25:10.639 INFO:tasks.workunit.client.0.smithi063.stdout:6/142: symlink d3/d10/d22/d28/l38 0 2024-09-16T01:25:10.641 INFO:tasks.workunit.client.0.smithi063.stdout:0/103: mkdir d1/d30 0 2024-09-16T01:25:10.641 INFO:tasks.workunit.client.0.smithi063.stdout:8/52: write d5/f7 [1893953,81959] 0 2024-09-16T01:25:10.642 INFO:tasks.workunit.client.0.smithi063.stdout:1/179: write d1/d5/d15/f19 [1386813,75286] 0 2024-09-16T01:25:10.642 INFO:tasks.workunit.client.0.smithi063.stdout:6/143: mkdir d3/d30/d39 0 2024-09-16T01:25:10.643 INFO:tasks.workunit.client.0.smithi063.stdout:7/99: dwrite d7/f10 [0,4194304] 0 2024-09-16T01:25:10.644 INFO:tasks.workunit.client.0.smithi063.stdout:4/166: rename d5/d9/df/d24 to d5/d9/df/d1c/d29/d32 0 2024-09-16T01:25:10.647 INFO:tasks.workunit.client.0.smithi063.stdout:7/100: rmdir d7/d18 39 2024-09-16T01:25:10.647 INFO:tasks.workunit.client.0.smithi063.stdout:0/104: dread d1/df/d13/f1f [0,4194304] 0 2024-09-16T01:25:10.648 INFO:tasks.workunit.client.0.smithi063.stdout:6/144: creat d3/d10/d35/f3a x:0 0 0 2024-09-16T01:25:10.650 INFO:tasks.workunit.client.0.smithi063.stdout:4/167: symlink d5/l33 0 2024-09-16T01:25:10.651 INFO:tasks.workunit.client.0.smithi063.stdout:5/157: dread d5/d18/f2a [4194304,4194304] 0 2024-09-16T01:25:10.651 INFO:tasks.workunit.client.0.smithi063.stdout:3/81: dwrite d2/d11/d18/fd [0,4194304] 0 2024-09-16T01:25:10.652 INFO:tasks.workunit.client.0.smithi063.stdout:0/105: creat d1/f31 x:0 0 0 2024-09-16T01:25:10.653 INFO:tasks.workunit.client.0.smithi063.stdout:0/106: write d1/fb [6499624,123311] 0 2024-09-16T01:25:10.654 INFO:tasks.workunit.client.0.smithi063.stdout:6/145: mknod d3/d30/c3b 0 2024-09-16T01:25:10.655 INFO:tasks.workunit.client.0.smithi063.stdout:9/124: sync 2024-09-16T01:25:10.656 INFO:tasks.workunit.client.0.smithi063.stdout:5/158: mkdir d5/d12/d35 0 2024-09-16T01:25:10.658 INFO:tasks.workunit.client.0.smithi063.stdout:1/180: getdents d1/dd 0 2024-09-16T01:25:10.659 INFO:tasks.workunit.client.0.smithi063.stdout:4/168: symlink d5/d9/df/d1c/d29/d20/l34 0 2024-09-16T01:25:10.660 INFO:tasks.workunit.client.0.smithi063.stdout:4/169: truncate d5/d9/f16 1115686 0 2024-09-16T01:25:10.660 INFO:tasks.workunit.client.0.smithi063.stdout:4/170: dread - d5/d9/f2d zero size 2024-09-16T01:25:10.661 INFO:tasks.workunit.client.0.smithi063.stdout:8/53: truncate d5/f8 2836355 0 2024-09-16T01:25:10.662 INFO:tasks.workunit.client.0.smithi063.stdout:8/54: dread - d5/fc zero size 2024-09-16T01:25:10.664 INFO:tasks.workunit.client.0.smithi063.stdout:6/146: creat d3/d10/d35/f3c x:0 0 0 2024-09-16T01:25:10.665 INFO:tasks.workunit.client.0.smithi063.stdout:5/159: chown d5/ca 106298094 1 2024-09-16T01:25:10.667 INFO:tasks.workunit.client.0.smithi063.stdout:1/181: write d1/d12/d16/f37 [360303,478] 0 2024-09-16T01:25:10.667 INFO:tasks.workunit.client.0.smithi063.stdout:4/171: creat d5/d9/df/d1c/f35 x:0 0 0 2024-09-16T01:25:10.668 INFO:tasks.workunit.client.0.smithi063.stdout:7/101: getdents d7/d1c 0 2024-09-16T01:25:10.670 INFO:tasks.workunit.client.0.smithi063.stdout:3/82: dwrite d2/f8 [0,4194304] 0 2024-09-16T01:25:10.670 INFO:tasks.workunit.client.0.smithi063.stdout:9/125: link d7/d9/d12/d14/f17 d7/d9/d12/f2e 0 2024-09-16T01:25:10.670 INFO:tasks.workunit.client.0.smithi063.stdout:3/83: chown d2/d17 78286668 1 2024-09-16T01:25:10.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/182: dread - d1/dd/f20 zero size 2024-09-16T01:25:10.672 INFO:tasks.workunit.client.0.smithi063.stdout:6/147: symlink d3/d30/l3d 0 2024-09-16T01:25:10.673 INFO:tasks.workunit.client.0.smithi063.stdout:3/84: chown d2/d12/l15 64467710 1 2024-09-16T01:25:10.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:10 smithi192 ceph-mon[34775]: pgmap v390: 97 pgs: 97 active+clean; 193 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 11 MiB/s wr, 229 op/s 2024-09-16T01:25:10.674 INFO:tasks.workunit.client.0.smithi063.stdout:8/55: mknod d5/db/cd 0 2024-09-16T01:25:10.675 INFO:tasks.workunit.client.0.smithi063.stdout:0/107: rename d1/df/d13 to d1/d2e/d32 0 2024-09-16T01:25:10.677 INFO:tasks.workunit.client.0.smithi063.stdout:9/126: creat d7/d1f/f2f x:0 0 0 2024-09-16T01:25:10.678 INFO:tasks.workunit.client.0.smithi063.stdout:3/85: chown d2/d11/d18/fc 610838955 1 2024-09-16T01:25:10.679 INFO:tasks.workunit.client.0.smithi063.stdout:8/56: rmdir d5/d9 39 2024-09-16T01:25:10.680 INFO:tasks.workunit.client.0.smithi063.stdout:1/183: unlink d1/d5/d15/d1b/f28 0 2024-09-16T01:25:10.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:10 smithi162 ceph-mon[34539]: pgmap v390: 97 pgs: 97 active+clean; 193 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 11 MiB/s wr, 229 op/s 2024-09-16T01:25:10.684 INFO:tasks.workunit.client.0.smithi063.stdout:8/57: truncate d5/fc 297118 0 2024-09-16T01:25:10.684 INFO:tasks.workunit.client.0.smithi063.stdout:4/172: dwrite d5/d9/df/d1c/f35 [0,4194304] 0 2024-09-16T01:25:10.686 INFO:tasks.workunit.client.0.smithi063.stdout:3/86: symlink d2/d11/l1a 0 2024-09-16T01:25:10.686 INFO:tasks.workunit.client.0.smithi063.stdout:7/102: dwrite d7/f19 [0,4194304] 0 2024-09-16T01:25:10.687 INFO:tasks.workunit.client.0.smithi063.stdout:9/127: symlink d7/d9/d12/l30 0 2024-09-16T01:25:10.687 INFO:tasks.workunit.client.0.smithi063.stdout:4/173: chown d5/f2e 1466820464 1 2024-09-16T01:25:10.689 INFO:tasks.workunit.client.0.smithi063.stdout:7/103: write d7/f19 [3924798,56671] 0 2024-09-16T01:25:10.691 INFO:tasks.workunit.client.0.smithi063.stdout:0/108: dwrite d1/d2e/d32/f19 [0,4194304] 0 2024-09-16T01:25:10.693 INFO:tasks.workunit.client.0.smithi063.stdout:1/184: write d1/d5/d15/f26 [4383776,65995] 0 2024-09-16T01:25:10.697 INFO:tasks.workunit.client.0.smithi063.stdout:5/160: truncate d5/f15 3284454 0 2024-09-16T01:25:10.698 INFO:tasks.workunit.client.0.smithi063.stdout:2/128: sync 2024-09-16T01:25:10.698 INFO:tasks.workunit.client.0.smithi063.stdout:4/174: creat d5/d9/df/d1c/f36 x:0 0 0 2024-09-16T01:25:10.699 INFO:tasks.workunit.client.0.smithi063.stdout:6/148: truncate d3/d10/f1d 3411447 0 2024-09-16T01:25:10.700 INFO:tasks.workunit.client.0.smithi063.stdout:3/87: rename d2/d11/d18/c13 to d2/d11/c1b 0 2024-09-16T01:25:10.702 INFO:tasks.workunit.client.0.smithi063.stdout:0/109: mknod d1/d2e/d32/c33 0 2024-09-16T01:25:10.703 INFO:tasks.workunit.client.0.smithi063.stdout:8/58: symlink d5/d9/le 0 2024-09-16T01:25:10.704 INFO:tasks.workunit.client.0.smithi063.stdout:5/161: readlink d5/d18/l27 0 2024-09-16T01:25:10.704 INFO:tasks.workunit.client.0.smithi063.stdout:2/129: mkdir d3/d7/d8/d1f/d32 0 2024-09-16T01:25:10.705 INFO:tasks.workunit.client.0.smithi063.stdout:9/128: link d7/f22 d7/d9/d12/d14/f31 0 2024-09-16T01:25:10.706 INFO:tasks.workunit.client.0.smithi063.stdout:4/175: creat d5/d9/df/d1c/f37 x:0 0 0 2024-09-16T01:25:10.707 INFO:tasks.workunit.client.0.smithi063.stdout:7/104: symlink d7/d18/l21 0 2024-09-16T01:25:10.708 INFO:tasks.workunit.client.0.smithi063.stdout:6/149: dwrite d3/f16 [0,4194304] 0 2024-09-16T01:25:10.708 INFO:tasks.workunit.client.0.smithi063.stdout:3/88: creat d2/d11/d18/f1c x:0 0 0 2024-09-16T01:25:10.709 INFO:tasks.workunit.client.0.smithi063.stdout:2/130: dread d3/d7/d8/f1a [0,4194304] 0 2024-09-16T01:25:10.709 INFO:tasks.workunit.client.0.smithi063.stdout:0/110: mkdir d1/df/d34 0 2024-09-16T01:25:10.711 INFO:tasks.workunit.client.0.smithi063.stdout:2/131: write d3/d7/f26 [1578513,32907] 0 2024-09-16T01:25:10.711 INFO:tasks.workunit.client.0.smithi063.stdout:6/150: truncate d3/d10/d35/f3c 833646 0 2024-09-16T01:25:10.713 INFO:tasks.workunit.client.0.smithi063.stdout:9/129: mknod d7/d1f/c32 0 2024-09-16T01:25:10.715 INFO:tasks.workunit.client.0.smithi063.stdout:2/132: write d3/d7/f22 [753136,53596] 0 2024-09-16T01:25:10.716 INFO:tasks.workunit.client.0.smithi063.stdout:7/105: creat d7/d18/f22 x:0 0 0 2024-09-16T01:25:10.718 INFO:tasks.workunit.client.0.smithi063.stdout:4/176: symlink d5/d9/df/d1c/l38 0 2024-09-16T01:25:10.719 INFO:tasks.workunit.client.0.smithi063.stdout:9/130: chown d7/d9/d12/d14/f31 12603 1 2024-09-16T01:25:10.719 INFO:tasks.workunit.client.0.smithi063.stdout:7/106: chown d7/d1c 405 1 2024-09-16T01:25:10.723 INFO:tasks.workunit.client.0.smithi063.stdout:3/89: dwrite d2/d11/d18/fd [4194304,4194304] 0 2024-09-16T01:25:10.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/111: dread d1/f7 [0,4194304] 0 2024-09-16T01:25:10.725 INFO:tasks.workunit.client.0.smithi063.stdout:6/151: rmdir d3 39 2024-09-16T01:25:10.729 INFO:tasks.workunit.client.0.smithi063.stdout:4/177: creat d5/d9/df/d1c/f39 x:0 0 0 2024-09-16T01:25:10.730 INFO:tasks.workunit.client.0.smithi063.stdout:1/185: dwrite d1/f3 [0,4194304] 0 2024-09-16T01:25:10.731 INFO:tasks.workunit.client.0.smithi063.stdout:2/133: dwrite d3/d7/d8/f20 [0,4194304] 0 2024-09-16T01:25:10.732 INFO:tasks.workunit.client.0.smithi063.stdout:8/59: getdents d5 0 2024-09-16T01:25:10.736 INFO:tasks.workunit.client.0.smithi063.stdout:6/152: write d3/d10/f29 [737936,58297] 0 2024-09-16T01:25:10.736 INFO:tasks.workunit.client.0.smithi063.stdout:0/112: creat d1/f35 x:0 0 0 2024-09-16T01:25:10.737 INFO:tasks.workunit.client.0.smithi063.stdout:8/60: dread d5/f8 [0,4194304] 0 2024-09-16T01:25:10.737 INFO:tasks.workunit.client.0.smithi063.stdout:3/90: unlink d2/d11/d18/f1c 0 2024-09-16T01:25:10.742 INFO:tasks.workunit.client.0.smithi063.stdout:9/131: dwrite d7/d9/d12/f2e [0,4194304] 0 2024-09-16T01:25:10.744 INFO:tasks.workunit.client.0.smithi063.stdout:2/134: creat d3/d7/de/f33 x:0 0 0 2024-09-16T01:25:10.744 INFO:tasks.workunit.client.0.smithi063.stdout:4/178: rmdir d5/d9/df 39 2024-09-16T01:25:10.746 INFO:tasks.workunit.client.0.smithi063.stdout:7/107: truncate d7/f12 290660 0 2024-09-16T01:25:10.747 INFO:tasks.workunit.client.0.smithi063.stdout:7/108: chown d7/d18/f1b 0 1 2024-09-16T01:25:10.748 INFO:tasks.workunit.client.0.smithi063.stdout:0/113: mkdir d1/d2e/d32/d36 0 2024-09-16T01:25:10.749 INFO:tasks.workunit.client.0.smithi063.stdout:6/153: mkdir d3/d10/d22/d28/d3e 0 2024-09-16T01:25:10.750 INFO:tasks.workunit.client.0.smithi063.stdout:8/61: mknod d5/d9/cf 0 2024-09-16T01:25:10.752 INFO:tasks.workunit.client.0.smithi063.stdout:3/91: creat d2/d11/f1d x:0 0 0 2024-09-16T01:25:10.755 INFO:tasks.workunit.client.0.smithi063.stdout:9/132: creat d7/d9/d12/f33 x:0 0 0 2024-09-16T01:25:10.757 INFO:tasks.workunit.client.0.smithi063.stdout:2/135: mkdir d3/d7/d8/d1f/d34 0 2024-09-16T01:25:10.758 INFO:tasks.workunit.client.0.smithi063.stdout:5/162: dwrite d5/f15 [0,4194304] 0 2024-09-16T01:25:10.758 INFO:tasks.workunit.client.0.smithi063.stdout:7/109: mknod d7/d1c/c23 0 2024-09-16T01:25:10.759 INFO:tasks.workunit.client.0.smithi063.stdout:0/114: creat d1/d2e/f37 x:0 0 0 2024-09-16T01:25:10.760 INFO:tasks.workunit.client.0.smithi063.stdout:7/110: read d7/f9 [4830397,35435] 0 2024-09-16T01:25:10.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/154: rmdir d3/d30 39 2024-09-16T01:25:10.761 INFO:tasks.workunit.client.0.smithi063.stdout:3/92: mknod d2/d11/d18/c1e 0 2024-09-16T01:25:10.762 INFO:tasks.workunit.client.0.smithi063.stdout:1/186: unlink d1/d12/d21/c27 0 2024-09-16T01:25:10.763 INFO:tasks.workunit.client.0.smithi063.stdout:8/62: rmdir d5/db 39 2024-09-16T01:25:10.764 INFO:tasks.workunit.client.0.smithi063.stdout:4/179: symlink d5/d9/df/d1c/l3a 0 2024-09-16T01:25:10.765 INFO:tasks.workunit.client.0.smithi063.stdout:9/133: mkdir d7/d9/d12/d14/d34 0 2024-09-16T01:25:10.795 INFO:tasks.workunit.client.0.smithi063.stdout:9/134: readlink d7/d1f/l25 0 2024-09-16T01:25:10.795 INFO:tasks.workunit.client.0.smithi063.stdout:2/136: mkdir d3/d35 0 2024-09-16T01:25:10.797 INFO:tasks.workunit.client.0.smithi063.stdout:7/111: dwrite d7/d18/f1b [4194304,4194304] 0 2024-09-16T01:25:10.797 INFO:tasks.workunit.client.0.smithi063.stdout:3/93: dread d2/f5 [0,4194304] 0 2024-09-16T01:25:10.801 INFO:tasks.workunit.client.0.smithi063.stdout:6/155: fdatasync d3/d10/f34 0 2024-09-16T01:25:10.804 INFO:tasks.workunit.client.0.smithi063.stdout:2/137: readlink d3/l5 0 2024-09-16T01:25:10.805 INFO:tasks.workunit.client.0.smithi063.stdout:4/180: dwrite d5/f2e [0,4194304] 0 2024-09-16T01:25:10.805 INFO:tasks.workunit.client.0.smithi063.stdout:6/156: fdatasync d3/d10/d35/f3a 0 2024-09-16T01:25:10.805 INFO:tasks.workunit.client.0.smithi063.stdout:9/135: creat d7/d9/d12/d14/f35 x:0 0 0 2024-09-16T01:25:10.806 INFO:tasks.workunit.client.0.smithi063.stdout:1/187: creat d1/f3e x:0 0 0 2024-09-16T01:25:10.809 INFO:tasks.workunit.client.0.smithi063.stdout:1/188: dread - d1/dd/f20 zero size 2024-09-16T01:25:10.883 INFO:tasks.workunit.client.0.smithi063.stdout:7/112: fdatasync d7/d18/f1b 0 2024-09-16T01:25:10.883 INFO:tasks.workunit.client.0.smithi063.stdout:8/63: rename d5/f6 to d5/f10 0 2024-09-16T01:25:10.884 INFO:tasks.workunit.client.0.smithi063.stdout:9/136: write d7/d9/d12/d14/f35 [398835,24272] 0 2024-09-16T01:25:10.885 INFO:tasks.workunit.client.0.smithi063.stdout:5/163: dwrite d5/fe [8388608,4194304] 0 2024-09-16T01:25:10.887 INFO:tasks.workunit.client.0.smithi063.stdout:3/94: dwrite d2/d12/f14 [0,4194304] 0 2024-09-16T01:25:10.889 INFO:tasks.workunit.client.0.smithi063.stdout:9/137: write d7/d9/d12/d14/f29 [865794,11426] 0 2024-09-16T01:25:10.889 INFO:tasks.workunit.client.0.smithi063.stdout:3/95: chown d2/d12/f14 3183254 1 2024-09-16T01:25:10.890 INFO:tasks.workunit.client.0.smithi063.stdout:6/157: link d3/d10/f1d d3/d10/d35/f3f 0 2024-09-16T01:25:10.892 INFO:tasks.workunit.client.0.smithi063.stdout:1/189: rmdir d1/d12/d3c 0 2024-09-16T01:25:10.894 INFO:tasks.workunit.client.0.smithi063.stdout:8/64: dread d5/f8 [0,4194304] 0 2024-09-16T01:25:10.897 INFO:tasks.workunit.client.0.smithi063.stdout:5/164: dread d5/f9 [4194304,4194304] 0 2024-09-16T01:25:10.897 INFO:tasks.workunit.client.0.smithi063.stdout:6/158: chown d3/d10/f34 418 1 2024-09-16T01:25:10.900 INFO:tasks.workunit.client.0.smithi063.stdout:4/181: truncate d5/d9/df/d1c/f31 1835066 0 2024-09-16T01:25:10.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/113: dread d7/ff [0,4194304] 0 2024-09-16T01:25:10.901 INFO:tasks.workunit.client.0.smithi063.stdout:9/138: fsync f4 0 2024-09-16T01:25:10.901 INFO:tasks.workunit.client.0.smithi063.stdout:6/159: dread f2 [0,4194304] 0 2024-09-16T01:25:10.904 INFO:tasks.workunit.client.0.smithi063.stdout:6/160: write d3/d10/f2a [381738,80109] 0 2024-09-16T01:25:10.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/190: write d1/d5/d15/f19 [91201,627] 0 2024-09-16T01:25:10.905 INFO:tasks.workunit.client.0.smithi063.stdout:8/65: dread d5/f10 [0,4194304] 0 2024-09-16T01:25:10.912 INFO:tasks.workunit.client.0.smithi063.stdout:3/96: rename d2/f5 to d2/f1f 0 2024-09-16T01:25:10.912 INFO:tasks.workunit.client.0.smithi063.stdout:7/114: symlink d7/d1c/l24 0 2024-09-16T01:25:10.912 INFO:tasks.workunit.client.0.smithi063.stdout:9/139: creat d7/f36 x:0 0 0 2024-09-16T01:25:10.913 INFO:tasks.workunit.client.0.smithi063.stdout:5/165: mknod d5/d12/d35/c36 0 2024-09-16T01:25:10.915 INFO:tasks.workunit.client.0.smithi063.stdout:5/166: dread f3 [8388608,4194304] 0 2024-09-16T01:25:10.916 INFO:tasks.workunit.client.0.smithi063.stdout:1/191: rename d1/d5/c34 to d1/dd/c3f 0 2024-09-16T01:25:10.916 INFO:tasks.workunit.client.0.smithi063.stdout:7/115: fdatasync d7/f14 0 2024-09-16T01:25:10.919 INFO:tasks.workunit.client.0.smithi063.stdout:0/115: sync 2024-09-16T01:25:10.921 INFO:tasks.workunit.client.0.smithi063.stdout:6/161: creat d3/d30/f40 x:0 0 0 2024-09-16T01:25:10.923 INFO:tasks.workunit.client.0.smithi063.stdout:5/167: dwrite d5/d12/f1e [0,4194304] 0 2024-09-16T01:25:10.923 INFO:tasks.workunit.client.0.smithi063.stdout:3/97: rename d2/f8 to d2/d17/f20 0 2024-09-16T01:25:10.929 INFO:tasks.workunit.client.0.smithi063.stdout:7/116: dwrite d7/d1c/f1d [0,4194304] 0 2024-09-16T01:25:10.929 INFO:tasks.workunit.client.0.smithi063.stdout:0/116: creat d1/d2e/f38 x:0 0 0 2024-09-16T01:25:10.932 INFO:tasks.workunit.client.0.smithi063.stdout:0/117: chown d1/d1c 7738 1 2024-09-16T01:25:10.933 INFO:tasks.workunit.client.0.smithi063.stdout:9/140: link d7/d9/c1b d7/d9/d12/d14/c37 0 2024-09-16T01:25:10.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/162: dread d3/f16 [0,4194304] 0 2024-09-16T01:25:10.937 INFO:tasks.workunit.client.0.smithi063.stdout:8/66: dwrite d5/f8 [0,4194304] 0 2024-09-16T01:25:10.941 INFO:tasks.workunit.client.0.smithi063.stdout:0/118: creat d1/df/d2c/f39 x:0 0 0 2024-09-16T01:25:10.941 INFO:tasks.workunit.client.0.smithi063.stdout:1/192: dread d1/d5/d15/d1b/f2e [0,4194304] 0 2024-09-16T01:25:10.943 INFO:tasks.workunit.client.0.smithi063.stdout:7/117: write d7/f12 [988427,21626] 0 2024-09-16T01:25:10.943 INFO:tasks.workunit.client.0.smithi063.stdout:5/168: rename d5/f22 to d5/d18/f37 0 2024-09-16T01:25:10.943 INFO:tasks.workunit.client.0.smithi063.stdout:6/163: dread d3/f21 [0,4194304] 0 2024-09-16T01:25:10.947 INFO:tasks.workunit.client.0.smithi063.stdout:5/169: dread - d5/d12/f23 zero size 2024-09-16T01:25:10.947 INFO:tasks.workunit.client.0.smithi063.stdout:0/119: write d1/d2e/d32/f19 [2167074,129287] 0 2024-09-16T01:25:10.947 INFO:tasks.workunit.client.0.smithi063.stdout:1/193: creat d1/d12/d16/f40 x:0 0 0 2024-09-16T01:25:10.948 INFO:tasks.workunit.client.0.smithi063.stdout:7/118: chown d7/f10 872941879 1 2024-09-16T01:25:10.949 INFO:tasks.workunit.client.0.smithi063.stdout:3/98: rename d2/c6 to d2/d11/d18/c21 0 2024-09-16T01:25:10.949 INFO:tasks.workunit.client.0.smithi063.stdout:6/164: chown d3/d30/c31 142182 1 2024-09-16T01:25:10.950 INFO:tasks.workunit.client.0.smithi063.stdout:9/141: dwrite d7/d1f/f2c [0,4194304] 0 2024-09-16T01:25:10.951 INFO:tasks.workunit.client.0.smithi063.stdout:7/119: read d7/d1c/f1d [3620474,94230] 0 2024-09-16T01:25:10.951 INFO:tasks.workunit.client.0.smithi063.stdout:0/120: chown d1/fa 542221 1 2024-09-16T01:25:10.953 INFO:tasks.workunit.client.0.smithi063.stdout:6/165: mkdir d3/d41 0 2024-09-16T01:25:10.954 INFO:tasks.workunit.client.0.smithi063.stdout:5/170: truncate d5/d18/f2a 8869769 0 2024-09-16T01:25:10.955 INFO:tasks.workunit.client.0.smithi063.stdout:7/120: chown f5 16007966 1 2024-09-16T01:25:10.958 INFO:tasks.workunit.client.0.smithi063.stdout:6/166: mknod d3/d10/c42 0 2024-09-16T01:25:10.958 INFO:tasks.workunit.client.0.smithi063.stdout:5/171: dread - d5/d18/f37 zero size 2024-09-16T01:25:10.959 INFO:tasks.workunit.client.0.smithi063.stdout:7/121: mkdir d7/d18/d25 0 2024-09-16T01:25:10.959 INFO:tasks.workunit.client.0.smithi063.stdout:8/67: dwrite d5/f7 [0,4194304] 0 2024-09-16T01:25:10.960 INFO:tasks.workunit.client.0.smithi063.stdout:7/122: fsync f2 0 2024-09-16T01:25:10.961 INFO:tasks.workunit.client.0.smithi063.stdout:5/172: stat d5/f15 0 2024-09-16T01:25:10.966 INFO:tasks.workunit.client.0.smithi063.stdout:0/121: link d1/d1c/l28 d1/df/d17/l3a 0 2024-09-16T01:25:10.967 INFO:tasks.workunit.client.0.smithi063.stdout:7/123: rmdir d7/d1c/d1f 39 2024-09-16T01:25:10.967 INFO:tasks.workunit.client.0.smithi063.stdout:3/99: dwrite d2/f10 [0,4194304] 0 2024-09-16T01:25:10.968 INFO:tasks.workunit.client.0.smithi063.stdout:1/194: dwrite d1/d12/d16/f40 [0,4194304] 0 2024-09-16T01:25:10.968 INFO:tasks.workunit.client.0.smithi063.stdout:5/173: truncate d5/fe 11877280 0 2024-09-16T01:25:10.969 INFO:tasks.workunit.client.0.smithi063.stdout:9/142: dread d7/d9/d12/d14/f16 [0,4194304] 0 2024-09-16T01:25:10.970 INFO:tasks.workunit.client.0.smithi063.stdout:7/124: fdatasync d7/d18/f1a 0 2024-09-16T01:25:10.970 INFO:tasks.workunit.client.0.smithi063.stdout:6/167: creat d3/d10/d22/d28/d3e/f43 x:0 0 0 2024-09-16T01:25:10.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/122: chown d1/d2e/f2f 177751 1 2024-09-16T01:25:10.971 INFO:tasks.workunit.client.0.smithi063.stdout:8/68: rename d5/d9/la to d5/d9/l11 0 2024-09-16T01:25:10.971 INFO:tasks.workunit.client.0.smithi063.stdout:9/143: dread - d7/f22 zero size 2024-09-16T01:25:10.971 INFO:tasks.workunit.client.0.smithi063.stdout:3/100: rmdir d2/d17 39 2024-09-16T01:25:10.972 INFO:tasks.workunit.client.0.smithi063.stdout:6/168: chown d3/c4 129504 1 2024-09-16T01:25:10.974 INFO:tasks.workunit.client.0.smithi063.stdout:6/169: write d3/d10/d35/f3c [1528748,46765] 0 2024-09-16T01:25:10.975 INFO:tasks.workunit.client.0.smithi063.stdout:8/69: fdatasync d5/fc 0 2024-09-16T01:25:10.977 INFO:tasks.workunit.client.0.smithi063.stdout:5/174: fsync d5/fe 0 2024-09-16T01:25:10.978 INFO:tasks.workunit.client.0.smithi063.stdout:9/144: mkdir d7/d9/d12/d14/d38 0 2024-09-16T01:25:10.978 INFO:tasks.workunit.client.0.smithi063.stdout:8/70: write d5/f8 [1525294,117935] 0 2024-09-16T01:25:10.983 INFO:tasks.workunit.client.0.smithi063.stdout:7/125: creat d7/d1c/d1f/f26 x:0 0 0 2024-09-16T01:25:10.983 INFO:tasks.workunit.client.0.smithi063.stdout:0/123: dwrite d1/fc [0,4194304] 0 2024-09-16T01:25:10.984 INFO:tasks.workunit.client.0.smithi063.stdout:1/195: creat d1/d12/f41 x:0 0 0 2024-09-16T01:25:10.986 INFO:tasks.workunit.client.0.smithi063.stdout:6/170: mkdir d3/d10/d22/d28/d3e/d44 0 2024-09-16T01:25:10.988 INFO:tasks.workunit.client.0.smithi063.stdout:9/145: creat d7/d9/d12/f39 x:0 0 0 2024-09-16T01:25:10.991 INFO:tasks.workunit.client.0.smithi063.stdout:3/101: creat d2/f22 x:0 0 0 2024-09-16T01:25:10.994 INFO:tasks.workunit.client.0.smithi063.stdout:6/171: symlink d3/d10/d22/d28/l45 0 2024-09-16T01:25:10.996 INFO:tasks.workunit.client.0.smithi063.stdout:8/71: dwrite d5/f7 [0,4194304] 0 2024-09-16T01:25:10.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/196: creat d1/d5/d15/d18/f42 x:0 0 0 2024-09-16T01:25:10.998 INFO:tasks.workunit.client.0.smithi063.stdout:8/72: stat d5/f7 0 2024-09-16T01:25:10.999 INFO:tasks.workunit.client.0.smithi063.stdout:9/146: creat d7/d9/d12/d14/d38/f3a x:0 0 0 2024-09-16T01:25:11.000 INFO:tasks.workunit.client.0.smithi063.stdout:7/126: dwrite d7/f12 [0,4194304] 0 2024-09-16T01:25:11.000 INFO:tasks.workunit.client.0.smithi063.stdout:9/147: chown d7 19710 1 2024-09-16T01:25:11.001 INFO:tasks.workunit.client.0.smithi063.stdout:3/102: creat d2/f23 x:0 0 0 2024-09-16T01:25:11.004 INFO:tasks.workunit.client.0.smithi063.stdout:7/127: fdatasync d7/d1c/d1f/f26 0 2024-09-16T01:25:11.008 INFO:tasks.workunit.client.0.smithi063.stdout:9/148: creat d7/d9/d20/f3b x:0 0 0 2024-09-16T01:25:11.009 INFO:tasks.workunit.client.0.smithi063.stdout:1/197: rename d1/d5/d15/c30 to d1/d12/d21/c43 0 2024-09-16T01:25:11.011 INFO:tasks.workunit.client.0.smithi063.stdout:5/175: dwrite d5/d18/d29/f2f [0,4194304] 0 2024-09-16T01:25:11.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/128: symlink d7/d18/d25/l27 0 2024-09-16T01:25:11.013 INFO:tasks.workunit.client.0.smithi063.stdout:9/149: write d7/d9/f28 [903101,34420] 0 2024-09-16T01:25:11.014 INFO:tasks.workunit.client.0.smithi063.stdout:3/103: dread d2/f1f [0,4194304] 0 2024-09-16T01:25:11.014 INFO:tasks.workunit.client.0.smithi063.stdout:1/198: write d1/f3e [400654,24668] 0 2024-09-16T01:25:11.015 INFO:tasks.workunit.client.0.smithi063.stdout:8/73: dread d5/f7 [0,4194304] 0 2024-09-16T01:25:11.019 INFO:tasks.workunit.client.0.smithi063.stdout:0/124: dwrite d1/fa [0,4194304] 0 2024-09-16T01:25:11.019 INFO:tasks.workunit.client.0.smithi063.stdout:6/172: dread d3/d10/d22/f26 [0,4194304] 0 2024-09-16T01:25:11.022 INFO:tasks.workunit.client.0.smithi063.stdout:5/176: write d5/d12/f21 [589684,52906] 0 2024-09-16T01:25:11.022 INFO:tasks.workunit.client.0.smithi063.stdout:9/150: fdatasync d7/d9/d12/d14/f1c 0 2024-09-16T01:25:11.022 INFO:tasks.workunit.client.0.smithi063.stdout:7/129: unlink d7/d1c/l24 0 2024-09-16T01:25:11.024 INFO:tasks.workunit.client.0.smithi063.stdout:6/173: chown d3/d10/l17 352 1 2024-09-16T01:25:11.024 INFO:tasks.workunit.client.0.smithi063.stdout:3/104: mknod d2/d17/c24 0 2024-09-16T01:25:11.024 INFO:tasks.workunit.client.0.smithi063.stdout:8/74: chown d5/d9/l11 9902 1 2024-09-16T01:25:11.026 INFO:tasks.workunit.client.0.smithi063.stdout:4/182: sync 2024-09-16T01:25:11.026 INFO:tasks.workunit.client.0.smithi063.stdout:2/138: sync 2024-09-16T01:25:11.027 INFO:tasks.workunit.client.0.smithi063.stdout:9/151: chown d7/d9/d12/f33 18113 1 2024-09-16T01:25:11.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/105: fsync d2/d11/f1d 0 2024-09-16T01:25:11.029 INFO:tasks.workunit.client.0.smithi063.stdout:6/174: mknod d3/d30/d39/c46 0 2024-09-16T01:25:11.031 INFO:tasks.workunit.client.0.smithi063.stdout:5/177: creat d5/f38 x:0 0 0 2024-09-16T01:25:11.032 INFO:tasks.workunit.client.0.smithi063.stdout:3/106: unlink d2/d12/f14 0 2024-09-16T01:25:11.036 INFO:tasks.workunit.client.0.smithi063.stdout:3/107: dread - d2/f23 zero size 2024-09-16T01:25:11.038 INFO:tasks.workunit.client.0.smithi063.stdout:7/130: dwrite d7/d1c/d1f/f26 [0,4194304] 0 2024-09-16T01:25:11.038 INFO:tasks.workunit.client.0.smithi063.stdout:3/108: dread - d2/f22 zero size 2024-09-16T01:25:11.039 INFO:tasks.workunit.client.0.smithi063.stdout:9/152: getdents d7/d9 0 2024-09-16T01:25:11.040 INFO:tasks.workunit.client.0.smithi063.stdout:8/75: truncate d5/f10 1054193 0 2024-09-16T01:25:11.041 INFO:tasks.workunit.client.0.smithi063.stdout:2/139: dwrite d3/f6 [0,4194304] 0 2024-09-16T01:25:11.043 INFO:tasks.workunit.client.0.smithi063.stdout:1/199: truncate d1/d5/d15/f19 520245 0 2024-09-16T01:25:11.044 INFO:tasks.workunit.client.0.smithi063.stdout:3/109: write d2/f23 [774405,88185] 0 2024-09-16T01:25:11.044 INFO:tasks.workunit.client.0.smithi063.stdout:7/131: write d7/d18/f1b [3888685,6947] 0 2024-09-16T01:25:11.047 INFO:tasks.workunit.client.0.smithi063.stdout:7/132: readlink d7/la 0 2024-09-16T01:25:11.048 INFO:tasks.workunit.client.0.smithi063.stdout:2/140: read d3/d7/d8/f27 [1357702,63209] 0 2024-09-16T01:25:11.049 INFO:tasks.workunit.client.0.smithi063.stdout:5/178: link d5/d12/f2d d5/d18/f39 0 2024-09-16T01:25:11.050 INFO:tasks.workunit.client.0.smithi063.stdout:8/76: rmdir d5/db 39 2024-09-16T01:25:11.050 INFO:tasks.workunit.client.0.smithi063.stdout:3/110: mknod d2/d17/c25 0 2024-09-16T01:25:11.051 INFO:tasks.workunit.client.0.smithi063.stdout:3/111: fdatasync d2/f10 0 2024-09-16T01:25:11.052 INFO:tasks.workunit.client.0.smithi063.stdout:0/125: dread d1/df/d17/f22 [4194304,4194304] 0 2024-09-16T01:25:11.053 INFO:tasks.workunit.client.0.smithi063.stdout:3/112: dread d2/f19 [0,4194304] 0 2024-09-16T01:25:11.054 INFO:tasks.workunit.client.0.smithi063.stdout:3/113: read d2/f19 [1618274,20342] 0 2024-09-16T01:25:11.058 INFO:tasks.workunit.client.0.smithi063.stdout:1/200: creat d1/dd/d3b/f44 x:0 0 0 2024-09-16T01:25:11.060 INFO:tasks.workunit.client.0.smithi063.stdout:0/126: symlink d1/df/d2c/l3b 0 2024-09-16T01:25:11.061 INFO:tasks.workunit.client.0.smithi063.stdout:3/114: creat d2/d11/f26 x:0 0 0 2024-09-16T01:25:11.062 INFO:tasks.workunit.client.0.smithi063.stdout:9/153: link d7/d9/l18 d7/d9/d12/d14/d23/l3c 0 2024-09-16T01:25:11.062 INFO:tasks.workunit.client.0.smithi063.stdout:3/115: chown d2/d12 354128 1 2024-09-16T01:25:11.063 INFO:tasks.workunit.client.0.smithi063.stdout:0/127: chown d1/df/d17/c15 13239 1 2024-09-16T01:25:11.064 INFO:tasks.workunit.client.0.smithi063.stdout:2/141: dwrite d3/d7/d8/d19/f24 [0,4194304] 0 2024-09-16T01:25:11.064 INFO:tasks.workunit.client.0.smithi063.stdout:3/116: stat d2/f19 0 2024-09-16T01:25:11.065 INFO:tasks.workunit.client.0.smithi063.stdout:0/128: write d1/f31 [30573,73731] 0 2024-09-16T01:25:11.066 INFO:tasks.workunit.client.0.smithi063.stdout:9/154: truncate d7/d9/f2a 320115 0 2024-09-16T01:25:11.067 INFO:tasks.workunit.client.0.smithi063.stdout:5/179: link d5/ca d5/d18/d29/c3a 0 2024-09-16T01:25:11.067 INFO:tasks.workunit.client.0.smithi063.stdout:7/133: getdents d7/d1c/d1f 0 2024-09-16T01:25:11.086 INFO:tasks.workunit.client.0.smithi063.stdout:3/117: creat d2/d11/d18/f27 x:0 0 0 2024-09-16T01:25:11.086 INFO:tasks.workunit.client.0.smithi063.stdout:1/201: link d1/d5/cc d1/d12/d21/c45 0 2024-09-16T01:25:11.086 INFO:tasks.workunit.client.0.smithi063.stdout:2/142: rename d3/d7/d8/d1f/c31 to d3/d7/c36 0 2024-09-16T01:25:11.087 INFO:tasks.workunit.client.0.smithi063.stdout:9/155: mknod d7/d9/d12/d14/d23/c3d 0 2024-09-16T01:25:11.087 INFO:tasks.workunit.client.0.smithi063.stdout:8/77: write d5/f10 [1202979,122611] 0 2024-09-16T01:25:11.087 INFO:tasks.workunit.client.0.smithi063.stdout:2/143: write f0 [1812056,36354] 0 2024-09-16T01:25:11.089 INFO:tasks.workunit.client.0.smithi063.stdout:7/134: creat d7/d1c/d1f/f28 x:0 0 0 2024-09-16T01:25:11.089 INFO:tasks.workunit.client.0.smithi063.stdout:8/78: write d5/f8 [3783313,110419] 0 2024-09-16T01:25:11.090 INFO:tasks.workunit.client.0.smithi063.stdout:3/118: write d2/f1f [917992,121587] 0 2024-09-16T01:25:11.091 INFO:tasks.workunit.client.0.smithi063.stdout:3/119: write f0 [2169800,10421] 0 2024-09-16T01:25:11.093 INFO:tasks.workunit.client.0.smithi063.stdout:2/144: write f2 [5185684,99411] 0 2024-09-16T01:25:11.094 INFO:tasks.workunit.client.0.smithi063.stdout:1/202: rename d1/d12/d16/f40 to d1/d12/d21/f46 0 2024-09-16T01:25:11.094 INFO:tasks.workunit.client.0.smithi063.stdout:7/135: dread d7/ff [0,4194304] 0 2024-09-16T01:25:11.095 INFO:tasks.workunit.client.0.smithi063.stdout:5/180: creat d5/f3b x:0 0 0 2024-09-16T01:25:11.095 INFO:tasks.workunit.client.0.smithi063.stdout:7/136: dread - d7/d1c/d1f/f28 zero size 2024-09-16T01:25:11.096 INFO:tasks.workunit.client.0.smithi063.stdout:7/137: chown d7/d18/c1e 3 1 2024-09-16T01:25:11.097 INFO:tasks.workunit.client.0.smithi063.stdout:0/129: link d1/d1c/c1e d1/df/d17/c3c 0 2024-09-16T01:25:11.103 INFO:tasks.workunit.client.0.smithi063.stdout:9/156: rename d7/d9/ce to d7/d9/d12/d14/c3e 0 2024-09-16T01:25:11.103 INFO:tasks.workunit.client.0.smithi063.stdout:9/157: fsync f5 0 2024-09-16T01:25:11.109 INFO:tasks.workunit.client.0.smithi063.stdout:8/79: mkdir d5/db/d12 0 2024-09-16T01:25:11.110 INFO:tasks.workunit.client.0.smithi063.stdout:7/138: mkdir d7/d1c/d1f/d29 0 2024-09-16T01:25:11.111 INFO:tasks.workunit.client.0.smithi063.stdout:3/120: truncate d2/f10 4157752 0 2024-09-16T01:25:11.112 INFO:tasks.workunit.client.0.smithi063.stdout:2/145: dread d3/d7/d8/d1f/f23 [0,4194304] 0 2024-09-16T01:25:11.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/158: unlink d7/d1f/l25 0 2024-09-16T01:25:11.114 INFO:tasks.workunit.client.0.smithi063.stdout:1/203: mknod d1/d5/d15/d1b/d31/c47 0 2024-09-16T01:25:11.115 INFO:tasks.workunit.client.0.smithi063.stdout:5/181: mkdir d5/d18/d29/d3c 0 2024-09-16T01:25:11.116 INFO:tasks.workunit.client.0.smithi063.stdout:1/204: dread - d1/d12/f41 zero size 2024-09-16T01:25:11.117 INFO:tasks.workunit.client.0.smithi063.stdout:8/80: mknod d5/db/c13 0 2024-09-16T01:25:11.118 INFO:tasks.workunit.client.0.smithi063.stdout:0/130: dwrite d1/d2e/d32/f1f [0,4194304] 0 2024-09-16T01:25:11.121 INFO:tasks.workunit.client.0.smithi063.stdout:2/146: mkdir d3/d7/d8/d1f/d37 0 2024-09-16T01:25:11.122 INFO:tasks.workunit.client.0.smithi063.stdout:5/182: creat d5/d12/d35/f3d x:0 0 0 2024-09-16T01:25:11.123 INFO:tasks.workunit.client.0.smithi063.stdout:1/205: mknod d1/dd/c48 0 2024-09-16T01:25:11.126 INFO:tasks.workunit.client.0.smithi063.stdout:9/159: dwrite d7/d1f/f2f [0,4194304] 0 2024-09-16T01:25:11.127 INFO:tasks.workunit.client.0.smithi063.stdout:3/121: rename c1 to d2/d11/d18/c28 0 2024-09-16T01:25:11.128 INFO:tasks.workunit.client.0.smithi063.stdout:2/147: mknod d3/d7/de/d21/d28/c38 0 2024-09-16T01:25:11.130 INFO:tasks.workunit.client.0.smithi063.stdout:1/206: fsync d1/d5/f11 0 2024-09-16T01:25:11.130 INFO:tasks.workunit.client.0.smithi063.stdout:3/122: readlink d2/d11/l1a 0 2024-09-16T01:25:11.134 INFO:tasks.workunit.client.0.smithi063.stdout:8/81: dread d5/f7 [0,4194304] 0 2024-09-16T01:25:11.134 INFO:tasks.workunit.client.0.smithi063.stdout:5/183: link d5/d12/c14 d5/d12/d35/c3e 0 2024-09-16T01:25:11.137 INFO:tasks.workunit.client.0.smithi063.stdout:0/131: dwrite d1/fa [0,4194304] 0 2024-09-16T01:25:11.137 INFO:tasks.workunit.client.0.smithi063.stdout:5/184: fdatasync d5/d12/f23 0 2024-09-16T01:25:11.139 INFO:tasks.workunit.client.0.smithi063.stdout:9/160: getdents d7/d9/d12/d14/d23 0 2024-09-16T01:25:11.139 INFO:tasks.workunit.client.0.smithi063.stdout:7/139: dwrite d7/f9 [4194304,4194304] 0 2024-09-16T01:25:11.140 INFO:tasks.workunit.client.0.smithi063.stdout:1/207: mknod d1/d5/d15/c49 0 2024-09-16T01:25:11.142 INFO:tasks.workunit.client.0.smithi063.stdout:5/185: chown d5/d18/l2c 223468976 1 2024-09-16T01:25:11.147 INFO:tasks.workunit.client.0.smithi063.stdout:9/161: read d7/d9/d12/d14/f29 [506416,106766] 0 2024-09-16T01:25:11.147 INFO:tasks.workunit.client.0.smithi063.stdout:5/186: readlink d5/d18/l27 0 2024-09-16T01:25:11.148 INFO:tasks.workunit.client.0.smithi063.stdout:1/208: chown d1/d5/d15/f29 3 1 2024-09-16T01:25:11.149 INFO:tasks.workunit.client.0.smithi063.stdout:3/123: dread d2/d17/f20 [0,4194304] 0 2024-09-16T01:25:11.150 INFO:tasks.workunit.client.0.smithi063.stdout:2/148: dwrite d3/d7/de/d21/f2d [0,4194304] 0 2024-09-16T01:25:11.154 INFO:tasks.workunit.client.0.smithi063.stdout:9/162: creat d7/d1f/f3f x:0 0 0 2024-09-16T01:25:11.155 INFO:tasks.workunit.client.0.smithi063.stdout:1/209: unlink d1/d12/d21/c17 0 2024-09-16T01:25:11.156 INFO:tasks.workunit.client.0.smithi063.stdout:8/82: dwrite d5/f8 [0,4194304] 0 2024-09-16T01:25:11.156 INFO:tasks.workunit.client.0.smithi063.stdout:5/187: symlink d5/d18/l3f 0 2024-09-16T01:25:11.158 INFO:tasks.workunit.client.0.smithi063.stdout:3/124: rename d2/f23 to d2/d11/f29 0 2024-09-16T01:25:11.159 INFO:tasks.workunit.client.0.smithi063.stdout:2/149: write d3/d7/d8/f20 [4083837,73052] 0 2024-09-16T01:25:11.159 INFO:tasks.workunit.client.0.smithi063.stdout:0/132: dwrite d1/f31 [0,4194304] 0 2024-09-16T01:25:11.160 INFO:tasks.workunit.client.0.smithi063.stdout:5/188: stat d5/d12/f1c 0 2024-09-16T01:25:11.165 INFO:tasks.workunit.client.0.smithi063.stdout:3/125: fdatasync d2/d11/f26 0 2024-09-16T01:25:11.165 INFO:tasks.workunit.client.0.smithi063.stdout:2/150: chown d3/d7/de/d21/d28 32492594 1 2024-09-16T01:25:11.166 INFO:tasks.workunit.client.0.smithi063.stdout:9/163: mkdir d7/d9/d12/d14/d40 0 2024-09-16T01:25:11.168 INFO:tasks.workunit.client.0.smithi063.stdout:5/189: creat d5/d12/f40 x:0 0 0 2024-09-16T01:25:11.169 INFO:tasks.workunit.client.0.smithi063.stdout:3/126: dread d2/f19 [0,4194304] 0 2024-09-16T01:25:11.170 INFO:tasks.workunit.client.0.smithi063.stdout:8/83: symlink d5/db/l14 0 2024-09-16T01:25:11.170 INFO:tasks.workunit.client.0.smithi063.stdout:1/210: mknod d1/d5/d15/c4a 0 2024-09-16T01:25:11.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/164: write d7/d9/d12/f2e [2118146,82674] 0 2024-09-16T01:25:11.173 INFO:tasks.workunit.client.0.smithi063.stdout:5/190: creat d5/d12/f41 x:0 0 0 2024-09-16T01:25:11.173 INFO:tasks.workunit.client.0.smithi063.stdout:2/151: getdents d3/d7/d8/d1f/d32 0 2024-09-16T01:25:11.174 INFO:tasks.workunit.client.0.smithi063.stdout:9/165: dread - d7/f36 zero size 2024-09-16T01:25:11.175 INFO:tasks.workunit.client.0.smithi063.stdout:5/191: dread - d5/f31 zero size 2024-09-16T01:25:11.176 INFO:tasks.workunit.client.0.smithi063.stdout:2/152: chown d3/d7/d8/d19/f24 916217 1 2024-09-16T01:25:11.176 INFO:tasks.workunit.client.0.smithi063.stdout:1/211: mkdir d1/d5/d15/d18/d4b 0 2024-09-16T01:25:11.177 INFO:tasks.workunit.client.0.smithi063.stdout:2/153: chown d3/d7/f26 839333394 1 2024-09-16T01:25:11.178 INFO:tasks.workunit.client.0.smithi063.stdout:8/84: creat d5/db/d12/f15 x:0 0 0 2024-09-16T01:25:11.178 INFO:tasks.workunit.client.0.smithi063.stdout:2/154: chown d3/d7/de/d21/d28/c30 0 1 2024-09-16T01:25:11.180 INFO:tasks.workunit.client.0.smithi063.stdout:3/127: rename d2/d11/d18/cb to d2/c2a 0 2024-09-16T01:25:11.181 INFO:tasks.workunit.client.0.smithi063.stdout:1/212: mkdir d1/d5/d15/d18/d4c 0 2024-09-16T01:25:11.182 INFO:tasks.workunit.client.0.smithi063.stdout:8/85: creat d5/d9/f16 x:0 0 0 2024-09-16T01:25:11.183 INFO:tasks.workunit.client.0.smithi063.stdout:9/166: symlink d7/d9/d12/d14/d34/l41 0 2024-09-16T01:25:11.184 INFO:tasks.workunit.client.0.smithi063.stdout:2/155: write d3/d7/d8/f18 [1537956,53875] 0 2024-09-16T01:25:11.184 INFO:tasks.workunit.client.0.smithi063.stdout:9/167: write d7/d9/f13 [490860,117626] 0 2024-09-16T01:25:11.185 INFO:tasks.workunit.client.0.smithi063.stdout:3/128: mknod d2/d17/c2b 0 2024-09-16T01:25:11.186 INFO:tasks.workunit.client.0.smithi063.stdout:1/213: rmdir d1 39 2024-09-16T01:25:11.187 INFO:tasks.workunit.client.0.smithi063.stdout:8/86: write d5/f7 [4117045,78862] 0 2024-09-16T01:25:11.187 INFO:tasks.workunit.client.0.smithi063.stdout:3/129: write d2/d11/d18/fc [3338821,42314] 0 2024-09-16T01:25:11.188 INFO:tasks.workunit.client.0.smithi063.stdout:5/192: getdents d5/d12/d35 0 2024-09-16T01:25:11.189 INFO:tasks.workunit.client.0.smithi063.stdout:9/168: creat d7/d9/d12/f42 x:0 0 0 2024-09-16T01:25:11.191 INFO:tasks.workunit.client.0.smithi063.stdout:3/130: truncate d2/d11/f1d 738424 0 2024-09-16T01:25:11.192 INFO:tasks.workunit.client.0.smithi063.stdout:9/169: read d7/d1f/f2c [2557379,95201] 0 2024-09-16T01:25:11.194 INFO:tasks.workunit.client.0.smithi063.stdout:9/170: stat d7/d9/d12/l19 0 2024-09-16T01:25:11.194 INFO:tasks.workunit.client.0.smithi063.stdout:2/156: dwrite f2 [0,4194304] 0 2024-09-16T01:25:11.195 INFO:tasks.workunit.client.0.smithi063.stdout:3/131: read d2/f1f [364202,45246] 0 2024-09-16T01:25:11.196 INFO:tasks.workunit.client.0.smithi063.stdout:1/214: creat d1/d12/d16/f4d x:0 0 0 2024-09-16T01:25:11.198 INFO:tasks.workunit.client.0.smithi063.stdout:5/193: link d5/fe d5/d18/f42 0 2024-09-16T01:25:11.199 INFO:tasks.workunit.client.0.smithi063.stdout:3/132: chown d2/d17/c24 0 1 2024-09-16T01:25:11.200 INFO:tasks.workunit.client.0.smithi063.stdout:8/87: fsync d5/d9/f16 0 2024-09-16T01:25:11.200 INFO:tasks.workunit.client.0.smithi063.stdout:9/171: mknod d7/d9/d12/d14/c43 0 2024-09-16T01:25:11.200 INFO:tasks.workunit.client.0.smithi063.stdout:0/133: dwrite d1/f11 [0,4194304] 0 2024-09-16T01:25:11.202 INFO:tasks.workunit.client.0.smithi063.stdout:1/215: chown d1/d12/d16/c1d 13 1 2024-09-16T01:25:11.203 INFO:tasks.workunit.client.0.smithi063.stdout:3/133: mknod d2/c2c 0 2024-09-16T01:25:11.204 INFO:tasks.workunit.client.0.smithi063.stdout:8/88: symlink d5/db/l17 0 2024-09-16T01:25:11.204 INFO:tasks.workunit.client.0.smithi063.stdout:1/216: chown d1/d12/d16/c1d 715394821 1 2024-09-16T01:25:11.205 INFO:tasks.workunit.client.0.smithi063.stdout:5/194: rename d5/d12/f41 to d5/d12/f43 0 2024-09-16T01:25:11.207 INFO:tasks.workunit.client.0.smithi063.stdout:5/195: readlink d5/d18/l30 0 2024-09-16T01:25:11.208 INFO:tasks.workunit.client.0.smithi063.stdout:9/172: rename d7/d9/d12/d14/f17 to d7/d1f/f44 0 2024-09-16T01:25:11.208 INFO:tasks.workunit.client.0.smithi063.stdout:3/134: write d2/d11/d18/fc [585181,55992] 0 2024-09-16T01:25:11.208 INFO:tasks.workunit.client.0.smithi063.stdout:8/89: write d5/f7 [1756633,116616] 0 2024-09-16T01:25:11.208 INFO:tasks.workunit.client.0.smithi063.stdout:2/157: dread f0 [0,4194304] 0 2024-09-16T01:25:11.210 INFO:tasks.workunit.client.0.smithi063.stdout:3/135: write f0 [723587,76013] 0 2024-09-16T01:25:11.211 INFO:tasks.workunit.client.0.smithi063.stdout:1/217: creat d1/d5/d15/d1b/d31/f4e x:0 0 0 2024-09-16T01:25:11.211 INFO:tasks.workunit.client.0.smithi063.stdout:0/134: dread d1/df/d17/f22 [0,4194304] 0 2024-09-16T01:25:11.212 INFO:tasks.workunit.client.0.smithi063.stdout:8/90: mknod d5/db/d12/c18 0 2024-09-16T01:25:11.214 INFO:tasks.workunit.client.0.smithi063.stdout:0/135: dread - d1/d2e/f2f zero size 2024-09-16T01:25:11.214 INFO:tasks.workunit.client.0.smithi063.stdout:8/91: rename d5 to d5/d9/d19 22 2024-09-16T01:25:11.215 INFO:tasks.workunit.client.0.smithi063.stdout:1/218: read d1/d12/d16/f37 [277835,71454] 0 2024-09-16T01:25:11.215 INFO:tasks.workunit.client.0.smithi063.stdout:3/136: creat d2/d11/d18/f2d x:0 0 0 2024-09-16T01:25:11.216 INFO:tasks.workunit.client.0.smithi063.stdout:9/173: creat d7/d9/d12/d14/d40/f45 x:0 0 0 2024-09-16T01:25:11.217 INFO:tasks.workunit.client.0.smithi063.stdout:5/196: truncate d5/fe 7697202 0 2024-09-16T01:25:11.219 INFO:tasks.workunit.client.0.smithi063.stdout:1/219: readlink d1/d5/d15/l3a 0 2024-09-16T01:25:11.219 INFO:tasks.workunit.client.0.smithi063.stdout:8/92: mkdir d5/db/d12/d1a 0 2024-09-16T01:25:11.221 INFO:tasks.workunit.client.0.smithi063.stdout:0/136: creat d1/d2e/d32/f3d x:0 0 0 2024-09-16T01:25:11.225 INFO:tasks.workunit.client.0.smithi063.stdout:2/158: dwrite d3/d7/de/d21/f2d [4194304,4194304] 0 2024-09-16T01:25:11.225 INFO:tasks.workunit.client.0.smithi063.stdout:8/93: stat d5/db/d12/c18 0 2024-09-16T01:25:11.225 INFO:tasks.workunit.client.0.smithi063.stdout:3/137: write d2/d11/f29 [1797450,27119] 0 2024-09-16T01:25:11.229 INFO:tasks.workunit.client.0.smithi063.stdout:3/138: chown d2/d11 6 1 2024-09-16T01:25:11.229 INFO:tasks.workunit.client.0.smithi063.stdout:2/159: chown f0 88 1 2024-09-16T01:25:11.231 INFO:tasks.workunit.client.0.smithi063.stdout:8/94: dread d5/fc [0,4194304] 0 2024-09-16T01:25:11.236 INFO:tasks.workunit.client.0.smithi063.stdout:0/137: rename d1/d2e/f38 to d1/d2e/d32/f3e 0 2024-09-16T01:25:11.238 INFO:tasks.workunit.client.0.smithi063.stdout:9/174: dwrite d7/d9/d12/d14/d40/f45 [0,4194304] 0 2024-09-16T01:25:11.239 INFO:tasks.workunit.client.0.smithi063.stdout:0/138: stat d1/d2e/d32/c26 0 2024-09-16T01:25:11.240 INFO:tasks.workunit.client.0.smithi063.stdout:3/139: symlink d2/d11/l2e 0 2024-09-16T01:25:11.241 INFO:tasks.workunit.client.0.smithi063.stdout:1/220: dwrite d1/d12/f41 [0,4194304] 0 2024-09-16T01:25:11.245 INFO:tasks.workunit.client.0.smithi063.stdout:2/160: getdents d3/d35 0 2024-09-16T01:25:11.245 INFO:tasks.workunit.client.0.smithi063.stdout:9/175: creat d7/d9/d12/d14/f46 x:0 0 0 2024-09-16T01:25:11.246 INFO:tasks.workunit.client.0.smithi063.stdout:3/140: creat d2/d12/f2f x:0 0 0 2024-09-16T01:25:11.247 INFO:tasks.workunit.client.0.smithi063.stdout:5/197: dread d5/d12/f21 [0,4194304] 0 2024-09-16T01:25:11.248 INFO:tasks.workunit.client.0.smithi063.stdout:1/221: dread - d1/dd/d3b/f44 zero size 2024-09-16T01:25:11.250 INFO:tasks.workunit.client.0.smithi063.stdout:9/176: write d7/d9/f28 [1729472,21375] 0 2024-09-16T01:25:11.252 INFO:tasks.workunit.client.0.smithi063.stdout:5/198: unlink d5/c16 0 2024-09-16T01:25:11.252 INFO:tasks.workunit.client.0.smithi063.stdout:8/95: dwrite d5/f7 [0,4194304] 0 2024-09-16T01:25:11.255 INFO:tasks.workunit.client.0.smithi063.stdout:9/177: chown d7/d1f/f44 247 1 2024-09-16T01:25:11.256 INFO:tasks.workunit.client.0.smithi063.stdout:3/141: unlink d2/d11/d18/c28 0 2024-09-16T01:25:11.257 INFO:tasks.workunit.client.0.smithi063.stdout:8/96: chown d5/f8 0 1 2024-09-16T01:25:11.259 INFO:tasks.workunit.client.0.smithi063.stdout:1/222: truncate d1/d12/d16/f37 1092367 0 2024-09-16T01:25:11.259 INFO:tasks.workunit.client.0.smithi063.stdout:0/139: dwrite d1/f35 [0,4194304] 0 2024-09-16T01:25:11.259 INFO:tasks.workunit.client.0.smithi063.stdout:9/178: chown d7/d9/d12/f2e 3192 1 2024-09-16T01:25:11.262 INFO:tasks.workunit.client.0.smithi063.stdout:8/97: symlink d5/l1b 0 2024-09-16T01:25:11.263 INFO:tasks.workunit.client.0.smithi063.stdout:9/179: dread - d7/d9/d12/f39 zero size 2024-09-16T01:25:11.264 INFO:tasks.workunit.client.0.smithi063.stdout:0/140: creat d1/d1c/f3f x:0 0 0 2024-09-16T01:25:11.265 INFO:tasks.workunit.client.0.smithi063.stdout:1/223: symlink d1/d5/l4f 0 2024-09-16T01:25:11.267 INFO:tasks.workunit.client.0.smithi063.stdout:5/199: dwrite d5/f3b [0,4194304] 0 2024-09-16T01:25:11.268 INFO:tasks.workunit.client.0.smithi063.stdout:9/180: truncate d7/d9/d20/f21 9078099 0 2024-09-16T01:25:11.268 INFO:tasks.workunit.client.0.smithi063.stdout:2/161: dread d3/d7/f22 [0,4194304] 0 2024-09-16T01:25:11.268 INFO:tasks.workunit.client.0.smithi063.stdout:1/224: truncate d1/d5/d15/d18/f42 168247 0 2024-09-16T01:25:11.269 INFO:tasks.workunit.client.0.smithi063.stdout:3/142: getdents d2/d17 0 2024-09-16T01:25:11.270 INFO:tasks.workunit.client.0.smithi063.stdout:8/98: symlink d5/db/d12/d1a/l1c 0 2024-09-16T01:25:11.309 INFO:tasks.workunit.client.0.smithi063.stdout:0/141: creat d1/df/f40 x:0 0 0 2024-09-16T01:25:11.310 INFO:tasks.workunit.client.0.smithi063.stdout:4/183: sync 2024-09-16T01:25:11.310 INFO:tasks.workunit.client.0.smithi063.stdout:8/99: chown d5/d9/le 2 1 2024-09-16T01:25:11.310 INFO:tasks.workunit.client.0.smithi063.stdout:3/143: mkdir d2/d12/d30 0 2024-09-16T01:25:11.347 INFO:tasks.workunit.client.0.smithi063.stdout:9/181: dwrite d7/d9/d12/f33 [0,4194304] 0 2024-09-16T01:25:11.348 INFO:tasks.workunit.client.0.smithi063.stdout:3/144: write f0 [4848436,93140] 0 2024-09-16T01:25:11.349 INFO:tasks.workunit.client.0.smithi063.stdout:1/225: dread d1/f3 [0,4194304] 0 2024-09-16T01:25:11.353 INFO:tasks.workunit.client.0.smithi063.stdout:3/145: creat d2/d17/f31 x:0 0 0 2024-09-16T01:25:11.353 INFO:tasks.workunit.client.0.smithi063.stdout:1/226: mkdir d1/dd/d3b/d50 0 2024-09-16T01:25:11.354 INFO:tasks.workunit.client.0.smithi063.stdout:4/184: rename d5/d9 to d5/d3b 0 2024-09-16T01:25:11.354 INFO:tasks.workunit.client.0.smithi063.stdout:0/142: dwrite d1/f31 [0,4194304] 0 2024-09-16T01:25:11.355 INFO:tasks.workunit.client.0.smithi063.stdout:2/162: dwrite d3/d7/d8/d1f/f23 [0,4194304] 0 2024-09-16T01:25:11.355 INFO:tasks.workunit.client.0.smithi063.stdout:8/100: dread d5/f8 [0,4194304] 0 2024-09-16T01:25:11.355 INFO:tasks.workunit.client.0.smithi063.stdout:9/182: link d7/d1f/f3f d7/d9/d12/d14/d23/f47 0 2024-09-16T01:25:11.357 INFO:tasks.workunit.client.0.smithi063.stdout:4/185: fsync d5/f2e 0 2024-09-16T01:25:11.357 INFO:tasks.workunit.client.0.smithi063.stdout:2/163: dread - d3/d7/f16 zero size 2024-09-16T01:25:11.359 INFO:tasks.workunit.client.0.smithi063.stdout:3/146: truncate d2/f1f 1614171 0 2024-09-16T01:25:11.359 INFO:tasks.workunit.client.0.smithi063.stdout:0/143: read d1/d2e/d32/f1f [3049434,38034] 0 2024-09-16T01:25:11.359 INFO:tasks.workunit.client.0.smithi063.stdout:9/183: fdatasync d7/d9/d20/f21 0 2024-09-16T01:25:11.359 INFO:tasks.workunit.client.0.smithi063.stdout:1/227: dread d1/d5/d15/d18/f42 [0,4194304] 0 2024-09-16T01:25:11.360 INFO:tasks.workunit.client.0.smithi063.stdout:8/101: write d5/f7 [2876598,68798] 0 2024-09-16T01:25:11.361 INFO:tasks.workunit.client.0.smithi063.stdout:4/186: truncate d5/f11 4519903 0 2024-09-16T01:25:11.361 INFO:tasks.workunit.client.0.smithi063.stdout:9/184: dread - d7/f36 zero size 2024-09-16T01:25:11.367 INFO:tasks.workunit.client.0.smithi063.stdout:9/185: rmdir d7/d9/d20 39 2024-09-16T01:25:11.367 INFO:tasks.workunit.client.0.smithi063.stdout:3/147: dwrite d2/f22 [0,4194304] 0 2024-09-16T01:25:11.368 INFO:tasks.workunit.client.0.smithi063.stdout:3/148: readlink d2/d12/l15 0 2024-09-16T01:25:11.368 INFO:tasks.workunit.client.0.smithi063.stdout:9/186: chown d7/d9/d12/d14/d40 485 1 2024-09-16T01:25:11.372 INFO:tasks.workunit.client.0.smithi063.stdout:0/144: mkdir d1/d2e/d32/d36/d41 0 2024-09-16T01:25:11.373 INFO:tasks.workunit.client.0.smithi063.stdout:4/187: creat d5/d3b/df/d1c/d29/d32/f3c x:0 0 0 2024-09-16T01:25:11.373 INFO:tasks.workunit.client.0.smithi063.stdout:0/145: chown d1 94530753 1 2024-09-16T01:25:11.376 INFO:tasks.workunit.client.0.smithi063.stdout:9/187: dwrite d7/f36 [0,4194304] 0 2024-09-16T01:25:11.377 INFO:tasks.workunit.client.0.smithi063.stdout:9/188: read d7/d1f/f2c [1227139,17078] 0 2024-09-16T01:25:11.377 INFO:tasks.workunit.client.0.smithi063.stdout:8/102: link d5/fc d5/db/d12/d1a/f1d 0 2024-09-16T01:25:11.379 INFO:tasks.workunit.client.0.smithi063.stdout:0/146: symlink d1/d1c/l42 0 2024-09-16T01:25:11.379 INFO:tasks.workunit.client.0.smithi063.stdout:1/228: write d1/d5/d15/f19 [1507123,71085] 0 2024-09-16T01:25:11.381 INFO:tasks.workunit.client.0.smithi063.stdout:1/229: chown d1/d12/l36 1262134 1 2024-09-16T01:25:11.381 INFO:tasks.workunit.client.0.smithi063.stdout:9/189: dread d7/d9/d12/d14/d40/f45 [0,4194304] 0 2024-09-16T01:25:11.382 INFO:tasks.workunit.client.0.smithi063.stdout:8/103: unlink d5/fc 0 2024-09-16T01:25:11.385 INFO:tasks.workunit.client.0.smithi063.stdout:0/147: mkdir d1/df/d2c/d43 0 2024-09-16T01:25:11.386 INFO:tasks.workunit.client.0.smithi063.stdout:1/230: symlink d1/dd/l51 0 2024-09-16T01:25:11.387 INFO:tasks.workunit.client.0.smithi063.stdout:0/148: truncate d1/d2e/d32/f16 4205412 0 2024-09-16T01:25:11.387 INFO:tasks.workunit.client.0.smithi063.stdout:9/190: unlink d7/d9/f11 0 2024-09-16T01:25:11.387 INFO:tasks.workunit.client.0.smithi063.stdout:1/231: dread - d1/dd/d3b/f44 zero size 2024-09-16T01:25:11.388 INFO:tasks.workunit.client.0.smithi063.stdout:8/104: unlink d5/db/l14 0 2024-09-16T01:25:11.394 INFO:tasks.workunit.client.0.smithi063.stdout:9/191: rename d7/d1f/f3f to d7/d9/d12/d14/d40/f48 0 2024-09-16T01:25:11.396 INFO:tasks.workunit.client.0.smithi063.stdout:9/192: write d7/d9/d12/d14/f1c [754001,51585] 0 2024-09-16T01:25:11.398 INFO:tasks.workunit.client.0.smithi063.stdout:3/149: read d2/f19 [770605,77141] 0 2024-09-16T01:25:11.399 INFO:tasks.workunit.client.0.smithi063.stdout:4/188: getdents d5/d3b/df 0 2024-09-16T01:25:11.401 INFO:tasks.workunit.client.0.smithi063.stdout:9/193: creat d7/d9/d12/d14/d23/f49 x:0 0 0 2024-09-16T01:25:11.401 INFO:tasks.workunit.client.0.smithi063.stdout:8/105: dwrite d5/f8 [0,4194304] 0 2024-09-16T01:25:11.402 INFO:tasks.workunit.client.0.smithi063.stdout:3/150: fdatasync d2/f1f 0 2024-09-16T01:25:11.404 INFO:tasks.workunit.client.0.smithi063.stdout:3/151: dread - d2/d17/f31 zero size 2024-09-16T01:25:11.407 INFO:tasks.workunit.client.0.smithi063.stdout:9/194: write d7/d9/d12/d14/d40/f45 [2969086,27987] 0 2024-09-16T01:25:11.410 INFO:tasks.workunit.client.0.smithi063.stdout:8/106: dwrite d5/d9/f16 [0,4194304] 0 2024-09-16T01:25:11.410 INFO:tasks.workunit.client.0.smithi063.stdout:3/152: mknod d2/d11/d18/c32 0 2024-09-16T01:25:11.411 INFO:tasks.workunit.client.0.smithi063.stdout:3/153: chown d2/d17/c2b 52775764 1 2024-09-16T01:25:11.411 INFO:tasks.workunit.client.0.smithi063.stdout:8/107: write d5/db/d12/f15 [390468,106764] 0 2024-09-16T01:25:11.411 INFO:tasks.workunit.client.0.smithi063.stdout:9/195: mkdir d7/d4a 0 2024-09-16T01:25:11.412 INFO:tasks.workunit.client.0.smithi063.stdout:9/196: readlink d7/d9/d12/d14/d34/l41 0 2024-09-16T01:25:11.414 INFO:tasks.workunit.client.0.smithi063.stdout:3/154: creat d2/f33 x:0 0 0 2024-09-16T01:25:11.415 INFO:tasks.workunit.client.0.smithi063.stdout:9/197: creat d7/d9/d12/f4b x:0 0 0 2024-09-16T01:25:11.417 INFO:tasks.workunit.client.0.smithi063.stdout:3/155: creat d2/d11/f34 x:0 0 0 2024-09-16T01:25:11.417 INFO:tasks.workunit.client.0.smithi063.stdout:3/156: stat d2/d11/f29 0 2024-09-16T01:25:11.418 INFO:tasks.workunit.client.0.smithi063.stdout:9/198: rmdir d7/d9/d12/d14/d38 39 2024-09-16T01:25:11.420 INFO:tasks.workunit.client.0.smithi063.stdout:9/199: symlink d7/d4a/l4c 0 2024-09-16T01:25:11.421 INFO:tasks.workunit.client.0.smithi063.stdout:9/200: mkdir d7/d4a/d4d 0 2024-09-16T01:25:11.423 INFO:tasks.workunit.client.0.smithi063.stdout:3/157: dwrite d2/d11/f1d [0,4194304] 0 2024-09-16T01:25:11.425 INFO:tasks.workunit.client.0.smithi063.stdout:9/201: mknod d7/d9/d12/d14/d40/c4e 0 2024-09-16T01:25:11.427 INFO:tasks.workunit.client.0.smithi063.stdout:3/158: symlink d2/l35 0 2024-09-16T01:25:11.428 INFO:tasks.workunit.client.0.smithi063.stdout:9/202: symlink d7/d9/d12/l4f 0 2024-09-16T01:25:11.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/159: fdatasync f0 0 2024-09-16T01:25:11.430 INFO:tasks.workunit.client.0.smithi063.stdout:8/108: dwrite d5/db/d12/d1a/f1d [0,4194304] 0 2024-09-16T01:25:11.430 INFO:tasks.workunit.client.0.smithi063.stdout:3/160: write d2/d12/f2f [898026,105302] 0 2024-09-16T01:25:11.434 INFO:tasks.workunit.client.0.smithi063.stdout:9/203: rename d7/d9/d12/d14/d40 to d7/d4a/d4d/d50 0 2024-09-16T01:25:11.435 INFO:tasks.workunit.client.0.smithi063.stdout:9/204: chown d7/d9/f2a 468375 1 2024-09-16T01:25:11.436 INFO:tasks.workunit.client.0.smithi063.stdout:8/109: mkdir d5/db/d12/d1a/d1e 0 2024-09-16T01:25:11.437 INFO:tasks.workunit.client.0.smithi063.stdout:9/205: unlink d7/l1d 0 2024-09-16T01:25:11.438 INFO:tasks.workunit.client.0.smithi063.stdout:9/206: dread - d7/f22 zero size 2024-09-16T01:25:11.440 INFO:tasks.workunit.client.0.smithi063.stdout:9/207: mknod d7/d4a/d4d/d50/c51 0 2024-09-16T01:25:11.441 INFO:tasks.workunit.client.0.smithi063.stdout:8/110: getdents d5/d9 0 2024-09-16T01:25:11.443 INFO:tasks.workunit.client.0.smithi063.stdout:9/208: creat d7/d9/d12/f52 x:0 0 0 2024-09-16T01:25:11.444 INFO:tasks.workunit.client.0.smithi063.stdout:8/111: mknod d5/db/d12/d1a/c1f 0 2024-09-16T01:25:11.444 INFO:tasks.workunit.client.0.smithi063.stdout:9/209: truncate d7/d9/d12/f42 17667 0 2024-09-16T01:25:11.445 INFO:tasks.workunit.client.0.smithi063.stdout:9/210: readlink d7/d9/d12/d14/d23/l2d 0 2024-09-16T01:25:11.446 INFO:tasks.workunit.client.0.smithi063.stdout:8/112: creat d5/db/d12/d1a/d1e/f20 x:0 0 0 2024-09-16T01:25:11.446 INFO:tasks.workunit.client.0.smithi063.stdout:9/211: creat d7/d4a/f53 x:0 0 0 2024-09-16T01:25:11.447 INFO:tasks.workunit.client.0.smithi063.stdout:9/212: fdatasync d7/d4a/f53 0 2024-09-16T01:25:11.448 INFO:tasks.workunit.client.0.smithi063.stdout:9/213: truncate d7/d4a/f53 271155 0 2024-09-16T01:25:11.449 INFO:tasks.workunit.client.0.smithi063.stdout:9/214: creat d7/d4a/d4d/d50/f54 x:0 0 0 2024-09-16T01:25:11.450 INFO:tasks.workunit.client.0.smithi063.stdout:9/215: write d7/d9/d12/f52 [278659,71118] 0 2024-09-16T01:25:11.451 INFO:tasks.workunit.client.0.smithi063.stdout:9/216: chown d7/d9/d12/l30 103 1 2024-09-16T01:25:11.451 INFO:tasks.workunit.client.0.smithi063.stdout:9/217: chown d7/d9/d12 4883 1 2024-09-16T01:25:11.452 INFO:tasks.workunit.client.0.smithi063.stdout:9/218: chown d7/d9/d12/d14/f35 20188285 1 2024-09-16T01:25:11.454 INFO:tasks.workunit.client.0.smithi063.stdout:9/219: chown d7/d9/d20/f3b 583849 1 2024-09-16T01:25:11.454 INFO:tasks.workunit.client.0.smithi063.stdout:9/220: chown d7/d9/d12/f33 3844 1 2024-09-16T01:25:11.455 INFO:tasks.workunit.client.0.smithi063.stdout:9/221: fsync d7/d1f/f2c 0 2024-09-16T01:25:11.458 INFO:tasks.workunit.client.0.smithi063.stdout:9/222: dread d7/d9/d12/d14/f16 [0,4194304] 0 2024-09-16T01:25:11.460 INFO:tasks.workunit.client.0.smithi063.stdout:9/223: mkdir d7/d9/d12/d14/d23/d55 0 2024-09-16T01:25:11.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/224: creat d7/d4a/f56 x:0 0 0 2024-09-16T01:25:11.464 INFO:tasks.workunit.client.0.smithi063.stdout:9/225: symlink d7/d9/d12/l57 0 2024-09-16T01:25:11.469 INFO:tasks.workunit.client.0.smithi063.stdout:9/226: dwrite d7/d9/d12/d14/d23/f49 [0,4194304] 0 2024-09-16T01:25:11.476 INFO:tasks.workunit.client.0.smithi063.stdout:9/227: dwrite d7/d9/d12/d14/d23/f49 [0,4194304] 0 2024-09-16T01:25:11.478 INFO:tasks.workunit.client.0.smithi063.stdout:9/228: write d7/d9/d12/f33 [1094019,13773] 0 2024-09-16T01:25:11.480 INFO:tasks.workunit.client.0.smithi063.stdout:9/229: unlink d7/d4a/f56 0 2024-09-16T01:25:11.482 INFO:tasks.workunit.client.0.smithi063.stdout:9/230: mkdir d7/d9/d20/d58 0 2024-09-16T01:25:11.487 INFO:tasks.workunit.client.0.smithi063.stdout:9/231: write f4 [707466,1448] 0 2024-09-16T01:25:11.489 INFO:tasks.workunit.client.0.smithi063.stdout:9/232: creat d7/d4a/f59 x:0 0 0 2024-09-16T01:25:11.492 INFO:tasks.workunit.client.0.smithi063.stdout:6/175: sync 2024-09-16T01:25:11.492 INFO:tasks.workunit.client.0.smithi063.stdout:7/140: sync 2024-09-16T01:25:11.493 INFO:tasks.workunit.client.0.smithi063.stdout:9/233: truncate d7/d9/d20/f21 4659678 0 2024-09-16T01:25:11.493 INFO:tasks.workunit.client.0.smithi063.stdout:6/176: read d3/f21 [470929,23816] 0 2024-09-16T01:25:11.494 INFO:tasks.workunit.client.0.smithi063.stdout:9/234: fsync d7/d4a/d4d/d50/f54 0 2024-09-16T01:25:11.494 INFO:tasks.workunit.client.0.smithi063.stdout:6/177: truncate d3/d10/f29 1662654 0 2024-09-16T01:25:11.496 INFO:tasks.workunit.client.0.smithi063.stdout:6/178: symlink d3/d41/l47 0 2024-09-16T01:25:11.498 INFO:tasks.workunit.client.0.smithi063.stdout:7/141: truncate d7/f19 1649638 0 2024-09-16T01:25:11.498 INFO:tasks.workunit.client.0.smithi063.stdout:7/142: readlink d7/d18/d25/l27 0 2024-09-16T01:25:11.500 INFO:tasks.workunit.client.0.smithi063.stdout:9/235: getdents d7/d9/d12 0 2024-09-16T01:25:11.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/179: dwrite d3/d10/d22/d28/d3e/f43 [0,4194304] 0 2024-09-16T01:25:11.507 INFO:tasks.workunit.client.0.smithi063.stdout:7/143: dwrite f2 [0,4194304] 0 2024-09-16T01:25:11.507 INFO:tasks.workunit.client.0.smithi063.stdout:6/180: read d3/f21 [452059,55951] 0 2024-09-16T01:25:11.508 INFO:tasks.workunit.client.0.smithi063.stdout:9/236: dread d7/d9/d12/f33 [0,4194304] 0 2024-09-16T01:25:11.508 INFO:tasks.workunit.client.0.smithi063.stdout:6/181: chown d3/d41/l47 55563 1 2024-09-16T01:25:11.509 INFO:tasks.workunit.client.0.smithi063.stdout:9/237: chown d7/d9/d20/f3b 356058 1 2024-09-16T01:25:11.511 INFO:tasks.workunit.client.0.smithi063.stdout:9/238: fdatasync d7/d9/d12/d14/f35 0 2024-09-16T01:25:11.513 INFO:tasks.workunit.client.0.smithi063.stdout:9/239: readlink d7/d9/d12/d14/d23/l3c 0 2024-09-16T01:25:11.516 INFO:tasks.workunit.client.0.smithi063.stdout:9/240: truncate d7/d9/d12/d14/f16 5063531 0 2024-09-16T01:25:11.517 INFO:tasks.workunit.client.0.smithi063.stdout:9/241: fdatasync d7/d9/d20/f3b 0 2024-09-16T01:25:11.517 INFO:tasks.workunit.client.0.smithi063.stdout:7/144: dwrite d7/d1c/f1d [4194304,4194304] 0 2024-09-16T01:25:11.521 INFO:tasks.workunit.client.0.smithi063.stdout:9/242: symlink d7/d9/d12/d14/d38/l5a 0 2024-09-16T01:25:11.522 INFO:tasks.workunit.client.0.smithi063.stdout:9/243: chown d7/d9/d12/f39 231064246 1 2024-09-16T01:25:11.528 INFO:tasks.workunit.client.0.smithi063.stdout:9/244: write d7/d4a/d4d/d50/f48 [961643,103456] 0 2024-09-16T01:25:11.529 INFO:tasks.workunit.client.0.smithi063.stdout:9/245: chown d7/d9/d12/d14/c43 581331 1 2024-09-16T01:25:11.534 INFO:tasks.workunit.client.0.smithi063.stdout:9/246: dwrite d7/f36 [0,4194304] 0 2024-09-16T01:25:11.536 INFO:tasks.workunit.client.0.smithi063.stdout:7/145: dread d7/fe [0,4194304] 0 2024-09-16T01:25:11.540 INFO:tasks.workunit.client.0.smithi063.stdout:7/146: dread d7/ff [0,4194304] 0 2024-09-16T01:25:11.545 INFO:tasks.workunit.client.0.smithi063.stdout:7/147: rename d7/d1c/c23 to d7/c2a 0 2024-09-16T01:25:11.548 INFO:tasks.workunit.client.0.smithi063.stdout:7/148: link d7/d18/f22 d7/d1c/d1f/f2b 0 2024-09-16T01:25:11.549 INFO:tasks.workunit.client.0.smithi063.stdout:7/149: write f5 [2575174,50850] 0 2024-09-16T01:25:11.550 INFO:tasks.workunit.client.0.smithi063.stdout:7/150: rename d7 to d7/d1c/d2c 22 2024-09-16T01:25:11.556 INFO:tasks.workunit.client.0.smithi063.stdout:7/151: truncate d7/d18/f1b 4437456 0 2024-09-16T01:25:11.557 INFO:tasks.workunit.client.0.smithi063.stdout:7/152: mknod d7/d18/d25/c2d 0 2024-09-16T01:25:11.562 INFO:tasks.workunit.client.0.smithi063.stdout:7/153: dwrite d7/d18/f1a [0,4194304] 0 2024-09-16T01:25:11.565 INFO:tasks.workunit.client.0.smithi063.stdout:7/154: creat d7/d1c/d1f/f2e x:0 0 0 2024-09-16T01:25:11.569 INFO:tasks.workunit.client.0.smithi063.stdout:7/155: link d7/cb d7/d1c/d1f/d29/c2f 0 2024-09-16T01:25:11.573 INFO:tasks.workunit.client.0.smithi063.stdout:7/156: rename d7/fc to d7/f30 0 2024-09-16T01:25:11.578 INFO:tasks.workunit.client.0.smithi063.stdout:7/157: truncate d7/d18/f1b 1377565 0 2024-09-16T01:25:11.580 INFO:tasks.workunit.client.0.smithi063.stdout:7/158: creat d7/d18/d25/f31 x:0 0 0 2024-09-16T01:25:11.585 INFO:tasks.workunit.client.0.smithi063.stdout:7/159: truncate d7/f10 584076 0 2024-09-16T01:25:11.587 INFO:tasks.workunit.client.0.smithi063.stdout:7/160: rename d7/d1c/f1d to d7/d1c/d1f/f32 0 2024-09-16T01:25:11.592 INFO:tasks.workunit.client.0.smithi063.stdout:7/161: dwrite d7/d1c/d1f/f26 [0,4194304] 0 2024-09-16T01:25:11.602 INFO:tasks.workunit.client.0.smithi063.stdout:7/162: dwrite d7/f19 [0,4194304] 0 2024-09-16T01:25:11.607 INFO:tasks.workunit.client.0.smithi063.stdout:7/163: dwrite d7/d18/d25/f31 [0,4194304] 0 2024-09-16T01:25:11.610 INFO:tasks.workunit.client.0.smithi063.stdout:7/164: write d7/ff [4061313,120573] 0 2024-09-16T01:25:11.612 INFO:tasks.workunit.client.0.smithi063.stdout:7/165: mknod d7/c33 0 2024-09-16T01:25:11.616 INFO:tasks.workunit.client.0.smithi063.stdout:7/166: dread d7/f30 [0,4194304] 0 2024-09-16T01:25:11.622 INFO:tasks.workunit.client.0.smithi063.stdout:7/167: truncate d7/ff 732321 0 2024-09-16T01:25:11.624 INFO:tasks.workunit.client.0.smithi063.stdout:7/168: mknod d7/d1c/c34 0 2024-09-16T01:25:11.627 INFO:tasks.workunit.client.0.smithi063.stdout:7/169: dread d7/d18/d25/f31 [0,4194304] 0 2024-09-16T01:25:11.629 INFO:tasks.workunit.client.0.smithi063.stdout:7/170: symlink d7/d18/l35 0 2024-09-16T01:25:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:5/200: sync 2024-09-16T01:25:11.631 INFO:tasks.workunit.client.0.smithi063.stdout:5/201: write d5/f38 [912368,65182] 0 2024-09-16T01:25:11.633 INFO:tasks.workunit.client.0.smithi063.stdout:5/202: symlink d5/d18/d29/l44 0 2024-09-16T01:25:11.635 INFO:tasks.workunit.client.0.smithi063.stdout:5/203: getdents d5/d18/d29/d3c 0 2024-09-16T01:25:11.636 INFO:tasks.workunit.client.0.smithi063.stdout:5/204: truncate d5/d12/f43 111050 0 2024-09-16T01:25:11.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/205: dwrite d5/d18/f39 [0,4194304] 0 2024-09-16T01:25:11.648 INFO:tasks.workunit.client.0.smithi063.stdout:5/206: creat d5/d12/f45 x:0 0 0 2024-09-16T01:25:11.652 INFO:tasks.workunit.client.0.smithi063.stdout:5/207: rename d5/d18/d29/c3a to d5/d12/d35/c46 0 2024-09-16T01:25:11.654 INFO:tasks.workunit.client.0.smithi063.stdout:5/208: write d5/d12/f21 [429071,130463] 0 2024-09-16T01:25:11.667 INFO:tasks.workunit.client.0.smithi063.stdout:5/209: dread d5/d12/f13 [0,4194304] 0 2024-09-16T01:25:11.670 INFO:tasks.workunit.client.0.smithi063.stdout:5/210: rename d5/d18/l30 to d5/d18/d29/l47 0 2024-09-16T01:25:11.671 INFO:tasks.workunit.client.0.smithi063.stdout:5/211: fdatasync d5/f17 0 2024-09-16T01:25:11.673 INFO:tasks.workunit.client.0.smithi063.stdout:5/212: mkdir d5/d18/d29/d48 0 2024-09-16T01:25:11.675 INFO:tasks.workunit.client.0.smithi063.stdout:5/213: rmdir d5/d12 39 2024-09-16T01:25:11.676 INFO:tasks.workunit.client.0.smithi063.stdout:5/214: stat d5/d18/d29/d48 0 2024-09-16T01:25:11.683 INFO:tasks.workunit.client.0.smithi063.stdout:5/215: truncate d5/d12/f1e 230084 0 2024-09-16T01:25:11.789 INFO:tasks.workunit.client.0.smithi063.stdout:2/164: sync 2024-09-16T01:25:11.789 INFO:tasks.workunit.client.0.smithi063.stdout:0/149: sync 2024-09-16T01:25:11.790 INFO:tasks.workunit.client.0.smithi063.stdout:2/165: truncate d3/d7/f2e 304785 0 2024-09-16T01:25:11.791 INFO:tasks.workunit.client.0.smithi063.stdout:0/150: mkdir d1/d2e/d32/d44 0 2024-09-16T01:25:11.793 INFO:tasks.workunit.client.0.smithi063.stdout:2/166: rename d3/d35 to d3/d7/d8/d1f/d34/d39 0 2024-09-16T01:25:11.795 INFO:tasks.workunit.client.0.smithi063.stdout:0/151: creat d1/df/d34/f45 x:0 0 0 2024-09-16T01:25:11.797 INFO:tasks.workunit.client.0.smithi063.stdout:2/167: rename d3/d7/f26 to d3/d7/d8/d1f/f3a 0 2024-09-16T01:25:11.797 INFO:tasks.workunit.client.0.smithi063.stdout:2/168: chown d3/d7/c1b 6 1 2024-09-16T01:25:11.798 INFO:tasks.workunit.client.0.smithi063.stdout:0/152: mknod d1/d2e/c46 0 2024-09-16T01:25:11.800 INFO:tasks.workunit.client.0.smithi063.stdout:0/153: write d1/df/d17/f22 [8428408,129490] 0 2024-09-16T01:25:11.802 INFO:tasks.workunit.client.0.smithi063.stdout:2/169: getdents d3/d7/de/d21/d28 0 2024-09-16T01:25:11.807 INFO:tasks.workunit.client.0.smithi063.stdout:0/154: dwrite d1/d2e/f2f [0,4194304] 0 2024-09-16T01:25:11.809 INFO:tasks.workunit.client.0.smithi063.stdout:0/155: fdatasync d1/d2e/d32/f16 0 2024-09-16T01:25:11.811 INFO:tasks.workunit.client.0.smithi063.stdout:2/170: dwrite d3/d7/f16 [0,4194304] 0 2024-09-16T01:25:11.818 INFO:tasks.workunit.client.0.smithi063.stdout:2/171: dread d3/d7/d8/f1a [0,4194304] 0 2024-09-16T01:25:11.818 INFO:tasks.workunit.client.0.smithi063.stdout:0/156: truncate d1/d2e/f2f 1232709 0 2024-09-16T01:25:11.822 INFO:tasks.workunit.client.0.smithi063.stdout:2/172: write d3/d7/d8/d1f/f3a [2614104,47428] 0 2024-09-16T01:25:11.824 INFO:tasks.workunit.client.0.smithi063.stdout:0/157: creat d1/d2e/d32/d36/d41/f47 x:0 0 0 2024-09-16T01:25:11.824 INFO:tasks.workunit.client.0.smithi063.stdout:2/173: dread d3/d7/d8/f1a [0,4194304] 0 2024-09-16T01:25:11.825 INFO:tasks.workunit.client.0.smithi063.stdout:0/158: fdatasync d1/df/d34/f45 0 2024-09-16T01:25:11.826 INFO:tasks.workunit.client.0.smithi063.stdout:2/174: readlink d3/d7/l1c 0 2024-09-16T01:25:11.827 INFO:tasks.workunit.client.0.smithi063.stdout:2/175: write d3/d7/de/d21/f2d [1189911,113479] 0 2024-09-16T01:25:11.827 INFO:tasks.workunit.client.0.smithi063.stdout:0/159: mkdir d1/d2e/d48 0 2024-09-16T01:25:11.830 INFO:tasks.workunit.client.0.smithi063.stdout:2/176: creat d3/d7/d8/f3b x:0 0 0 2024-09-16T01:25:11.834 INFO:tasks.workunit.client.0.smithi063.stdout:0/160: dwrite d1/d2e/d32/d36/d41/f47 [0,4194304] 0 2024-09-16T01:25:11.834 INFO:tasks.workunit.client.0.smithi063.stdout:2/177: rename d3/d7/d8/d1f/d32 to d3/d7/d8/d19/d3c 0 2024-09-16T01:25:11.837 INFO:tasks.workunit.client.0.smithi063.stdout:0/161: mknod d1/d2e/d32/c49 0 2024-09-16T01:25:11.838 INFO:tasks.workunit.client.0.smithi063.stdout:2/178: creat d3/d7/d8/d1f/f3d x:0 0 0 2024-09-16T01:25:11.838 INFO:tasks.workunit.client.0.smithi063.stdout:2/179: chown d3/d7/de 910 1 2024-09-16T01:25:11.839 INFO:tasks.workunit.client.0.smithi063.stdout:0/162: creat d1/d2e/f4a x:0 0 0 2024-09-16T01:25:11.840 INFO:tasks.workunit.client.0.smithi063.stdout:4/189: sync 2024-09-16T01:25:11.840 INFO:tasks.workunit.client.0.smithi063.stdout:1/232: sync 2024-09-16T01:25:11.841 INFO:tasks.workunit.client.0.smithi063.stdout:2/180: unlink d3/d7/d8/d1f/f3d 0 2024-09-16T01:25:11.842 INFO:tasks.workunit.client.0.smithi063.stdout:4/190: read d5/f11 [3260293,23955] 0 2024-09-16T01:25:11.843 INFO:tasks.workunit.client.0.smithi063.stdout:0/163: rename d1/d2e/d32/f16 to d1/d1c/f4b 0 2024-09-16T01:25:11.843 INFO:tasks.workunit.client.0.smithi063.stdout:4/191: dread - d5/d3b/df/d1c/d29/d32/f3c zero size 2024-09-16T01:25:11.844 INFO:tasks.workunit.client.0.smithi063.stdout:4/192: fdatasync d5/d3b/df/d1c/f35 0 2024-09-16T01:25:11.845 INFO:tasks.workunit.client.0.smithi063.stdout:1/233: creat d1/d5/d15/d1b/f52 x:0 0 0 2024-09-16T01:25:11.847 INFO:tasks.workunit.client.0.smithi063.stdout:2/181: rename d3/d7/d8/d1f/f23 to d3/d7/d8/d1f/f3e 0 2024-09-16T01:25:11.847 INFO:tasks.workunit.client.0.smithi063.stdout:2/182: chown d3/d7/c1b 4 1 2024-09-16T01:25:11.849 INFO:tasks.workunit.client.0.smithi063.stdout:0/164: dread d1/fb [0,4194304] 0 2024-09-16T01:25:11.850 INFO:tasks.workunit.client.0.smithi063.stdout:1/234: creat d1/d12/f53 x:0 0 0 2024-09-16T01:25:11.852 INFO:tasks.workunit.client.0.smithi063.stdout:4/193: dwrite d5/d3b/df/f18 [0,4194304] 0 2024-09-16T01:25:11.853 INFO:tasks.workunit.client.0.smithi063.stdout:2/183: write d3/d7/de/d21/f29 [1958581,127139] 0 2024-09-16T01:25:11.853 INFO:tasks.workunit.client.0.smithi063.stdout:1/235: read d1/d5/f10 [2792458,117832] 0 2024-09-16T01:25:11.853 INFO:tasks.workunit.client.0.smithi063.stdout:0/165: mknod d1/c4c 0 2024-09-16T01:25:11.854 INFO:tasks.workunit.client.0.smithi063.stdout:2/184: stat d3/d7/d8/f3b 0 2024-09-16T01:25:11.854 INFO:tasks.workunit.client.0.smithi063.stdout:1/236: chown d1/d12/l36 787 1 2024-09-16T01:25:11.855 INFO:tasks.workunit.client.0.smithi063.stdout:4/194: symlink d5/d3b/df/l3d 0 2024-09-16T01:25:11.857 INFO:tasks.workunit.client.0.smithi063.stdout:4/195: chown d5/d3b/l1e 4093 1 2024-09-16T01:25:11.857 INFO:tasks.workunit.client.0.smithi063.stdout:1/237: unlink f0 0 2024-09-16T01:25:11.860 INFO:tasks.workunit.client.0.smithi063.stdout:0/166: dread d1/d1c/f4b [0,4194304] 0 2024-09-16T01:25:11.861 INFO:tasks.workunit.client.0.smithi063.stdout:2/185: dread d3/d7/d8/d19/f24 [0,4194304] 0 2024-09-16T01:25:11.861 INFO:tasks.workunit.client.0.smithi063.stdout:4/196: creat d5/d3b/df/f3e x:0 0 0 2024-09-16T01:25:11.862 INFO:tasks.workunit.client.0.smithi063.stdout:1/238: unlink d1/d5/d15/d1b/f2e 0 2024-09-16T01:25:11.862 INFO:tasks.workunit.client.0.smithi063.stdout:2/186: truncate d3/d7/de/f33 556571 0 2024-09-16T01:25:11.863 INFO:tasks.workunit.client.0.smithi063.stdout:4/197: rmdir d5/d3b/df/d1c/d29/d20 39 2024-09-16T01:25:11.864 INFO:tasks.workunit.client.0.smithi063.stdout:1/239: readlink d1/d5/d15/d1b/d31/l2c 0 2024-09-16T01:25:11.865 INFO:tasks.workunit.client.0.smithi063.stdout:2/187: unlink d3/d7/d8/f20 0 2024-09-16T01:25:11.867 INFO:tasks.workunit.client.0.smithi063.stdout:0/167: dwrite d1/fb [8388608,4194304] 0 2024-09-16T01:25:11.868 INFO:tasks.workunit.client.0.smithi063.stdout:2/188: write f0 [1977281,61392] 0 2024-09-16T01:25:11.870 INFO:tasks.workunit.client.0.smithi063.stdout:4/198: creat d5/f3f x:0 0 0 2024-09-16T01:25:11.871 INFO:tasks.workunit.client.0.smithi063.stdout:2/189: rmdir d3 39 2024-09-16T01:25:11.873 INFO:tasks.workunit.client.0.smithi063.stdout:2/190: chown d3/c12 918 1 2024-09-16T01:25:11.950 INFO:tasks.workunit.client.0.smithi063.stdout:2/191: truncate d3/d7/d8/f1a 1296302 0 2024-09-16T01:25:11.950 INFO:tasks.workunit.client.0.smithi063.stdout:0/168: dwrite d1/df/f40 [0,4194304] 0 2024-09-16T01:25:11.950 INFO:tasks.workunit.client.0.smithi063.stdout:4/199: mknod d5/d3b/df/d1c/d29/d20/d30/c40 0 2024-09-16T01:25:11.950 INFO:tasks.workunit.client.0.smithi063.stdout:2/192: chown d3/d7/c14 3728 1 2024-09-16T01:25:11.950 INFO:tasks.workunit.client.0.smithi063.stdout:2/193: fsync d3/d7/d8/d1f/f3e 0 2024-09-16T01:25:11.950 INFO:tasks.workunit.client.0.smithi063.stdout:4/200: read d5/d3b/df/d1c/f31 [1240855,122796] 0 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:2/194: read d3/d7/d8/f1a [512768,57790] 0 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:0/169: fdatasync d1/df/d17/f22 0 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:2/195: getdents d3/d7/d8/d1f/d34/d39 0 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:2/196: rmdir d3/d7/de/d21/d28 39 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:4/201: getdents d5/d3b/df/d1c/d29/d20/d30 0 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:2/197: chown d3/d7/de/d21/f29 7695 1 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:0/170: dread d1/f31 [0,4194304] 0 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:2/198: chown d3/d7/de 157 1 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:0/171: dread - d1/d2e/d32/f3d zero size 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:2/199: write d3/ff [959242,78276] 0 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:4/202: creat d5/d3b/f41 x:0 0 0 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:2/200: read d3/d7/d8/f18 [3208597,56309] 0 2024-09-16T01:25:11.951 INFO:tasks.workunit.client.0.smithi063.stdout:4/203: chown d5/d3b/df/d1c/l38 75 1 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/172: link d1/d2e/f4a d1/d2e/d32/d36/d41/f4d 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/201: rename d3/d7/d8/f27 to d3/d7/f3f 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/202: write d3/d7/de/d21/f2d [5635309,127270] 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/173: mkdir d1/df/d2c/d4e 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/203: chown d3/ff 33 1 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/174: write d1/d2e/f2f [859593,82149] 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/204: symlink d3/d7/de/l40 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/205: fsync d3/d7/de/f33 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/175: symlink d1/d30/l4f 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/206: symlink d3/d7/de/l41 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/176: write d1/f31 [4993383,21405] 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/207: symlink d3/d7/d8/d19/d3c/l42 0 2024-09-16T01:25:11.952 INFO:tasks.workunit.client.0.smithi063.stdout:2/208: readlink d3/d7/l1c 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:4/204: truncate d5/d3b/df/f18 1769908 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:0/177: mkdir d1/d2e/d50 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:2/209: dread d3/d7/d8/f1a [0,4194304] 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:4/205: write d5/d3b/f19 [385995,41325] 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:0/178: symlink d1/d2e/d32/d36/d41/l51 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:4/206: creat d5/f42 x:0 0 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:2/210: dread d3/d7/f3f [0,4194304] 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:0/179: unlink d1/d2e/d32/c33 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:4/207: unlink d5/d3b/df/d1c/f35 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:2/211: dread f0 [0,4194304] 0 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:4/208: dread - d5/f42 zero size 2024-09-16T01:25:11.953 INFO:tasks.workunit.client.0.smithi063.stdout:2/212: chown d3/d7 835 1 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:0/180: mkdir d1/d30/d52 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:2/213: mknod d3/d7/de/c43 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:0/181: mknod d1/df/d34/c53 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:4/209: dwrite d5/d3b/f16 [0,4194304] 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:2/214: write d3/d7/f22 [4178139,119237] 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:0/182: dread d1/d2e/f2f [0,4194304] 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:0/183: chown d1/df/d17 13316 1 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:4/210: getdents d5/d3b/df/d1c/d29/d20 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:2/215: dwrite f2 [4194304,4194304] 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:4/211: rename d5/c13 to d5/d3b/df/d1c/d29/d32/c43 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:0/184: dwrite d1/d1c/f3f [0,4194304] 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:2/216: link d3/d7/f16 d3/d7/d8/d19/f44 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:0/185: fdatasync d1/df/d17/f22 0 2024-09-16T01:25:11.954 INFO:tasks.workunit.client.0.smithi063.stdout:2/217: write d3/d7/d8/f10 [4669141,7349] 0 2024-09-16T01:25:11.955 INFO:tasks.workunit.client.0.smithi063.stdout:0/186: creat d1/df/f54 x:0 0 0 2024-09-16T01:25:11.955 INFO:tasks.workunit.client.0.smithi063.stdout:2/218: mkdir d3/d7/d8/d1f/d34/d45 0 2024-09-16T01:25:11.955 INFO:tasks.workunit.client.0.smithi063.stdout:2/219: rename d3/d7/de/d21/d28/c38 to d3/d7/de/d21/d28/c46 0 2024-09-16T01:25:11.955 INFO:tasks.workunit.client.0.smithi063.stdout:0/187: truncate d1/fa 1839758 0 2024-09-16T01:25:11.955 INFO:tasks.workunit.client.0.smithi063.stdout:2/220: dread f2 [0,4194304] 0 2024-09-16T01:25:11.955 INFO:tasks.workunit.client.0.smithi063.stdout:0/188: creat d1/df/d2c/f55 x:0 0 0 2024-09-16T01:25:11.955 INFO:tasks.workunit.client.0.smithi063.stdout:2/221: creat d3/d7/d8/d1f/d34/d39/f47 x:0 0 0 2024-09-16T01:25:11.955 INFO:tasks.workunit.client.0.smithi063.stdout:0/189: symlink d1/df/d17/l56 0 2024-09-16T01:25:11.956 INFO:tasks.workunit.client.0.smithi063.stdout:2/222: write d3/d7/d8/f10 [5565728,13280] 0 2024-09-16T01:25:11.956 INFO:tasks.workunit.client.0.smithi063.stdout:0/190: dread d1/f31 [0,4194304] 0 2024-09-16T01:25:11.956 INFO:tasks.workunit.client.0.smithi063.stdout:2/223: dwrite f2 [4194304,4194304] 0 2024-09-16T01:25:11.957 INFO:tasks.workunit.client.0.smithi063.stdout:0/191: creat d1/df/d2c/d43/f57 x:0 0 0 2024-09-16T01:25:11.960 INFO:tasks.workunit.client.0.smithi063.stdout:0/192: rename d1/df/d2c/d43/f57 to d1/d30/d52/f58 0 2024-09-16T01:25:11.963 INFO:tasks.workunit.client.0.smithi063.stdout:0/193: mknod d1/d2e/d32/c59 0 2024-09-16T01:25:11.966 INFO:tasks.workunit.client.0.smithi063.stdout:2/224: truncate d3/ff 4003459 0 2024-09-16T01:25:11.969 INFO:tasks.workunit.client.0.smithi063.stdout:2/225: symlink d3/d7/d8/l48 0 2024-09-16T01:25:11.969 INFO:tasks.workunit.client.0.smithi063.stdout:0/194: dwrite d1/d2e/f2f [0,4194304] 0 2024-09-16T01:25:11.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/195: stat d1/d1c/c1e 0 2024-09-16T01:25:11.971 INFO:tasks.workunit.client.0.smithi063.stdout:2/226: mknod d3/d7/d8/d1f/d34/d39/c49 0 2024-09-16T01:25:11.973 INFO:tasks.workunit.client.0.smithi063.stdout:2/227: unlink d3/d7/de/f33 0 2024-09-16T01:25:11.979 INFO:tasks.workunit.client.0.smithi063.stdout:2/228: write d3/d7/d8/f10 [2071221,84899] 0 2024-09-16T01:25:11.979 INFO:tasks.workunit.client.0.smithi063.stdout:0/196: dread d1/d1c/f4b [0,4194304] 0 2024-09-16T01:25:11.981 INFO:tasks.workunit.client.0.smithi063.stdout:8/113: sync 2024-09-16T01:25:11.981 INFO:tasks.workunit.client.0.smithi063.stdout:7/171: sync 2024-09-16T01:25:11.981 INFO:tasks.workunit.client.0.smithi063.stdout:9/247: sync 2024-09-16T01:25:11.981 INFO:tasks.workunit.client.0.smithi063.stdout:3/161: sync 2024-09-16T01:25:11.981 INFO:tasks.workunit.client.0.smithi063.stdout:5/216: sync 2024-09-16T01:25:11.981 INFO:tasks.workunit.client.0.smithi063.stdout:6/182: sync 2024-09-16T01:25:11.982 INFO:tasks.workunit.client.0.smithi063.stdout:0/197: truncate d1/d1c/f4b 1568814 0 2024-09-16T01:25:11.982 INFO:tasks.workunit.client.0.smithi063.stdout:2/229: write d3/d7/f16 [2014170,64769] 0 2024-09-16T01:25:11.982 INFO:tasks.workunit.client.0.smithi063.stdout:3/162: chown d2/d17 1078531 1 2024-09-16T01:25:11.983 INFO:tasks.workunit.client.0.smithi063.stdout:8/114: rename d5/d9 to d5/d9/d21 22 2024-09-16T01:25:11.983 INFO:tasks.workunit.client.0.smithi063.stdout:9/248: rmdir d7/d4a 39 2024-09-16T01:25:11.984 INFO:tasks.workunit.client.0.smithi063.stdout:6/183: read d3/d10/d22/f24 [668693,92578] 0 2024-09-16T01:25:11.986 INFO:tasks.workunit.client.0.smithi063.stdout:8/115: write d5/f10 [1439107,34530] 0 2024-09-16T01:25:11.986 INFO:tasks.workunit.client.0.smithi063.stdout:3/163: creat d2/d17/f36 x:0 0 0 2024-09-16T01:25:11.990 INFO:tasks.workunit.client.0.smithi063.stdout:3/164: mkdir d2/d11/d37 0 2024-09-16T01:25:11.992 INFO:tasks.workunit.client.0.smithi063.stdout:8/116: truncate d5/db/d12/f15 1106026 0 2024-09-16T01:25:11.994 INFO:tasks.workunit.client.0.smithi063.stdout:5/217: dwrite d5/d18/f39 [0,4194304] 0 2024-09-16T01:25:11.994 INFO:tasks.workunit.client.0.smithi063.stdout:3/165: write d2/d11/f29 [1252344,13439] 0 2024-09-16T01:25:11.996 INFO:tasks.workunit.client.0.smithi063.stdout:2/230: dread d3/d7/d8/d1f/f3e [0,4194304] 0 2024-09-16T01:25:11.996 INFO:tasks.workunit.client.0.smithi063.stdout:0/198: rename d1/d2e/d32 to d1/d30/d52/d5a 0 2024-09-16T01:25:11.996 INFO:tasks.workunit.client.0.smithi063.stdout:8/117: chown d5/db/d12/d1a/d1e 1934 1 2024-09-16T01:25:11.998 INFO:tasks.workunit.client.0.smithi063.stdout:3/166: chown d2/d17/f31 104817877 1 2024-09-16T01:25:11.999 INFO:tasks.workunit.client.0.smithi063.stdout:9/249: dwrite d7/d9/d12/f52 [0,4194304] 0 2024-09-16T01:25:12.000 INFO:tasks.workunit.client.0.smithi063.stdout:5/218: creat d5/d12/f49 x:0 0 0 2024-09-16T01:25:12.005 INFO:tasks.workunit.client.0.smithi063.stdout:0/199: rename d1/f11 to d1/d30/d52/d5a/d36/f5b 0 2024-09-16T01:25:12.006 INFO:tasks.workunit.client.0.smithi063.stdout:6/184: dwrite d3/d10/d35/f3f [0,4194304] 0 2024-09-16T01:25:12.010 INFO:tasks.workunit.client.0.smithi063.stdout:2/231: fsync d3/d7/d8/f1a 0 2024-09-16T01:25:12.014 INFO:tasks.workunit.client.0.smithi063.stdout:5/219: creat d5/d12/f4a x:0 0 0 2024-09-16T01:25:12.017 INFO:tasks.workunit.client.0.smithi063.stdout:6/185: unlink d3/d10/d35/f3f 0 2024-09-16T01:25:12.018 INFO:tasks.workunit.client.0.smithi063.stdout:8/118: dwrite d5/db/d12/d1a/f1d [0,4194304] 0 2024-09-16T01:25:12.018 INFO:tasks.workunit.client.0.smithi063.stdout:0/200: rename d1/f35 to d1/df/d34/f5c 0 2024-09-16T01:25:12.020 INFO:tasks.workunit.client.0.smithi063.stdout:2/232: symlink d3/d7/d8/l4a 0 2024-09-16T01:25:12.021 INFO:tasks.workunit.client.0.smithi063.stdout:3/167: dwrite d2/f33 [0,4194304] 0 2024-09-16T01:25:12.022 INFO:tasks.workunit.client.0.smithi063.stdout:0/201: write d1/d1c/f3f [1019462,115895] 0 2024-09-16T01:25:12.025 INFO:tasks.workunit.client.0.smithi063.stdout:5/220: mkdir d5/d18/d4b 0 2024-09-16T01:25:12.025 INFO:tasks.workunit.client.0.smithi063.stdout:0/202: chown d1/d30/d52/d5a/l24 5122 1 2024-09-16T01:25:12.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/250: dread d7/d9/d20/f21 [0,4194304] 0 2024-09-16T01:25:12.028 INFO:tasks.workunit.client.0.smithi063.stdout:8/119: rename d5/db/d12/d1a/c1f to d5/d9/c22 0 2024-09-16T01:25:12.030 INFO:tasks.workunit.client.0.smithi063.stdout:6/186: write d3/d10/f34 [3240736,62305] 0 2024-09-16T01:25:12.032 INFO:tasks.workunit.client.0.smithi063.stdout:6/187: write d3/d10/f20 [1037355,73027] 0 2024-09-16T01:25:12.033 INFO:tasks.workunit.client.0.smithi063.stdout:3/168: truncate d2/f19 1001563 0 2024-09-16T01:25:12.035 INFO:tasks.workunit.client.0.smithi063.stdout:5/221: chown d5/f10 0 1 2024-09-16T01:25:12.036 INFO:tasks.workunit.client.0.smithi063.stdout:8/120: creat d5/db/d12/f23 x:0 0 0 2024-09-16T01:25:12.037 INFO:tasks.workunit.client.0.smithi063.stdout:3/169: mknod d2/d12/c38 0 2024-09-16T01:25:12.038 INFO:tasks.workunit.client.0.smithi063.stdout:2/233: dwrite d3/d7/d8/f18 [0,4194304] 0 2024-09-16T01:25:12.039 INFO:tasks.workunit.client.0.smithi063.stdout:0/203: rename d1/df/d17/l1b to d1/d2e/d48/l5d 0 2024-09-16T01:25:12.039 INFO:tasks.workunit.client.0.smithi063.stdout:5/222: creat d5/d12/f4c x:0 0 0 2024-09-16T01:25:12.040 INFO:tasks.workunit.client.0.smithi063.stdout:0/204: chown d1/df/d2c/d4e 3428 1 2024-09-16T01:25:12.040 INFO:tasks.workunit.client.0.smithi063.stdout:8/121: creat d5/d9/f24 x:0 0 0 2024-09-16T01:25:12.040 INFO:tasks.workunit.client.0.smithi063.stdout:9/251: link d7/d1f/c32 d7/d9/d20/c5b 0 2024-09-16T01:25:12.042 INFO:tasks.workunit.client.0.smithi063.stdout:8/122: fdatasync d5/f10 0 2024-09-16T01:25:12.043 INFO:tasks.workunit.client.0.smithi063.stdout:0/205: creat d1/df/d34/f5e x:0 0 0 2024-09-16T01:25:12.043 INFO:tasks.workunit.client.0.smithi063.stdout:5/223: symlink d5/d18/l4d 0 2024-09-16T01:25:12.045 INFO:tasks.workunit.client.0.smithi063.stdout:9/252: creat d7/d9/d20/f5c x:0 0 0 2024-09-16T01:25:12.045 INFO:tasks.workunit.client.0.smithi063.stdout:5/224: chown d5/f15 35 1 2024-09-16T01:25:12.047 INFO:tasks.workunit.client.0.smithi063.stdout:2/234: dread d3/d7/f3f [0,4194304] 0 2024-09-16T01:25:12.052 INFO:tasks.workunit.client.0.smithi063.stdout:2/235: fsync d3/ff 0 2024-09-16T01:25:12.054 INFO:tasks.workunit.client.0.smithi063.stdout:6/188: rename d3/d10/d22 to d3/d48 0 2024-09-16T01:25:12.054 INFO:tasks.workunit.client.0.smithi063.stdout:8/123: dread d5/d9/f16 [0,4194304] 0 2024-09-16T01:25:12.057 INFO:tasks.workunit.client.0.smithi063.stdout:0/206: dwrite d1/d1c/f3f [4194304,4194304] 0 2024-09-16T01:25:12.057 INFO:tasks.workunit.client.0.smithi063.stdout:9/253: dread d7/d9/d12/f33 [0,4194304] 0 2024-09-16T01:25:12.061 INFO:tasks.workunit.client.0.smithi063.stdout:9/254: fdatasync d7/d9/d12/d14/d23/f49 0 2024-09-16T01:25:12.062 INFO:tasks.workunit.client.0.smithi063.stdout:9/255: readlink d7/l8 0 2024-09-16T01:25:12.066 INFO:tasks.workunit.client.0.smithi063.stdout:3/170: rename d2/d17 to d2/d11/d39 0 2024-09-16T01:25:12.067 INFO:tasks.workunit.client.0.smithi063.stdout:0/207: dwrite d1/fc [0,4194304] 0 2024-09-16T01:25:12.067 INFO:tasks.workunit.client.0.smithi063.stdout:5/225: dread d5/fd [0,4194304] 0 2024-09-16T01:25:12.068 INFO:tasks.workunit.client.0.smithi063.stdout:6/189: getdents d3/d10 0 2024-09-16T01:25:12.072 INFO:tasks.workunit.client.0.smithi063.stdout:6/190: mkdir d3/d10/d49 0 2024-09-16T01:25:12.073 INFO:tasks.workunit.client.0.smithi063.stdout:9/256: dwrite d7/d9/d12/f42 [0,4194304] 0 2024-09-16T01:25:12.075 INFO:tasks.workunit.client.0.smithi063.stdout:2/236: rename d3/d7/de/d21/f2d to d3/f4b 0 2024-09-16T01:25:12.079 INFO:tasks.workunit.client.0.smithi063.stdout:3/171: dwrite d2/d11/d18/fc [4194304,4194304] 0 2024-09-16T01:25:12.079 INFO:tasks.workunit.client.0.smithi063.stdout:5/226: getdents d5/d18/d29/d48 0 2024-09-16T01:25:12.080 INFO:tasks.workunit.client.0.smithi063.stdout:0/208: symlink d1/d30/d52/d5a/d44/l5f 0 2024-09-16T01:25:12.080 INFO:tasks.workunit.client.0.smithi063.stdout:5/227: fsync d5/d12/f4a 0 2024-09-16T01:25:12.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/237: symlink d3/d7/d8/d19/l4c 0 2024-09-16T01:25:12.083 INFO:tasks.workunit.client.0.smithi063.stdout:0/209: symlink d1/df/l60 0 2024-09-16T01:25:12.083 INFO:tasks.workunit.client.0.smithi063.stdout:6/191: dread d3/d10/d35/f3c [0,4194304] 0 2024-09-16T01:25:12.084 INFO:tasks.workunit.client.0.smithi063.stdout:0/210: chown d1/fc 45 1 2024-09-16T01:25:12.084 INFO:tasks.workunit.client.0.smithi063.stdout:8/124: rename d5/db/d12/d1a/f1d to d5/f25 0 2024-09-16T01:25:12.085 INFO:tasks.workunit.client.0.smithi063.stdout:5/228: symlink d5/d12/l4e 0 2024-09-16T01:25:12.085 INFO:tasks.workunit.client.0.smithi063.stdout:8/125: write d5/f8 [3630708,83255] 0 2024-09-16T01:25:12.086 INFO:tasks.workunit.client.0.smithi063.stdout:0/211: creat d1/d30/d52/d5a/d36/d41/f61 x:0 0 0 2024-09-16T01:25:12.088 INFO:tasks.workunit.client.0.smithi063.stdout:9/257: rename d7/f36 to d7/d9/d12/f5d 0 2024-09-16T01:25:12.089 INFO:tasks.workunit.client.0.smithi063.stdout:2/238: symlink d3/d7/d8/d1f/d37/l4d 0 2024-09-16T01:25:12.089 INFO:tasks.workunit.client.0.smithi063.stdout:6/192: mkdir d3/d4a 0 2024-09-16T01:25:12.091 INFO:tasks.workunit.client.0.smithi063.stdout:8/126: unlink d5/db/d12/d1a/d1e/f20 0 2024-09-16T01:25:12.092 INFO:tasks.workunit.client.0.smithi063.stdout:3/172: rename d2/d12/l15 to d2/d11/d37/l3a 0 2024-09-16T01:25:12.093 INFO:tasks.workunit.client.0.smithi063.stdout:9/258: dread d7/d9/d12/f52 [0,4194304] 0 2024-09-16T01:25:12.094 INFO:tasks.workunit.client.0.smithi063.stdout:2/239: rmdir d3/d7/d8/d19 39 2024-09-16T01:25:12.095 INFO:tasks.workunit.client.0.smithi063.stdout:6/193: mknod d3/d48/d28/c4b 0 2024-09-16T01:25:12.096 INFO:tasks.workunit.client.0.smithi063.stdout:5/229: truncate d5/d18/f42 60911 0 2024-09-16T01:25:12.097 INFO:tasks.workunit.client.0.smithi063.stdout:8/127: write d5/d9/f16 [4739176,47186] 0 2024-09-16T01:25:12.100 INFO:tasks.workunit.client.0.smithi063.stdout:9/259: dread d7/d9/d12/f24 [0,4194304] 0 2024-09-16T01:25:12.101 INFO:tasks.workunit.client.0.smithi063.stdout:2/240: fsync d3/d7/d8/d19/f44 0 2024-09-16T01:25:12.102 INFO:tasks.workunit.client.0.smithi063.stdout:8/128: read d5/db/d12/f15 [648771,37159] 0 2024-09-16T01:25:12.103 INFO:tasks.workunit.client.0.smithi063.stdout:3/173: dwrite d2/d11/f29 [0,4194304] 0 2024-09-16T01:25:12.108 INFO:tasks.workunit.client.0.smithi063.stdout:8/129: dread - d5/d9/f24 zero size 2024-09-16T01:25:12.108 INFO:tasks.workunit.client.0.smithi063.stdout:9/260: fdatasync d7/d9/d12/f33 0 2024-09-16T01:25:12.109 INFO:tasks.workunit.client.0.smithi063.stdout:5/230: link d5/d18/l3f d5/d12/l4f 0 2024-09-16T01:25:12.110 INFO:tasks.workunit.client.0.smithi063.stdout:3/174: mkdir d2/d11/d39/d3b 0 2024-09-16T01:25:12.111 INFO:tasks.workunit.client.0.smithi063.stdout:5/231: readlink d5/d18/l27 0 2024-09-16T01:25:12.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/261: read - d7/d9/d12/d14/f46 zero size 2024-09-16T01:25:12.114 INFO:tasks.workunit.client.0.smithi063.stdout:8/130: mknod d5/c26 0 2024-09-16T01:25:12.114 INFO:tasks.workunit.client.0.smithi063.stdout:3/175: write d2/f33 [1858368,87924] 0 2024-09-16T01:25:12.115 INFO:tasks.workunit.client.0.smithi063.stdout:6/194: dwrite d3/f21 [0,4194304] 0 2024-09-16T01:25:12.119 INFO:tasks.workunit.client.0.smithi063.stdout:6/195: chown d3/l1a 0 1 2024-09-16T01:25:12.122 INFO:tasks.workunit.client.0.smithi063.stdout:2/241: dwrite d3/d7/d8/d1f/f3a [4194304,4194304] 0 2024-09-16T01:25:12.125 INFO:tasks.workunit.client.0.smithi063.stdout:5/232: rename d5/d18/l28 to d5/d18/d4b/l50 0 2024-09-16T01:25:12.128 INFO:tasks.workunit.client.0.smithi063.stdout:2/242: chown d3/ff 1 1 2024-09-16T01:25:12.129 INFO:tasks.workunit.client.0.smithi063.stdout:3/176: truncate d2/f10 4564925 0 2024-09-16T01:25:12.131 INFO:tasks.workunit.client.0.smithi063.stdout:6/196: dread d3/d10/d35/f3c [0,4194304] 0 2024-09-16T01:25:12.132 INFO:tasks.workunit.client.0.smithi063.stdout:8/131: dwrite d5/f7 [0,4194304] 0 2024-09-16T01:25:12.134 INFO:tasks.workunit.client.0.smithi063.stdout:9/262: dwrite d7/d1f/f44 [4194304,4194304] 0 2024-09-16T01:25:12.136 INFO:tasks.workunit.client.0.smithi063.stdout:5/233: link d5/d12/f40 d5/f51 0 2024-09-16T01:25:12.137 INFO:tasks.workunit.client.0.smithi063.stdout:2/243: mkdir d3/d7/de/d21/d28/d4e 0 2024-09-16T01:25:12.139 INFO:tasks.workunit.client.0.smithi063.stdout:3/177: creat d2/d12/d30/f3c x:0 0 0 2024-09-16T01:25:12.139 INFO:tasks.workunit.client.0.smithi063.stdout:5/234: mkdir d5/d18/d29/d52 0 2024-09-16T01:25:12.140 INFO:tasks.workunit.client.0.smithi063.stdout:9/263: fdatasync d7/d9/d12/f5d 0 2024-09-16T01:25:12.144 INFO:tasks.workunit.client.0.smithi063.stdout:8/132: rename d5/db/l17 to d5/db/d12/d1a/l27 0 2024-09-16T01:25:12.144 INFO:tasks.workunit.client.0.smithi063.stdout:6/197: dwrite d3/d48/d28/f33 [0,4194304] 0 2024-09-16T01:25:12.148 INFO:tasks.workunit.client.0.smithi063.stdout:6/198: chown d3/d48/d28/d3e/d44 550036413 1 2024-09-16T01:25:12.149 INFO:tasks.workunit.client.0.smithi063.stdout:9/264: rename d7/d9/d12/d14/d23/f47 to d7/d9/d12/f5e 0 2024-09-16T01:25:12.150 INFO:tasks.workunit.client.0.smithi063.stdout:2/244: dread d3/d7/d8/d19/f24 [0,4194304] 0 2024-09-16T01:25:12.152 INFO:tasks.workunit.client.0.smithi063.stdout:5/235: dwrite d5/f9 [0,4194304] 0 2024-09-16T01:25:12.152 INFO:tasks.workunit.client.0.smithi063.stdout:8/133: unlink d5/d9/c22 0 2024-09-16T01:25:12.158 INFO:tasks.workunit.client.0.smithi063.stdout:3/178: dread d2/d11/d39/f20 [0,4194304] 0 2024-09-16T01:25:12.158 INFO:tasks.workunit.client.0.smithi063.stdout:2/245: unlink d3/d7/c14 0 2024-09-16T01:25:12.159 INFO:tasks.workunit.client.0.smithi063.stdout:6/199: symlink d3/l4c 0 2024-09-16T01:25:12.161 INFO:tasks.workunit.client.0.smithi063.stdout:8/134: chown d5/db/d12/d1a/l1c 1091 1 2024-09-16T01:25:12.165 INFO:tasks.workunit.client.0.smithi063.stdout:2/246: mkdir d3/d7/d8/d1f/d37/d4f 0 2024-09-16T01:25:12.165 INFO:tasks.workunit.client.0.smithi063.stdout:6/200: rmdir d3/d30/d39 39 2024-09-16T01:25:12.167 INFO:tasks.workunit.client.0.smithi063.stdout:5/236: symlink d5/d18/d29/d52/l53 0 2024-09-16T01:25:12.168 INFO:tasks.workunit.client.0.smithi063.stdout:9/265: rmdir d7/d9/d20/d58 0 2024-09-16T01:25:12.170 INFO:tasks.workunit.client.0.smithi063.stdout:2/247: mknod d3/d7/d8/d1f/d34/c50 0 2024-09-16T01:25:12.171 INFO:tasks.workunit.client.0.smithi063.stdout:3/179: creat d2/d11/d18/f3d x:0 0 0 2024-09-16T01:25:12.172 INFO:tasks.workunit.client.0.smithi063.stdout:9/266: stat d7/d9/d20/f2b 0 2024-09-16T01:25:12.172 INFO:tasks.workunit.client.0.smithi063.stdout:8/135: dread d5/db/d12/f15 [0,4194304] 0 2024-09-16T01:25:12.174 INFO:tasks.workunit.client.0.smithi063.stdout:9/267: fsync d7/d1f/f2f 0 2024-09-16T01:25:12.174 INFO:tasks.workunit.client.0.smithi063.stdout:2/248: creat d3/f51 x:0 0 0 2024-09-16T01:25:12.175 INFO:tasks.workunit.client.0.smithi063.stdout:3/180: fdatasync d2/d11/d18/fd 0 2024-09-16T01:25:12.177 INFO:tasks.workunit.client.0.smithi063.stdout:8/136: unlink d5/db/d12/c18 0 2024-09-16T01:25:12.177 INFO:tasks.workunit.client.0.smithi063.stdout:5/237: dwrite d5/d12/f4a [0,4194304] 0 2024-09-16T01:25:12.179 INFO:tasks.workunit.client.0.smithi063.stdout:5/238: chown d5/d12/f4a 29 1 2024-09-16T01:25:12.180 INFO:tasks.workunit.client.0.smithi063.stdout:9/268: mkdir d7/d9/d12/d14/d23/d55/d5f 0 2024-09-16T01:25:12.180 INFO:tasks.workunit.client.0.smithi063.stdout:5/239: readlink d5/d18/d29/l44 0 2024-09-16T01:25:12.182 INFO:tasks.workunit.client.0.smithi063.stdout:5/240: write d5/f38 [335551,55070] 0 2024-09-16T01:25:12.182 INFO:tasks.workunit.client.0.smithi063.stdout:2/249: symlink d3/d7/d8/d1f/d37/d4f/l52 0 2024-09-16T01:25:12.184 INFO:tasks.workunit.client.0.smithi063.stdout:3/181: mknod d2/d11/d39/d3b/c3e 0 2024-09-16T01:25:12.185 INFO:tasks.workunit.client.0.smithi063.stdout:8/137: dread d5/f7 [0,4194304] 0 2024-09-16T01:25:12.185 INFO:tasks.workunit.client.0.smithi063.stdout:9/269: fdatasync d7/d4a/f59 0 2024-09-16T01:25:12.186 INFO:tasks.workunit.client.0.smithi063.stdout:3/182: write d2/d11/d18/f3d [322986,81788] 0 2024-09-16T01:25:12.186 INFO:tasks.workunit.client.0.smithi063.stdout:9/270: dread - d7/d9/d12/d14/f46 zero size 2024-09-16T01:25:12.192 INFO:tasks.workunit.client.0.smithi063.stdout:8/138: dwrite d5/f10 [0,4194304] 0 2024-09-16T01:25:12.195 INFO:tasks.workunit.client.0.smithi063.stdout:3/183: creat d2/d11/d18/f3f x:0 0 0 2024-09-16T01:25:12.199 INFO:tasks.workunit.client.0.smithi063.stdout:2/250: getdents d3/d7/d8/d1f 0 2024-09-16T01:25:12.200 INFO:tasks.workunit.client.0.smithi063.stdout:3/184: mkdir d2/d11/d37/d40 0 2024-09-16T01:25:12.202 INFO:tasks.workunit.client.0.smithi063.stdout:8/139: link d5/f7 d5/f28 0 2024-09-16T01:25:12.203 INFO:tasks.workunit.client.0.smithi063.stdout:5/241: write d5/d12/f1e [754391,16531] 0 2024-09-16T01:25:12.206 INFO:tasks.workunit.client.0.smithi063.stdout:9/271: write f5 [2794390,8599] 0 2024-09-16T01:25:12.206 INFO:tasks.workunit.client.0.smithi063.stdout:3/185: chown d2/d11/d18/c1e 1 1 2024-09-16T01:25:12.208 INFO:tasks.workunit.client.0.smithi063.stdout:2/251: dwrite d3/d7/f16 [0,4194304] 0 2024-09-16T01:25:12.209 INFO:tasks.workunit.client.0.smithi063.stdout:9/272: mknod d7/d9/d12/c60 0 2024-09-16T01:25:12.211 INFO:tasks.workunit.client.0.smithi063.stdout:3/186: unlink d2/d11/d39/c25 0 2024-09-16T01:25:12.213 INFO:tasks.workunit.client.0.smithi063.stdout:8/140: truncate d5/f7 578720 0 2024-09-16T01:25:12.213 INFO:tasks.workunit.client.0.smithi063.stdout:8/141: dread - d5/db/d12/f23 zero size 2024-09-16T01:25:12.216 INFO:tasks.workunit.client.0.smithi063.stdout:3/187: getdents d2/d12 0 2024-09-16T01:25:12.270 INFO:tasks.workunit.client.0.smithi063.stdout:1/240: sync 2024-09-16T01:25:12.271 INFO:tasks.workunit.client.0.smithi063.stdout:4/212: sync 2024-09-16T01:25:12.271 INFO:tasks.workunit.client.0.smithi063.stdout:7/172: sync 2024-09-16T01:25:12.284 INFO:tasks.workunit.client.0.smithi063.stdout:8/142: creat d5/f29 x:0 0 0 2024-09-16T01:25:12.284 INFO:tasks.workunit.client.0.smithi063.stdout:1/241: stat d1 0 2024-09-16T01:25:12.285 INFO:tasks.workunit.client.0.smithi063.stdout:3/188: fdatasync d2/d11/d18/fd 0 2024-09-16T01:25:12.288 INFO:tasks.workunit.client.0.smithi063.stdout:8/143: read - d5/db/d12/f23 zero size 2024-09-16T01:25:12.288 INFO:tasks.workunit.client.0.smithi063.stdout:7/173: creat d7/d18/f36 x:0 0 0 2024-09-16T01:25:12.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/273: dwrite d7/d9/d12/d14/f31 [0,4194304] 0 2024-09-16T01:25:12.290 INFO:tasks.workunit.client.0.smithi063.stdout:8/144: readlink d5/l1b 0 2024-09-16T01:25:12.292 INFO:tasks.workunit.client.0.smithi063.stdout:8/145: read d5/f10 [2345952,106670] 0 2024-09-16T01:25:12.293 INFO:tasks.workunit.client.0.smithi063.stdout:4/213: truncate d5/d3b/df/f18 1212336 0 2024-09-16T01:25:12.293 INFO:tasks.workunit.client.0.smithi063.stdout:7/174: creat d7/d18/f37 x:0 0 0 2024-09-16T01:25:12.296 INFO:tasks.workunit.client.0.smithi063.stdout:7/175: dread - d7/d18/f36 zero size 2024-09-16T01:25:12.296 INFO:tasks.workunit.client.0.smithi063.stdout:8/146: rmdir d5 39 2024-09-16T01:25:12.297 INFO:tasks.workunit.client.0.smithi063.stdout:5/242: dread d5/f3b [0,4194304] 0 2024-09-16T01:25:12.301 INFO:tasks.workunit.client.0.smithi063.stdout:8/147: stat d5/d9/f16 0 2024-09-16T01:25:12.301 INFO:tasks.workunit.client.0.smithi063.stdout:7/176: creat d7/d1c/d1f/f38 x:0 0 0 2024-09-16T01:25:12.303 INFO:tasks.workunit.client.0.smithi063.stdout:5/243: creat d5/d18/d29/d48/f54 x:0 0 0 2024-09-16T01:25:12.304 INFO:tasks.workunit.client.0.smithi063.stdout:9/274: dwrite d7/d9/d12/f2e [8388608,4194304] 0 2024-09-16T01:25:12.305 INFO:tasks.workunit.client.0.smithi063.stdout:8/148: chown d5/d9/cf 123 1 2024-09-16T01:25:12.306 INFO:tasks.workunit.client.0.smithi063.stdout:7/177: mkdir d7/d18/d39 0 2024-09-16T01:25:12.307 INFO:tasks.workunit.client.0.smithi063.stdout:1/242: dread d1/d5/f13 [0,4194304] 0 2024-09-16T01:25:12.308 INFO:tasks.workunit.client.0.smithi063.stdout:5/244: symlink d5/d18/d29/d52/l55 0 2024-09-16T01:25:12.309 INFO:tasks.workunit.client.0.smithi063.stdout:8/149: chown d5/db/d12/f23 486 1 2024-09-16T01:25:12.311 INFO:tasks.workunit.client.0.smithi063.stdout:4/214: dwrite d5/d3b/f1d [4194304,4194304] 0 2024-09-16T01:25:12.311 INFO:tasks.workunit.client.0.smithi063.stdout:9/275: write d7/d9/d12/d14/f29 [728917,37418] 0 2024-09-16T01:25:12.311 INFO:tasks.workunit.client.0.smithi063.stdout:1/243: write d1/dd/d3b/f44 [489548,51889] 0 2024-09-16T01:25:12.314 INFO:tasks.workunit.client.0.smithi063.stdout:7/178: truncate d7/d1c/d1f/f26 4742492 0 2024-09-16T01:25:12.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/245: creat d5/d12/f56 x:0 0 0 2024-09-16T01:25:12.315 INFO:tasks.workunit.client.0.smithi063.stdout:8/150: creat d5/db/f2a x:0 0 0 2024-09-16T01:25:12.318 INFO:tasks.workunit.client.0.smithi063.stdout:7/179: chown d7/d18/f22 13 1 2024-09-16T01:25:12.318 INFO:tasks.workunit.client.0.smithi063.stdout:4/215: write d5/d3b/df/d1c/d29/d32/f3c [118744,31881] 0 2024-09-16T01:25:12.318 INFO:tasks.workunit.client.0.smithi063.stdout:9/276: write d7/d9/d12/f52 [3787509,111018] 0 2024-09-16T01:25:12.318 INFO:tasks.workunit.client.0.smithi063.stdout:1/244: creat d1/d12/d16/f54 x:0 0 0 2024-09-16T01:25:12.319 INFO:tasks.workunit.client.0.smithi063.stdout:8/151: creat d5/db/d12/d1a/d1e/f2b x:0 0 0 2024-09-16T01:25:12.320 INFO:tasks.workunit.client.0.smithi063.stdout:7/180: dread - d7/d1c/d1f/f28 zero size 2024-09-16T01:25:12.321 INFO:tasks.workunit.client.0.smithi063.stdout:9/277: write d7/d9/d12/f39 [36600,101801] 0 2024-09-16T01:25:12.321 INFO:tasks.workunit.client.0.smithi063.stdout:5/246: truncate d5/d18/d29/f32 4315790 0 2024-09-16T01:25:12.322 INFO:tasks.workunit.client.0.smithi063.stdout:1/245: unlink d1/l38 0 2024-09-16T01:25:12.322 INFO:tasks.workunit.client.0.smithi063.stdout:4/216: dread - d5/d3b/df/d1c/f39 zero size 2024-09-16T01:25:12.326 INFO:tasks.workunit.client.0.smithi063.stdout:9/278: write d7/d9/d12/d14/f29 [165569,65097] 0 2024-09-16T01:25:12.329 INFO:tasks.workunit.client.0.smithi063.stdout:7/181: symlink d7/d18/d39/l3a 0 2024-09-16T01:25:12.330 INFO:tasks.workunit.client.0.smithi063.stdout:9/279: stat d7/d9/d20/f3b 0 2024-09-16T01:25:12.330 INFO:tasks.workunit.client.0.smithi063.stdout:8/152: rename d5/db/d12/d1a/d1e/f2b to d5/db/d12/d1a/f2c 0 2024-09-16T01:25:12.332 INFO:tasks.workunit.client.0.smithi063.stdout:8/153: readlink l2 0 2024-09-16T01:25:12.333 INFO:tasks.workunit.client.0.smithi063.stdout:5/247: dread d5/f10 [0,4194304] 0 2024-09-16T01:25:12.333 INFO:tasks.workunit.client.0.smithi063.stdout:7/182: dread - d7/d1c/d1f/f2b zero size 2024-09-16T01:25:12.335 INFO:tasks.workunit.client.0.smithi063.stdout:8/154: chown d5/c26 136633 1 2024-09-16T01:25:12.335 INFO:tasks.workunit.client.0.smithi063.stdout:9/280: unlink d7/d9/d12/d14/c37 0 2024-09-16T01:25:12.338 INFO:tasks.workunit.client.0.smithi063.stdout:4/217: dwrite d5/d3b/df/f3e [0,4194304] 0 2024-09-16T01:25:12.339 INFO:tasks.workunit.client.0.smithi063.stdout:1/246: dwrite d1/d5/d15/f19 [0,4194304] 0 2024-09-16T01:25:12.341 INFO:tasks.workunit.client.0.smithi063.stdout:9/281: write d7/d4a/d4d/d50/f45 [3467200,37460] 0 2024-09-16T01:25:12.346 INFO:tasks.workunit.client.0.smithi063.stdout:4/218: creat d5/d3b/df/d1c/d29/d20/f44 x:0 0 0 2024-09-16T01:25:12.348 INFO:tasks.workunit.client.0.smithi063.stdout:5/248: dwrite d5/d18/d29/f2f [0,4194304] 0 2024-09-16T01:25:12.352 INFO:tasks.workunit.client.0.smithi063.stdout:8/155: getdents d5/db/d12/d1a/d1e 0 2024-09-16T01:25:12.352 INFO:tasks.workunit.client.0.smithi063.stdout:1/247: link d1/d12/l36 d1/d12/l55 0 2024-09-16T01:25:12.352 INFO:tasks.workunit.client.0.smithi063.stdout:5/249: dread d5/d12/f43 [0,4194304] 0 2024-09-16T01:25:12.355 INFO:tasks.workunit.client.0.smithi063.stdout:5/250: mknod d5/d12/c57 0 2024-09-16T01:25:12.356 INFO:tasks.workunit.client.0.smithi063.stdout:1/248: mkdir d1/d12/d56 0 2024-09-16T01:25:12.358 INFO:tasks.workunit.client.0.smithi063.stdout:4/219: write d5/d3b/df/d1c/f31 [795638,119756] 0 2024-09-16T01:25:12.359 INFO:tasks.workunit.client.0.smithi063.stdout:5/251: mknod d5/d12/d35/c58 0 2024-09-16T01:25:12.361 INFO:tasks.workunit.client.0.smithi063.stdout:8/156: dwrite d5/f8 [0,4194304] 0 2024-09-16T01:25:12.361 INFO:tasks.workunit.client.0.smithi063.stdout:5/252: truncate d5/d12/f2d 5191029 0 2024-09-16T01:25:12.362 INFO:tasks.workunit.client.0.smithi063.stdout:7/183: dread d7/d1c/d1f/f32 [0,4194304] 0 2024-09-16T01:25:12.364 INFO:tasks.workunit.client.0.smithi063.stdout:8/157: creat d5/db/d12/f2d x:0 0 0 2024-09-16T01:25:12.365 INFO:tasks.workunit.client.0.smithi063.stdout:4/220: getdents d5/d3b/df 0 2024-09-16T01:25:12.367 INFO:tasks.workunit.client.0.smithi063.stdout:7/184: write d7/d18/d25/f31 [5153398,126636] 0 2024-09-16T01:25:12.368 INFO:tasks.workunit.client.0.smithi063.stdout:8/158: mknod d5/d9/c2e 0 2024-09-16T01:25:12.369 INFO:tasks.workunit.client.0.smithi063.stdout:4/221: readlink d5/d3b/l15 0 2024-09-16T01:25:12.370 INFO:tasks.workunit.client.0.smithi063.stdout:5/253: rmdir d5/d18/d29/d3c 0 2024-09-16T01:25:12.372 INFO:tasks.workunit.client.0.smithi063.stdout:8/159: mkdir d5/d9/d2f 0 2024-09-16T01:25:12.374 INFO:tasks.workunit.client.0.smithi063.stdout:8/160: dread d5/f28 [0,4194304] 0 2024-09-16T01:25:12.374 INFO:tasks.workunit.client.0.smithi063.stdout:7/185: rename d7/c16 to d7/d1c/d1f/c3b 0 2024-09-16T01:25:12.375 INFO:tasks.workunit.client.0.smithi063.stdout:1/249: dread d1/d5/f10 [0,4194304] 0 2024-09-16T01:25:12.376 INFO:tasks.workunit.client.0.smithi063.stdout:4/222: rename d5/d3b/df/c2a to d5/d3b/df/d1c/d29/d20/c45 0 2024-09-16T01:25:12.377 INFO:tasks.workunit.client.0.smithi063.stdout:7/186: read d7/d1c/d1f/f26 [1432568,45351] 0 2024-09-16T01:25:12.377 INFO:tasks.workunit.client.0.smithi063.stdout:5/254: getdents d5/d18/d29/d52 0 2024-09-16T01:25:12.378 INFO:tasks.workunit.client.0.smithi063.stdout:5/255: fsync d5/d12/f49 0 2024-09-16T01:25:12.379 INFO:tasks.workunit.client.0.smithi063.stdout:7/187: chown d7/ff 102645830 1 2024-09-16T01:25:12.380 INFO:tasks.workunit.client.0.smithi063.stdout:5/256: fsync d5/d12/f13 0 2024-09-16T01:25:12.380 INFO:tasks.workunit.client.0.smithi063.stdout:8/161: link d5/db/cd d5/d9/d2f/c30 0 2024-09-16T01:25:12.381 INFO:tasks.workunit.client.0.smithi063.stdout:5/257: chown d5/d12/f49 46 1 2024-09-16T01:25:12.382 INFO:tasks.workunit.client.0.smithi063.stdout:1/250: rename d1/d12/d16/f54 to d1/f57 0 2024-09-16T01:25:12.382 INFO:tasks.workunit.client.0.smithi063.stdout:1/251: read d1/d5/f10 [3624742,7136] 0 2024-09-16T01:25:12.384 INFO:tasks.workunit.client.0.smithi063.stdout:8/162: dread d5/f8 [0,4194304] 0 2024-09-16T01:25:12.385 INFO:tasks.workunit.client.0.smithi063.stdout:0/212: sync 2024-09-16T01:25:12.386 INFO:tasks.workunit.client.0.smithi063.stdout:1/252: creat d1/dd/d3b/f58 x:0 0 0 2024-09-16T01:25:12.387 INFO:tasks.workunit.client.0.smithi063.stdout:4/223: rename d5/d3b/df/d1c/d29/d32/c2b to d5/d3b/df/c46 0 2024-09-16T01:25:12.388 INFO:tasks.workunit.client.0.smithi063.stdout:7/188: link d7/d18/d39/l3a d7/d18/l3c 0 2024-09-16T01:25:12.389 INFO:tasks.workunit.client.0.smithi063.stdout:4/224: chown d5/d3b/f2d 6 1 2024-09-16T01:25:12.389 INFO:tasks.workunit.client.0.smithi063.stdout:7/189: fsync f5 0 2024-09-16T01:25:12.391 INFO:tasks.workunit.client.0.smithi063.stdout:1/253: unlink d1/dd/f20 0 2024-09-16T01:25:12.392 INFO:tasks.workunit.client.0.smithi063.stdout:4/225: chown d5/d3b/df/d1c/d29 172 1 2024-09-16T01:25:12.393 INFO:tasks.workunit.client.0.smithi063.stdout:0/213: dwrite d1/d2e/f37 [0,4194304] 0 2024-09-16T01:25:12.397 INFO:tasks.workunit.client.0.smithi063.stdout:8/163: dwrite d5/f8 [0,4194304] 0 2024-09-16T01:25:12.397 INFO:tasks.workunit.client.0.smithi063.stdout:4/226: write d5/f6 [3692648,12338] 0 2024-09-16T01:25:12.397 INFO:tasks.workunit.client.0.smithi063.stdout:0/214: mknod d1/d2e/d48/c62 0 2024-09-16T01:25:12.402 INFO:tasks.workunit.client.0.smithi063.stdout:7/190: dwrite d7/d1c/d1f/f2e [0,4194304] 0 2024-09-16T01:25:12.406 INFO:tasks.workunit.client.0.smithi063.stdout:7/191: readlink d7/d18/l21 0 2024-09-16T01:25:12.413 INFO:tasks.workunit.client.0.smithi063.stdout:5/258: dwrite d5/d18/f24 [0,4194304] 0 2024-09-16T01:25:12.413 INFO:tasks.workunit.client.0.smithi063.stdout:4/227: dwrite d5/d3b/f1d [0,4194304] 0 2024-09-16T01:25:12.414 INFO:tasks.workunit.client.0.smithi063.stdout:0/215: dwrite d1/fb [8388608,4194304] 0 2024-09-16T01:25:12.415 INFO:tasks.workunit.client.0.smithi063.stdout:8/164: dread d5/d9/f16 [0,4194304] 0 2024-09-16T01:25:12.416 INFO:tasks.workunit.client.0.smithi063.stdout:7/192: rename d7/d1c/d1f/f26 to d7/d1c/d1f/d29/f3d 0 2024-09-16T01:25:12.417 INFO:tasks.workunit.client.0.smithi063.stdout:7/193: readlink d7/l17 0 2024-09-16T01:25:12.417 INFO:tasks.workunit.client.0.smithi063.stdout:4/228: write d5/f42 [477933,127502] 0 2024-09-16T01:25:12.419 INFO:tasks.workunit.client.0.smithi063.stdout:4/229: fdatasync d5/f3f 0 2024-09-16T01:25:12.422 INFO:tasks.workunit.client.0.smithi063.stdout:4/230: write d5/d3b/f2d [550046,75305] 0 2024-09-16T01:25:12.424 INFO:tasks.workunit.client.0.smithi063.stdout:0/216: getdents d1/df/d2c 0 2024-09-16T01:25:12.424 INFO:tasks.workunit.client.0.smithi063.stdout:8/165: mknod d5/d9/d2f/c31 0 2024-09-16T01:25:12.426 INFO:tasks.workunit.client.0.smithi063.stdout:5/259: dwrite d5/d12/f4a [4194304,4194304] 0 2024-09-16T01:25:12.429 INFO:tasks.workunit.client.0.smithi063.stdout:4/231: symlink d5/d3b/df/d1c/d29/l47 0 2024-09-16T01:25:12.430 INFO:tasks.workunit.client.0.smithi063.stdout:4/232: stat d5/f42 0 2024-09-16T01:25:12.430 INFO:tasks.workunit.client.0.smithi063.stdout:8/166: creat d5/db/d12/d1a/d1e/f32 x:0 0 0 2024-09-16T01:25:12.431 INFO:tasks.workunit.client.0.smithi063.stdout:4/233: dread - d5/d3b/df/d1c/f36 zero size 2024-09-16T01:25:12.432 INFO:tasks.workunit.client.0.smithi063.stdout:5/260: rename d5/d18/f34 to d5/d12/d35/f59 0 2024-09-16T01:25:12.433 INFO:tasks.workunit.client.0.smithi063.stdout:7/194: truncate d7/fe 6285786 0 2024-09-16T01:25:12.433 INFO:tasks.workunit.client.0.smithi063.stdout:7/195: chown d7/c33 4192 1 2024-09-16T01:25:12.437 INFO:tasks.workunit.client.0.smithi063.stdout:4/234: rename d5/d3b/c12 to d5/d3b/df/d1c/c48 0 2024-09-16T01:25:12.438 INFO:tasks.workunit.client.0.smithi063.stdout:5/261: dread d5/d12/f4a [0,4194304] 0 2024-09-16T01:25:12.441 INFO:tasks.workunit.client.0.smithi063.stdout:7/196: creat d7/f3e x:0 0 0 2024-09-16T01:25:12.443 INFO:tasks.workunit.client.0.smithi063.stdout:8/167: write d5/db/d12/f15 [348185,129658] 0 2024-09-16T01:25:12.444 INFO:tasks.workunit.client.0.smithi063.stdout:0/217: dread d1/f7 [0,4194304] 0 2024-09-16T01:25:12.444 INFO:tasks.workunit.client.0.smithi063.stdout:4/235: rmdir d5/d3b/df/d1c/d29/d32 39 2024-09-16T01:25:12.445 INFO:tasks.workunit.client.0.smithi063.stdout:4/236: dread - d5/d3b/f41 zero size 2024-09-16T01:25:12.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/262: dread d5/d12/f1e [0,4194304] 0 2024-09-16T01:25:12.447 INFO:tasks.workunit.client.0.smithi063.stdout:4/237: dread - d5/d3b/df/d1c/f36 zero size 2024-09-16T01:25:12.447 INFO:tasks.workunit.client.0.smithi063.stdout:5/263: read - d5/d12/f49 zero size 2024-09-16T01:25:12.447 INFO:tasks.workunit.client.0.smithi063.stdout:8/168: unlink d5/f7 0 2024-09-16T01:25:12.447 INFO:tasks.workunit.client.0.smithi063.stdout:0/218: fdatasync d1/d30/d52/d5a/f3e 0 2024-09-16T01:25:12.448 INFO:tasks.workunit.client.0.smithi063.stdout:8/169: fdatasync d5/db/d12/f2d 0 2024-09-16T01:25:12.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/238: mkdir d5/d3b/df/d1c/d49 0 2024-09-16T01:25:12.450 INFO:tasks.workunit.client.0.smithi063.stdout:0/219: mknod d1/c63 0 2024-09-16T01:25:12.450 INFO:tasks.workunit.client.0.smithi063.stdout:8/170: fdatasync d5/d9/f16 0 2024-09-16T01:25:12.451 INFO:tasks.workunit.client.0.smithi063.stdout:8/171: dread - d5/db/d12/f2d zero size 2024-09-16T01:25:12.453 INFO:tasks.workunit.client.0.smithi063.stdout:0/220: creat d1/d30/d52/d5a/d44/f64 x:0 0 0 2024-09-16T01:25:12.453 INFO:tasks.workunit.client.0.smithi063.stdout:5/264: dwrite d5/d12/f21 [4194304,4194304] 0 2024-09-16T01:25:12.454 INFO:tasks.workunit.client.0.smithi063.stdout:8/172: truncate d5/db/d12/d1a/f2c 993296 0 2024-09-16T01:25:12.457 INFO:tasks.workunit.client.0.smithi063.stdout:5/265: symlink d5/d12/l5a 0 2024-09-16T01:25:12.458 INFO:tasks.workunit.client.0.smithi063.stdout:0/221: dread d1/d2e/f2f [0,4194304] 0 2024-09-16T01:25:12.460 INFO:tasks.workunit.client.0.smithi063.stdout:8/173: rename d5/d9/cf to d5/db/d12/d1a/c33 0 2024-09-16T01:25:12.460 INFO:tasks.workunit.client.0.smithi063.stdout:0/222: mknod d1/d30/c65 0 2024-09-16T01:25:12.462 INFO:tasks.workunit.client.0.smithi063.stdout:0/223: write d1/df/d17/f22 [7457024,13569] 0 2024-09-16T01:25:12.465 INFO:tasks.workunit.client.0.smithi063.stdout:8/174: getdents d5 0 2024-09-16T01:25:12.467 INFO:tasks.workunit.client.0.smithi063.stdout:5/266: dwrite d5/d12/d35/f59 [0,4194304] 0 2024-09-16T01:25:12.467 INFO:tasks.workunit.client.0.smithi063.stdout:0/224: mknod d1/d30/d52/d5a/d44/c66 0 2024-09-16T01:25:12.468 INFO:tasks.workunit.client.0.smithi063.stdout:0/225: write d1/df/f40 [2125567,112397] 0 2024-09-16T01:25:12.469 INFO:tasks.workunit.client.0.smithi063.stdout:8/175: mknod d5/db/d12/d1a/d1e/c34 0 2024-09-16T01:25:12.470 INFO:tasks.workunit.client.0.smithi063.stdout:0/226: chown d1/df/d34/f5c 0 1 2024-09-16T01:25:12.474 INFO:tasks.workunit.client.0.smithi063.stdout:5/267: dwrite d5/d18/f37 [4194304,4194304] 0 2024-09-16T01:25:12.476 INFO:tasks.workunit.client.0.smithi063.stdout:5/268: chown d5/d18/l2c 92320 1 2024-09-16T01:25:12.480 INFO:tasks.workunit.client.0.smithi063.stdout:0/227: dwrite d1/f31 [0,4194304] 0 2024-09-16T01:25:12.481 INFO:tasks.workunit.client.0.smithi063.stdout:0/228: read - d1/d2e/f4a zero size 2024-09-16T01:25:12.483 INFO:tasks.workunit.client.0.smithi063.stdout:5/269: truncate d5/d12/f13 2529128 0 2024-09-16T01:25:12.485 INFO:tasks.workunit.client.0.smithi063.stdout:0/229: write d1/df/d2c/f39 [897891,42842] 0 2024-09-16T01:25:12.486 INFO:tasks.workunit.client.0.smithi063.stdout:5/270: mkdir d5/d18/d29/d5b 0 2024-09-16T01:25:12.488 INFO:tasks.workunit.client.0.smithi063.stdout:8/176: dwrite d5/db/d12/d1a/f2c [0,4194304] 0 2024-09-16T01:25:12.489 INFO:tasks.workunit.client.0.smithi063.stdout:0/230: mknod d1/df/d17/c67 0 2024-09-16T01:25:12.492 INFO:tasks.workunit.client.0.smithi063.stdout:5/271: rename d5/fd to d5/d18/d29/d52/f5c 0 2024-09-16T01:25:12.494 INFO:tasks.workunit.client.0.smithi063.stdout:5/272: write d5/d12/f49 [937049,80574] 0 2024-09-16T01:25:12.498 INFO:tasks.workunit.client.0.smithi063.stdout:8/177: dread d5/f10 [0,4194304] 0 2024-09-16T01:25:12.499 INFO:tasks.workunit.client.0.smithi063.stdout:0/231: dwrite d1/df/d34/f45 [0,4194304] 0 2024-09-16T01:25:12.502 INFO:tasks.workunit.client.0.smithi063.stdout:5/273: truncate d5/d12/f13 3549154 0 2024-09-16T01:25:12.503 INFO:tasks.workunit.client.0.smithi063.stdout:8/178: creat d5/d9/f35 x:0 0 0 2024-09-16T01:25:12.505 INFO:tasks.workunit.client.0.smithi063.stdout:5/274: mkdir d5/d12/d5d 0 2024-09-16T01:25:12.506 INFO:tasks.workunit.client.0.smithi063.stdout:5/275: fsync d5/d12/f23 0 2024-09-16T01:25:12.506 INFO:tasks.workunit.client.0.smithi063.stdout:0/232: dwrite d1/d30/d52/d5a/d36/d41/f47 [0,4194304] 0 2024-09-16T01:25:12.507 INFO:tasks.workunit.client.0.smithi063.stdout:8/179: write d5/f29 [14356,64167] 0 2024-09-16T01:25:12.513 INFO:tasks.workunit.client.0.smithi063.stdout:8/180: getdents d5/db/d12/d1a/d1e 0 2024-09-16T01:25:12.514 INFO:tasks.workunit.client.0.smithi063.stdout:0/233: dread d1/fc [0,4194304] 0 2024-09-16T01:25:12.514 INFO:tasks.workunit.client.0.smithi063.stdout:5/276: dwrite d5/f9 [0,4194304] 0 2024-09-16T01:25:12.514 INFO:tasks.workunit.client.0.smithi063.stdout:8/181: chown d5/d9/f24 109 1 2024-09-16T01:25:12.518 INFO:tasks.workunit.client.0.smithi063.stdout:0/234: creat d1/df/d17/f68 x:0 0 0 2024-09-16T01:25:12.518 INFO:tasks.workunit.client.0.smithi063.stdout:0/235: stat d1/l25 0 2024-09-16T01:25:12.519 INFO:tasks.workunit.client.0.smithi063.stdout:8/182: rename d5/db/d12/f23 to d5/db/d12/d1a/d1e/f36 0 2024-09-16T01:25:12.522 INFO:tasks.workunit.client.0.smithi063.stdout:0/236: mkdir d1/df/d2c/d69 0 2024-09-16T01:25:12.523 INFO:tasks.workunit.client.0.smithi063.stdout:5/277: dwrite f2 [0,4194304] 0 2024-09-16T01:25:12.523 INFO:tasks.workunit.client.0.smithi063.stdout:8/183: symlink d5/db/l37 0 2024-09-16T01:25:12.526 INFO:tasks.workunit.client.0.smithi063.stdout:5/278: unlink d5/d12/f1c 0 2024-09-16T01:25:12.528 INFO:tasks.workunit.client.0.smithi063.stdout:0/237: rmdir d1/df/d2c/d4e 0 2024-09-16T01:25:12.529 INFO:tasks.workunit.client.0.smithi063.stdout:0/238: chown d1/d2e/d50 87893 1 2024-09-16T01:25:12.529 INFO:tasks.workunit.client.0.smithi063.stdout:8/184: dwrite d5/d9/f35 [0,4194304] 0 2024-09-16T01:25:12.530 INFO:tasks.workunit.client.0.smithi063.stdout:8/185: read d5/db/d12/f15 [666290,70602] 0 2024-09-16T01:25:12.531 INFO:tasks.workunit.client.0.smithi063.stdout:0/239: truncate d1/df/d34/f5e 838847 0 2024-09-16T01:25:12.531 INFO:tasks.workunit.client.0.smithi063.stdout:5/279: mkdir d5/d18/d29/d5b/d5e 0 2024-09-16T01:25:12.532 INFO:tasks.workunit.client.0.smithi063.stdout:0/240: fdatasync d1/df/d2c/f55 0 2024-09-16T01:25:12.533 INFO:tasks.workunit.client.0.smithi063.stdout:8/186: creat d5/db/d12/f38 x:0 0 0 2024-09-16T01:25:12.533 INFO:tasks.workunit.client.0.smithi063.stdout:0/241: stat d1/d30/d52/d5a/d44/l5f 0 2024-09-16T01:25:12.535 INFO:tasks.workunit.client.0.smithi063.stdout:0/242: read - d1/d30/d52/d5a/d36/d41/f61 zero size 2024-09-16T01:25:12.535 INFO:tasks.workunit.client.0.smithi063.stdout:8/187: mknod d5/d9/c39 0 2024-09-16T01:25:12.536 INFO:tasks.workunit.client.0.smithi063.stdout:0/243: chown d1/d2e/f2f 3 1 2024-09-16T01:25:12.537 INFO:tasks.workunit.client.0.smithi063.stdout:0/244: write d1/fb [5390093,125984] 0 2024-09-16T01:25:12.538 INFO:tasks.workunit.client.0.smithi063.stdout:0/245: fsync d1/d1c/f3f 0 2024-09-16T01:25:12.538 INFO:tasks.workunit.client.0.smithi063.stdout:0/246: chown d1/d30/d52/d5a/l23 417595013 1 2024-09-16T01:25:12.539 INFO:tasks.workunit.client.0.smithi063.stdout:0/247: write d1/d30/d52/d5a/f3d [393296,14982] 0 2024-09-16T01:25:12.540 INFO:tasks.workunit.client.0.smithi063.stdout:8/188: unlink d5/f28 0 2024-09-16T01:25:12.543 INFO:tasks.workunit.client.0.smithi063.stdout:0/248: creat d1/d30/d52/d5a/d36/d41/f6a x:0 0 0 2024-09-16T01:25:12.544 INFO:tasks.workunit.client.0.smithi063.stdout:0/249: chown d1/l3 184028313 1 2024-09-16T01:25:12.547 INFO:tasks.workunit.client.0.smithi063.stdout:8/189: dwrite d5/db/d12/f2d [0,4194304] 0 2024-09-16T01:25:12.549 INFO:tasks.workunit.client.0.smithi063.stdout:0/250: truncate d1/df/f40 2575500 0 2024-09-16T01:25:12.552 INFO:tasks.workunit.client.0.smithi063.stdout:6/201: sync 2024-09-16T01:25:12.553 INFO:tasks.workunit.client.0.smithi063.stdout:2/252: sync 2024-09-16T01:25:12.553 INFO:tasks.workunit.client.0.smithi063.stdout:8/190: write d5/f10 [235927,21807] 0 2024-09-16T01:25:12.554 INFO:tasks.workunit.client.0.smithi063.stdout:0/251: dread d1/df/d34/f45 [0,4194304] 0 2024-09-16T01:25:12.555 INFO:tasks.workunit.client.0.smithi063.stdout:6/202: mknod d3/d30/c4d 0 2024-09-16T01:25:12.556 INFO:tasks.workunit.client.0.smithi063.stdout:2/253: mkdir d3/d7/d8/d19/d3c/d53 0 2024-09-16T01:25:12.557 INFO:tasks.workunit.client.0.smithi063.stdout:0/252: mknod d1/df/d2c/c6b 0 2024-09-16T01:25:12.558 INFO:tasks.workunit.client.0.smithi063.stdout:2/254: rmdir d3/d7/d8/d1f/d37 39 2024-09-16T01:25:12.559 INFO:tasks.workunit.client.0.smithi063.stdout:0/253: write d1/fc [3059949,62112] 0 2024-09-16T01:25:12.564 INFO:tasks.workunit.client.0.smithi063.stdout:2/255: dread d3/d7/d8/d1f/f3e [0,4194304] 0 2024-09-16T01:25:12.567 INFO:tasks.workunit.client.0.smithi063.stdout:0/254: dwrite d1/fc [4194304,4194304] 0 2024-09-16T01:25:12.568 INFO:tasks.workunit.client.0.smithi063.stdout:6/203: dwrite d3/d10/f23 [0,4194304] 0 2024-09-16T01:25:12.575 INFO:tasks.workunit.client.0.smithi063.stdout:2/256: dwrite d3/f4b [0,4194304] 0 2024-09-16T01:25:12.576 INFO:tasks.workunit.client.0.smithi063.stdout:0/255: dread d1/fc [0,4194304] 0 2024-09-16T01:25:12.578 INFO:tasks.workunit.client.0.smithi063.stdout:2/257: chown d3/ff 3673524 1 2024-09-16T01:25:12.578 INFO:tasks.workunit.client.0.smithi063.stdout:0/256: chown d1/fc 43080 1 2024-09-16T01:25:12.578 INFO:tasks.workunit.client.0.smithi063.stdout:6/204: creat d3/d30/f4e x:0 0 0 2024-09-16T01:25:12.579 INFO:tasks.workunit.client.0.smithi063.stdout:2/258: write d3/d7/f2e [1199521,103092] 0 2024-09-16T01:25:12.581 INFO:tasks.workunit.client.0.smithi063.stdout:0/257: truncate d1/d2e/f4a 901349 0 2024-09-16T01:25:12.583 INFO:tasks.workunit.client.0.smithi063.stdout:2/259: mknod d3/d7/d8/d1f/d37/c54 0 2024-09-16T01:25:12.584 INFO:tasks.workunit.client.0.smithi063.stdout:0/258: rmdir d1/d30/d52/d5a/d44 39 2024-09-16T01:25:12.585 INFO:tasks.workunit.client.0.smithi063.stdout:2/260: mkdir d3/d7/de/d55 0 2024-09-16T01:25:12.586 INFO:tasks.workunit.client.0.smithi063.stdout:0/259: symlink d1/df/d17/l6c 0 2024-09-16T01:25:12.588 INFO:tasks.workunit.client.0.smithi063.stdout:0/260: creat d1/df/d17/f6d x:0 0 0 2024-09-16T01:25:12.589 INFO:tasks.workunit.client.0.smithi063.stdout:0/261: chown d1/d30/d52/d5a/d36 0 1 2024-09-16T01:25:12.590 INFO:tasks.workunit.client.0.smithi063.stdout:2/261: getdents d3 0 2024-09-16T01:25:12.591 INFO:tasks.workunit.client.0.smithi063.stdout:0/262: creat d1/d2e/f6e x:0 0 0 2024-09-16T01:25:12.592 INFO:tasks.workunit.client.0.smithi063.stdout:0/263: read d1/fc [3535837,28669] 0 2024-09-16T01:25:12.592 INFO:tasks.workunit.client.0.smithi063.stdout:6/205: dread d3/d48/f26 [0,4194304] 0 2024-09-16T01:25:12.596 INFO:tasks.workunit.client.0.smithi063.stdout:6/206: creat d3/d48/d28/f4f x:0 0 0 2024-09-16T01:25:12.597 INFO:tasks.workunit.client.0.smithi063.stdout:2/262: dwrite f2 [0,4194304] 0 2024-09-16T01:25:12.600 INFO:tasks.workunit.client.0.smithi063.stdout:2/263: write d3/d7/d8/d19/f24 [3938616,124366] 0 2024-09-16T01:25:12.601 INFO:tasks.workunit.client.0.smithi063.stdout:2/264: fdatasync d3/f4b 0 2024-09-16T01:25:12.603 INFO:tasks.workunit.client.0.smithi063.stdout:0/264: dread d1/d30/d52/d5a/d36/d41/f4d [0,4194304] 0 2024-09-16T01:25:12.606 INFO:tasks.workunit.client.0.smithi063.stdout:6/207: dwrite d3/d48/d28/f4f [0,4194304] 0 2024-09-16T01:25:12.606 INFO:tasks.workunit.client.0.smithi063.stdout:2/265: truncate d3/d7/d8/d19/f24 4825157 0 2024-09-16T01:25:12.607 INFO:tasks.workunit.client.0.smithi063.stdout:0/265: chown d1/d1c/l28 9 1 2024-09-16T01:25:12.608 INFO:tasks.workunit.client.0.smithi063.stdout:0/266: chown d1/df/d17/c21 3 1 2024-09-16T01:25:12.609 INFO:tasks.workunit.client.0.smithi063.stdout:6/208: creat d3/d10/d35/f50 x:0 0 0 2024-09-16T01:25:12.609 INFO:tasks.workunit.client.0.smithi063.stdout:0/267: fsync d1/d1c/f3f 0 2024-09-16T01:25:12.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:12 smithi063 ceph-mon[31070]: pgmap v391: 97 pgs: 97 active+clean; 347 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 30 MiB/s wr, 271 op/s 2024-09-16T01:25:12.610 INFO:tasks.workunit.client.0.smithi063.stdout:2/266: mkdir d3/d7/d8/d1f/d34/d56 0 2024-09-16T01:25:12.612 INFO:tasks.workunit.client.0.smithi063.stdout:0/268: mkdir d1/d2e/d50/d6f 0 2024-09-16T01:25:12.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/267: symlink d3/d7/de/d21/l57 0 2024-09-16T01:25:12.615 INFO:tasks.workunit.client.0.smithi063.stdout:6/209: link d3/le d3/d10/d35/l51 0 2024-09-16T01:25:12.615 INFO:tasks.workunit.client.0.smithi063.stdout:0/269: mknod d1/d2e/d50/d6f/c70 0 2024-09-16T01:25:12.616 INFO:tasks.workunit.client.0.smithi063.stdout:2/268: mkdir d3/d7/d8/d19/d3c/d58 0 2024-09-16T01:25:12.616 INFO:tasks.workunit.client.0.smithi063.stdout:6/210: chown d3/d30/d39 768 1 2024-09-16T01:25:12.617 INFO:tasks.workunit.client.0.smithi063.stdout:2/269: creat d3/d7/f59 x:0 0 0 2024-09-16T01:25:12.619 INFO:tasks.workunit.client.0.smithi063.stdout:6/211: mkdir d3/d48/d28/d3e/d44/d52 0 2024-09-16T01:25:12.623 INFO:tasks.workunit.client.0.smithi063.stdout:0/270: write d1/df/f40 [556313,38493] 0 2024-09-16T01:25:12.625 INFO:tasks.workunit.client.0.smithi063.stdout:0/271: readlink d1/d1c/l28 0 2024-09-16T01:25:12.625 INFO:tasks.workunit.client.0.smithi063.stdout:2/270: dwrite d3/d7/d8/d19/f44 [0,4194304] 0 2024-09-16T01:25:12.627 INFO:tasks.workunit.client.0.smithi063.stdout:6/212: dwrite d3/d10/d35/f3a [0,4194304] 0 2024-09-16T01:25:12.628 INFO:tasks.workunit.client.0.smithi063.stdout:0/272: creat d1/d30/f71 x:0 0 0 2024-09-16T01:25:12.628 INFO:tasks.workunit.client.0.smithi063.stdout:6/213: fdatasync d3/d30/f4e 0 2024-09-16T01:25:12.629 INFO:tasks.workunit.client.0.smithi063.stdout:0/273: symlink d1/d1c/l72 0 2024-09-16T01:25:12.633 INFO:tasks.workunit.client.0.smithi063.stdout:0/274: rename d1/df/d2c/d69 to d1/d2e/d73 0 2024-09-16T01:25:12.637 INFO:tasks.workunit.client.0.smithi063.stdout:0/275: dread d1/d2e/f37 [0,4194304] 0 2024-09-16T01:25:12.639 INFO:tasks.workunit.client.0.smithi063.stdout:0/276: rmdir d1/d30/d52/d5a/d36/d41 39 2024-09-16T01:25:12.642 INFO:tasks.workunit.client.0.smithi063.stdout:0/277: creat d1/d2e/d73/f74 x:0 0 0 2024-09-16T01:25:12.642 INFO:tasks.workunit.client.0.smithi063.stdout:2/271: dread d3/d7/d8/f10 [0,4194304] 0 2024-09-16T01:25:12.645 INFO:tasks.workunit.client.0.smithi063.stdout:0/278: dread d1/d30/d52/d5a/f19 [8388608,4194304] 0 2024-09-16T01:25:12.645 INFO:tasks.workunit.client.0.smithi063.stdout:0/279: chown d1/ce 0 1 2024-09-16T01:25:12.646 INFO:tasks.workunit.client.0.smithi063.stdout:2/272: getdents d3/d7/d8/d1f/d34 0 2024-09-16T01:25:12.647 INFO:tasks.workunit.client.0.smithi063.stdout:2/273: truncate d3/d7/d8/f1a 1746658 0 2024-09-16T01:25:12.650 INFO:tasks.workunit.client.0.smithi063.stdout:2/274: creat d3/d7/d8/d1f/d34/d39/f5a x:0 0 0 2024-09-16T01:25:12.651 INFO:tasks.workunit.client.0.smithi063.stdout:0/280: write d1/d30/d52/d5a/d36/d41/f4d [1396420,123627] 0 2024-09-16T01:25:12.654 INFO:tasks.workunit.client.0.smithi063.stdout:0/281: symlink d1/df/d2c/l75 0 2024-09-16T01:25:12.654 INFO:tasks.workunit.client.0.smithi063.stdout:2/275: link d3/d7/d8/d1f/d37/c54 d3/d7/c5b 0 2024-09-16T01:25:12.654 INFO:tasks.workunit.client.0.smithi063.stdout:0/282: fsync d1/d30/f71 0 2024-09-16T01:25:12.655 INFO:tasks.workunit.client.0.smithi063.stdout:2/276: readlink d3/d7/l25 0 2024-09-16T01:25:12.656 INFO:tasks.workunit.client.0.smithi063.stdout:2/277: symlink d3/l5c 0 2024-09-16T01:25:12.657 INFO:tasks.workunit.client.0.smithi063.stdout:0/283: mkdir d1/d30/d52/d5a/d76 0 2024-09-16T01:25:12.658 INFO:tasks.workunit.client.0.smithi063.stdout:2/278: fdatasync d3/d7/d8/d19/f44 0 2024-09-16T01:25:12.659 INFO:tasks.workunit.client.0.smithi063.stdout:2/279: write d3/d7/f22 [2662847,19512] 0 2024-09-16T01:25:12.660 INFO:tasks.workunit.client.0.smithi063.stdout:0/284: rename d1/d30/d52/f58 to d1/df/d2c/d43/f77 0 2024-09-16T01:25:12.662 INFO:tasks.workunit.client.0.smithi063.stdout:0/285: creat d1/d1c/f78 x:0 0 0 2024-09-16T01:25:12.664 INFO:tasks.workunit.client.0.smithi063.stdout:0/286: creat d1/df/d34/f79 x:0 0 0 2024-09-16T01:25:12.666 INFO:tasks.workunit.client.0.smithi063.stdout:0/287: stat d1/d30/d52/d5a/d44/l5f 0 2024-09-16T01:25:12.667 INFO:tasks.workunit.client.0.smithi063.stdout:0/288: mknod d1/d2e/d50/c7a 0 2024-09-16T01:25:12.669 INFO:tasks.workunit.client.0.smithi063.stdout:0/289: unlink d1/l20 0 2024-09-16T01:25:12.670 INFO:tasks.workunit.client.0.smithi063.stdout:2/280: dread d3/d7/f22 [0,4194304] 0 2024-09-16T01:25:12.673 INFO:tasks.workunit.client.0.smithi063.stdout:0/290: getdents d1/df/d17 0 2024-09-16T01:25:12.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:12 smithi192 ceph-mon[34775]: pgmap v391: 97 pgs: 97 active+clean; 347 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 30 MiB/s wr, 271 op/s 2024-09-16T01:25:12.675 INFO:tasks.workunit.client.0.smithi063.stdout:2/281: dread d3/f4b [0,4194304] 0 2024-09-16T01:25:12.676 INFO:tasks.workunit.client.0.smithi063.stdout:0/291: creat d1/d2e/d50/d6f/f7b x:0 0 0 2024-09-16T01:25:12.677 INFO:tasks.workunit.client.0.smithi063.stdout:0/292: truncate d1/df/f40 3467738 0 2024-09-16T01:25:12.677 INFO:tasks.workunit.client.0.smithi063.stdout:2/282: creat d3/d7/d8/d19/d3c/d58/f5d x:0 0 0 2024-09-16T01:25:12.679 INFO:tasks.workunit.client.0.smithi063.stdout:0/293: creat d1/d30/d52/d5a/d44/f7c x:0 0 0 2024-09-16T01:25:12.680 INFO:tasks.workunit.client.0.smithi063.stdout:2/283: rename d3/d7/f59 to d3/d7/d8/d1f/d34/d39/f5e 0 2024-09-16T01:25:12.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:12 smithi162 ceph-mon[34539]: pgmap v391: 97 pgs: 97 active+clean; 347 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 30 MiB/s wr, 271 op/s 2024-09-16T01:25:12.683 INFO:tasks.workunit.client.0.smithi063.stdout:2/284: getdents d3/d7/d8/d1f/d34/d56 0 2024-09-16T01:25:12.685 INFO:tasks.workunit.client.0.smithi063.stdout:0/294: dwrite d1/df/f54 [0,4194304] 0 2024-09-16T01:25:12.687 INFO:tasks.workunit.client.0.smithi063.stdout:0/295: write d1/d30/d52/d5a/f3d [1286805,86189] 0 2024-09-16T01:25:12.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/285: dwrite d3/d7/d8/d19/f44 [0,4194304] 0 2024-09-16T01:25:12.694 INFO:tasks.workunit.client.0.smithi063.stdout:2/286: truncate d3/d7/d8/d1f/f3e 4336291 0 2024-09-16T01:25:12.694 INFO:tasks.workunit.client.0.smithi063.stdout:0/296: dwrite d1/d30/d52/d5a/f3e [0,4194304] 0 2024-09-16T01:25:12.698 INFO:tasks.workunit.client.0.smithi063.stdout:0/297: symlink d1/d30/d52/d5a/d36/l7d 0 2024-09-16T01:25:12.702 INFO:tasks.workunit.client.0.smithi063.stdout:2/287: dwrite d3/d7/d8/f10 [4194304,4194304] 0 2024-09-16T01:25:12.705 INFO:tasks.workunit.client.0.smithi063.stdout:0/298: getdents d1/d30/d52/d5a/d36 0 2024-09-16T01:25:12.710 INFO:tasks.workunit.client.0.smithi063.stdout:2/288: dread f0 [0,4194304] 0 2024-09-16T01:25:12.712 INFO:tasks.workunit.client.0.smithi063.stdout:0/299: dwrite d1/df/f54 [4194304,4194304] 0 2024-09-16T01:25:12.713 INFO:tasks.workunit.client.0.smithi063.stdout:2/289: symlink d3/d7/d8/d1f/d34/d39/l5f 0 2024-09-16T01:25:12.714 INFO:tasks.workunit.client.0.smithi063.stdout:2/290: dread - d3/d7/d8/f3b zero size 2024-09-16T01:25:12.715 INFO:tasks.workunit.client.0.smithi063.stdout:0/300: truncate d1/d30/d52/d5a/d36/d41/f61 104226 0 2024-09-16T01:25:12.717 INFO:tasks.workunit.client.0.smithi063.stdout:0/301: mkdir d1/df/d7e 0 2024-09-16T01:25:12.717 INFO:tasks.workunit.client.0.smithi063.stdout:2/291: write d3/d7/d8/d19/f44 [2208558,9313] 0 2024-09-16T01:25:12.721 INFO:tasks.workunit.client.0.smithi063.stdout:2/292: link d3/d7/f16 d3/f60 0 2024-09-16T01:25:12.727 INFO:tasks.workunit.client.0.smithi063.stdout:2/293: dwrite d3/ff [0,4194304] 0 2024-09-16T01:25:12.731 INFO:tasks.workunit.client.0.smithi063.stdout:2/294: dread d3/f4b [0,4194304] 0 2024-09-16T01:25:12.731 INFO:tasks.workunit.client.0.smithi063.stdout:0/302: dread d1/fb [0,4194304] 0 2024-09-16T01:25:12.732 INFO:tasks.workunit.client.0.smithi063.stdout:2/295: chown d3/d7/de/d21/l57 3824 1 2024-09-16T01:25:12.734 INFO:tasks.workunit.client.0.smithi063.stdout:0/303: rmdir d1/df/d17 39 2024-09-16T01:25:12.737 INFO:tasks.workunit.client.0.smithi063.stdout:2/296: dwrite d3/d7/f2e [0,4194304] 0 2024-09-16T01:25:12.739 INFO:tasks.workunit.client.0.smithi063.stdout:0/304: dread d1/d2e/f2f [0,4194304] 0 2024-09-16T01:25:12.739 INFO:tasks.workunit.client.0.smithi063.stdout:2/297: mknod d3/d7/de/c61 0 2024-09-16T01:25:12.744 INFO:tasks.workunit.client.0.smithi063.stdout:0/305: link d1/df/l18 d1/d30/d52/d5a/d36/l7f 0 2024-09-16T01:25:12.746 INFO:tasks.workunit.client.0.smithi063.stdout:2/298: dwrite d3/f6 [0,4194304] 0 2024-09-16T01:25:12.746 INFO:tasks.workunit.client.0.smithi063.stdout:0/306: write d1/d30/d52/d5a/d44/f7c [353440,24706] 0 2024-09-16T01:25:12.753 INFO:tasks.workunit.client.0.smithi063.stdout:2/299: dwrite d3/d7/de/d21/f29 [4194304,4194304] 0 2024-09-16T01:25:12.791 INFO:tasks.workunit.client.0.smithi063.stdout:0/307: rename d1/d2e/f2f to d1/d1c/f80 0 2024-09-16T01:25:12.794 INFO:tasks.workunit.client.0.smithi063.stdout:0/308: creat d1/df/d17/f81 x:0 0 0 2024-09-16T01:25:12.796 INFO:tasks.workunit.client.0.smithi063.stdout:0/309: creat d1/d2e/d50/d6f/f82 x:0 0 0 2024-09-16T01:25:12.796 INFO:tasks.workunit.client.0.smithi063.stdout:2/300: link d3/d7/c5b d3/d7/d8/d19/d3c/d58/c62 0 2024-09-16T01:25:12.799 INFO:tasks.workunit.client.0.smithi063.stdout:2/301: creat d3/d7/d8/d1f/d37/d4f/f63 x:0 0 0 2024-09-16T01:25:12.799 INFO:tasks.workunit.client.0.smithi063.stdout:0/310: symlink d1/d30/d52/d5a/d36/d41/l83 0 2024-09-16T01:25:12.800 INFO:tasks.workunit.client.0.smithi063.stdout:0/311: chown d1/d30/c65 1609 1 2024-09-16T01:25:12.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/302: unlink d3/d7/d8/d1f/d34/c50 0 2024-09-16T01:25:12.801 INFO:tasks.workunit.client.0.smithi063.stdout:2/303: fsync d3/ff 0 2024-09-16T01:25:12.801 INFO:tasks.workunit.client.0.smithi063.stdout:0/312: truncate d1/d30/d52/d5a/d36/d41/f61 993833 0 2024-09-16T01:25:12.802 INFO:tasks.workunit.client.0.smithi063.stdout:0/313: read d1/fb [8760909,44531] 0 2024-09-16T01:25:12.803 INFO:tasks.workunit.client.0.smithi063.stdout:2/304: truncate d3/f60 1645217 0 2024-09-16T01:25:12.806 INFO:tasks.workunit.client.0.smithi063.stdout:2/305: creat d3/d7/d8/d1f/f64 x:0 0 0 2024-09-16T01:25:12.807 INFO:tasks.workunit.client.0.smithi063.stdout:0/314: dwrite d1/df/d2c/f39 [0,4194304] 0 2024-09-16T01:25:12.809 INFO:tasks.workunit.client.0.smithi063.stdout:2/306: symlink d3/d7/d8/d1f/d37/d4f/l65 0 2024-09-16T01:25:12.811 INFO:tasks.workunit.client.0.smithi063.stdout:2/307: unlink d3/d7/d8/f3b 0 2024-09-16T01:25:12.812 INFO:tasks.workunit.client.0.smithi063.stdout:0/315: dread d1/d30/d52/d5a/d36/d41/f47 [0,4194304] 0 2024-09-16T01:25:12.817 INFO:tasks.workunit.client.0.smithi063.stdout:2/308: rename d3/d7/d8/d1f/d37/c54 to d3/d7/de/d21/d28/d4e/c66 0 2024-09-16T01:25:12.818 INFO:tasks.workunit.client.0.smithi063.stdout:0/316: link d1/d30/d52/d5a/c49 d1/d2e/d50/d6f/c84 0 2024-09-16T01:25:12.819 INFO:tasks.workunit.client.0.smithi063.stdout:0/317: readlink d1/df/l18 0 2024-09-16T01:25:12.820 INFO:tasks.workunit.client.0.smithi063.stdout:0/318: stat d1/df/d17/c21 0 2024-09-16T01:25:12.820 INFO:tasks.workunit.client.0.smithi063.stdout:2/309: mknod d3/d7/d8/d1f/c67 0 2024-09-16T01:25:12.820 INFO:tasks.workunit.client.0.smithi063.stdout:0/319: chown d1/df/d34/f5e 919148 1 2024-09-16T01:25:12.821 INFO:tasks.workunit.client.0.smithi063.stdout:0/320: readlink d1/d30/l4f 0 2024-09-16T01:25:12.821 INFO:tasks.workunit.client.0.smithi063.stdout:0/321: readlink d1/df/d2c/l75 0 2024-09-16T01:25:12.824 INFO:tasks.workunit.client.0.smithi063.stdout:0/322: rename d1/ce to d1/d2e/d50/c85 0 2024-09-16T01:25:12.825 INFO:tasks.workunit.client.0.smithi063.stdout:2/310: dwrite d3/d7/d8/f10 [0,4194304] 0 2024-09-16T01:25:12.827 INFO:tasks.workunit.client.0.smithi063.stdout:0/323: mknod d1/d2e/d50/d6f/c86 0 2024-09-16T01:25:12.842 INFO:tasks.workunit.client.0.smithi063.stdout:2/311: rename d3/d7/de/d21/d28/d4e/c66 to d3/d7/de/c68 0 2024-09-16T01:25:12.844 INFO:tasks.workunit.client.0.smithi063.stdout:2/312: mknod d3/d7/d8/d19/d3c/c69 0 2024-09-16T01:25:12.846 INFO:tasks.workunit.client.0.smithi063.stdout:2/313: mknod d3/d7/d8/d19/d3c/d58/c6a 0 2024-09-16T01:25:12.847 INFO:tasks.workunit.client.0.smithi063.stdout:2/314: dread - d3/d7/d8/d1f/d37/d4f/f63 zero size 2024-09-16T01:25:12.848 INFO:tasks.workunit.client.0.smithi063.stdout:2/315: mknod d3/d7/d8/d1f/d34/d39/c6b 0 2024-09-16T01:25:12.851 INFO:tasks.workunit.client.0.smithi063.stdout:2/316: dread d3/d7/d8/d1f/f3a [4194304,4194304] 0 2024-09-16T01:25:12.854 INFO:tasks.workunit.client.0.smithi063.stdout:2/317: creat d3/d7/d8/d1f/f6c x:0 0 0 2024-09-16T01:25:12.855 INFO:tasks.workunit.client.0.smithi063.stdout:2/318: write d3/d7/d8/f10 [8639245,118409] 0 2024-09-16T01:25:12.865 INFO:tasks.workunit.client.0.smithi063.stdout:2/319: dwrite f0 [0,4194304] 0 2024-09-16T01:25:12.868 INFO:tasks.workunit.client.0.smithi063.stdout:3/189: sync 2024-09-16T01:25:12.868 INFO:tasks.workunit.client.0.smithi063.stdout:9/282: sync 2024-09-16T01:25:12.869 INFO:tasks.workunit.client.0.smithi063.stdout:2/320: creat d3/d7/de/d21/d28/d4e/f6d x:0 0 0 2024-09-16T01:25:12.871 INFO:tasks.workunit.client.0.smithi063.stdout:9/283: mknod d7/c61 0 2024-09-16T01:25:12.873 INFO:tasks.workunit.client.0.smithi063.stdout:2/321: dread d3/f4b [4194304,4194304] 0 2024-09-16T01:25:12.874 INFO:tasks.workunit.client.0.smithi063.stdout:9/284: creat d7/d9/d12/d14/d23/d55/d5f/f62 x:0 0 0 2024-09-16T01:25:12.877 INFO:tasks.workunit.client.0.smithi063.stdout:3/190: rename d2/d12 to d2/d11/d18/d41 0 2024-09-16T01:25:12.878 INFO:tasks.workunit.client.0.smithi063.stdout:2/322: dwrite d3/d7/d8/f18 [0,4194304] 0 2024-09-16T01:25:12.879 INFO:tasks.workunit.client.0.smithi063.stdout:3/191: chown d2/d11/c1b 2506449 1 2024-09-16T01:25:12.882 INFO:tasks.workunit.client.0.smithi063.stdout:2/323: mkdir d3/d7/d8/d1f/d34/d45/d6e 0 2024-09-16T01:25:12.885 INFO:tasks.workunit.client.0.smithi063.stdout:9/285: dwrite d7/d9/d20/f2b [0,4194304] 0 2024-09-16T01:25:12.886 INFO:tasks.workunit.client.0.smithi063.stdout:9/286: chown d7/d9/d20/f21 10 1 2024-09-16T01:25:12.887 INFO:tasks.workunit.client.0.smithi063.stdout:3/192: getdents d2/d11/d39 0 2024-09-16T01:25:12.891 INFO:tasks.workunit.client.0.smithi063.stdout:3/193: unlink d2/c2a 0 2024-09-16T01:25:12.891 INFO:tasks.workunit.client.0.smithi063.stdout:2/324: write d3/f60 [881464,62692] 0 2024-09-16T01:25:12.892 INFO:tasks.workunit.client.0.smithi063.stdout:3/194: dread - d2/d11/d39/f31 zero size 2024-09-16T01:25:12.892 INFO:tasks.workunit.client.0.smithi063.stdout:2/325: chown d3/d7/d8/l13 41382 1 2024-09-16T01:25:12.893 INFO:tasks.workunit.client.0.smithi063.stdout:9/287: rename d7/d9/d12/d14/d23/d55 to d7/d9/d12/d14/d63 0 2024-09-16T01:25:12.895 INFO:tasks.workunit.client.0.smithi063.stdout:2/326: mkdir d3/d7/d8/d1f/d34/d39/d6f 0 2024-09-16T01:25:12.895 INFO:tasks.workunit.client.0.smithi063.stdout:3/195: truncate d2/f19 1381914 0 2024-09-16T01:25:12.896 INFO:tasks.workunit.client.0.smithi063.stdout:2/327: write d3/f6 [1091158,124000] 0 2024-09-16T01:25:12.900 INFO:tasks.workunit.client.0.smithi063.stdout:3/196: rename d2/d11/d18/fc to d2/d11/d18/f42 0 2024-09-16T01:25:12.900 INFO:tasks.workunit.client.0.smithi063.stdout:2/328: dread d3/d7/d8/f10 [4194304,4194304] 0 2024-09-16T01:25:12.905 INFO:tasks.workunit.client.0.smithi063.stdout:2/329: dread d3/d7/d8/d1f/f3e [4194304,4194304] 0 2024-09-16T01:25:12.906 INFO:tasks.workunit.client.0.smithi063.stdout:2/330: chown d3/ff 29542689 1 2024-09-16T01:25:12.908 INFO:tasks.workunit.client.0.smithi063.stdout:9/288: dread d7/d9/d12/d14/f16 [0,4194304] 0 2024-09-16T01:25:12.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/331: dwrite d3/d7/d8/d1f/f3a [4194304,4194304] 0 2024-09-16T01:25:12.919 INFO:tasks.workunit.client.0.smithi063.stdout:3/197: dwrite d2/f1f [0,4194304] 0 2024-09-16T01:25:12.921 INFO:tasks.workunit.client.0.smithi063.stdout:9/289: dwrite d7/d9/d12/f2e [8388608,4194304] 0 2024-09-16T01:25:12.927 INFO:tasks.workunit.client.0.smithi063.stdout:9/290: unlink d7/d9/f28 0 2024-09-16T01:25:12.928 INFO:tasks.workunit.client.0.smithi063.stdout:9/291: stat d7/d9 0 2024-09-16T01:25:12.929 INFO:tasks.workunit.client.0.smithi063.stdout:2/332: creat d3/d7/d8/f70 x:0 0 0 2024-09-16T01:25:12.929 INFO:tasks.workunit.client.0.smithi063.stdout:3/198: symlink d2/d11/d18/l43 0 2024-09-16T01:25:12.930 INFO:tasks.workunit.client.0.smithi063.stdout:9/292: symlink d7/d9/d12/d14/d23/l64 0 2024-09-16T01:25:12.931 INFO:tasks.workunit.client.0.smithi063.stdout:9/293: write d7/d9/f2a [1208693,24240] 0 2024-09-16T01:25:12.932 INFO:tasks.workunit.client.0.smithi063.stdout:2/333: unlink d3/d7/d8/c15 0 2024-09-16T01:25:12.933 INFO:tasks.workunit.client.0.smithi063.stdout:3/199: chown d2/d11/d18/f27 7 1 2024-09-16T01:25:12.935 INFO:tasks.workunit.client.0.smithi063.stdout:2/334: fsync d3/d7/d8/f10 0 2024-09-16T01:25:12.938 INFO:tasks.workunit.client.0.smithi063.stdout:3/200: symlink d2/d11/d18/l44 0 2024-09-16T01:25:12.938 INFO:tasks.workunit.client.0.smithi063.stdout:9/294: dwrite d7/f22 [0,4194304] 0 2024-09-16T01:25:12.939 INFO:tasks.workunit.client.0.smithi063.stdout:2/335: symlink d3/d7/d8/d1f/d37/l71 0 2024-09-16T01:25:12.939 INFO:tasks.workunit.client.0.smithi063.stdout:2/336: readlink d3/d7/d8/l13 0 2024-09-16T01:25:12.942 INFO:tasks.workunit.client.0.smithi063.stdout:2/337: mkdir d3/d7/d8/d1f/d34/d72 0 2024-09-16T01:25:12.944 INFO:tasks.workunit.client.0.smithi063.stdout:2/338: fdatasync d3/d7/de/d21/d28/d4e/f6d 0 2024-09-16T01:25:12.946 INFO:tasks.workunit.client.0.smithi063.stdout:2/339: write d3/d7/f16 [2648031,51021] 0 2024-09-16T01:25:12.947 INFO:tasks.workunit.client.0.smithi063.stdout:9/295: dwrite d7/d9/d12/d14/d63/d5f/f62 [0,4194304] 0 2024-09-16T01:25:12.949 INFO:tasks.workunit.client.0.smithi063.stdout:9/296: write d7/d9/f2a [283558,9425] 0 2024-09-16T01:25:12.949 INFO:tasks.workunit.client.0.smithi063.stdout:2/340: mknod d3/d7/de/d21/d28/d4e/c73 0 2024-09-16T01:25:12.952 INFO:tasks.workunit.client.0.smithi063.stdout:9/297: creat d7/d9/d12/d14/f65 x:0 0 0 2024-09-16T01:25:12.953 INFO:tasks.workunit.client.0.smithi063.stdout:9/298: chown d7/d9/f13 111 1 2024-09-16T01:25:12.955 INFO:tasks.workunit.client.0.smithi063.stdout:2/341: link d3/f4b d3/d7/d8/d1f/d37/f74 0 2024-09-16T01:25:12.957 INFO:tasks.workunit.client.0.smithi063.stdout:2/342: chown d3/d7/d8/f18 1348664 1 2024-09-16T01:25:12.960 INFO:tasks.workunit.client.0.smithi063.stdout:3/201: dread d2/d11/f29 [0,4194304] 0 2024-09-16T01:25:12.961 INFO:tasks.workunit.client.0.smithi063.stdout:2/343: creat d3/d7/d8/d19/f75 x:0 0 0 2024-09-16T01:25:12.961 INFO:tasks.workunit.client.0.smithi063.stdout:9/299: dwrite d7/d9/f13 [0,4194304] 0 2024-09-16T01:25:12.961 INFO:tasks.workunit.client.0.smithi063.stdout:3/202: getdents d2/d11/d18/d41 0 2024-09-16T01:25:12.961 INFO:tasks.workunit.client.0.smithi063.stdout:2/344: fdatasync d3/d7/f22 0 2024-09-16T01:25:12.961 INFO:tasks.workunit.client.0.smithi063.stdout:9/300: stat d7/d9/d12/d14/f29 0 2024-09-16T01:25:12.962 INFO:tasks.workunit.client.0.smithi063.stdout:2/345: fdatasync d3/d7/d8/d1f/f3a 0 2024-09-16T01:25:12.963 INFO:tasks.workunit.client.0.smithi063.stdout:9/301: fdatasync d7/d9/d12/d14/f31 0 2024-09-16T01:25:12.969 INFO:tasks.workunit.client.0.smithi063.stdout:2/346: link d3/d7/f22 d3/d7/d8/d1f/d34/d45/f76 0 2024-09-16T01:25:12.970 INFO:tasks.workunit.client.0.smithi063.stdout:3/203: dwrite d2/d11/d39/f31 [0,4194304] 0 2024-09-16T01:25:12.970 INFO:tasks.workunit.client.0.smithi063.stdout:1/254: sync 2024-09-16T01:25:12.972 INFO:tasks.workunit.client.0.smithi063.stdout:9/302: link d7/d1f/c32 d7/d9/d12/c66 0 2024-09-16T01:25:12.973 INFO:tasks.workunit.client.0.smithi063.stdout:1/255: chown d1/d5/f11 27631 1 2024-09-16T01:25:12.973 INFO:tasks.workunit.client.0.smithi063.stdout:2/347: mkdir d3/d77 0 2024-09-16T01:25:12.976 INFO:tasks.workunit.client.0.smithi063.stdout:9/303: creat d7/d1f/f67 x:0 0 0 2024-09-16T01:25:12.977 INFO:tasks.workunit.client.0.smithi063.stdout:1/256: symlink d1/d12/d21/l59 0 2024-09-16T01:25:12.979 INFO:tasks.workunit.client.0.smithi063.stdout:3/204: dwrite d2/d11/d18/d41/d30/f3c [0,4194304] 0 2024-09-16T01:25:12.980 INFO:tasks.workunit.client.0.smithi063.stdout:9/304: symlink d7/d9/l68 0 2024-09-16T01:25:12.980 INFO:tasks.workunit.client.0.smithi063.stdout:1/257: write d1/d12/d16/f35 [1080779,57939] 0 2024-09-16T01:25:12.985 INFO:tasks.workunit.client.0.smithi063.stdout:1/258: unlink d1/d12/f53 0 2024-09-16T01:25:12.985 INFO:tasks.workunit.client.0.smithi063.stdout:1/259: fdatasync d1/f3e 0 2024-09-16T01:25:12.986 INFO:tasks.workunit.client.0.smithi063.stdout:9/305: symlink d7/d9/d12/d14/d34/l69 0 2024-09-16T01:25:12.986 INFO:tasks.workunit.client.0.smithi063.stdout:3/205: dread d2/d11/d18/f3d [0,4194304] 0 2024-09-16T01:25:12.987 INFO:tasks.workunit.client.0.smithi063.stdout:2/348: link d3/d7/d8/d1f/d34/d39/c6b d3/d7/d8/d1f/d34/d72/c78 0 2024-09-16T01:25:12.987 INFO:tasks.workunit.client.0.smithi063.stdout:2/349: chown d3/d7/de/c61 140406 1 2024-09-16T01:25:12.988 INFO:tasks.workunit.client.0.smithi063.stdout:9/306: symlink d7/d4a/l6a 0 2024-09-16T01:25:12.988 INFO:tasks.workunit.client.0.smithi063.stdout:3/206: readlink d2/d11/d18/le 0 2024-09-16T01:25:12.990 INFO:tasks.workunit.client.0.smithi063.stdout:1/260: mknod d1/d5/d15/d1b/d31/c5a 0 2024-09-16T01:25:12.990 INFO:tasks.workunit.client.0.smithi063.stdout:9/307: write d7/d4a/d4d/d50/f45 [4372465,11857] 0 2024-09-16T01:25:12.994 INFO:tasks.workunit.client.0.smithi063.stdout:9/308: rename d7/d9/d12/f5e to d7/d9/d12/d14/d34/f6b 0 2024-09-16T01:25:12.994 INFO:tasks.workunit.client.0.smithi063.stdout:9/309: stat d7/d9/d12/d14/d23 0 2024-09-16T01:25:12.995 INFO:tasks.workunit.client.0.smithi063.stdout:9/310: fdatasync d7/d9/d20/f21 0 2024-09-16T01:25:12.996 INFO:tasks.workunit.client.0.smithi063.stdout:9/311: write d7/d4a/d4d/d50/f54 [464312,14474] 0 2024-09-16T01:25:12.997 INFO:tasks.workunit.client.0.smithi063.stdout:9/312: readlink d7/d9/l68 0 2024-09-16T01:25:12.998 INFO:tasks.workunit.client.0.smithi063.stdout:3/207: getdents d2/d11/d37 0 2024-09-16T01:25:13.000 INFO:tasks.workunit.client.0.smithi063.stdout:9/313: creat d7/d4a/d4d/d50/f6c x:0 0 0 2024-09-16T01:25:13.000 INFO:tasks.workunit.client.0.smithi063.stdout:2/350: write d3/d7/d8/d1f/d37/f74 [5764445,51397] 0 2024-09-16T01:25:13.001 INFO:tasks.workunit.client.0.smithi063.stdout:3/208: mkdir d2/d11/d39/d3b/d45 0 2024-09-16T01:25:13.002 INFO:tasks.workunit.client.0.smithi063.stdout:1/261: write d1/d5/f7 [2243056,120041] 0 2024-09-16T01:25:13.003 INFO:tasks.workunit.client.0.smithi063.stdout:3/209: write d2/f33 [1858622,101586] 0 2024-09-16T01:25:13.003 INFO:tasks.workunit.client.0.smithi063.stdout:9/314: rename d7/d9/d20/f3b to d7/d4a/d4d/d50/f6d 0 2024-09-16T01:25:13.004 INFO:tasks.workunit.client.0.smithi063.stdout:2/351: truncate d3/d7/d8/d1f/d34/d39/f47 924818 0 2024-09-16T01:25:13.006 INFO:tasks.workunit.client.0.smithi063.stdout:2/352: mknod d3/d7/c79 0 2024-09-16T01:25:13.008 INFO:tasks.workunit.client.0.smithi063.stdout:1/262: creat d1/d12/f5b x:0 0 0 2024-09-16T01:25:13.009 INFO:tasks.workunit.client.0.smithi063.stdout:9/315: creat d7/d9/d12/d14/f6e x:0 0 0 2024-09-16T01:25:13.009 INFO:tasks.workunit.client.0.smithi063.stdout:9/316: chown d7/d4a/d4d/d50/f48 444295 1 2024-09-16T01:25:13.011 INFO:tasks.workunit.client.0.smithi063.stdout:2/353: rename d3/d7/d8/f18 to d3/d7/d8/d1f/d37/f7a 0 2024-09-16T01:25:13.011 INFO:tasks.workunit.client.0.smithi063.stdout:9/317: read d7/d9/d12/f33 [352478,49544] 0 2024-09-16T01:25:13.012 INFO:tasks.workunit.client.0.smithi063.stdout:1/263: dread d1/d5/d15/d18/f42 [0,4194304] 0 2024-09-16T01:25:13.013 INFO:tasks.workunit.client.0.smithi063.stdout:3/210: write d2/f10 [736977,100483] 0 2024-09-16T01:25:13.015 INFO:tasks.workunit.client.0.smithi063.stdout:9/318: creat d7/d9/d12/d14/d34/f6f x:0 0 0 2024-09-16T01:25:13.015 INFO:tasks.workunit.client.0.smithi063.stdout:3/211: chown d2/d11/f29 6 1 2024-09-16T01:25:13.018 INFO:tasks.workunit.client.0.smithi063.stdout:2/354: getdents d3 0 2024-09-16T01:25:13.018 INFO:tasks.workunit.client.0.smithi063.stdout:3/212: truncate d2/d11/d39/f36 443663 0 2024-09-16T01:25:13.018 INFO:tasks.workunit.client.0.smithi063.stdout:9/319: creat d7/d9/d12/d14/d38/f70 x:0 0 0 2024-09-16T01:25:13.019 INFO:tasks.workunit.client.0.smithi063.stdout:1/264: dwrite d1/d5/f7 [0,4194304] 0 2024-09-16T01:25:13.021 INFO:tasks.workunit.client.0.smithi063.stdout:3/213: symlink d2/d11/d39/l46 0 2024-09-16T01:25:13.022 INFO:tasks.workunit.client.0.smithi063.stdout:3/214: fsync d2/d11/d39/f36 0 2024-09-16T01:25:13.024 INFO:tasks.workunit.client.0.smithi063.stdout:9/320: getdents d7/d4a/d4d 0 2024-09-16T01:25:13.025 INFO:tasks.workunit.client.0.smithi063.stdout:3/215: rename d2/d11/l2e to d2/d11/d18/d41/d30/l47 0 2024-09-16T01:25:13.027 INFO:tasks.workunit.client.0.smithi063.stdout:3/216: stat d2/d11/d18/f42 0 2024-09-16T01:25:13.028 INFO:tasks.workunit.client.0.smithi063.stdout:1/265: dwrite d1/d5/d15/f26 [0,4194304] 0 2024-09-16T01:25:13.034 INFO:tasks.workunit.client.0.smithi063.stdout:3/217: dread d2/f1f [0,4194304] 0 2024-09-16T01:25:13.036 INFO:tasks.workunit.client.0.smithi063.stdout:9/321: truncate d7/d9/d12/d14/f16 4593394 0 2024-09-16T01:25:13.036 INFO:tasks.workunit.client.0.smithi063.stdout:3/218: write d2/d11/d18/d41/f2f [1064094,110465] 0 2024-09-16T01:25:13.037 INFO:tasks.workunit.client.0.smithi063.stdout:1/266: dwrite d1/dd/d3b/f58 [0,4194304] 0 2024-09-16T01:25:13.038 INFO:tasks.workunit.client.0.smithi063.stdout:9/322: fsync d7/d9/f2a 0 2024-09-16T01:25:13.041 INFO:tasks.workunit.client.0.smithi063.stdout:3/219: symlink d2/d11/d18/d41/d30/l48 0 2024-09-16T01:25:13.043 INFO:tasks.workunit.client.0.smithi063.stdout:9/323: dread d7/f22 [0,4194304] 0 2024-09-16T01:25:13.043 INFO:tasks.workunit.client.0.smithi063.stdout:1/267: dread d1/dd/d3b/f58 [0,4194304] 0 2024-09-16T01:25:13.043 INFO:tasks.workunit.client.0.smithi063.stdout:3/220: truncate d2/d11/d18/d41/f2f 1208987 0 2024-09-16T01:25:13.050 INFO:tasks.workunit.client.0.smithi063.stdout:1/268: link d1/d5/c1c d1/d12/d16/c5c 0 2024-09-16T01:25:13.051 INFO:tasks.workunit.client.0.smithi063.stdout:9/324: dwrite d7/d4a/d4d/d50/f45 [0,4194304] 0 2024-09-16T01:25:13.052 INFO:tasks.workunit.client.0.smithi063.stdout:3/221: dwrite d2/d11/f1d [0,4194304] 0 2024-09-16T01:25:13.056 INFO:tasks.workunit.client.0.smithi063.stdout:3/222: write d2/d11/d18/f42 [2677345,78704] 0 2024-09-16T01:25:13.056 INFO:tasks.workunit.client.0.smithi063.stdout:1/269: mknod d1/d5/d15/d18/d4b/c5d 0 2024-09-16T01:25:13.057 INFO:tasks.workunit.client.0.smithi063.stdout:9/325: creat d7/f71 x:0 0 0 2024-09-16T01:25:13.059 INFO:tasks.workunit.client.0.smithi063.stdout:1/270: symlink d1/d5/d15/d18/l5e 0 2024-09-16T01:25:13.065 INFO:tasks.workunit.client.0.smithi063.stdout:3/223: dread d2/f1f [0,4194304] 0 2024-09-16T01:25:13.067 INFO:tasks.workunit.client.0.smithi063.stdout:3/224: chown d2/f33 3610 1 2024-09-16T01:25:13.067 INFO:tasks.workunit.client.0.smithi063.stdout:9/326: dwrite d7/d9/d12/f52 [0,4194304] 0 2024-09-16T01:25:13.069 INFO:tasks.workunit.client.0.smithi063.stdout:1/271: dwrite d1/d5/d15/f26 [4194304,4194304] 0 2024-09-16T01:25:13.075 INFO:tasks.workunit.client.0.smithi063.stdout:1/272: creat d1/d5/d15/d18/d4b/f5f x:0 0 0 2024-09-16T01:25:13.078 INFO:tasks.workunit.client.0.smithi063.stdout:3/225: getdents d2/d11/d18 0 2024-09-16T01:25:13.081 INFO:tasks.workunit.client.0.smithi063.stdout:1/273: getdents d1/d12 0 2024-09-16T01:25:13.081 INFO:tasks.workunit.client.0.smithi063.stdout:9/327: dwrite d7/d9/d12/d14/f6e [0,4194304] 0 2024-09-16T01:25:13.082 INFO:tasks.workunit.client.0.smithi063.stdout:1/274: fsync d1/d12/f41 0 2024-09-16T01:25:13.082 INFO:tasks.workunit.client.0.smithi063.stdout:9/328: write d7/d9/d12/f33 [1051126,51629] 0 2024-09-16T01:25:13.084 INFO:tasks.workunit.client.0.smithi063.stdout:9/329: readlink d7/d9/d12/d14/d23/l3c 0 2024-09-16T01:25:13.088 INFO:tasks.workunit.client.0.smithi063.stdout:9/330: readlink d7/d9/d12/d14/d38/l5a 0 2024-09-16T01:25:13.093 INFO:tasks.workunit.client.0.smithi063.stdout:9/331: dwrite d7/d9/d20/f5c [0,4194304] 0 2024-09-16T01:25:13.096 INFO:tasks.workunit.client.0.smithi063.stdout:9/332: mknod d7/d9/d12/d14/d34/c72 0 2024-09-16T01:25:13.098 INFO:tasks.workunit.client.0.smithi063.stdout:3/226: dread d2/d11/d18/f42 [0,4194304] 0 2024-09-16T01:25:13.100 INFO:tasks.workunit.client.0.smithi063.stdout:9/333: mknod d7/d4a/d4d/d50/c73 0 2024-09-16T01:25:13.103 INFO:tasks.workunit.client.0.smithi063.stdout:3/227: symlink d2/d11/d18/d41/d30/l49 0 2024-09-16T01:25:13.107 INFO:tasks.workunit.client.0.smithi063.stdout:3/228: symlink d2/d11/d39/l4a 0 2024-09-16T01:25:13.111 INFO:tasks.workunit.client.0.smithi063.stdout:3/229: mknod d2/d11/d37/c4b 0 2024-09-16T01:25:13.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/334: creat d7/d9/f74 x:0 0 0 2024-09-16T01:25:13.114 INFO:tasks.workunit.client.0.smithi063.stdout:3/230: fdatasync d2/f19 0 2024-09-16T01:25:13.123 INFO:tasks.workunit.client.0.smithi063.stdout:3/231: link d2/d11/d18/c21 d2/d11/d37/c4c 0 2024-09-16T01:25:13.124 INFO:tasks.workunit.client.0.smithi063.stdout:3/232: read d2/d11/d39/f36 [414729,13292] 0 2024-09-16T01:25:13.125 INFO:tasks.workunit.client.0.smithi063.stdout:1/275: getdents d1/d12/d21 0 2024-09-16T01:25:13.126 INFO:tasks.workunit.client.0.smithi063.stdout:9/335: link d7/d9/d12/d14/f16 d7/d9/d12/d14/f75 0 2024-09-16T01:25:13.127 INFO:tasks.workunit.client.0.smithi063.stdout:3/233: creat d2/d11/d18/d41/f4d x:0 0 0 2024-09-16T01:25:13.127 INFO:tasks.workunit.client.0.smithi063.stdout:3/234: chown d2/l35 862996 1 2024-09-16T01:25:13.130 INFO:tasks.workunit.client.0.smithi063.stdout:3/235: creat d2/f4e x:0 0 0 2024-09-16T01:25:13.131 INFO:tasks.workunit.client.0.smithi063.stdout:9/336: getdents d7/d1f 0 2024-09-16T01:25:13.133 INFO:tasks.workunit.client.0.smithi063.stdout:9/337: truncate f5 994819 0 2024-09-16T01:25:13.136 INFO:tasks.workunit.client.0.smithi063.stdout:9/338: truncate d7/d9/f74 19870 0 2024-09-16T01:25:13.137 INFO:tasks.workunit.client.0.smithi063.stdout:3/236: dwrite d2/d11/f29 [0,4194304] 0 2024-09-16T01:25:13.137 INFO:tasks.workunit.client.0.smithi063.stdout:3/237: fsync d2/f22 0 2024-09-16T01:25:13.138 INFO:tasks.workunit.client.0.smithi063.stdout:9/339: symlink d7/d1f/l76 0 2024-09-16T01:25:13.138 INFO:tasks.workunit.client.0.smithi063.stdout:3/238: write f0 [1181264,38126] 0 2024-09-16T01:25:13.140 INFO:tasks.workunit.client.0.smithi063.stdout:1/276: dread d1/d12/d21/f46 [0,4194304] 0 2024-09-16T01:25:13.140 INFO:tasks.workunit.client.0.smithi063.stdout:3/239: chown d2/d11/d39/f20 21 1 2024-09-16T01:25:13.142 INFO:tasks.workunit.client.0.smithi063.stdout:9/340: creat d7/d9/d12/f77 x:0 0 0 2024-09-16T01:25:13.142 INFO:tasks.workunit.client.0.smithi063.stdout:4/239: sync 2024-09-16T01:25:13.142 INFO:tasks.workunit.client.0.smithi063.stdout:7/197: sync 2024-09-16T01:25:13.144 INFO:tasks.workunit.client.0.smithi063.stdout:1/277: write d1/d12/f41 [3083791,5291] 0 2024-09-16T01:25:13.147 INFO:tasks.workunit.client.0.smithi063.stdout:3/240: rename d2/d11/d39/c24 to d2/d11/d18/d41/c4f 0 2024-09-16T01:25:13.148 INFO:tasks.workunit.client.0.smithi063.stdout:7/198: truncate d7/f10 148191 0 2024-09-16T01:25:13.153 INFO:tasks.workunit.client.0.smithi063.stdout:1/278: write d1/d5/d15/d18/f42 [583637,26271] 0 2024-09-16T01:25:13.154 INFO:tasks.workunit.client.0.smithi063.stdout:9/341: dwrite d7/d9/d12/d14/f1c [0,4194304] 0 2024-09-16T01:25:13.155 INFO:tasks.workunit.client.0.smithi063.stdout:7/199: truncate d7/fe 5440428 0 2024-09-16T01:25:13.157 INFO:tasks.workunit.client.0.smithi063.stdout:4/240: rename d5/d3b/df/d1c/f37 to d5/d3b/df/d1c/d29/f4a 0 2024-09-16T01:25:13.158 INFO:tasks.workunit.client.0.smithi063.stdout:3/241: creat d2/d11/d39/d3b/d45/f50 x:0 0 0 2024-09-16T01:25:13.160 INFO:tasks.workunit.client.0.smithi063.stdout:9/342: fdatasync d7/d9/d12/f24 0 2024-09-16T01:25:13.161 INFO:tasks.workunit.client.0.smithi063.stdout:3/242: chown d2/d11/d18/d41/d30/l48 1 1 2024-09-16T01:25:13.162 INFO:tasks.workunit.client.0.smithi063.stdout:7/200: creat d7/d1c/d1f/d29/f3f x:0 0 0 2024-09-16T01:25:13.162 INFO:tasks.workunit.client.0.smithi063.stdout:4/241: dread d5/d3b/df/d1c/d29/d20/f23 [0,4194304] 0 2024-09-16T01:25:13.164 INFO:tasks.workunit.client.0.smithi063.stdout:1/279: rename d1/d5/d15/d1b/d31/c47 to d1/dd/c60 0 2024-09-16T01:25:13.164 INFO:tasks.workunit.client.0.smithi063.stdout:4/242: dread - d5/d3b/df/d1c/d29/f26 zero size 2024-09-16T01:25:13.165 INFO:tasks.workunit.client.0.smithi063.stdout:7/201: mkdir d7/d18/d40 0 2024-09-16T01:25:13.171 INFO:tasks.workunit.client.0.smithi063.stdout:7/202: symlink d7/d18/l41 0 2024-09-16T01:25:13.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/343: dwrite d7/d9/d12/d14/d63/d5f/f62 [0,4194304] 0 2024-09-16T01:25:13.171 INFO:tasks.workunit.client.0.smithi063.stdout:1/280: rmdir d1/d12/d21 39 2024-09-16T01:25:13.173 INFO:tasks.workunit.client.0.smithi063.stdout:1/281: fsync d1/f8 0 2024-09-16T01:25:13.173 INFO:tasks.workunit.client.0.smithi063.stdout:4/243: dwrite d5/d3b/f2d [0,4194304] 0 2024-09-16T01:25:13.177 INFO:tasks.workunit.client.0.smithi063.stdout:9/344: rename d7/d9/d12/f39 to d7/d1f/f78 0 2024-09-16T01:25:13.178 INFO:tasks.workunit.client.0.smithi063.stdout:4/244: fdatasync d5/f11 0 2024-09-16T01:25:13.182 INFO:tasks.workunit.client.0.smithi063.stdout:7/203: dwrite d7/f3e [0,4194304] 0 2024-09-16T01:25:13.184 INFO:tasks.workunit.client.0.smithi063.stdout:4/245: rename d5/d3b/df to d5/d3b/df/d1c/d29/d4b 22 2024-09-16T01:25:13.186 INFO:tasks.workunit.client.0.smithi063.stdout:1/282: dwrite d1/d12/d16/f35 [0,4194304] 0 2024-09-16T01:25:13.190 INFO:tasks.workunit.client.0.smithi063.stdout:4/246: creat d5/d3b/df/d1c/d29/d20/d30/f4c x:0 0 0 2024-09-16T01:25:13.190 INFO:tasks.workunit.client.0.smithi063.stdout:7/204: truncate d7/d18/f1b 491171 0 2024-09-16T01:25:13.191 INFO:tasks.workunit.client.0.smithi063.stdout:9/345: truncate d7/d9/d12/f2e 12003405 0 2024-09-16T01:25:13.191 INFO:tasks.workunit.client.0.smithi063.stdout:7/205: chown d7/ff 120762540 1 2024-09-16T01:25:13.192 INFO:tasks.workunit.client.0.smithi063.stdout:1/283: mknod d1/d12/d16/c61 0 2024-09-16T01:25:13.194 INFO:tasks.workunit.client.0.smithi063.stdout:4/247: chown d5/d3b/df/d1c/d29/d32/f3c 3415 1 2024-09-16T01:25:13.194 INFO:tasks.workunit.client.0.smithi063.stdout:7/206: truncate d7/d1c/d1f/d29/f3f 612710 0 2024-09-16T01:25:13.195 INFO:tasks.workunit.client.0.smithi063.stdout:1/284: write d1/f57 [201185,89360] 0 2024-09-16T01:25:13.197 INFO:tasks.workunit.client.0.smithi063.stdout:7/207: creat d7/d18/d39/f42 x:0 0 0 2024-09-16T01:25:13.198 INFO:tasks.workunit.client.0.smithi063.stdout:1/285: truncate d1/d5/d15/d18/f42 658782 0 2024-09-16T01:25:13.203 INFO:tasks.workunit.client.0.smithi063.stdout:4/248: link d5/d3b/df/d1c/d29/f26 d5/d3b/df/d1c/d29/d32/f4d 0 2024-09-16T01:25:13.205 INFO:tasks.workunit.client.0.smithi063.stdout:9/346: write d7/d9/d12/d14/f16 [1197165,88250] 0 2024-09-16T01:25:13.206 INFO:tasks.workunit.client.0.smithi063.stdout:1/286: dwrite d1/d5/d15/d18/d4b/f5f [0,4194304] 0 2024-09-16T01:25:13.208 INFO:tasks.workunit.client.0.smithi063.stdout:4/249: dread - d5/d3b/df/d1c/d29/d20/f44 zero size 2024-09-16T01:25:13.210 INFO:tasks.workunit.client.0.smithi063.stdout:9/347: write d7/d9/d12/d14/f35 [1023510,113507] 0 2024-09-16T01:25:13.211 INFO:tasks.workunit.client.0.smithi063.stdout:1/287: creat d1/d5/d15/f62 x:0 0 0 2024-09-16T01:25:13.212 INFO:tasks.workunit.client.0.smithi063.stdout:7/208: dread d7/d1c/d1f/f32 [4194304,4194304] 0 2024-09-16T01:25:13.212 INFO:tasks.workunit.client.0.smithi063.stdout:4/250: truncate d5/f11 2547914 0 2024-09-16T01:25:13.213 INFO:tasks.workunit.client.0.smithi063.stdout:7/209: write d7/d18/f1a [486636,40817] 0 2024-09-16T01:25:13.214 INFO:tasks.workunit.client.0.smithi063.stdout:7/210: dread - d7/d1c/d1f/f28 zero size 2024-09-16T01:25:13.215 INFO:tasks.workunit.client.0.smithi063.stdout:9/348: rename d7/d9/d12/d14/f6e to d7/d9/d20/f79 0 2024-09-16T01:25:13.219 INFO:tasks.workunit.client.0.smithi063.stdout:1/288: fsync d1/d5/d15/f62 0 2024-09-16T01:25:13.221 INFO:tasks.workunit.client.0.smithi063.stdout:1/289: write d1/d5/d15/f62 [367479,22365] 0 2024-09-16T01:25:13.222 INFO:tasks.workunit.client.0.smithi063.stdout:9/349: dread d7/d9/d12/d14/f35 [0,4194304] 0 2024-09-16T01:25:13.224 INFO:tasks.workunit.client.0.smithi063.stdout:7/211: write d7/d1c/d1f/f2b [243987,98919] 0 2024-09-16T01:25:13.224 INFO:tasks.workunit.client.0.smithi063.stdout:1/290: chown d1/l33 392809 1 2024-09-16T01:25:13.226 INFO:tasks.workunit.client.0.smithi063.stdout:4/251: dwrite d5/d3b/df/d1c/d29/f4a [0,4194304] 0 2024-09-16T01:25:13.226 INFO:tasks.workunit.client.0.smithi063.stdout:9/350: write d7/d9/d12/d14/d34/f6f [379722,91812] 0 2024-09-16T01:25:13.227 INFO:tasks.workunit.client.0.smithi063.stdout:1/291: mkdir d1/d5/d63 0 2024-09-16T01:25:13.228 INFO:tasks.workunit.client.0.smithi063.stdout:7/212: chown d7/d1c/d1f/d29/c2f 1 1 2024-09-16T01:25:13.229 INFO:tasks.workunit.client.0.smithi063.stdout:7/213: dread - d7/d18/d39/f42 zero size 2024-09-16T01:25:13.232 INFO:tasks.workunit.client.0.smithi063.stdout:1/292: rmdir d1/dd/d3b/d50 0 2024-09-16T01:25:13.236 INFO:tasks.workunit.client.0.smithi063.stdout:7/214: dwrite d7/d1c/d1f/f28 [0,4194304] 0 2024-09-16T01:25:13.237 INFO:tasks.workunit.client.0.smithi063.stdout:9/351: getdents d7 0 2024-09-16T01:25:13.241 INFO:tasks.workunit.client.0.smithi063.stdout:7/215: readlink d7/d18/l3c 0 2024-09-16T01:25:13.244 INFO:tasks.workunit.client.0.smithi063.stdout:4/252: dwrite d5/d3b/f2d [4194304,4194304] 0 2024-09-16T01:25:13.244 INFO:tasks.workunit.client.0.smithi063.stdout:1/293: dwrite d1/dd/d3b/f44 [0,4194304] 0 2024-09-16T01:25:13.245 INFO:tasks.workunit.client.0.smithi063.stdout:9/352: rename d7/d9/d12/d14/d34/l69 to d7/d1f/l7a 0 2024-09-16T01:25:13.246 INFO:tasks.workunit.client.0.smithi063.stdout:7/216: symlink d7/d1c/d1f/l43 0 2024-09-16T01:25:13.247 INFO:tasks.workunit.client.0.smithi063.stdout:1/294: chown d1/d5/d15/d18/f42 0 1 2024-09-16T01:25:13.247 INFO:tasks.workunit.client.0.smithi063.stdout:4/253: mkdir d5/d3b/df/d1c/d29/d32/d4e 0 2024-09-16T01:25:13.248 INFO:tasks.workunit.client.0.smithi063.stdout:9/353: truncate d7/d4a/f53 770482 0 2024-09-16T01:25:13.248 INFO:tasks.workunit.client.0.smithi063.stdout:1/295: chown d1/d5/d15/d18/l5e 6 1 2024-09-16T01:25:13.249 INFO:tasks.workunit.client.0.smithi063.stdout:4/254: dread - d5/d3b/df/d1c/f36 zero size 2024-09-16T01:25:13.252 INFO:tasks.workunit.client.0.smithi063.stdout:9/354: symlink d7/d9/d12/d14/d63/d5f/l7b 0 2024-09-16T01:25:13.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/355: truncate d7/d4a/f59 195446 0 2024-09-16T01:25:13.255 INFO:tasks.workunit.client.0.smithi063.stdout:9/356: write d7/d9/d12/f4b [690384,104321] 0 2024-09-16T01:25:13.256 INFO:tasks.workunit.client.0.smithi063.stdout:4/255: creat d5/d3b/df/d1c/d29/f4f x:0 0 0 2024-09-16T01:25:13.257 INFO:tasks.workunit.client.0.smithi063.stdout:9/357: creat d7/d4a/d4d/d50/f7c x:0 0 0 2024-09-16T01:25:13.258 INFO:tasks.workunit.client.0.smithi063.stdout:4/256: write d5/d3b/df/d1c/f39 [4819,108256] 0 2024-09-16T01:25:13.258 INFO:tasks.workunit.client.0.smithi063.stdout:9/358: chown d7/d4a/d4d/d50/f7c 997137 1 2024-09-16T01:25:13.260 INFO:tasks.workunit.client.0.smithi063.stdout:9/359: write d7/d9/d12/d14/d34/f6f [915272,91291] 0 2024-09-16T01:25:13.264 INFO:tasks.workunit.client.0.smithi063.stdout:9/360: link d7/d4a/l4c d7/d4a/d4d/l7d 0 2024-09-16T01:25:13.264 INFO:tasks.workunit.client.0.smithi063.stdout:4/257: dwrite d5/d3b/f19 [0,4194304] 0 2024-09-16T01:25:13.267 INFO:tasks.workunit.client.0.smithi063.stdout:1/296: dwrite d1/d5/f1a [0,4194304] 0 2024-09-16T01:25:13.268 INFO:tasks.workunit.client.0.smithi063.stdout:9/361: unlink d7/d9/d12/d14/d34/f6f 0 2024-09-16T01:25:13.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/297: mknod d1/d5/d15/d1b/d31/c64 0 2024-09-16T01:25:13.280 INFO:tasks.workunit.client.0.smithi063.stdout:1/298: dwrite d1/f57 [0,4194304] 0 2024-09-16T01:25:13.281 INFO:tasks.workunit.client.0.smithi063.stdout:4/258: fsync d5/d3b/f19 0 2024-09-16T01:25:13.285 INFO:tasks.workunit.client.0.smithi063.stdout:1/299: creat d1/d12/d56/f65 x:0 0 0 2024-09-16T01:25:13.285 INFO:tasks.workunit.client.0.smithi063.stdout:4/259: chown d5/d3b/df/d1c/d29/d20 35217 1 2024-09-16T01:25:13.287 INFO:tasks.workunit.client.0.smithi063.stdout:9/362: dwrite f5 [0,4194304] 0 2024-09-16T01:25:13.289 INFO:tasks.workunit.client.0.smithi063.stdout:4/260: write d5/d3b/f2d [4073899,95905] 0 2024-09-16T01:25:13.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/363: write d7/d9/d12/f77 [863671,11276] 0 2024-09-16T01:25:13.292 INFO:tasks.workunit.client.0.smithi063.stdout:9/364: chown d7/d9/d12/c66 274233298 1 2024-09-16T01:25:13.294 INFO:tasks.workunit.client.0.smithi063.stdout:4/261: symlink d5/d3b/df/d1c/d29/d20/l50 0 2024-09-16T01:25:13.297 INFO:tasks.workunit.client.0.smithi063.stdout:1/300: dwrite d1/dd/d3b/f44 [4194304,4194304] 0 2024-09-16T01:25:13.298 INFO:tasks.workunit.client.0.smithi063.stdout:4/262: creat d5/d3b/df/d1c/d29/d20/f51 x:0 0 0 2024-09-16T01:25:13.299 INFO:tasks.workunit.client.0.smithi063.stdout:4/263: readlink d5/d3b/l1e 0 2024-09-16T01:25:13.303 INFO:tasks.workunit.client.0.smithi063.stdout:9/365: dwrite d7/d9/d12/d14/f16 [0,4194304] 0 2024-09-16T01:25:13.305 INFO:tasks.workunit.client.0.smithi063.stdout:9/366: stat d7/d4a/d4d/d50/f48 0 2024-09-16T01:25:13.306 INFO:tasks.workunit.client.0.smithi063.stdout:4/264: creat d5/d3b/df/d1c/d49/f52 x:0 0 0 2024-09-16T01:25:13.307 INFO:tasks.workunit.client.0.smithi063.stdout:9/367: chown d7/d9/d12/d14/d38/l5a 6597084 1 2024-09-16T01:25:13.309 INFO:tasks.workunit.client.0.smithi063.stdout:1/301: dwrite d1/d12/d21/f46 [0,4194304] 0 2024-09-16T01:25:13.309 INFO:tasks.workunit.client.0.smithi063.stdout:9/368: rename d7/d9 to d7/d9/d12/d7e 22 2024-09-16T01:25:13.310 INFO:tasks.workunit.client.0.smithi063.stdout:9/369: readlink d7/d9/d12/l4f 0 2024-09-16T01:25:13.312 INFO:tasks.workunit.client.0.smithi063.stdout:5/280: sync 2024-09-16T01:25:13.314 INFO:tasks.workunit.client.0.smithi063.stdout:4/265: getdents d5/d3b/df/d1c 0 2024-09-16T01:25:13.317 INFO:tasks.workunit.client.0.smithi063.stdout:5/281: creat d5/d18/d4b/f5f x:0 0 0 2024-09-16T01:25:13.321 INFO:tasks.workunit.client.0.smithi063.stdout:4/266: creat d5/d3b/df/d1c/f53 x:0 0 0 2024-09-16T01:25:13.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/302: dwrite d1/f57 [0,4194304] 0 2024-09-16T01:25:13.326 INFO:tasks.workunit.client.0.smithi063.stdout:9/370: dwrite d7/d4a/d4d/d50/f7c [0,4194304] 0 2024-09-16T01:25:13.327 INFO:tasks.workunit.client.0.smithi063.stdout:5/282: truncate d5/d12/f13 1351588 0 2024-09-16T01:25:13.334 INFO:tasks.workunit.client.0.smithi063.stdout:1/303: mkdir d1/d5/d63/d66 0 2024-09-16T01:25:13.334 INFO:tasks.workunit.client.0.smithi063.stdout:4/267: creat d5/d3b/df/d1c/d29/d32/d4e/f54 x:0 0 0 2024-09-16T01:25:13.338 INFO:tasks.workunit.client.0.smithi063.stdout:4/268: truncate d5/f3f 127480 0 2024-09-16T01:25:13.339 INFO:tasks.workunit.client.0.smithi063.stdout:1/304: symlink d1/d5/d15/l67 0 2024-09-16T01:25:13.339 INFO:tasks.workunit.client.0.smithi063.stdout:5/283: dwrite d5/d18/f42 [0,4194304] 0 2024-09-16T01:25:13.342 INFO:tasks.workunit.client.0.smithi063.stdout:4/269: unlink d5/d3b/df/d1c/d29/d20/f51 0 2024-09-16T01:25:13.343 INFO:tasks.workunit.client.0.smithi063.stdout:4/270: chown d5/d3b/f19 43956 1 2024-09-16T01:25:13.345 INFO:tasks.workunit.client.0.smithi063.stdout:9/371: dwrite d7/d9/d12/f2e [0,4194304] 0 2024-09-16T01:25:13.345 INFO:tasks.workunit.client.0.smithi063.stdout:5/284: rename d5/fe to d5/d12/d35/f60 0 2024-09-16T01:25:13.346 INFO:tasks.workunit.client.0.smithi063.stdout:1/305: mknod d1/d12/c68 0 2024-09-16T01:25:13.349 INFO:tasks.workunit.client.0.smithi063.stdout:5/285: write d5/d18/f2a [9472003,64768] 0 2024-09-16T01:25:13.350 INFO:tasks.workunit.client.0.smithi063.stdout:9/372: mkdir d7/d4a/d4d/d50/d7f 0 2024-09-16T01:25:13.350 INFO:tasks.workunit.client.0.smithi063.stdout:1/306: read d1/d5/f11 [1878165,53408] 0 2024-09-16T01:25:13.354 INFO:tasks.workunit.client.0.smithi063.stdout:4/271: dwrite d5/f6 [0,4194304] 0 2024-09-16T01:25:13.354 INFO:tasks.workunit.client.0.smithi063.stdout:1/307: creat d1/d5/d15/d18/f69 x:0 0 0 2024-09-16T01:25:13.355 INFO:tasks.workunit.client.0.smithi063.stdout:9/373: rename d7/d9/d20/f2b to d7/d4a/d4d/f80 0 2024-09-16T01:25:13.355 INFO:tasks.workunit.client.0.smithi063.stdout:5/286: dread d5/d12/f1e [0,4194304] 0 2024-09-16T01:25:13.356 INFO:tasks.workunit.client.0.smithi063.stdout:9/374: write d7/d9/d12/d14/d63/d5f/f62 [1296736,29502] 0 2024-09-16T01:25:13.358 INFO:tasks.workunit.client.0.smithi063.stdout:4/272: chown d5/d3b/cc 492530884 1 2024-09-16T01:25:13.360 INFO:tasks.workunit.client.0.smithi063.stdout:1/308: write d1/f3 [1968051,119535] 0 2024-09-16T01:25:13.361 INFO:tasks.workunit.client.0.smithi063.stdout:5/287: mknod d5/d18/d4b/c61 0 2024-09-16T01:25:13.362 INFO:tasks.workunit.client.0.smithi063.stdout:5/288: fdatasync d5/d18/d29/f2f 0 2024-09-16T01:25:13.362 INFO:tasks.workunit.client.0.smithi063.stdout:5/289: chown d5/d12/f1e 182 1 2024-09-16T01:25:13.364 INFO:tasks.workunit.client.0.smithi063.stdout:4/273: mknod d5/d3b/df/c55 0 2024-09-16T01:25:13.369 INFO:tasks.workunit.client.0.smithi063.stdout:4/274: write d5/d3b/df/f3e [4746691,94286] 0 2024-09-16T01:25:13.369 INFO:tasks.workunit.client.0.smithi063.stdout:9/375: creat d7/f81 x:0 0 0 2024-09-16T01:25:13.369 INFO:tasks.workunit.client.0.smithi063.stdout:1/309: creat d1/d5/d15/d18/f6a x:0 0 0 2024-09-16T01:25:13.372 INFO:tasks.workunit.client.0.smithi063.stdout:1/310: dwrite d1/d5/d15/f29 [0,4194304] 0 2024-09-16T01:25:13.373 INFO:tasks.workunit.client.0.smithi063.stdout:1/311: dread - d1/d5/d15/d18/f69 zero size 2024-09-16T01:25:13.374 INFO:tasks.workunit.client.0.smithi063.stdout:9/376: symlink d7/d9/d12/d14/d23/l82 0 2024-09-16T01:25:13.374 INFO:tasks.workunit.client.0.smithi063.stdout:1/312: chown d1/d5/d15/d18/f69 145512 1 2024-09-16T01:25:13.378 INFO:tasks.workunit.client.0.smithi063.stdout:9/377: creat d7/d1f/f83 x:0 0 0 2024-09-16T01:25:13.379 INFO:tasks.workunit.client.0.smithi063.stdout:1/313: rmdir d1/d5/d15/d18 39 2024-09-16T01:25:13.379 INFO:tasks.workunit.client.0.smithi063.stdout:5/290: truncate d5/d12/f4a 6816490 0 2024-09-16T01:25:13.380 INFO:tasks.workunit.client.0.smithi063.stdout:1/314: mknod d1/d5/d63/c6b 0 2024-09-16T01:25:13.382 INFO:tasks.workunit.client.0.smithi063.stdout:1/315: write d1/d5/f7 [3146031,50123] 0 2024-09-16T01:25:13.386 INFO:tasks.workunit.client.0.smithi063.stdout:9/378: dwrite d7/d9/d12/f4b [0,4194304] 0 2024-09-16T01:25:13.387 INFO:tasks.workunit.client.0.smithi063.stdout:1/316: creat d1/d5/d63/d66/f6c x:0 0 0 2024-09-16T01:25:13.392 INFO:tasks.workunit.client.0.smithi063.stdout:9/379: chown d7/d4a/d4d/d50/f45 37541188 1 2024-09-16T01:25:13.393 INFO:tasks.workunit.client.0.smithi063.stdout:5/291: dread d5/d12/f21 [0,4194304] 0 2024-09-16T01:25:13.395 INFO:tasks.workunit.client.0.smithi063.stdout:1/317: getdents d1/d5 0 2024-09-16T01:25:13.396 INFO:tasks.workunit.client.0.smithi063.stdout:9/380: creat d7/d9/d12/d14/d34/f84 x:0 0 0 2024-09-16T01:25:13.400 INFO:tasks.workunit.client.0.smithi063.stdout:5/292: truncate d5/d18/f37 1648043 0 2024-09-16T01:25:13.401 INFO:tasks.workunit.client.0.smithi063.stdout:9/381: dread d7/d9/d20/f21 [0,4194304] 0 2024-09-16T01:25:13.402 INFO:tasks.workunit.client.0.smithi063.stdout:5/293: stat d5/d18/d29/d5b/d5e 0 2024-09-16T01:25:13.403 INFO:tasks.workunit.client.0.smithi063.stdout:1/318: dwrite d1/d5/d15/f19 [0,4194304] 0 2024-09-16T01:25:13.404 INFO:tasks.workunit.client.0.smithi063.stdout:9/382: write d7/d4a/d4d/d50/f45 [4398822,35852] 0 2024-09-16T01:25:13.404 INFO:tasks.workunit.client.0.smithi063.stdout:5/294: creat d5/d12/d35/f62 x:0 0 0 2024-09-16T01:25:13.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/319: symlink d1/dd/l6d 0 2024-09-16T01:25:13.406 INFO:tasks.workunit.client.0.smithi063.stdout:9/383: mknod d7/c85 0 2024-09-16T01:25:13.406 INFO:tasks.workunit.client.0.smithi063.stdout:1/320: chown d1/d12/d16 51597219 1 2024-09-16T01:25:13.407 INFO:tasks.workunit.client.0.smithi063.stdout:5/295: symlink d5/d12/d5d/l63 0 2024-09-16T01:25:13.408 INFO:tasks.workunit.client.0.smithi063.stdout:9/384: symlink d7/d9/d12/d14/l86 0 2024-09-16T01:25:13.410 INFO:tasks.workunit.client.0.smithi063.stdout:1/321: creat d1/d5/d15/d18/d4b/f6e x:0 0 0 2024-09-16T01:25:13.412 INFO:tasks.workunit.client.0.smithi063.stdout:1/322: chown d1/d12/d21/f46 4035 1 2024-09-16T01:25:13.414 INFO:tasks.workunit.client.0.smithi063.stdout:9/385: dread d7/d9/d12/f2e [8388608,4194304] 0 2024-09-16T01:25:13.415 INFO:tasks.workunit.client.0.smithi063.stdout:5/296: dwrite d5/d12/f21 [4194304,4194304] 0 2024-09-16T01:25:13.416 INFO:tasks.workunit.client.0.smithi063.stdout:9/386: chown d7/d4a/d4d/d50/f45 10 1 2024-09-16T01:25:13.421 INFO:tasks.workunit.client.0.smithi063.stdout:9/387: creat d7/d4a/d4d/d50/d7f/f87 x:0 0 0 2024-09-16T01:25:13.425 INFO:tasks.workunit.client.0.smithi063.stdout:9/388: mknod d7/d1f/c88 0 2024-09-16T01:25:13.425 INFO:tasks.workunit.client.0.smithi063.stdout:5/297: dwrite d5/d12/f23 [0,4194304] 0 2024-09-16T01:25:13.428 INFO:tasks.workunit.client.0.smithi063.stdout:9/389: fsync d7/d9/d12/d14/d23/f49 0 2024-09-16T01:25:13.430 INFO:tasks.workunit.client.0.smithi063.stdout:5/298: rename d5/d12/f1e to d5/d12/d35/f64 0 2024-09-16T01:25:13.433 INFO:tasks.workunit.client.0.smithi063.stdout:9/390: creat d7/d9/d12/d14/f89 x:0 0 0 2024-09-16T01:25:13.439 INFO:tasks.workunit.client.0.smithi063.stdout:9/391: dwrite d7/d9/d12/f42 [0,4194304] 0 2024-09-16T01:25:13.442 INFO:tasks.workunit.client.0.smithi063.stdout:5/299: dread d5/d18/f2a [0,4194304] 0 2024-09-16T01:25:13.443 INFO:tasks.workunit.client.0.smithi063.stdout:9/392: rename d7/d9/d12/d14/d34/c72 to d7/c8a 0 2024-09-16T01:25:13.446 INFO:tasks.workunit.client.0.smithi063.stdout:5/300: rmdir d5/d18/d29/d5b/d5e 0 2024-09-16T01:25:13.448 INFO:tasks.workunit.client.0.smithi063.stdout:9/393: rename d7/d9/d20/f21 to d7/d9/d12/d14/d38/f8b 0 2024-09-16T01:25:13.449 INFO:tasks.workunit.client.0.smithi063.stdout:5/301: unlink d5/d18/l2c 0 2024-09-16T01:25:13.450 INFO:tasks.workunit.client.0.smithi063.stdout:9/394: creat d7/d1f/f8c x:0 0 0 2024-09-16T01:25:13.451 INFO:tasks.workunit.client.0.smithi063.stdout:5/302: creat d5/d12/d5d/f65 x:0 0 0 2024-09-16T01:25:13.451 INFO:tasks.workunit.client.0.smithi063.stdout:9/395: mknod d7/d9/d12/d14/d63/d5f/c8d 0 2024-09-16T01:25:13.457 INFO:tasks.workunit.client.0.smithi063.stdout:5/303: dread d5/d12/f13 [0,4194304] 0 2024-09-16T01:25:13.458 INFO:tasks.workunit.client.0.smithi063.stdout:5/304: chown d5/f17 4640 1 2024-09-16T01:25:13.458 INFO:tasks.workunit.client.0.smithi063.stdout:9/396: dwrite d7/d4a/d4d/d50/f7c [4194304,4194304] 0 2024-09-16T01:25:13.460 INFO:tasks.workunit.client.0.smithi063.stdout:9/397: mkdir d7/d9/d12/d8e 0 2024-09-16T01:25:13.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/398: mknod d7/c8f 0 2024-09-16T01:25:13.464 INFO:tasks.workunit.client.0.smithi063.stdout:5/305: dwrite d5/f3b [0,4194304] 0 2024-09-16T01:25:13.466 INFO:tasks.workunit.client.0.smithi063.stdout:9/399: rename d7/d9/d20/f5c to d7/d9/d12/d8e/f90 0 2024-09-16T01:25:13.468 INFO:tasks.workunit.client.0.smithi063.stdout:5/306: mkdir d5/d18/d29/d48/d66 0 2024-09-16T01:25:13.471 INFO:tasks.workunit.client.0.smithi063.stdout:9/400: creat d7/d9/d12/d14/f91 x:0 0 0 2024-09-16T01:25:13.472 INFO:tasks.workunit.client.0.smithi063.stdout:9/401: fdatasync d7/d9/d12/d14/f75 0 2024-09-16T01:25:13.473 INFO:tasks.workunit.client.0.smithi063.stdout:9/402: truncate d7/d9/d12/f77 908916 0 2024-09-16T01:25:13.473 INFO:tasks.workunit.client.0.smithi063.stdout:9/403: fdatasync d7/d9/d12/d14/f16 0 2024-09-16T01:25:13.476 INFO:tasks.workunit.client.0.smithi063.stdout:5/307: getdents d5/d12 0 2024-09-16T01:25:13.477 INFO:tasks.workunit.client.0.smithi063.stdout:5/308: write d5/d12/f49 [1517045,68082] 0 2024-09-16T01:25:13.482 INFO:tasks.workunit.client.0.smithi063.stdout:9/404: dwrite d7/d9/d12/d14/d38/f3a [0,4194304] 0 2024-09-16T01:25:13.487 INFO:tasks.workunit.client.0.smithi063.stdout:9/405: creat d7/d9/d12/d8e/f92 x:0 0 0 2024-09-16T01:25:13.487 INFO:tasks.workunit.client.0.smithi063.stdout:5/309: dwrite d5/d12/d35/f3d [0,4194304] 0 2024-09-16T01:25:13.490 INFO:tasks.workunit.client.0.smithi063.stdout:9/406: creat d7/d4a/f93 x:0 0 0 2024-09-16T01:25:13.498 INFO:tasks.workunit.client.0.smithi063.stdout:9/407: rename d7/f22 to d7/d9/d12/d8e/f94 0 2024-09-16T01:25:13.500 INFO:tasks.workunit.client.0.smithi063.stdout:9/408: symlink d7/d9/d12/d14/d63/l95 0 2024-09-16T01:25:13.502 INFO:tasks.workunit.client.0.smithi063.stdout:9/409: write d7/d9/d12/d14/d38/f8b [3050734,108840] 0 2024-09-16T01:25:13.504 INFO:tasks.workunit.client.0.smithi063.stdout:5/310: dread d5/f15 [0,4194304] 0 2024-09-16T01:25:13.504 INFO:tasks.workunit.client.0.smithi063.stdout:9/410: mkdir d7/d4a/d4d/d96 0 2024-09-16T01:25:13.506 INFO:tasks.workunit.client.0.smithi063.stdout:9/411: write d7/d9/d12/d14/f46 [588737,77882] 0 2024-09-16T01:25:13.508 INFO:tasks.workunit.client.0.smithi063.stdout:9/412: mknod d7/d9/d12/d14/c97 0 2024-09-16T01:25:13.510 INFO:tasks.workunit.client.0.smithi063.stdout:9/413: dread d7/d4a/f59 [0,4194304] 0 2024-09-16T01:25:13.511 INFO:tasks.workunit.client.0.smithi063.stdout:5/311: dwrite d5/d12/f43 [0,4194304] 0 2024-09-16T01:25:13.512 INFO:tasks.workunit.client.0.smithi063.stdout:5/312: chown d5/d18/d29/d48 44416 1 2024-09-16T01:25:13.512 INFO:tasks.workunit.client.0.smithi063.stdout:9/414: dread - d7/d4a/d4d/d50/f6c zero size 2024-09-16T01:25:13.514 INFO:tasks.workunit.client.0.smithi063.stdout:9/415: creat d7/d1f/f98 x:0 0 0 2024-09-16T01:25:13.514 INFO:tasks.workunit.client.0.smithi063.stdout:8/191: sync 2024-09-16T01:25:13.514 INFO:tasks.workunit.client.0.smithi063.stdout:6/214: sync 2024-09-16T01:25:13.515 INFO:tasks.workunit.client.0.smithi063.stdout:0/324: sync 2024-09-16T01:25:13.517 INFO:tasks.workunit.client.0.smithi063.stdout:8/192: dread - d5/d9/f24 zero size 2024-09-16T01:25:13.517 INFO:tasks.workunit.client.0.smithi063.stdout:9/416: write d7/d9/d12/d14/f1c [5012232,103561] 0 2024-09-16T01:25:13.519 INFO:tasks.workunit.client.0.smithi063.stdout:9/417: write d7/d9/d12/d14/f16 [4543772,3523] 0 2024-09-16T01:25:13.520 INFO:tasks.workunit.client.0.smithi063.stdout:6/215: rename d3/f21 to d3/d48/d28/d3e/d44/d52/f53 0 2024-09-16T01:25:13.522 INFO:tasks.workunit.client.0.smithi063.stdout:8/193: mkdir d5/d3a 0 2024-09-16T01:25:13.524 INFO:tasks.workunit.client.0.smithi063.stdout:9/418: dwrite d7/d9/d12/f33 [0,4194304] 0 2024-09-16T01:25:13.526 INFO:tasks.workunit.client.0.smithi063.stdout:9/419: chown d7/d9/d12/d14/d34/f6b 1522590 1 2024-09-16T01:25:13.526 INFO:tasks.workunit.client.0.smithi063.stdout:6/216: readlink d3/l1c 0 2024-09-16T01:25:13.527 INFO:tasks.workunit.client.0.smithi063.stdout:8/194: readlink d5/db/d12/d1a/l27 0 2024-09-16T01:25:13.529 INFO:tasks.workunit.client.0.smithi063.stdout:8/195: write d5/db/d12/f38 [535236,50811] 0 2024-09-16T01:25:13.529 INFO:tasks.workunit.client.0.smithi063.stdout:8/196: readlink l2 0 2024-09-16T01:25:13.530 INFO:tasks.workunit.client.0.smithi063.stdout:6/217: creat d3/d48/f54 x:0 0 0 2024-09-16T01:25:13.533 INFO:tasks.workunit.client.0.smithi063.stdout:9/420: dwrite d7/d9/d12/d14/f91 [0,4194304] 0 2024-09-16T01:25:13.533 INFO:tasks.workunit.client.0.smithi063.stdout:8/197: creat d5/f3b x:0 0 0 2024-09-16T01:25:13.534 INFO:tasks.workunit.client.0.smithi063.stdout:9/421: chown d7/d9/d12/d14/d34/f84 56474471 1 2024-09-16T01:25:13.535 INFO:tasks.workunit.client.0.smithi063.stdout:8/198: write d5/db/d12/d1a/d1e/f32 [673680,33386] 0 2024-09-16T01:25:13.538 INFO:tasks.workunit.client.0.smithi063.stdout:9/422: write d7/d9/d12/f2e [6345724,86143] 0 2024-09-16T01:25:13.540 INFO:tasks.workunit.client.0.smithi063.stdout:9/423: chown d7/d4a/d4d/d50/d7f 1724835079 1 2024-09-16T01:25:13.542 INFO:tasks.workunit.client.0.smithi063.stdout:6/218: dwrite d3/d10/d35/f3c [0,4194304] 0 2024-09-16T01:25:13.545 INFO:tasks.workunit.client.0.smithi063.stdout:9/424: dread d7/d9/d12/d14/f91 [0,4194304] 0 2024-09-16T01:25:13.546 INFO:tasks.workunit.client.0.smithi063.stdout:9/425: dread - d7/d1f/f67 zero size 2024-09-16T01:25:13.547 INFO:tasks.workunit.client.0.smithi063.stdout:6/219: mkdir d3/d48/d28/d3e/d44/d52/d55 0 2024-09-16T01:25:13.548 INFO:tasks.workunit.client.0.smithi063.stdout:6/220: mkdir d3/d10/d35/d56 0 2024-09-16T01:25:13.552 INFO:tasks.workunit.client.0.smithi063.stdout:9/426: dwrite d7/d9/d12/d14/f29 [0,4194304] 0 2024-09-16T01:25:13.554 INFO:tasks.workunit.client.0.smithi063.stdout:9/427: write d7/d9/d12/d14/f65 [107220,69740] 0 2024-09-16T01:25:13.556 INFO:tasks.workunit.client.0.smithi063.stdout:6/221: dwrite d3/d10/f20 [0,4194304] 0 2024-09-16T01:25:13.558 INFO:tasks.workunit.client.0.smithi063.stdout:6/222: truncate d3/d30/f4e 558249 0 2024-09-16T01:25:13.561 INFO:tasks.workunit.client.0.smithi063.stdout:9/428: link d7/d9/d12/c60 d7/d1f/c99 0 2024-09-16T01:25:13.562 INFO:tasks.workunit.client.0.smithi063.stdout:6/223: creat d3/f57 x:0 0 0 2024-09-16T01:25:13.563 INFO:tasks.workunit.client.0.smithi063.stdout:9/429: symlink d7/d9/d12/d8e/l9a 0 2024-09-16T01:25:13.565 INFO:tasks.workunit.client.0.smithi063.stdout:9/430: unlink d7/d9/d12/d14/f89 0 2024-09-16T01:25:13.566 INFO:tasks.workunit.client.0.smithi063.stdout:6/224: creat d3/d48/f58 x:0 0 0 2024-09-16T01:25:13.567 INFO:tasks.workunit.client.0.smithi063.stdout:9/431: write d7/d9/d20/f79 [2678938,99925] 0 2024-09-16T01:25:13.572 INFO:tasks.workunit.client.0.smithi063.stdout:9/432: chown d7/d4a/d4d/l7d 229755737 1 2024-09-16T01:25:13.574 INFO:tasks.workunit.client.0.smithi063.stdout:6/225: write f2 [1055230,15722] 0 2024-09-16T01:25:13.574 INFO:tasks.workunit.client.0.smithi063.stdout:9/433: dwrite d7/d9/d12/d14/f46 [0,4194304] 0 2024-09-16T01:25:13.578 INFO:tasks.workunit.client.0.smithi063.stdout:6/226: rmdir d3/d48/d28/d3e/d44/d52/d55 0 2024-09-16T01:25:13.579 INFO:tasks.workunit.client.0.smithi063.stdout:9/434: link d7/d1f/l7a d7/d9/l9b 0 2024-09-16T01:25:13.585 INFO:tasks.workunit.client.0.smithi063.stdout:6/227: dwrite d3/d48/d28/d3e/d44/d52/f53 [0,4194304] 0 2024-09-16T01:25:13.591 INFO:tasks.workunit.client.0.smithi063.stdout:6/228: dread d3/d10/d35/f3c [0,4194304] 0 2024-09-16T01:25:13.593 INFO:tasks.workunit.client.0.smithi063.stdout:9/435: dread d7/d4a/d4d/d50/f45 [0,4194304] 0 2024-09-16T01:25:13.594 INFO:tasks.workunit.client.0.smithi063.stdout:6/229: mknod d3/d30/d39/c59 0 2024-09-16T01:25:13.596 INFO:tasks.workunit.client.0.smithi063.stdout:9/436: mkdir d7/d9/d12/d14/d23/d9c 0 2024-09-16T01:25:13.597 INFO:tasks.workunit.client.0.smithi063.stdout:9/437: write d7/d1f/f44 [10771589,113361] 0 2024-09-16T01:25:13.597 INFO:tasks.workunit.client.0.smithi063.stdout:6/230: rmdir d3/d4a 0 2024-09-16T01:25:13.598 INFO:tasks.workunit.client.0.smithi063.stdout:9/438: write d7/d9/d12/d14/f75 [4572624,23255] 0 2024-09-16T01:25:13.599 INFO:tasks.workunit.client.0.smithi063.stdout:9/439: fdatasync d7/d9/d12/d14/f29 0 2024-09-16T01:25:13.606 INFO:tasks.workunit.client.0.smithi063.stdout:9/440: dwrite d7/d4a/d4d/d50/f48 [0,4194304] 0 2024-09-16T01:25:13.608 INFO:tasks.workunit.client.0.smithi063.stdout:6/231: dwrite d3/d48/f24 [0,4194304] 0 2024-09-16T01:25:13.610 INFO:tasks.workunit.client.0.smithi063.stdout:6/232: chown d3/d48/d28/l45 802254602 1 2024-09-16T01:25:13.611 INFO:tasks.workunit.client.0.smithi063.stdout:9/441: mkdir d7/d4a/d9d 0 2024-09-16T01:25:13.612 INFO:tasks.workunit.client.0.smithi063.stdout:6/233: mkdir d3/d10/d35/d5a 0 2024-09-16T01:25:13.613 INFO:tasks.workunit.client.0.smithi063.stdout:9/442: truncate d7/d9/d12/d14/d34/f84 330729 0 2024-09-16T01:25:13.616 INFO:tasks.workunit.client.0.smithi063.stdout:9/443: creat d7/d4a/d4d/d50/d7f/f9e x:0 0 0 2024-09-16T01:25:13.619 INFO:tasks.workunit.client.0.smithi063.stdout:6/234: dwrite d3/d10/f2a [0,4194304] 0 2024-09-16T01:25:13.622 INFO:tasks.workunit.client.0.smithi063.stdout:6/235: mknod d3/d48/d28/c5b 0 2024-09-16T01:25:13.623 INFO:tasks.workunit.client.0.smithi063.stdout:6/236: read d3/d48/f24 [2940662,28239] 0 2024-09-16T01:25:13.624 INFO:tasks.workunit.client.0.smithi063.stdout:9/444: dwrite d7/d4a/f53 [0,4194304] 0 2024-09-16T01:25:13.625 INFO:tasks.workunit.client.0.smithi063.stdout:9/445: write d7/d1f/f2c [3083591,53760] 0 2024-09-16T01:25:13.628 INFO:tasks.workunit.client.0.smithi063.stdout:9/446: creat d7/d9/d12/d14/d23/f9f x:0 0 0 2024-09-16T01:25:13.629 INFO:tasks.workunit.client.0.smithi063.stdout:6/237: creat d3/d10/d49/f5c x:0 0 0 2024-09-16T01:25:13.631 INFO:tasks.workunit.client.0.smithi063.stdout:9/447: creat d7/d1f/fa0 x:0 0 0 2024-09-16T01:25:13.637 INFO:tasks.workunit.client.0.smithi063.stdout:9/448: rename d7/d1f/l76 to d7/d9/la1 0 2024-09-16T01:25:13.641 INFO:tasks.workunit.client.0.smithi063.stdout:9/449: dread d7/d9/d12/f24 [0,4194304] 0 2024-09-16T01:25:13.645 INFO:tasks.workunit.client.0.smithi063.stdout:6/238: dread d3/d48/d28/d3e/f43 [0,4194304] 0 2024-09-16T01:25:13.646 INFO:tasks.workunit.client.0.smithi063.stdout:6/239: write d3/d10/f20 [2735837,763] 0 2024-09-16T01:25:13.648 INFO:tasks.workunit.client.0.smithi063.stdout:6/240: mknod d3/d10/d35/d56/c5d 0 2024-09-16T01:25:13.651 INFO:tasks.workunit.client.0.smithi063.stdout:6/241: link d3/d30/l3d d3/d10/d35/d5a/l5e 0 2024-09-16T01:25:13.651 INFO:tasks.workunit.client.0.smithi063.stdout:6/242: chown d3/d41/l47 64834856 1 2024-09-16T01:25:13.656 INFO:tasks.workunit.client.0.smithi063.stdout:6/243: truncate d3/d10/f34 3757679 0 2024-09-16T01:25:13.661 INFO:tasks.workunit.client.0.smithi063.stdout:6/244: write d3/d10/f1d [1647982,73322] 0 2024-09-16T01:25:13.663 INFO:tasks.workunit.client.0.smithi063.stdout:6/245: symlink d3/l5f 0 2024-09-16T01:25:13.664 INFO:tasks.workunit.client.0.smithi063.stdout:6/246: stat d3/d48/d28/l38 0 2024-09-16T01:25:13.665 INFO:tasks.workunit.client.0.smithi063.stdout:6/247: read d3/d48/d28/f33 [4011214,49041] 0 2024-09-16T01:25:13.667 INFO:tasks.workunit.client.0.smithi063.stdout:6/248: truncate d3/d48/d28/f2b 100683 0 2024-09-16T01:25:13.667 INFO:tasks.workunit.client.0.smithi063.stdout:6/249: write d3/d10/f29 [2299456,58871] 0 2024-09-16T01:25:13.668 INFO:tasks.workunit.client.0.smithi063.stdout:6/250: truncate d3/d30/f40 316583 0 2024-09-16T01:25:13.674 INFO:tasks.workunit.client.0.smithi063.stdout:6/251: dread d3/d10/f29 [0,4194304] 0 2024-09-16T01:25:13.680 INFO:tasks.workunit.client.0.smithi063.stdout:6/252: dwrite d3/d10/d35/f50 [0,4194304] 0 2024-09-16T01:25:13.684 INFO:tasks.workunit.client.0.smithi063.stdout:6/253: link d3/d30/f40 d3/d10/f60 0 2024-09-16T01:25:13.686 INFO:tasks.workunit.client.0.smithi063.stdout:6/254: symlink d3/l61 0 2024-09-16T01:25:13.688 INFO:tasks.workunit.client.0.smithi063.stdout:6/255: creat d3/f62 x:0 0 0 2024-09-16T01:25:13.695 INFO:tasks.workunit.client.0.smithi063.stdout:3/243: sync 2024-09-16T01:25:13.696 INFO:tasks.workunit.client.0.smithi063.stdout:2/355: sync 2024-09-16T01:25:13.697 INFO:tasks.workunit.client.0.smithi063.stdout:3/244: write d2/d11/d18/f3f [900247,106348] 0 2024-09-16T01:25:13.699 INFO:tasks.workunit.client.0.smithi063.stdout:3/245: rename d2/d11/d18/l16 to d2/d11/d39/l51 0 2024-09-16T01:25:13.706 INFO:tasks.workunit.client.0.smithi063.stdout:3/246: symlink d2/d11/d18/l52 0 2024-09-16T01:25:13.708 INFO:tasks.workunit.client.0.smithi063.stdout:3/247: rename d2/f19 to d2/d11/d37/d40/f53 0 2024-09-16T01:25:13.710 INFO:tasks.workunit.client.0.smithi063.stdout:3/248: creat d2/f54 x:0 0 0 2024-09-16T01:25:13.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/249: creat d2/d11/d39/f55 x:0 0 0 2024-09-16T01:25:13.713 INFO:tasks.workunit.client.0.smithi063.stdout:3/250: write d2/d11/d39/f55 [993198,84734] 0 2024-09-16T01:25:13.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/251: link f0 d2/d11/d18/d41/d30/f56 0 2024-09-16T01:25:13.718 INFO:tasks.workunit.client.0.smithi063.stdout:3/252: dread - d2/d11/d18/f2d zero size 2024-09-16T01:25:13.723 INFO:tasks.workunit.client.0.smithi063.stdout:3/253: dwrite d2/d11/d18/d41/f2f [0,4194304] 0 2024-09-16T01:25:13.725 INFO:tasks.workunit.client.0.smithi063.stdout:3/254: creat d2/d11/d18/d41/d30/f57 x:0 0 0 2024-09-16T01:25:13.727 INFO:tasks.workunit.client.0.smithi063.stdout:3/255: dread - d2/d11/d18/d41/d30/f57 zero size 2024-09-16T01:25:13.728 INFO:tasks.workunit.client.0.smithi063.stdout:3/256: write d2/d11/f26 [10524,72814] 0 2024-09-16T01:25:13.731 INFO:tasks.workunit.client.0.smithi063.stdout:3/257: write d2/d11/d18/fd [3930154,91963] 0 2024-09-16T01:25:13.733 INFO:tasks.workunit.client.0.smithi063.stdout:3/258: symlink d2/d11/d18/d41/l58 0 2024-09-16T01:25:13.734 INFO:tasks.workunit.client.0.smithi063.stdout:3/259: creat d2/d11/d37/f59 x:0 0 0 2024-09-16T01:25:13.740 INFO:tasks.workunit.client.0.smithi063.stdout:3/260: dwrite d2/f22 [4194304,4194304] 0 2024-09-16T01:25:13.743 INFO:tasks.workunit.client.0.smithi063.stdout:3/261: unlink d2/d11/d18/d41/d30/l49 0 2024-09-16T01:25:13.743 INFO:tasks.workunit.client.0.smithi063.stdout:3/262: write d2/d11/f29 [3209684,75080] 0 2024-09-16T01:25:13.751 INFO:tasks.workunit.client.0.smithi063.stdout:3/263: dwrite d2/d11/d18/f3f [0,4194304] 0 2024-09-16T01:25:13.753 INFO:tasks.workunit.client.0.smithi063.stdout:3/264: rmdir d2/d11/d39 39 2024-09-16T01:25:13.758 INFO:tasks.workunit.client.0.smithi063.stdout:3/265: write d2/d11/d18/d41/d30/f56 [4155508,1307] 0 2024-09-16T01:25:13.759 INFO:tasks.workunit.client.0.smithi063.stdout:3/266: write d2/d11/f29 [3680883,115237] 0 2024-09-16T01:25:13.764 INFO:tasks.workunit.client.0.smithi063.stdout:3/267: dwrite d2/d11/d18/d41/d30/f56 [0,4194304] 0 2024-09-16T01:25:13.768 INFO:tasks.workunit.client.0.smithi063.stdout:3/268: symlink d2/d11/d39/d3b/d45/l5a 0 2024-09-16T01:25:13.770 INFO:tasks.workunit.client.0.smithi063.stdout:3/269: mkdir d2/d5b 0 2024-09-16T01:25:13.862 INFO:tasks.workunit.client.0.smithi063.stdout:7/217: sync 2024-09-16T01:25:13.865 INFO:tasks.workunit.client.0.smithi063.stdout:7/218: dread d7/d1c/d1f/f32 [4194304,4194304] 0 2024-09-16T01:25:13.865 INFO:tasks.workunit.client.0.smithi063.stdout:7/219: readlink d7/d18/l21 0 2024-09-16T01:25:13.866 INFO:tasks.workunit.client.0.smithi063.stdout:7/220: read d7/f3e [745332,47850] 0 2024-09-16T01:25:13.867 INFO:tasks.workunit.client.0.smithi063.stdout:7/221: chown d7/d18/c1e 74505 1 2024-09-16T01:25:13.879 INFO:tasks.workunit.client.0.smithi063.stdout:7/222: dread d7/f19 [0,4194304] 0 2024-09-16T01:25:13.879 INFO:tasks.workunit.client.0.smithi063.stdout:7/223: chown d7 32567 1 2024-09-16T01:25:13.880 INFO:tasks.workunit.client.0.smithi063.stdout:7/224: chown d7/d1c/d1f/f28 73979293 1 2024-09-16T01:25:13.882 INFO:tasks.workunit.client.0.smithi063.stdout:7/225: rename d7/d18/f37 to d7/d18/f44 0 2024-09-16T01:25:13.883 INFO:tasks.workunit.client.0.smithi063.stdout:7/226: creat d7/d18/f45 x:0 0 0 2024-09-16T01:25:13.884 INFO:tasks.workunit.client.0.smithi063.stdout:7/227: stat d7/d18/d39 0 2024-09-16T01:25:13.884 INFO:tasks.workunit.client.0.smithi063.stdout:7/228: write d7/d18/f1a [3174909,7977] 0 2024-09-16T01:25:13.885 INFO:tasks.workunit.client.0.smithi063.stdout:7/229: truncate d7/d1c/d1f/f38 362269 0 2024-09-16T01:25:13.888 INFO:tasks.workunit.client.0.smithi063.stdout:7/230: rename d7/d1c/c34 to d7/d1c/c46 0 2024-09-16T01:25:13.889 INFO:tasks.workunit.client.0.smithi063.stdout:7/231: write f2 [3773933,54132] 0 2024-09-16T01:25:13.891 INFO:tasks.workunit.client.0.smithi063.stdout:7/232: mknod d7/d1c/d1f/d29/c47 0 2024-09-16T01:25:13.892 INFO:tasks.workunit.client.0.smithi063.stdout:7/233: fsync d7/f14 0 2024-09-16T01:25:13.896 INFO:tasks.workunit.client.0.smithi063.stdout:7/234: dwrite f5 [0,4194304] 0 2024-09-16T01:25:13.898 INFO:tasks.workunit.client.0.smithi063.stdout:7/235: chown d7/f10 89 1 2024-09-16T01:25:13.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/236: creat d7/f48 x:0 0 0 2024-09-16T01:25:13.901 INFO:tasks.workunit.client.0.smithi063.stdout:7/237: stat d7/d1c/d1f/f28 0 2024-09-16T01:25:13.902 INFO:tasks.workunit.client.0.smithi063.stdout:7/238: unlink f2 0 2024-09-16T01:25:13.904 INFO:tasks.workunit.client.0.smithi063.stdout:7/239: dread d7/f14 [0,4194304] 0 2024-09-16T01:25:13.905 INFO:tasks.workunit.client.0.smithi063.stdout:7/240: dread - d7/d18/f44 zero size 2024-09-16T01:25:13.906 INFO:tasks.workunit.client.0.smithi063.stdout:7/241: mknod d7/d18/d25/c49 0 2024-09-16T01:25:13.909 INFO:tasks.workunit.client.0.smithi063.stdout:7/242: symlink d7/d18/d25/l4a 0 2024-09-16T01:25:13.909 INFO:tasks.workunit.client.0.smithi063.stdout:1/323: sync 2024-09-16T01:25:13.909 INFO:tasks.workunit.client.0.smithi063.stdout:8/199: sync 2024-09-16T01:25:13.909 INFO:tasks.workunit.client.0.smithi063.stdout:0/325: sync 2024-09-16T01:25:13.909 INFO:tasks.workunit.client.0.smithi063.stdout:4/275: sync 2024-09-16T01:25:13.910 INFO:tasks.workunit.client.0.smithi063.stdout:5/313: sync 2024-09-16T01:25:13.910 INFO:tasks.workunit.client.0.smithi063.stdout:9/450: sync 2024-09-16T01:25:13.910 INFO:tasks.workunit.client.0.smithi063.stdout:5/314: fdatasync d5/d12/f56 0 2024-09-16T01:25:13.912 INFO:tasks.workunit.client.0.smithi063.stdout:1/324: mkdir d1/d5/d6f 0 2024-09-16T01:25:13.912 INFO:tasks.workunit.client.0.smithi063.stdout:5/315: chown d5/d12/d35/f59 119 1 2024-09-16T01:25:13.913 INFO:tasks.workunit.client.0.smithi063.stdout:9/451: mkdir d7/d4a/d4d/d96/da2 0 2024-09-16T01:25:13.914 INFO:tasks.workunit.client.0.smithi063.stdout:5/316: chown d5/d12/f4c 57829 1 2024-09-16T01:25:13.918 INFO:tasks.workunit.client.0.smithi063.stdout:1/325: write d1/f3 [389019,87661] 0 2024-09-16T01:25:13.918 INFO:tasks.workunit.client.0.smithi063.stdout:0/326: creat d1/d30/d52/d5a/f87 x:0 0 0 2024-09-16T01:25:13.923 INFO:tasks.workunit.client.0.smithi063.stdout:5/317: write d5/d12/f56 [854377,43009] 0 2024-09-16T01:25:13.923 INFO:tasks.workunit.client.0.smithi063.stdout:0/327: stat d1/d2e/d50/c85 0 2024-09-16T01:25:13.924 INFO:tasks.workunit.client.0.smithi063.stdout:4/276: dwrite d5/f3f [0,4194304] 0 2024-09-16T01:25:13.924 INFO:tasks.workunit.client.0.smithi063.stdout:9/452: creat d7/d9/d12/d14/d38/fa3 x:0 0 0 2024-09-16T01:25:13.924 INFO:tasks.workunit.client.0.smithi063.stdout:8/200: dwrite d5/f8 [0,4194304] 0 2024-09-16T01:25:13.926 INFO:tasks.workunit.client.0.smithi063.stdout:1/326: unlink d1/d5/d15/f26 0 2024-09-16T01:25:13.926 INFO:tasks.workunit.client.0.smithi063.stdout:9/453: read d7/d9/d12/d14/f35 [674041,2770] 0 2024-09-16T01:25:13.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/318: write f3 [2178640,106699] 0 2024-09-16T01:25:13.930 INFO:tasks.workunit.client.0.smithi063.stdout:4/277: symlink d5/d3b/df/d1c/d29/d32/d4e/l56 0 2024-09-16T01:25:13.930 INFO:tasks.workunit.client.0.smithi063.stdout:8/201: truncate d5/db/d12/f15 122639 0 2024-09-16T01:25:13.931 INFO:tasks.workunit.client.0.smithi063.stdout:1/327: rmdir d1/d5/d15 39 2024-09-16T01:25:13.935 INFO:tasks.workunit.client.0.smithi063.stdout:0/328: write d1/d30/d52/d5a/f1f [3989850,122105] 0 2024-09-16T01:25:13.936 INFO:tasks.workunit.client.0.smithi063.stdout:9/454: rename d7/d9/d12/c60 to d7/d1f/ca4 0 2024-09-16T01:25:13.936 INFO:tasks.workunit.client.0.smithi063.stdout:7/243: dwrite d7/d1c/d1f/d29/f3d [0,4194304] 0 2024-09-16T01:25:13.939 INFO:tasks.workunit.client.0.smithi063.stdout:1/328: truncate d1/d5/d15/d1b/f52 490894 0 2024-09-16T01:25:13.941 INFO:tasks.workunit.client.0.smithi063.stdout:0/329: mknod d1/d30/d52/c88 0 2024-09-16T01:25:13.945 INFO:tasks.workunit.client.0.smithi063.stdout:4/278: dwrite d5/d3b/df/d1c/f36 [0,4194304] 0 2024-09-16T01:25:13.945 INFO:tasks.workunit.client.0.smithi063.stdout:9/455: mknod d7/d4a/d4d/d96/da2/ca5 0 2024-09-16T01:25:13.947 INFO:tasks.workunit.client.0.smithi063.stdout:5/319: truncate f3 1677093 0 2024-09-16T01:25:13.949 INFO:tasks.workunit.client.0.smithi063.stdout:1/329: creat d1/d5/f70 x:0 0 0 2024-09-16T01:25:13.966 INFO:tasks.workunit.client.0.smithi063.stdout:3/270: sync 2024-09-16T01:25:13.966 INFO:tasks.workunit.client.0.smithi063.stdout:6/256: sync 2024-09-16T01:25:13.966 INFO:tasks.workunit.client.0.smithi063.stdout:2/356: sync 2024-09-16T01:25:13.984 INFO:tasks.workunit.client.0.smithi063.stdout:4/279: unlink d5/d3b/df/d1c/d29/d20/d30/c40 0 2024-09-16T01:25:13.986 INFO:tasks.workunit.client.0.smithi063.stdout:6/257: fdatasync d3/d48/d28/f4f 0 2024-09-16T01:25:13.986 INFO:tasks.workunit.client.0.smithi063.stdout:2/357: chown d3/d7/c1b 51456 1 2024-09-16T01:25:13.987 INFO:tasks.workunit.client.0.smithi063.stdout:1/330: read d1/d12/d21/f46 [1361292,104217] 0 2024-09-16T01:25:13.988 INFO:tasks.workunit.client.0.smithi063.stdout:7/244: dwrite d7/f3e [0,4194304] 0 2024-09-16T01:25:13.988 INFO:tasks.workunit.client.0.smithi063.stdout:3/271: creat d2/d11/d18/d41/f5c x:0 0 0 2024-09-16T01:25:13.989 INFO:tasks.workunit.client.0.smithi063.stdout:5/320: truncate d5/d12/d35/f62 700459 0 2024-09-16T01:25:13.989 INFO:tasks.workunit.client.0.smithi063.stdout:8/202: dread d5/d9/f16 [0,4194304] 0 2024-09-16T01:25:13.990 INFO:tasks.workunit.client.0.smithi063.stdout:2/358: fsync d3/d7/d8/f70 0 2024-09-16T01:25:13.991 INFO:tasks.workunit.client.0.smithi063.stdout:7/245: fdatasync d7/d18/f1a 0 2024-09-16T01:25:13.991 INFO:tasks.workunit.client.0.smithi063.stdout:6/258: dread - d3/d10/d49/f5c zero size 2024-09-16T01:25:13.992 INFO:tasks.workunit.client.0.smithi063.stdout:8/203: fsync d5/f10 0 2024-09-16T01:25:13.993 INFO:tasks.workunit.client.0.smithi063.stdout:4/280: write d5/d3b/df/d1c/d49/f52 [991853,123424] 0 2024-09-16T01:25:13.994 INFO:tasks.workunit.client.0.smithi063.stdout:7/246: stat d7/d18/d25/c49 0 2024-09-16T01:25:13.995 INFO:tasks.workunit.client.0.smithi063.stdout:9/456: dwrite d7/d9/d12/f33 [4194304,4194304] 0 2024-09-16T01:25:13.995 INFO:tasks.workunit.client.0.smithi063.stdout:1/331: mknod d1/d5/d6f/c71 0 2024-09-16T01:25:13.996 INFO:tasks.workunit.client.0.smithi063.stdout:3/272: truncate d2/d11/d37/f59 159175 0 2024-09-16T01:25:13.998 INFO:tasks.workunit.client.0.smithi063.stdout:2/359: write d3/d7/de/d21/d28/d4e/f6d [216880,125035] 0 2024-09-16T01:25:13.999 INFO:tasks.workunit.client.0.smithi063.stdout:7/247: read d7/ff [348865,86171] 0 2024-09-16T01:25:14.000 INFO:tasks.workunit.client.0.smithi063.stdout:9/457: stat d7/d9/d12/d8e/f94 0 2024-09-16T01:25:14.000 INFO:tasks.workunit.client.0.smithi063.stdout:6/259: truncate d3/d10/f60 1331849 0 2024-09-16T01:25:14.001 INFO:tasks.workunit.client.0.smithi063.stdout:4/281: mkdir d5/d3b/d57 0 2024-09-16T01:25:14.001 INFO:tasks.workunit.client.0.smithi063.stdout:3/273: chown d2/d11/d39/f31 79485 1 2024-09-16T01:25:14.003 INFO:tasks.workunit.client.0.smithi063.stdout:7/248: fdatasync d7/d18/d25/f31 0 2024-09-16T01:25:14.008 INFO:tasks.workunit.client.0.smithi063.stdout:6/260: symlink d3/d48/d28/d3e/d44/d52/l63 0 2024-09-16T01:25:14.008 INFO:tasks.workunit.client.0.smithi063.stdout:5/321: dwrite d5/d18/f39 [0,4194304] 0 2024-09-16T01:25:14.008 INFO:tasks.workunit.client.0.smithi063.stdout:9/458: mknod d7/d9/d12/d14/ca6 0 2024-09-16T01:25:14.010 INFO:tasks.workunit.client.0.smithi063.stdout:3/274: creat d2/d11/d18/f5d x:0 0 0 2024-09-16T01:25:14.012 INFO:tasks.workunit.client.0.smithi063.stdout:1/332: getdents d1/d12 0 2024-09-16T01:25:14.014 INFO:tasks.workunit.client.0.smithi063.stdout:6/261: write d3/d48/f26 [27111,61012] 0 2024-09-16T01:25:14.015 INFO:tasks.workunit.client.0.smithi063.stdout:5/322: creat d5/f67 x:0 0 0 2024-09-16T01:25:14.015 INFO:tasks.workunit.client.0.smithi063.stdout:9/459: dread - d7/d4a/d4d/d50/d7f/f87 zero size 2024-09-16T01:25:14.016 INFO:tasks.workunit.client.0.smithi063.stdout:4/282: rename d5/d3b/df/d1c/d29/d32/c43 to d5/d3b/d57/c58 0 2024-09-16T01:25:14.017 INFO:tasks.workunit.client.0.smithi063.stdout:8/204: dwrite d5/db/d12/f15 [0,4194304] 0 2024-09-16T01:25:14.019 INFO:tasks.workunit.client.0.smithi063.stdout:2/360: dread d3/d7/d8/d1f/d37/f74 [4194304,4194304] 0 2024-09-16T01:25:14.021 INFO:tasks.workunit.client.0.smithi063.stdout:9/460: rmdir d7/d9/d20 39 2024-09-16T01:25:14.021 INFO:tasks.workunit.client.0.smithi063.stdout:6/262: truncate d3/d10/d49/f5c 619189 0 2024-09-16T01:25:14.022 INFO:tasks.workunit.client.0.smithi063.stdout:5/323: write d5/f9 [8558205,6974] 0 2024-09-16T01:25:14.022 INFO:tasks.workunit.client.0.smithi063.stdout:4/283: chown d5/d3b/f41 3434 1 2024-09-16T01:25:14.022 INFO:tasks.workunit.client.0.smithi063.stdout:8/205: mknod d5/db/c3c 0 2024-09-16T01:25:14.023 INFO:tasks.workunit.client.0.smithi063.stdout:2/361: chown d3/d7/d8/f1a 23990694 1 2024-09-16T01:25:14.024 INFO:tasks.workunit.client.0.smithi063.stdout:3/275: rename d2/d11/d39 to d2/d11/d37/d40/d5e 0 2024-09-16T01:25:14.025 INFO:tasks.workunit.client.0.smithi063.stdout:6/263: chown d3/d10/d49/f5c 38 1 2024-09-16T01:25:14.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/461: readlink d7/d9/d12/d14/d38/l5a 0 2024-09-16T01:25:14.026 INFO:tasks.workunit.client.0.smithi063.stdout:2/362: read d3/f60 [2285179,96820] 0 2024-09-16T01:25:14.027 INFO:tasks.workunit.client.0.smithi063.stdout:4/284: mkdir d5/d3b/df/d59 0 2024-09-16T01:25:14.029 INFO:tasks.workunit.client.0.smithi063.stdout:8/206: mkdir d5/db/d12/d3d 0 2024-09-16T01:25:14.029 INFO:tasks.workunit.client.0.smithi063.stdout:1/333: dwrite d1/d12/d16/f4d [0,4194304] 0 2024-09-16T01:25:14.030 INFO:tasks.workunit.client.0.smithi063.stdout:6/264: creat d3/d41/f64 x:0 0 0 2024-09-16T01:25:14.032 INFO:tasks.workunit.client.0.smithi063.stdout:9/462: rmdir d7/d9/d12/d14/d63 39 2024-09-16T01:25:14.034 INFO:tasks.workunit.client.0.smithi063.stdout:6/265: write d3/d10/d49/f5c [1147028,76570] 0 2024-09-16T01:25:14.034 INFO:tasks.workunit.client.0.smithi063.stdout:3/276: symlink d2/d11/d18/l5f 0 2024-09-16T01:25:14.034 INFO:tasks.workunit.client.0.smithi063.stdout:5/324: dread d5/d18/d29/f32 [0,4194304] 0 2024-09-16T01:25:14.036 INFO:tasks.workunit.client.0.smithi063.stdout:5/325: dread - d5/f51 zero size 2024-09-16T01:25:14.039 INFO:tasks.workunit.client.0.smithi063.stdout:1/334: write d1/d5/f13 [2923554,42563] 0 2024-09-16T01:25:14.040 INFO:tasks.workunit.client.0.smithi063.stdout:2/363: truncate d3/ff 8515938 0 2024-09-16T01:25:14.041 INFO:tasks.workunit.client.0.smithi063.stdout:8/207: rename d5/db/d12/d1a/c33 to d5/d3a/c3e 0 2024-09-16T01:25:14.042 INFO:tasks.workunit.client.0.smithi063.stdout:5/326: write d5/f15 [1424766,16679] 0 2024-09-16T01:25:14.043 INFO:tasks.workunit.client.0.smithi063.stdout:4/285: dread d5/f2e [0,4194304] 0 2024-09-16T01:25:14.044 INFO:tasks.workunit.client.0.smithi063.stdout:9/463: creat d7/d9/d12/d14/d63/d5f/fa7 x:0 0 0 2024-09-16T01:25:14.045 INFO:tasks.workunit.client.0.smithi063.stdout:4/286: chown d5/d3b/df/d1c/f39 0 1 2024-09-16T01:25:14.046 INFO:tasks.workunit.client.0.smithi063.stdout:3/277: mknod d2/d11/c60 0 2024-09-16T01:25:14.047 INFO:tasks.workunit.client.0.smithi063.stdout:3/278: dread - d2/d11/d18/d41/d30/f57 zero size 2024-09-16T01:25:14.048 INFO:tasks.workunit.client.0.smithi063.stdout:2/364: read d3/f60 [274108,126180] 0 2024-09-16T01:25:14.049 INFO:tasks.workunit.client.0.smithi063.stdout:8/208: write d5/db/d12/d1a/d1e/f36 [623050,106397] 0 2024-09-16T01:25:14.049 INFO:tasks.workunit.client.0.smithi063.stdout:6/266: creat d3/f65 x:0 0 0 2024-09-16T01:25:14.049 INFO:tasks.workunit.client.0.smithi063.stdout:2/365: fdatasync d3/f51 0 2024-09-16T01:25:14.050 INFO:tasks.workunit.client.0.smithi063.stdout:9/464: dread d7/d9/d12/d14/f91 [0,4194304] 0 2024-09-16T01:25:14.050 INFO:tasks.workunit.client.0.smithi063.stdout:5/327: creat d5/d18/d4b/f68 x:0 0 0 2024-09-16T01:25:14.050 INFO:tasks.workunit.client.0.smithi063.stdout:4/287: rmdir d5/d3b/df/d1c/d29/d32/d4e 39 2024-09-16T01:25:14.051 INFO:tasks.workunit.client.0.smithi063.stdout:2/366: readlink d3/d7/l1c 0 2024-09-16T01:25:14.052 INFO:tasks.workunit.client.0.smithi063.stdout:3/279: rename d2/d11/d18/l52 to d2/d11/d37/l61 0 2024-09-16T01:25:14.053 INFO:tasks.workunit.client.0.smithi063.stdout:9/465: read d7/d9/d12/d14/f91 [2830220,118092] 0 2024-09-16T01:25:14.053 INFO:tasks.workunit.client.0.smithi063.stdout:6/267: symlink d3/d10/d35/d56/l66 0 2024-09-16T01:25:14.055 INFO:tasks.workunit.client.0.smithi063.stdout:9/466: write d7/d1f/f2f [3066753,56804] 0 2024-09-16T01:25:14.056 INFO:tasks.workunit.client.0.smithi063.stdout:5/328: creat d5/d18/d29/d48/d66/f69 x:0 0 0 2024-09-16T01:25:14.057 INFO:tasks.workunit.client.0.smithi063.stdout:5/329: dread - d5/d12/f40 zero size 2024-09-16T01:25:14.057 INFO:tasks.workunit.client.0.smithi063.stdout:9/467: truncate d7/d9/d12/f24 984526 0 2024-09-16T01:25:14.057 INFO:tasks.workunit.client.0.smithi063.stdout:2/367: mknod d3/d7/d8/d1f/d37/d4f/c7b 0 2024-09-16T01:25:14.058 INFO:tasks.workunit.client.0.smithi063.stdout:2/368: stat d3/d7/de/c61 0 2024-09-16T01:25:14.059 INFO:tasks.workunit.client.0.smithi063.stdout:2/369: write d3/d7/d8/d19/d3c/d58/f5d [690469,95097] 0 2024-09-16T01:25:14.059 INFO:tasks.workunit.client.0.smithi063.stdout:8/209: rename d5/f29 to d5/d9/d2f/f3f 0 2024-09-16T01:25:14.060 INFO:tasks.workunit.client.0.smithi063.stdout:1/335: truncate d1/d5/d15/f29 3842593 0 2024-09-16T01:25:14.062 INFO:tasks.workunit.client.0.smithi063.stdout:3/280: unlink d2/d11/d37/d40/d5e/d3b/c3e 0 2024-09-16T01:25:14.063 INFO:tasks.workunit.client.0.smithi063.stdout:6/268: symlink d3/d48/l67 0 2024-09-16T01:25:14.064 INFO:tasks.workunit.client.0.smithi063.stdout:5/330: rename d5/d12/l5a to d5/d18/d29/d5b/l6a 0 2024-09-16T01:25:14.065 INFO:tasks.workunit.client.0.smithi063.stdout:8/210: mkdir d5/d3a/d40 0 2024-09-16T01:25:14.067 INFO:tasks.workunit.client.0.smithi063.stdout:6/269: mkdir d3/d48/d28/d3e/d68 0 2024-09-16T01:25:14.068 INFO:tasks.workunit.client.0.smithi063.stdout:1/336: rename d1/d12/d16/f4d to d1/d12/d56/f72 0 2024-09-16T01:25:14.070 INFO:tasks.workunit.client.0.smithi063.stdout:9/468: creat d7/fa8 x:0 0 0 2024-09-16T01:25:14.071 INFO:tasks.workunit.client.0.smithi063.stdout:5/331: symlink d5/d18/l6b 0 2024-09-16T01:25:14.071 INFO:tasks.workunit.client.0.smithi063.stdout:4/288: link d5/d3b/df/d1c/d29/d32/f4d d5/d3b/df/d1c/d29/f5a 0 2024-09-16T01:25:14.074 INFO:tasks.workunit.client.0.smithi063.stdout:3/281: rename d2/d11/f26 to d2/d11/d18/d41/f62 0 2024-09-16T01:25:14.074 INFO:tasks.workunit.client.0.smithi063.stdout:2/370: dwrite d3/d7/d8/d1f/f3e [0,4194304] 0 2024-09-16T01:25:14.074 INFO:tasks.workunit.client.0.smithi063.stdout:8/211: dwrite d5/db/d12/f15 [0,4194304] 0 2024-09-16T01:25:14.075 INFO:tasks.workunit.client.0.smithi063.stdout:1/337: write d1/dd/d3b/f58 [5163687,59508] 0 2024-09-16T01:25:14.075 INFO:tasks.workunit.client.0.smithi063.stdout:3/282: dread - d2/d11/d18/f2d zero size 2024-09-16T01:25:14.094 INFO:tasks.workunit.client.0.smithi063.stdout:0/330: sync 2024-09-16T01:25:14.111 INFO:tasks.workunit.client.0.smithi063.stdout:8/212: stat d5/db/d12/d1a/f2c 0 2024-09-16T01:25:14.113 INFO:tasks.workunit.client.0.smithi063.stdout:2/371: fsync d3/d7/f16 0 2024-09-16T01:25:14.114 INFO:tasks.workunit.client.0.smithi063.stdout:5/332: mknod d5/c6c 0 2024-09-16T01:25:14.114 INFO:tasks.workunit.client.0.smithi063.stdout:4/289: write d5/d3b/df/d1c/d29/d20/f23 [1319546,7680] 0 2024-09-16T01:25:14.115 INFO:tasks.workunit.client.0.smithi063.stdout:3/283: mkdir d2/d11/d37/d63 0 2024-09-16T01:25:14.116 INFO:tasks.workunit.client.0.smithi063.stdout:8/213: mkdir d5/d9/d41 0 2024-09-16T01:25:14.119 INFO:tasks.workunit.client.0.smithi063.stdout:1/338: creat d1/d5/d15/d18/d4c/f73 x:0 0 0 2024-09-16T01:25:14.119 INFO:tasks.workunit.client.0.smithi063.stdout:4/290: truncate d5/d3b/df/d1c/d29/d20/f44 923807 0 2024-09-16T01:25:14.120 INFO:tasks.workunit.client.0.smithi063.stdout:6/270: getdents d3/d10/d35/d56 0 2024-09-16T01:25:14.120 INFO:tasks.workunit.client.0.smithi063.stdout:6/271: chown d3/d10 2665 1 2024-09-16T01:25:14.120 INFO:tasks.workunit.client.0.smithi063.stdout:5/333: rename d5/d12/d35/c3e to d5/d18/d29/d5b/c6d 0 2024-09-16T01:25:14.121 INFO:tasks.workunit.client.0.smithi063.stdout:1/339: fdatasync d1/d5/d15/d1b/f52 0 2024-09-16T01:25:14.125 INFO:tasks.workunit.client.0.smithi063.stdout:3/284: symlink d2/d11/d18/l64 0 2024-09-16T01:25:14.126 INFO:tasks.workunit.client.0.smithi063.stdout:6/272: mkdir d3/d30/d39/d69 0 2024-09-16T01:25:14.126 INFO:tasks.workunit.client.0.smithi063.stdout:8/214: symlink d5/l42 0 2024-09-16T01:25:14.127 INFO:tasks.workunit.client.0.smithi063.stdout:2/372: dread f0 [0,4194304] 0 2024-09-16T01:25:14.127 INFO:tasks.workunit.client.0.smithi063.stdout:1/340: creat d1/dd/f74 x:0 0 0 2024-09-16T01:25:14.130 INFO:tasks.workunit.client.0.smithi063.stdout:4/291: creat d5/d3b/df/d1c/d29/d32/f5b x:0 0 0 2024-09-16T01:25:14.131 INFO:tasks.workunit.client.0.smithi063.stdout:2/373: symlink d3/d7/d8/d1f/d34/d56/l7c 0 2024-09-16T01:25:14.134 INFO:tasks.workunit.client.0.smithi063.stdout:4/292: mkdir d5/d3b/d5c 0 2024-09-16T01:25:14.134 INFO:tasks.workunit.client.0.smithi063.stdout:1/341: dwrite d1/d12/f41 [4194304,4194304] 0 2024-09-16T01:25:14.135 INFO:tasks.workunit.client.0.smithi063.stdout:2/374: mknod d3/d7/d8/d19/d3c/c7d 0 2024-09-16T01:25:14.137 INFO:tasks.workunit.client.0.smithi063.stdout:1/342: rename d1/d5/d15/d18/d4b/c5d to d1/dd/c75 0 2024-09-16T01:25:14.137 INFO:tasks.workunit.client.0.smithi063.stdout:0/331: truncate d1/d30/d52/d5a/d36/f5b 3633948 0 2024-09-16T01:25:14.138 INFO:tasks.workunit.client.0.smithi063.stdout:4/293: symlink d5/l5d 0 2024-09-16T01:25:14.140 INFO:tasks.workunit.client.0.smithi063.stdout:2/375: creat d3/d7/d8/d19/f7e x:0 0 0 2024-09-16T01:25:14.141 INFO:tasks.workunit.client.0.smithi063.stdout:0/332: mkdir d1/df/d2c/d43/d89 0 2024-09-16T01:25:14.144 INFO:tasks.workunit.client.0.smithi063.stdout:2/376: write f0 [3950984,127004] 0 2024-09-16T01:25:14.144 INFO:tasks.workunit.client.0.smithi063.stdout:4/294: rmdir d5/d3b/df/d59 0 2024-09-16T01:25:14.146 INFO:tasks.workunit.client.0.smithi063.stdout:5/334: dwrite d5/d18/d29/f2f [0,4194304] 0 2024-09-16T01:25:14.146 INFO:tasks.workunit.client.0.smithi063.stdout:0/333: truncate d1/df/d17/f6d 670146 0 2024-09-16T01:25:14.151 INFO:tasks.workunit.client.0.smithi063.stdout:4/295: write d5/d3b/df/d1c/d29/d32/f3c [1015416,99835] 0 2024-09-16T01:25:14.152 INFO:tasks.workunit.client.0.smithi063.stdout:1/343: dwrite d1/d12/d21/f46 [0,4194304] 0 2024-09-16T01:25:14.156 INFO:tasks.workunit.client.0.smithi063.stdout:2/377: fsync d3/d7/d8/d1f/d37/f7a 0 2024-09-16T01:25:14.157 INFO:tasks.workunit.client.0.smithi063.stdout:5/335: creat d5/d18/f6e x:0 0 0 2024-09-16T01:25:14.164 INFO:tasks.workunit.client.0.smithi063.stdout:0/334: dwrite d1/df/d17/f6d [0,4194304] 0 2024-09-16T01:25:14.164 INFO:tasks.workunit.client.0.smithi063.stdout:2/378: fdatasync d3/d7/d8/f10 0 2024-09-16T01:25:14.165 INFO:tasks.workunit.client.0.smithi063.stdout:4/296: creat d5/d3b/df/d1c/d29/d32/f5e x:0 0 0 2024-09-16T01:25:14.170 INFO:tasks.workunit.client.0.smithi063.stdout:0/335: creat d1/df/d17/f8a x:0 0 0 2024-09-16T01:25:14.199 INFO:tasks.workunit.client.0.smithi063.stdout:7/249: sync 2024-09-16T01:25:14.213 INFO:tasks.workunit.client.0.smithi063.stdout:1/344: dwrite d1/d5/d15/d18/f6a [0,4194304] 0 2024-09-16T01:25:14.215 INFO:tasks.workunit.client.0.smithi063.stdout:5/336: dwrite d5/d18/f2a [0,4194304] 0 2024-09-16T01:25:14.215 INFO:tasks.workunit.client.0.smithi063.stdout:7/250: chown d7/d1c/d1f/d29/f3d 1366795 1 2024-09-16T01:25:14.217 INFO:tasks.workunit.client.0.smithi063.stdout:2/379: rename d3/d7/de/d55 to d3/d7/d8/d19/d3c/d53/d7f 0 2024-09-16T01:25:14.220 INFO:tasks.workunit.client.0.smithi063.stdout:4/297: symlink d5/d3b/df/d1c/d29/d32/d4e/l5f 0 2024-09-16T01:25:14.220 INFO:tasks.workunit.client.0.smithi063.stdout:7/251: chown d7/d18/d25/c2d 77193 1 2024-09-16T01:25:14.225 INFO:tasks.workunit.client.0.smithi063.stdout:0/336: dwrite d1/df/f40 [0,4194304] 0 2024-09-16T01:25:14.225 INFO:tasks.workunit.client.0.smithi063.stdout:2/380: rmdir d3/d7/d8/d19/d3c/d58 39 2024-09-16T01:25:14.227 INFO:tasks.workunit.client.0.smithi063.stdout:1/345: dread d1/d12/d56/f72 [0,4194304] 0 2024-09-16T01:25:14.229 INFO:tasks.workunit.client.0.smithi063.stdout:5/337: dread d5/d18/f39 [0,4194304] 0 2024-09-16T01:25:14.230 INFO:tasks.workunit.client.0.smithi063.stdout:2/381: mkdir d3/d7/d8/d19/d3c/d53/d7f/d80 0 2024-09-16T01:25:14.230 INFO:tasks.workunit.client.0.smithi063.stdout:1/346: chown d1/d5/f70 187090683 1 2024-09-16T01:25:14.232 INFO:tasks.workunit.client.0.smithi063.stdout:4/298: write d5/d3b/df/d1c/d29/f5a [523673,33648] 0 2024-09-16T01:25:14.233 INFO:tasks.workunit.client.0.smithi063.stdout:0/337: truncate d1/d2e/d50/d6f/f7b 254317 0 2024-09-16T01:25:14.237 INFO:tasks.workunit.client.0.smithi063.stdout:4/299: mkdir d5/d3b/df/d1c/d29/d32/d60 0 2024-09-16T01:25:14.237 INFO:tasks.workunit.client.0.smithi063.stdout:0/338: dread d1/d30/d52/d5a/d44/f7c [0,4194304] 0 2024-09-16T01:25:14.239 INFO:tasks.workunit.client.0.smithi063.stdout:4/300: rmdir d5 39 2024-09-16T01:25:14.243 INFO:tasks.workunit.client.0.smithi063.stdout:4/301: write d5/f2e [3846312,60202] 0 2024-09-16T01:25:14.244 INFO:tasks.workunit.client.0.smithi063.stdout:5/338: dwrite f3 [0,4194304] 0 2024-09-16T01:25:14.246 INFO:tasks.workunit.client.0.smithi063.stdout:2/382: dread d3/d7/f16 [0,4194304] 0 2024-09-16T01:25:14.246 INFO:tasks.workunit.client.0.smithi063.stdout:4/302: chown d5/l33 60741 1 2024-09-16T01:25:14.248 INFO:tasks.workunit.client.0.smithi063.stdout:4/303: chown d5/d3b/f19 43463584 1 2024-09-16T01:25:14.250 INFO:tasks.workunit.client.0.smithi063.stdout:5/339: write d5/d18/d29/d52/f5c [1345657,20415] 0 2024-09-16T01:25:14.251 INFO:tasks.workunit.client.0.smithi063.stdout:0/339: dwrite d1/d30/d52/d5a/f1f [0,4194304] 0 2024-09-16T01:25:14.252 INFO:tasks.workunit.client.0.smithi063.stdout:1/347: dread d1/d5/f7 [0,4194304] 0 2024-09-16T01:25:14.256 INFO:tasks.workunit.client.0.smithi063.stdout:4/304: rmdir d5/d3b/df/d1c/d29/d20 39 2024-09-16T01:25:14.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/340: creat d5/d18/f6f x:0 0 0 2024-09-16T01:25:14.260 INFO:tasks.workunit.client.0.smithi063.stdout:0/340: creat d1/df/d2c/d43/d89/f8b x:0 0 0 2024-09-16T01:25:14.260 INFO:tasks.workunit.client.0.smithi063.stdout:2/383: dwrite d3/d7/d8/d1f/f6c [0,4194304] 0 2024-09-16T01:25:14.262 INFO:tasks.workunit.client.0.smithi063.stdout:0/341: dread - d1/d1c/f2d zero size 2024-09-16T01:25:14.263 INFO:tasks.workunit.client.0.smithi063.stdout:4/305: rename d5/d3b/df/d1c/d49 to d5/d3b/df/d1c/d29/d32/d60/d61 0 2024-09-16T01:25:14.264 INFO:tasks.workunit.client.0.smithi063.stdout:1/348: link d1/d5/f1a d1/d5/f76 0 2024-09-16T01:25:14.265 INFO:tasks.workunit.client.0.smithi063.stdout:4/306: write d5/d3b/df/d1c/d29/d32/d60/d61/f52 [1384913,64916] 0 2024-09-16T01:25:14.265 INFO:tasks.workunit.client.0.smithi063.stdout:2/384: symlink d3/d7/de/d21/d28/l81 0 2024-09-16T01:25:14.266 INFO:tasks.workunit.client.0.smithi063.stdout:0/342: symlink d1/d1c/l8c 0 2024-09-16T01:25:14.268 INFO:tasks.workunit.client.0.smithi063.stdout:1/349: rmdir d1/d5/d6f 39 2024-09-16T01:25:14.269 INFO:tasks.workunit.client.0.smithi063.stdout:0/343: write d1/d2e/d73/f74 [531856,42935] 0 2024-09-16T01:25:14.270 INFO:tasks.workunit.client.0.smithi063.stdout:2/385: rename d3/d7/de/c43 to d3/d7/d8/d1f/d34/d72/c82 0 2024-09-16T01:25:14.271 INFO:tasks.workunit.client.0.smithi063.stdout:5/341: link d5/lf d5/d18/d29/d5b/l70 0 2024-09-16T01:25:14.272 INFO:tasks.workunit.client.0.smithi063.stdout:0/344: fdatasync d1/d1c/f80 0 2024-09-16T01:25:14.272 INFO:tasks.workunit.client.0.smithi063.stdout:1/350: mkdir d1/d5/d15/d1b/d31/d77 0 2024-09-16T01:25:14.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/307: dwrite d5/d3b/df/d1c/d29/f4a [4194304,4194304] 0 2024-09-16T01:25:14.276 INFO:tasks.workunit.client.0.smithi063.stdout:5/342: creat d5/d18/d29/d48/f71 x:0 0 0 2024-09-16T01:25:14.277 INFO:tasks.workunit.client.0.smithi063.stdout:5/343: stat d5/d18/l6b 0 2024-09-16T01:25:14.277 INFO:tasks.workunit.client.0.smithi063.stdout:2/386: creat d3/d7/d8/d19/d3c/d53/f83 x:0 0 0 2024-09-16T01:25:14.278 INFO:tasks.workunit.client.0.smithi063.stdout:1/351: truncate d1/d5/d15/d18/f69 283473 0 2024-09-16T01:25:14.281 INFO:tasks.workunit.client.0.smithi063.stdout:0/345: mknod d1/d30/d52/d5a/d36/c8d 0 2024-09-16T01:25:14.281 INFO:tasks.workunit.client.0.smithi063.stdout:2/387: rmdir d3/d7/d8/d1f/d34/d45 39 2024-09-16T01:25:14.283 INFO:tasks.workunit.client.0.smithi063.stdout:5/344: read d5/d12/d35/f59 [2556767,90677] 0 2024-09-16T01:25:14.284 INFO:tasks.workunit.client.0.smithi063.stdout:1/352: creat d1/d5/d15/d1b/d31/f78 x:0 0 0 2024-09-16T01:25:14.285 INFO:tasks.workunit.client.0.smithi063.stdout:0/346: mknod d1/d2e/c8e 0 2024-09-16T01:25:14.288 INFO:tasks.workunit.client.0.smithi063.stdout:4/308: rename d5/d3b/df/d1c/d29/l47 to d5/l62 0 2024-09-16T01:25:14.290 INFO:tasks.workunit.client.0.smithi063.stdout:5/345: mkdir d5/d18/d29/d5b/d72 0 2024-09-16T01:25:14.291 INFO:tasks.workunit.client.0.smithi063.stdout:0/347: mknod d1/df/d2c/d43/d89/c8f 0 2024-09-16T01:25:14.292 INFO:tasks.workunit.client.0.smithi063.stdout:2/388: mknod d3/d7/d8/d19/d3c/c84 0 2024-09-16T01:25:14.294 INFO:tasks.workunit.client.0.smithi063.stdout:1/353: rename d1/d12/d56/f72 to d1/d5/d15/d1b/d31/f79 0 2024-09-16T01:25:14.295 INFO:tasks.workunit.client.0.smithi063.stdout:2/389: stat d3/d7/c5b 0 2024-09-16T01:25:14.296 INFO:tasks.workunit.client.0.smithi063.stdout:4/309: dwrite d5/f42 [0,4194304] 0 2024-09-16T01:25:14.296 INFO:tasks.workunit.client.0.smithi063.stdout:5/346: symlink d5/d18/l73 0 2024-09-16T01:25:14.300 INFO:tasks.workunit.client.0.smithi063.stdout:4/310: mknod d5/d3b/df/d1c/c63 0 2024-09-16T01:25:14.301 INFO:tasks.workunit.client.0.smithi063.stdout:0/348: dwrite d1/df/f54 [8388608,4194304] 0 2024-09-16T01:25:14.304 INFO:tasks.workunit.client.0.smithi063.stdout:2/390: getdents d3/d7/d8 0 2024-09-16T01:25:14.308 INFO:tasks.workunit.client.0.smithi063.stdout:5/347: dwrite d5/d12/f4c [0,4194304] 0 2024-09-16T01:25:14.314 INFO:tasks.workunit.client.0.smithi063.stdout:3/285: sync 2024-09-16T01:25:14.314 INFO:tasks.workunit.client.0.smithi063.stdout:9/469: sync 2024-09-16T01:25:14.319 INFO:tasks.workunit.client.0.smithi063.stdout:0/349: dread d1/df/d17/f6d [0,4194304] 0 2024-09-16T01:25:14.320 INFO:tasks.workunit.client.0.smithi063.stdout:5/348: link d5/d12/d35/c58 d5/c74 0 2024-09-16T01:25:14.321 INFO:tasks.workunit.client.0.smithi063.stdout:3/286: chown d2/d11/d18/c21 4609 1 2024-09-16T01:25:14.321 INFO:tasks.workunit.client.0.smithi063.stdout:1/354: dwrite d1/d12/d16/f37 [0,4194304] 0 2024-09-16T01:25:14.321 INFO:tasks.workunit.client.0.smithi063.stdout:4/311: dwrite d5/d3b/df/d1c/d29/d32/f5b [0,4194304] 0 2024-09-16T01:25:14.323 INFO:tasks.workunit.client.0.smithi063.stdout:1/355: chown d1/dd/c48 210 1 2024-09-16T01:25:14.327 INFO:tasks.workunit.client.0.smithi063.stdout:9/470: rename d7/d4a/d4d/d50/d7f/f87 to d7/fa9 0 2024-09-16T01:25:14.327 INFO:tasks.workunit.client.0.smithi063.stdout:1/356: read d1/d5/d15/f19 [1292031,2731] 0 2024-09-16T01:25:14.329 INFO:tasks.workunit.client.0.smithi063.stdout:3/287: unlink d2/d11/d18/le 0 2024-09-16T01:25:14.329 INFO:tasks.workunit.client.0.smithi063.stdout:0/350: write d1/d1c/f4b [276709,124000] 0 2024-09-16T01:25:14.331 INFO:tasks.workunit.client.0.smithi063.stdout:5/349: rename d5/d18/f37 to d5/d18/d29/d52/f75 0 2024-09-16T01:25:14.333 INFO:tasks.workunit.client.0.smithi063.stdout:4/312: creat d5/d3b/df/d1c/d29/d32/f64 x:0 0 0 2024-09-16T01:25:14.335 INFO:tasks.workunit.client.0.smithi063.stdout:3/288: creat d2/d11/d37/d40/d5e/f65 x:0 0 0 2024-09-16T01:25:14.336 INFO:tasks.workunit.client.0.smithi063.stdout:3/289: fdatasync d2/d11/f1d 0 2024-09-16T01:25:14.336 INFO:tasks.workunit.client.0.smithi063.stdout:1/357: symlink d1/l7a 0 2024-09-16T01:25:14.337 INFO:tasks.workunit.client.0.smithi063.stdout:5/350: fdatasync d5/f10 0 2024-09-16T01:25:14.394 INFO:tasks.workunit.client.0.smithi063.stdout:9/471: dwrite d7/d4a/d4d/d50/f45 [0,4194304] 0 2024-09-16T01:25:14.394 INFO:tasks.workunit.client.0.smithi063.stdout:1/358: stat d1/d5/d15/d18/f69 0 2024-09-16T01:25:14.395 INFO:tasks.workunit.client.0.smithi063.stdout:4/313: unlink d5/d3b/df/d1c/d29/c22 0 2024-09-16T01:25:14.396 INFO:tasks.workunit.client.0.smithi063.stdout:2/391: dread d3/d7/d8/d19/f24 [0,4194304] 0 2024-09-16T01:25:14.397 INFO:tasks.workunit.client.0.smithi063.stdout:5/351: creat d5/d12/f76 x:0 0 0 2024-09-16T01:25:14.398 INFO:tasks.workunit.client.0.smithi063.stdout:3/290: write d2/d11/d18/f42 [2168959,124526] 0 2024-09-16T01:25:14.400 INFO:tasks.workunit.client.0.smithi063.stdout:3/291: chown d2/d11/f1d 4 1 2024-09-16T01:25:14.400 INFO:tasks.workunit.client.0.smithi063.stdout:2/392: mknod d3/d7/d8/d1f/d37/d4f/c85 0 2024-09-16T01:25:14.400 INFO:tasks.workunit.client.0.smithi063.stdout:1/359: rmdir d1/d5/d15/d1b/d31 39 2024-09-16T01:25:14.403 INFO:tasks.workunit.client.0.smithi063.stdout:1/360: write d1/dd/d3b/f58 [136403,70638] 0 2024-09-16T01:25:14.403 INFO:tasks.workunit.client.0.smithi063.stdout:2/393: read d3/f6 [3187064,36454] 0 2024-09-16T01:25:14.404 INFO:tasks.workunit.client.0.smithi063.stdout:9/472: getdents d7/d9/d12/d14/d63 0 2024-09-16T01:25:14.408 INFO:tasks.workunit.client.0.smithi063.stdout:5/352: rename d5/d18/d29/l47 to d5/d18/d29/d48/l77 0 2024-09-16T01:25:14.412 INFO:tasks.workunit.client.0.smithi063.stdout:2/394: symlink d3/d7/d8/d1f/l86 0 2024-09-16T01:25:14.413 INFO:tasks.workunit.client.0.smithi063.stdout:4/314: getdents d5/d3b/df/d1c/d29/d32/d60 0 2024-09-16T01:25:14.414 INFO:tasks.workunit.client.0.smithi063.stdout:4/315: dread - d5/d3b/f41 zero size 2024-09-16T01:25:14.415 INFO:tasks.workunit.client.0.smithi063.stdout:3/292: link d2/d11/d18/l64 d2/d11/d37/d40/d5e/d3b/l66 0 2024-09-16T01:25:14.417 INFO:tasks.workunit.client.0.smithi063.stdout:1/361: dwrite d1/d5/f10 [0,4194304] 0 2024-09-16T01:25:14.417 INFO:tasks.workunit.client.0.smithi063.stdout:5/353: creat d5/d18/f78 x:0 0 0 2024-09-16T01:25:14.418 INFO:tasks.workunit.client.0.smithi063.stdout:5/354: read - d5/f51 zero size 2024-09-16T01:25:14.420 INFO:tasks.workunit.client.0.smithi063.stdout:2/395: dread d3/d7/f3f [0,4194304] 0 2024-09-16T01:25:14.420 INFO:tasks.workunit.client.0.smithi063.stdout:9/473: truncate d7/d9/d12/d8e/f94 3233014 0 2024-09-16T01:25:14.421 INFO:tasks.workunit.client.0.smithi063.stdout:1/362: mknod d1/d5/d6f/c7b 0 2024-09-16T01:25:14.422 INFO:tasks.workunit.client.0.smithi063.stdout:5/355: write d5/d18/d29/d48/f54 [883188,54143] 0 2024-09-16T01:25:14.425 INFO:tasks.workunit.client.0.smithi063.stdout:5/356: fsync d5/f38 0 2024-09-16T01:25:14.425 INFO:tasks.workunit.client.0.smithi063.stdout:2/396: write d3/f4b [948321,23777] 0 2024-09-16T01:25:14.426 INFO:tasks.workunit.client.0.smithi063.stdout:3/293: dwrite d2/d11/d37/f59 [0,4194304] 0 2024-09-16T01:25:14.426 INFO:tasks.workunit.client.0.smithi063.stdout:9/474: write d7/d4a/d4d/d50/f45 [1192631,70393] 0 2024-09-16T01:25:14.430 INFO:tasks.workunit.client.0.smithi063.stdout:5/357: creat d5/d18/d29/f79 x:0 0 0 2024-09-16T01:25:14.432 INFO:tasks.workunit.client.0.smithi063.stdout:9/475: chown d7/d1f/ca4 761650809 1 2024-09-16T01:25:14.433 INFO:tasks.workunit.client.0.smithi063.stdout:2/397: unlink d3/d7/d8/d19/f7e 0 2024-09-16T01:25:14.435 INFO:tasks.workunit.client.0.smithi063.stdout:3/294: creat d2/d11/d37/d40/d5e/f67 x:0 0 0 2024-09-16T01:25:14.438 INFO:tasks.workunit.client.0.smithi063.stdout:1/363: rename d1/d12/d16 to d1/d5/d15/d18/d7c 0 2024-09-16T01:25:14.439 INFO:tasks.workunit.client.0.smithi063.stdout:2/398: creat d3/d7/d8/d19/d3c/d53/d7f/d80/f87 x:0 0 0 2024-09-16T01:25:14.440 INFO:tasks.workunit.client.0.smithi063.stdout:3/295: mkdir d2/d11/d37/d40/d5e/d3b/d68 0 2024-09-16T01:25:14.441 INFO:tasks.workunit.client.0.smithi063.stdout:1/364: stat d1/d5/l4f 0 2024-09-16T01:25:14.444 INFO:tasks.workunit.client.0.smithi063.stdout:3/296: mkdir d2/d11/d69 0 2024-09-16T01:25:14.445 INFO:tasks.workunit.client.0.smithi063.stdout:2/399: mknod d3/d7/d8/d19/d3c/c88 0 2024-09-16T01:25:14.446 INFO:tasks.workunit.client.0.smithi063.stdout:9/476: dwrite d7/d4a/d4d/d50/f48 [4194304,4194304] 0 2024-09-16T01:25:14.447 INFO:tasks.workunit.client.0.smithi063.stdout:5/358: dwrite d5/d18/d29/f32 [0,4194304] 0 2024-09-16T01:25:14.449 INFO:tasks.workunit.client.0.smithi063.stdout:3/297: write d2/d11/d18/d41/d30/f3c [832552,12697] 0 2024-09-16T01:25:14.450 INFO:tasks.workunit.client.0.smithi063.stdout:5/359: chown d5/d18/f39 2364068 1 2024-09-16T01:25:14.452 INFO:tasks.workunit.client.0.smithi063.stdout:2/400: creat d3/d77/f89 x:0 0 0 2024-09-16T01:25:14.453 INFO:tasks.workunit.client.0.smithi063.stdout:3/298: write d2/d11/d18/f3f [1878465,82631] 0 2024-09-16T01:25:14.454 INFO:tasks.workunit.client.0.smithi063.stdout:5/360: chown d5/d12/d35/f60 172 1 2024-09-16T01:25:14.456 INFO:tasks.workunit.client.0.smithi063.stdout:1/365: dwrite d1/d5/d15/d18/f69 [0,4194304] 0 2024-09-16T01:25:14.461 INFO:tasks.workunit.client.0.smithi063.stdout:5/361: symlink d5/d12/d5d/l7a 0 2024-09-16T01:25:14.462 INFO:tasks.workunit.client.0.smithi063.stdout:3/299: rename d2/f1f to d2/d11/d37/d40/f6a 0 2024-09-16T01:25:14.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/477: truncate d7/d9/d12/d14/f46 3674217 0 2024-09-16T01:25:14.466 INFO:tasks.workunit.client.0.smithi063.stdout:5/362: unlink d5/f9 0 2024-09-16T01:25:14.466 INFO:tasks.workunit.client.0.smithi063.stdout:2/401: dwrite d3/d7/de/d21/d28/d4e/f6d [0,4194304] 0 2024-09-16T01:25:14.467 INFO:tasks.workunit.client.0.smithi063.stdout:6/273: sync 2024-09-16T01:25:14.468 INFO:tasks.workunit.client.0.smithi063.stdout:9/478: creat d7/d9/d12/d8e/faa x:0 0 0 2024-09-16T01:25:14.470 INFO:tasks.workunit.client.0.smithi063.stdout:1/366: mkdir d1/d5/d15/d1b/d31/d77/d7d 0 2024-09-16T01:25:14.472 INFO:tasks.workunit.client.0.smithi063.stdout:2/402: fdatasync d3/d7/d8/d19/f44 0 2024-09-16T01:25:14.474 INFO:tasks.workunit.client.0.smithi063.stdout:3/300: rmdir d2/d11/d37/d63 0 2024-09-16T01:25:14.476 INFO:tasks.workunit.client.0.smithi063.stdout:6/274: dwrite d3/d10/d35/f3a [4194304,4194304] 0 2024-09-16T01:25:14.476 INFO:tasks.workunit.client.0.smithi063.stdout:5/363: rename d5/d12/d5d to d5/d18/d29/d48/d7b 0 2024-09-16T01:25:14.478 INFO:tasks.workunit.client.0.smithi063.stdout:9/479: mkdir d7/d9/d12/d14/d63/d5f/dab 0 2024-09-16T01:25:14.483 INFO:tasks.workunit.client.0.smithi063.stdout:2/403: mkdir d3/d7/de/d21/d28/d8a 0 2024-09-16T01:25:14.483 INFO:tasks.workunit.client.0.smithi063.stdout:5/364: dwrite d5/d12/f49 [0,4194304] 0 2024-09-16T01:25:14.484 INFO:tasks.workunit.client.0.smithi063.stdout:5/365: fsync d5/f38 0 2024-09-16T01:25:14.488 INFO:tasks.workunit.client.0.smithi063.stdout:6/275: creat d3/d48/d28/d3e/d44/f6a x:0 0 0 2024-09-16T01:25:14.489 INFO:tasks.workunit.client.0.smithi063.stdout:1/367: rename d1/l33 to d1/d5/d63/d66/l7e 0 2024-09-16T01:25:14.490 INFO:tasks.workunit.client.0.smithi063.stdout:9/480: symlink d7/d4a/d4d/d50/d7f/lac 0 2024-09-16T01:25:14.492 INFO:tasks.workunit.client.0.smithi063.stdout:2/404: chown d3/d7/d8/d19/d3c/d58/c6a 118632820 1 2024-09-16T01:25:14.492 INFO:tasks.workunit.client.0.smithi063.stdout:3/301: mkdir d2/d11/d37/d40/d5e/d3b/d68/d6b 0 2024-09-16T01:25:14.494 INFO:tasks.workunit.client.0.smithi063.stdout:3/302: dread - d2/d11/d18/f2d zero size 2024-09-16T01:25:14.494 INFO:tasks.workunit.client.0.smithi063.stdout:5/366: mknod d5/d12/d35/c7c 0 2024-09-16T01:25:14.495 INFO:tasks.workunit.client.0.smithi063.stdout:6/276: dwrite d3/d10/d35/f50 [0,4194304] 0 2024-09-16T01:25:14.496 INFO:tasks.workunit.client.0.smithi063.stdout:3/303: chown d2/d11/d37/d40/d5e/f55 1953 1 2024-09-16T01:25:14.497 INFO:tasks.workunit.client.0.smithi063.stdout:1/368: creat d1/d5/d15/d18/d4c/f7f x:0 0 0 2024-09-16T01:25:14.499 INFO:tasks.workunit.client.0.smithi063.stdout:9/481: write d7/fa9 [975606,66101] 0 2024-09-16T01:25:14.499 INFO:tasks.workunit.client.0.smithi063.stdout:2/405: dread d3/d7/d8/d19/f24 [0,4194304] 0 2024-09-16T01:25:14.500 INFO:tasks.workunit.client.0.smithi063.stdout:6/277: write d3/d48/d28/f2e [708128,86120] 0 2024-09-16T01:25:14.503 INFO:tasks.workunit.client.0.smithi063.stdout:6/278: dread - d3/f57 zero size 2024-09-16T01:25:14.504 INFO:tasks.workunit.client.0.smithi063.stdout:1/369: truncate d1/d5/d15/f19 3264399 0 2024-09-16T01:25:14.506 INFO:tasks.workunit.client.0.smithi063.stdout:9/482: creat d7/d4a/d4d/d50/fad x:0 0 0 2024-09-16T01:25:14.506 INFO:tasks.workunit.client.0.smithi063.stdout:6/279: write d3/d10/f34 [990164,70576] 0 2024-09-16T01:25:14.508 INFO:tasks.workunit.client.0.smithi063.stdout:3/304: dwrite d2/d11/d18/f5d [0,4194304] 0 2024-09-16T01:25:14.509 INFO:tasks.workunit.client.0.smithi063.stdout:1/370: write d1/d5/d15/d1b/f39 [899349,75932] 0 2024-09-16T01:25:14.509 INFO:tasks.workunit.client.0.smithi063.stdout:2/406: dread d3/d7/d8/d1f/d34/d39/f47 [0,4194304] 0 2024-09-16T01:25:14.511 INFO:tasks.workunit.client.0.smithi063.stdout:9/483: fdatasync d7/d9/d12/f52 0 2024-09-16T01:25:14.513 INFO:tasks.workunit.client.0.smithi063.stdout:1/371: dread - d1/d5/d15/d1b/d31/f78 zero size 2024-09-16T01:25:14.515 INFO:tasks.workunit.client.0.smithi063.stdout:5/367: rename d5/d18/l6b to d5/d18/d29/d48/d66/l7d 0 2024-09-16T01:25:14.516 INFO:tasks.workunit.client.0.smithi063.stdout:6/280: mkdir d3/d10/d35/d5a/d6b 0 2024-09-16T01:25:14.517 INFO:tasks.workunit.client.0.smithi063.stdout:1/372: dread d1/f3e [0,4194304] 0 2024-09-16T01:25:14.517 INFO:tasks.workunit.client.0.smithi063.stdout:5/368: dread - d5/d12/f40 zero size 2024-09-16T01:25:14.519 INFO:tasks.workunit.client.0.smithi063.stdout:3/305: rename d2/d11/d18/d41/d30/f56 to d2/d11/d37/d40/d5e/d3b/d45/f6c 0 2024-09-16T01:25:14.520 INFO:tasks.workunit.client.0.smithi063.stdout:2/407: creat d3/d7/de/d21/f8b x:0 0 0 2024-09-16T01:25:14.520 INFO:tasks.workunit.client.0.smithi063.stdout:1/373: chown d1/dd/l51 1173297 1 2024-09-16T01:25:14.520 INFO:tasks.workunit.client.0.smithi063.stdout:9/484: dwrite f4 [0,4194304] 0 2024-09-16T01:25:14.521 INFO:tasks.workunit.client.0.smithi063.stdout:3/306: read - d2/d11/f34 zero size 2024-09-16T01:25:14.522 INFO:tasks.workunit.client.0.smithi063.stdout:9/485: fsync d7/d9/d12/f4b 0 2024-09-16T01:25:14.523 INFO:tasks.workunit.client.0.smithi063.stdout:6/281: symlink d3/d48/d28/d3e/d68/l6c 0 2024-09-16T01:25:14.526 INFO:tasks.workunit.client.0.smithi063.stdout:6/282: read d3/d10/f1d [2168788,31481] 0 2024-09-16T01:25:14.527 INFO:tasks.workunit.client.0.smithi063.stdout:9/486: write d7/d9/d12/d14/d63/d5f/fa7 [626166,125794] 0 2024-09-16T01:25:14.527 INFO:tasks.workunit.client.0.smithi063.stdout:1/374: creat d1/d5/f80 x:0 0 0 2024-09-16T01:25:14.532 INFO:tasks.workunit.client.0.smithi063.stdout:3/307: mkdir d2/d11/d37/d40/d5e/d3b/d68/d6d 0 2024-09-16T01:25:14.533 INFO:tasks.workunit.client.0.smithi063.stdout:3/308: write d2/f33 [3410675,101353] 0 2024-09-16T01:25:14.535 INFO:tasks.workunit.client.0.smithi063.stdout:6/283: creat d3/d10/d35/d5a/f6d x:0 0 0 2024-09-16T01:25:14.536 INFO:tasks.workunit.client.0.smithi063.stdout:8/215: sync 2024-09-16T01:25:14.536 INFO:tasks.workunit.client.0.smithi063.stdout:7/252: sync 2024-09-16T01:25:14.537 INFO:tasks.workunit.client.0.smithi063.stdout:6/284: write f2 [861797,64351] 0 2024-09-16T01:25:14.537 INFO:tasks.workunit.client.0.smithi063.stdout:6/285: readlink d3/l61 0 2024-09-16T01:25:14.540 INFO:tasks.workunit.client.0.smithi063.stdout:2/408: rename d3/d7/de to d3/d7/d8/d19/d8c 0 2024-09-16T01:25:14.541 INFO:tasks.workunit.client.0.smithi063.stdout:8/216: dread d5/f8 [0,4194304] 0 2024-09-16T01:25:14.541 INFO:tasks.workunit.client.0.smithi063.stdout:7/253: chown d7/d1c/c46 28563 1 2024-09-16T01:25:14.542 INFO:tasks.workunit.client.0.smithi063.stdout:3/309: mkdir d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e 0 2024-09-16T01:25:14.543 INFO:tasks.workunit.client.0.smithi063.stdout:5/369: dread d5/d18/f2a [4194304,4194304] 0 2024-09-16T01:25:14.543 INFO:tasks.workunit.client.0.smithi063.stdout:3/310: chown d2/d11/d18 63062 1 2024-09-16T01:25:14.543 INFO:tasks.workunit.client.0.smithi063.stdout:9/487: link d7/f71 d7/d9/d12/d8e/fae 0 2024-09-16T01:25:14.544 INFO:tasks.workunit.client.0.smithi063.stdout:6/286: mknod d3/d48/d28/d3e/d44/c6e 0 2024-09-16T01:25:14.545 INFO:tasks.workunit.client.0.smithi063.stdout:6/287: chown d3/d30/d39/d69 2 1 2024-09-16T01:25:14.546 INFO:tasks.workunit.client.0.smithi063.stdout:2/409: mknod d3/d7/d8/d19/c8d 0 2024-09-16T01:25:14.547 INFO:tasks.workunit.client.0.smithi063.stdout:1/375: truncate d1/f3 2540964 0 2024-09-16T01:25:14.547 INFO:tasks.workunit.client.0.smithi063.stdout:7/254: rmdir d7/d18/d25 39 2024-09-16T01:25:14.548 INFO:tasks.workunit.client.0.smithi063.stdout:6/288: read - d3/d48/f58 zero size 2024-09-16T01:25:14.551 INFO:tasks.workunit.client.0.smithi063.stdout:5/370: chown d5/d18/d29/d48/f71 0 1 2024-09-16T01:25:14.552 INFO:tasks.workunit.client.0.smithi063.stdout:8/217: dwrite d5/db/d12/f2d [4194304,4194304] 0 2024-09-16T01:25:14.552 INFO:tasks.workunit.client.0.smithi063.stdout:2/410: write d3/d7/d8/d1f/d37/d4f/f63 [1010309,98256] 0 2024-09-16T01:25:14.555 INFO:tasks.workunit.client.0.smithi063.stdout:1/376: fsync d1/d5/d15/f19 0 2024-09-16T01:25:14.558 INFO:tasks.workunit.client.0.smithi063.stdout:3/311: creat d2/d11/d18/f6f x:0 0 0 2024-09-16T01:25:14.558 INFO:tasks.workunit.client.0.smithi063.stdout:8/218: dread - d5/f3b zero size 2024-09-16T01:25:14.561 INFO:tasks.workunit.client.0.smithi063.stdout:9/488: dwrite d7/d9/d12/d14/d38/f3a [4194304,4194304] 0 2024-09-16T01:25:14.565 INFO:tasks.workunit.client.0.smithi063.stdout:2/411: write d3/d7/d8/d1f/d37/f74 [3034901,86684] 0 2024-09-16T01:25:14.565 INFO:tasks.workunit.client.0.smithi063.stdout:5/371: rename d5/d12/d35/f64 to d5/d18/d29/f7e 0 2024-09-16T01:25:14.569 INFO:tasks.workunit.client.0.smithi063.stdout:8/219: creat d5/d3a/f43 x:0 0 0 2024-09-16T01:25:14.570 INFO:tasks.workunit.client.0.smithi063.stdout:1/377: write d1/d5/f1a [837103,120600] 0 2024-09-16T01:25:14.570 INFO:tasks.workunit.client.0.smithi063.stdout:6/289: dwrite d3/d48/d28/f2e [0,4194304] 0 2024-09-16T01:25:14.572 INFO:tasks.workunit.client.0.smithi063.stdout:7/255: dwrite d7/d18/f45 [0,4194304] 0 2024-09-16T01:25:14.572 INFO:tasks.workunit.client.0.smithi063.stdout:9/489: creat d7/d9/d12/d14/d23/faf x:0 0 0 2024-09-16T01:25:14.575 INFO:tasks.workunit.client.0.smithi063.stdout:3/312: rename d2/d11/d37/l3a to d2/d11/d18/d41/l70 0 2024-09-16T01:25:14.576 INFO:tasks.workunit.client.0.smithi063.stdout:8/220: symlink d5/d3a/l44 0 2024-09-16T01:25:14.577 INFO:tasks.workunit.client.0.smithi063.stdout:5/372: mkdir d5/d7f 0 2024-09-16T01:25:14.578 INFO:tasks.workunit.client.0.smithi063.stdout:3/313: write d2/d11/d18/d41/d30/f3c [1510585,47908] 0 2024-09-16T01:25:14.580 INFO:tasks.workunit.client.0.smithi063.stdout:7/256: creat d7/d18/f4b x:0 0 0 2024-09-16T01:25:14.580 INFO:tasks.workunit.client.0.smithi063.stdout:5/373: fsync d5/d18/f2a 0 2024-09-16T01:25:14.581 INFO:tasks.workunit.client.0.smithi063.stdout:2/412: link c1 d3/d7/d8/d1f/d34/d45/c8e 0 2024-09-16T01:25:14.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:14 smithi063 ceph-mon[31070]: pgmap v392: 97 pgs: 97 active+clean; 469 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 52 MiB/s wr, 218 op/s 2024-09-16T01:25:14.645 INFO:tasks.workunit.client.0.smithi063.stdout:6/290: read d3/d48/d28/f2b [4078,120846] 0 2024-09-16T01:25:14.646 INFO:tasks.workunit.client.0.smithi063.stdout:5/374: readlink d5/d12/l4e 0 2024-09-16T01:25:14.648 INFO:tasks.workunit.client.0.smithi063.stdout:3/314: write d2/d11/d18/d41/f5c [947330,96720] 0 2024-09-16T01:25:14.648 INFO:tasks.workunit.client.0.smithi063.stdout:7/257: mknod d7/d1c/c4c 0 2024-09-16T01:25:14.648 INFO:tasks.workunit.client.0.smithi063.stdout:1/378: dwrite d1/f8 [0,4194304] 0 2024-09-16T01:25:14.650 INFO:tasks.workunit.client.0.smithi063.stdout:9/490: dwrite d7/d9/d12/d14/d34/f84 [0,4194304] 0 2024-09-16T01:25:14.651 INFO:tasks.workunit.client.0.smithi063.stdout:5/375: chown d5/d18/f39 0 1 2024-09-16T01:25:14.652 INFO:tasks.workunit.client.0.smithi063.stdout:7/258: chown d7/d18/d39 65302343 1 2024-09-16T01:25:14.654 INFO:tasks.workunit.client.0.smithi063.stdout:1/379: write d1/d5/f10 [3343299,5551] 0 2024-09-16T01:25:14.654 INFO:tasks.workunit.client.0.smithi063.stdout:6/291: link d3/c8 d3/d41/c6f 0 2024-09-16T01:25:14.656 INFO:tasks.workunit.client.0.smithi063.stdout:9/491: write d7/d1f/f2f [2447983,70508] 0 2024-09-16T01:25:14.658 INFO:tasks.workunit.client.0.smithi063.stdout:7/259: write d7/d18/f44 [106478,130187] 0 2024-09-16T01:25:14.659 INFO:tasks.workunit.client.0.smithi063.stdout:5/376: unlink d5/d18/d29/d52/f75 0 2024-09-16T01:25:14.661 INFO:tasks.workunit.client.0.smithi063.stdout:6/292: mknod d3/d30/c70 0 2024-09-16T01:25:14.662 INFO:tasks.workunit.client.0.smithi063.stdout:5/377: write d5/d18/f39 [5867480,9057] 0 2024-09-16T01:25:14.662 INFO:tasks.workunit.client.0.smithi063.stdout:2/413: dread d3/d7/d8/d19/d8c/d21/f29 [4194304,4194304] 0 2024-09-16T01:25:14.663 INFO:tasks.workunit.client.0.smithi063.stdout:7/260: read d7/d18/f1a [983561,49851] 0 2024-09-16T01:25:14.664 INFO:tasks.workunit.client.0.smithi063.stdout:3/315: dwrite d2/d11/d18/fd [8388608,4194304] 0 2024-09-16T01:25:14.665 INFO:tasks.workunit.client.0.smithi063.stdout:9/492: truncate d7/d9/d12/d14/d23/f49 4978195 0 2024-09-16T01:25:14.665 INFO:tasks.workunit.client.0.smithi063.stdout:5/378: dread - d5/f67 zero size 2024-09-16T01:25:14.666 INFO:tasks.workunit.client.0.smithi063.stdout:6/293: write d3/d10/d35/f50 [1038720,21816] 0 2024-09-16T01:25:14.668 INFO:tasks.workunit.client.0.smithi063.stdout:7/261: creat d7/d1c/d1f/f4d x:0 0 0 2024-09-16T01:25:14.669 INFO:tasks.workunit.client.0.smithi063.stdout:2/414: fdatasync d3/d7/d8/d1f/f3a 0 2024-09-16T01:25:14.672 INFO:tasks.workunit.client.0.smithi063.stdout:5/379: creat d5/d18/d29/d48/f80 x:0 0 0 2024-09-16T01:25:14.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:14 smithi192 ceph-mon[34775]: pgmap v392: 97 pgs: 97 active+clean; 469 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 52 MiB/s wr, 218 op/s 2024-09-16T01:25:14.674 INFO:tasks.workunit.client.0.smithi063.stdout:6/294: symlink d3/d48/d28/d3e/d44/d52/l71 0 2024-09-16T01:25:14.674 INFO:tasks.workunit.client.0.smithi063.stdout:6/295: chown d3/d48/c27 37695884 1 2024-09-16T01:25:14.675 INFO:tasks.workunit.client.0.smithi063.stdout:6/296: chown d3/d10/d35/f3c 5819 1 2024-09-16T01:25:14.676 INFO:tasks.workunit.client.0.smithi063.stdout:3/316: mknod d2/d11/d69/c71 0 2024-09-16T01:25:14.678 INFO:tasks.workunit.client.0.smithi063.stdout:2/415: symlink d3/d7/d8/d1f/d37/d4f/l8f 0 2024-09-16T01:25:14.679 INFO:tasks.workunit.client.0.smithi063.stdout:1/380: truncate d1/d5/d15/d18/f1e 2861002 0 2024-09-16T01:25:14.680 INFO:tasks.workunit.client.0.smithi063.stdout:6/297: dread f2 [0,4194304] 0 2024-09-16T01:25:14.680 INFO:tasks.workunit.client.0.smithi063.stdout:5/380: truncate d5/d12/f40 100193 0 2024-09-16T01:25:14.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/262: dwrite d7/f30 [0,4194304] 0 2024-09-16T01:25:14.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:14 smithi162 ceph-mon[34539]: pgmap v392: 97 pgs: 97 active+clean; 469 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 52 MiB/s wr, 218 op/s 2024-09-16T01:25:14.683 INFO:tasks.workunit.client.0.smithi063.stdout:3/317: symlink d2/d11/d37/d40/d5e/d3b/d68/l72 0 2024-09-16T01:25:14.688 INFO:tasks.workunit.client.0.smithi063.stdout:6/298: unlink d3/d41/f64 0 2024-09-16T01:25:14.690 INFO:tasks.workunit.client.0.smithi063.stdout:1/381: dwrite d1/d5/d15/d1b/d31/f78 [0,4194304] 0 2024-09-16T01:25:14.690 INFO:tasks.workunit.client.0.smithi063.stdout:9/493: link d7/d9/d20/c5b d7/d1f/cb0 0 2024-09-16T01:25:14.692 INFO:tasks.workunit.client.0.smithi063.stdout:0/351: sync 2024-09-16T01:25:14.692 INFO:tasks.workunit.client.0.smithi063.stdout:4/316: sync 2024-09-16T01:25:14.696 INFO:tasks.workunit.client.0.smithi063.stdout:7/263: dwrite d7/d18/f36 [0,4194304] 0 2024-09-16T01:25:14.696 INFO:tasks.workunit.client.0.smithi063.stdout:4/317: dread - d5/d3b/f41 zero size 2024-09-16T01:25:14.697 INFO:tasks.workunit.client.0.smithi063.stdout:5/381: mknod d5/d7f/c81 0 2024-09-16T01:25:14.700 INFO:tasks.workunit.client.0.smithi063.stdout:4/318: readlink d5/d3b/df/d1c/d29/d32/d4e/l5f 0 2024-09-16T01:25:14.701 INFO:tasks.workunit.client.0.smithi063.stdout:6/299: truncate d3/d10/f1d 2017371 0 2024-09-16T01:25:14.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/318: dread d2/d11/d18/f3d [0,4194304] 0 2024-09-16T01:25:14.701 INFO:tasks.workunit.client.0.smithi063.stdout:5/382: chown d5/f38 1 1 2024-09-16T01:25:14.704 INFO:tasks.workunit.client.0.smithi063.stdout:6/300: write d3/f65 [153380,102540] 0 2024-09-16T01:25:14.704 INFO:tasks.workunit.client.0.smithi063.stdout:7/264: creat d7/d1c/d1f/d29/f4e x:0 0 0 2024-09-16T01:25:14.707 INFO:tasks.workunit.client.0.smithi063.stdout:7/265: chown d7/d1c/d1f 119 1 2024-09-16T01:25:14.707 INFO:tasks.workunit.client.0.smithi063.stdout:4/319: rmdir d5/d3b/df/d1c/d29/d32/d4e 39 2024-09-16T01:25:14.708 INFO:tasks.workunit.client.0.smithi063.stdout:1/382: chown d1/d12/d56/f65 1 1 2024-09-16T01:25:14.711 INFO:tasks.workunit.client.0.smithi063.stdout:0/352: getdents d1 0 2024-09-16T01:25:14.713 INFO:tasks.workunit.client.0.smithi063.stdout:3/319: rename d2/d11/d18/f27 to d2/d11/d18/d41/d30/f73 0 2024-09-16T01:25:14.713 INFO:tasks.workunit.client.0.smithi063.stdout:2/416: dwrite d3/d7/d8/d1f/f3a [4194304,4194304] 0 2024-09-16T01:25:14.713 INFO:tasks.workunit.client.0.smithi063.stdout:1/383: stat d1/d5/d6f/c71 0 2024-09-16T01:25:14.715 INFO:tasks.workunit.client.0.smithi063.stdout:7/266: mknod d7/d18/d40/c4f 0 2024-09-16T01:25:14.715 INFO:tasks.workunit.client.0.smithi063.stdout:4/320: chown d5/d3b/df/d1c/d29/d20/l34 2 1 2024-09-16T01:25:14.716 INFO:tasks.workunit.client.0.smithi063.stdout:9/494: dread d7/d4a/d4d/f80 [0,4194304] 0 2024-09-16T01:25:14.716 INFO:tasks.workunit.client.0.smithi063.stdout:5/383: link d5/f3b d5/d18/d29/d48/d66/f82 0 2024-09-16T01:25:14.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/320: chown d2/d11/d37/d40/d5e/d3b/d68 1614574 1 2024-09-16T01:25:14.717 INFO:tasks.workunit.client.0.smithi063.stdout:6/301: link d3/d30/c70 d3/c72 0 2024-09-16T01:25:14.717 INFO:tasks.workunit.client.0.smithi063.stdout:8/221: sync 2024-09-16T01:25:14.718 INFO:tasks.workunit.client.0.smithi063.stdout:8/222: chown d5/db 228 1 2024-09-16T01:25:14.733 INFO:tasks.workunit.client.0.smithi063.stdout:0/353: rename d1/df/d7e to d1/df/d2c/d43/d90 0 2024-09-16T01:25:14.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/302: truncate d3/f62 5415 0 2024-09-16T01:25:14.734 INFO:tasks.workunit.client.0.smithi063.stdout:9/495: unlink d7/d4a/d4d/d50/f7c 0 2024-09-16T01:25:14.736 INFO:tasks.workunit.client.0.smithi063.stdout:0/354: chown d1/d30/d52/d5a/f87 15442658 1 2024-09-16T01:25:14.736 INFO:tasks.workunit.client.0.smithi063.stdout:7/267: write d7/f10 [1102545,58218] 0 2024-09-16T01:25:14.736 INFO:tasks.workunit.client.0.smithi063.stdout:5/384: creat d5/d18/d29/d48/d66/f83 x:0 0 0 2024-09-16T01:25:14.737 INFO:tasks.workunit.client.0.smithi063.stdout:9/496: fsync d7/d9/d12/d14/f29 0 2024-09-16T01:25:14.737 INFO:tasks.workunit.client.0.smithi063.stdout:2/417: symlink d3/d7/d8/d1f/l90 0 2024-09-16T01:25:14.737 INFO:tasks.workunit.client.0.smithi063.stdout:8/223: mknod d5/db/c45 0 2024-09-16T01:25:14.739 INFO:tasks.workunit.client.0.smithi063.stdout:9/497: stat d7/d9/d12/d14/f91 0 2024-09-16T01:25:14.742 INFO:tasks.workunit.client.0.smithi063.stdout:4/321: creat d5/d3b/df/d1c/d29/f65 x:0 0 0 2024-09-16T01:25:14.743 INFO:tasks.workunit.client.0.smithi063.stdout:0/355: symlink d1/df/d2c/d43/d90/l91 0 2024-09-16T01:25:14.744 INFO:tasks.workunit.client.0.smithi063.stdout:8/224: dread d5/db/d12/d1a/d1e/f36 [0,4194304] 0 2024-09-16T01:25:14.744 INFO:tasks.workunit.client.0.smithi063.stdout:3/321: link d2/d11/d18/fd d2/d11/d37/f74 0 2024-09-16T01:25:14.746 INFO:tasks.workunit.client.0.smithi063.stdout:9/498: mknod d7/d9/d12/cb1 0 2024-09-16T01:25:14.747 INFO:tasks.workunit.client.0.smithi063.stdout:5/385: creat d5/d18/d4b/f84 x:0 0 0 2024-09-16T01:25:14.748 INFO:tasks.workunit.client.0.smithi063.stdout:4/322: mkdir d5/d3b/d57/d66 0 2024-09-16T01:25:14.749 INFO:tasks.workunit.client.0.smithi063.stdout:8/225: creat d5/d9/f46 x:0 0 0 2024-09-16T01:25:14.749 INFO:tasks.workunit.client.0.smithi063.stdout:5/386: fdatasync d5/d12/f76 0 2024-09-16T01:25:14.750 INFO:tasks.workunit.client.0.smithi063.stdout:4/323: fsync d5/d3b/f41 0 2024-09-16T01:25:14.753 INFO:tasks.workunit.client.0.smithi063.stdout:6/303: dwrite d3/d10/f60 [0,4194304] 0 2024-09-16T01:25:14.753 INFO:tasks.workunit.client.0.smithi063.stdout:3/322: creat d2/f75 x:0 0 0 2024-09-16T01:25:14.754 INFO:tasks.workunit.client.0.smithi063.stdout:9/499: truncate d7/d9/d12/d8e/fae 29755 0 2024-09-16T01:25:14.755 INFO:tasks.workunit.client.0.smithi063.stdout:2/418: getdents d3/d7/d8/d1f/d34/d72 0 2024-09-16T01:25:14.755 INFO:tasks.workunit.client.0.smithi063.stdout:0/356: dwrite d1/d2e/d50/d6f/f82 [0,4194304] 0 2024-09-16T01:25:14.755 INFO:tasks.workunit.client.0.smithi063.stdout:8/226: truncate d5/db/d12/f38 660060 0 2024-09-16T01:25:14.756 INFO:tasks.workunit.client.0.smithi063.stdout:7/268: getdents d7/d18/d39 0 2024-09-16T01:25:14.758 INFO:tasks.workunit.client.0.smithi063.stdout:6/304: chown d3/d10/d35/d56/c5d 35 1 2024-09-16T01:25:14.760 INFO:tasks.workunit.client.0.smithi063.stdout:5/387: mkdir d5/d18/d29/d48/d7b/d85 0 2024-09-16T01:25:14.761 INFO:tasks.workunit.client.0.smithi063.stdout:6/305: write d3/f62 [813153,94657] 0 2024-09-16T01:25:14.762 INFO:tasks.workunit.client.0.smithi063.stdout:5/388: fdatasync d5/d18/d29/d48/d66/f83 0 2024-09-16T01:25:14.764 INFO:tasks.workunit.client.0.smithi063.stdout:8/227: creat d5/db/f47 x:0 0 0 2024-09-16T01:25:14.766 INFO:tasks.workunit.client.0.smithi063.stdout:2/419: symlink d3/d7/d8/d19/d3c/d58/l91 0 2024-09-16T01:25:14.767 INFO:tasks.workunit.client.0.smithi063.stdout:2/420: fsync f2 0 2024-09-16T01:25:14.768 INFO:tasks.workunit.client.0.smithi063.stdout:6/306: symlink d3/d48/d28/d3e/d68/l73 0 2024-09-16T01:25:14.770 INFO:tasks.workunit.client.0.smithi063.stdout:6/307: fsync d3/d30/f4e 0 2024-09-16T01:25:14.772 INFO:tasks.workunit.client.0.smithi063.stdout:7/269: rename d7/c2a to d7/d18/d40/c50 0 2024-09-16T01:25:14.772 INFO:tasks.workunit.client.0.smithi063.stdout:0/357: dwrite d1/df/d17/f22 [8388608,4194304] 0 2024-09-16T01:25:14.774 INFO:tasks.workunit.client.0.smithi063.stdout:4/324: dread d5/f3f [0,4194304] 0 2024-09-16T01:25:14.775 INFO:tasks.workunit.client.0.smithi063.stdout:7/270: write d7/d18/f4b [681239,40080] 0 2024-09-16T01:25:14.775 INFO:tasks.workunit.client.0.smithi063.stdout:2/421: mknod d3/d7/d8/d19/d3c/d53/d7f/c92 0 2024-09-16T01:25:14.777 INFO:tasks.workunit.client.0.smithi063.stdout:0/358: chown d1/d30/d52/d5a/d36/d41/l83 2075527 1 2024-09-16T01:25:14.779 INFO:tasks.workunit.client.0.smithi063.stdout:9/500: getdents d7/d4a/d4d/d50/d7f 0 2024-09-16T01:25:14.780 INFO:tasks.workunit.client.0.smithi063.stdout:7/271: write d7/d1c/d1f/d29/f3d [4172792,87587] 0 2024-09-16T01:25:14.780 INFO:tasks.workunit.client.0.smithi063.stdout:3/323: truncate d2/d11/d18/d41/f5c 602767 0 2024-09-16T01:25:14.781 INFO:tasks.workunit.client.0.smithi063.stdout:8/228: link d5/d9/c39 d5/c48 0 2024-09-16T01:25:14.783 INFO:tasks.workunit.client.0.smithi063.stdout:9/501: fsync d7/d1f/f8c 0 2024-09-16T01:25:14.785 INFO:tasks.workunit.client.0.smithi063.stdout:4/325: rmdir d5/d3b/df/d1c/d29/d32 39 2024-09-16T01:25:14.785 INFO:tasks.workunit.client.0.smithi063.stdout:2/422: creat d3/d7/d8/d19/d3c/d58/f93 x:0 0 0 2024-09-16T01:25:14.786 INFO:tasks.workunit.client.0.smithi063.stdout:6/308: dwrite d3/d10/f23 [0,4194304] 0 2024-09-16T01:25:14.786 INFO:tasks.workunit.client.0.smithi063.stdout:0/359: rename d1/df/d34/f5c to d1/df/d17/f92 0 2024-09-16T01:25:14.789 INFO:tasks.workunit.client.0.smithi063.stdout:5/389: dread d5/d18/d29/f2f [0,4194304] 0 2024-09-16T01:25:14.789 INFO:tasks.workunit.client.0.smithi063.stdout:7/272: mknod d7/c51 0 2024-09-16T01:25:14.795 INFO:tasks.workunit.client.0.smithi063.stdout:7/273: fsync d7/f10 0 2024-09-16T01:25:14.795 INFO:tasks.workunit.client.0.smithi063.stdout:2/423: creat d3/d7/d8/d1f/d37/d4f/f94 x:0 0 0 2024-09-16T01:25:14.796 INFO:tasks.workunit.client.0.smithi063.stdout:5/390: dread - d5/d12/f45 zero size 2024-09-16T01:25:14.800 INFO:tasks.workunit.client.0.smithi063.stdout:3/324: dwrite d2/d11/d37/d40/d5e/f31 [0,4194304] 0 2024-09-16T01:25:14.800 INFO:tasks.workunit.client.0.smithi063.stdout:8/229: rename d5/d9/c39 to d5/db/d12/d3d/c49 0 2024-09-16T01:25:14.802 INFO:tasks.workunit.client.0.smithi063.stdout:2/424: write d3/d7/d8/f1a [403421,55413] 0 2024-09-16T01:25:14.804 INFO:tasks.workunit.client.0.smithi063.stdout:7/274: creat d7/d1c/d1f/d29/f52 x:0 0 0 2024-09-16T01:25:14.805 INFO:tasks.workunit.client.0.smithi063.stdout:9/502: dwrite d7/d9/d12/d14/f35 [0,4194304] 0 2024-09-16T01:25:14.805 INFO:tasks.workunit.client.0.smithi063.stdout:6/309: dread d3/d10/d35/f50 [0,4194304] 0 2024-09-16T01:25:14.807 INFO:tasks.workunit.client.0.smithi063.stdout:0/360: getdents d1/df/d2c/d43/d89 0 2024-09-16T01:25:14.809 INFO:tasks.workunit.client.0.smithi063.stdout:4/326: dwrite d5/d3b/df/d1c/d29/d32/f4d [0,4194304] 0 2024-09-16T01:25:14.810 INFO:tasks.workunit.client.0.smithi063.stdout:0/361: fdatasync d1/d2e/d50/d6f/f82 0 2024-09-16T01:25:14.810 INFO:tasks.workunit.client.0.smithi063.stdout:5/391: unlink d5/d18/l20 0 2024-09-16T01:25:14.813 INFO:tasks.workunit.client.0.smithi063.stdout:7/275: symlink d7/d1c/d1f/d29/l53 0 2024-09-16T01:25:14.814 INFO:tasks.workunit.client.0.smithi063.stdout:7/276: chown d7 7 1 2024-09-16T01:25:14.816 INFO:tasks.workunit.client.0.smithi063.stdout:2/425: creat d3/d7/d8/d19/d3c/d53/d7f/d80/f95 x:0 0 0 2024-09-16T01:25:14.819 INFO:tasks.workunit.client.0.smithi063.stdout:8/230: dwrite d5/db/d12/d1a/f2c [0,4194304] 0 2024-09-16T01:25:14.819 INFO:tasks.workunit.client.0.smithi063.stdout:0/362: creat d1/d30/f93 x:0 0 0 2024-09-16T01:25:14.819 INFO:tasks.workunit.client.0.smithi063.stdout:5/392: read d5/d18/f24 [1767633,119989] 0 2024-09-16T01:25:14.820 INFO:tasks.workunit.client.0.smithi063.stdout:4/327: unlink d5/d3b/df/d1c/d29/d32/f4d 0 2024-09-16T01:25:14.825 INFO:tasks.workunit.client.0.smithi063.stdout:9/503: dwrite d7/d9/f74 [0,4194304] 0 2024-09-16T01:25:14.827 INFO:tasks.workunit.client.0.smithi063.stdout:1/384: sync 2024-09-16T01:25:14.828 INFO:tasks.workunit.client.0.smithi063.stdout:2/426: unlink d3/d7/d8/d19/d8c/d21/f29 0 2024-09-16T01:25:14.829 INFO:tasks.workunit.client.0.smithi063.stdout:3/325: dwrite d2/d11/d37/d40/d5e/f20 [0,4194304] 0 2024-09-16T01:25:14.829 INFO:tasks.workunit.client.0.smithi063.stdout:4/328: chown d5/d3b/df/d1c/c48 288221669 1 2024-09-16T01:25:14.830 INFO:tasks.workunit.client.0.smithi063.stdout:5/393: creat d5/d12/d35/f86 x:0 0 0 2024-09-16T01:25:14.831 INFO:tasks.workunit.client.0.smithi063.stdout:9/504: fsync d7/d9/d12/d14/d63/d5f/f62 0 2024-09-16T01:25:14.831 INFO:tasks.workunit.client.0.smithi063.stdout:6/310: truncate d3/d10/d35/f50 2435337 0 2024-09-16T01:25:14.833 INFO:tasks.workunit.client.0.smithi063.stdout:1/385: readlink d1/d12/d21/l2f 0 2024-09-16T01:25:14.833 INFO:tasks.workunit.client.0.smithi063.stdout:7/277: write d7/d18/f1b [242062,9773] 0 2024-09-16T01:25:14.836 INFO:tasks.workunit.client.0.smithi063.stdout:3/326: creat d2/d11/d37/d40/d5e/d3b/f76 x:0 0 0 2024-09-16T01:25:14.836 INFO:tasks.workunit.client.0.smithi063.stdout:5/394: dread - d5/d18/d4b/f5f zero size 2024-09-16T01:25:14.837 INFO:tasks.workunit.client.0.smithi063.stdout:2/427: creat d3/d7/d8/d1f/d34/d56/f96 x:0 0 0 2024-09-16T01:25:14.839 INFO:tasks.workunit.client.0.smithi063.stdout:6/311: write d3/d48/d28/d3e/f43 [909752,79896] 0 2024-09-16T01:25:14.840 INFO:tasks.workunit.client.0.smithi063.stdout:2/428: write d3/d7/d8/d1f/d37/d4f/f63 [2086860,34569] 0 2024-09-16T01:25:14.861 INFO:tasks.workunit.client.0.smithi063.stdout:5/395: mknod d5/d7f/c87 0 2024-09-16T01:25:14.862 INFO:tasks.workunit.client.0.smithi063.stdout:0/363: link d1/df/d17/c3c d1/d30/c94 0 2024-09-16T01:25:14.862 INFO:tasks.workunit.client.0.smithi063.stdout:0/364: chown d1 254 1 2024-09-16T01:25:14.863 INFO:tasks.workunit.client.0.smithi063.stdout:3/327: creat d2/d11/d18/d41/f77 x:0 0 0 2024-09-16T01:25:14.866 INFO:tasks.workunit.client.0.smithi063.stdout:3/328: dread - d2/d11/d18/f2d zero size 2024-09-16T01:25:14.866 INFO:tasks.workunit.client.0.smithi063.stdout:8/231: dread d5/d9/f16 [0,4194304] 0 2024-09-16T01:25:14.867 INFO:tasks.workunit.client.0.smithi063.stdout:2/429: write d3/d7/d8/d19/d3c/d58/f5d [333740,111629] 0 2024-09-16T01:25:14.867 INFO:tasks.workunit.client.0.smithi063.stdout:3/329: chown d2/d11/d37/d40/d5e 2016933 1 2024-09-16T01:25:14.868 INFO:tasks.workunit.client.0.smithi063.stdout:9/505: truncate d7/d9/d12/f2e 11611244 0 2024-09-16T01:25:14.868 INFO:tasks.workunit.client.0.smithi063.stdout:8/232: chown d5/d9/l11 1616 1 2024-09-16T01:25:14.870 INFO:tasks.workunit.client.0.smithi063.stdout:4/329: getdents d5/d3b/df/d1c 0 2024-09-16T01:25:14.870 INFO:tasks.workunit.client.0.smithi063.stdout:6/312: write d3/d48/d28/f33 [4202078,59164] 0 2024-09-16T01:25:14.873 INFO:tasks.workunit.client.0.smithi063.stdout:2/430: mknod d3/d7/d8/d19/d8c/c97 0 2024-09-16T01:25:14.875 INFO:tasks.workunit.client.0.smithi063.stdout:8/233: mkdir d5/d3a/d40/d4a 0 2024-09-16T01:25:14.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/386: dread d1/d5/f1a [0,4194304] 0 2024-09-16T01:25:14.876 INFO:tasks.workunit.client.0.smithi063.stdout:9/506: rename d7/d9/d12/d8e to d7/d9/d12/db2 0 2024-09-16T01:25:14.877 INFO:tasks.workunit.client.0.smithi063.stdout:8/234: read - d5/f3b zero size 2024-09-16T01:25:14.879 INFO:tasks.workunit.client.0.smithi063.stdout:5/396: dread d5/d12/d35/f60 [0,4194304] 0 2024-09-16T01:25:14.880 INFO:tasks.workunit.client.0.smithi063.stdout:6/313: symlink d3/d10/d35/l74 0 2024-09-16T01:25:14.882 INFO:tasks.workunit.client.0.smithi063.stdout:0/365: dread d1/d1c/f3f [0,4194304] 0 2024-09-16T01:25:14.886 INFO:tasks.workunit.client.0.smithi063.stdout:0/366: chown d1/d1c/l42 252 1 2024-09-16T01:25:14.886 INFO:tasks.workunit.client.0.smithi063.stdout:4/330: dwrite d5/d3b/f16 [0,4194304] 0 2024-09-16T01:25:14.887 INFO:tasks.workunit.client.0.smithi063.stdout:3/330: link d2/d11/d18/l44 d2/d11/d37/d40/d5e/d3b/d68/d6b/l78 0 2024-09-16T01:25:14.887 INFO:tasks.workunit.client.0.smithi063.stdout:5/397: write d5/d12/d35/f59 [2802754,18192] 0 2024-09-16T01:25:14.889 INFO:tasks.workunit.client.0.smithi063.stdout:1/387: mknod d1/d5/d15/d1b/d31/d77/d7d/c81 0 2024-09-16T01:25:14.893 INFO:tasks.workunit.client.0.smithi063.stdout:5/398: mknod d5/d7f/c88 0 2024-09-16T01:25:14.894 INFO:tasks.workunit.client.0.smithi063.stdout:4/331: unlink d5/d3b/df/f18 0 2024-09-16T01:25:14.895 INFO:tasks.workunit.client.0.smithi063.stdout:0/367: unlink d1/df/d2c/d43/d89/f8b 0 2024-09-16T01:25:14.898 INFO:tasks.workunit.client.0.smithi063.stdout:8/235: dwrite d5/db/d12/f15 [0,4194304] 0 2024-09-16T01:25:14.899 INFO:tasks.workunit.client.0.smithi063.stdout:1/388: write d1/d5/d15/d18/d4b/f5f [318417,47916] 0 2024-09-16T01:25:14.899 INFO:tasks.workunit.client.0.smithi063.stdout:3/331: mkdir d2/d11/d37/d40/d5e/d3b/d68/d6d/d79 0 2024-09-16T01:25:14.900 INFO:tasks.workunit.client.0.smithi063.stdout:2/431: dwrite d3/d7/d8/d1f/d34/d39/f47 [0,4194304] 0 2024-09-16T01:25:14.903 INFO:tasks.workunit.client.0.smithi063.stdout:0/368: mkdir d1/d30/d95 0 2024-09-16T01:25:14.904 INFO:tasks.workunit.client.0.smithi063.stdout:8/236: fsync d5/db/f2a 0 2024-09-16T01:25:14.906 INFO:tasks.workunit.client.0.smithi063.stdout:9/507: dwrite d7/d9/d12/db2/f94 [0,4194304] 0 2024-09-16T01:25:14.907 INFO:tasks.workunit.client.0.smithi063.stdout:4/332: chown d5/d3b/df/d1c/d29/d32/d4e/f54 99 1 2024-09-16T01:25:14.907 INFO:tasks.workunit.client.0.smithi063.stdout:6/314: dread d3/d48/d28/d3e/d44/d52/f53 [0,4194304] 0 2024-09-16T01:25:14.908 INFO:tasks.workunit.client.0.smithi063.stdout:4/333: chown d5/d3b/d57/d66 109875 1 2024-09-16T01:25:14.911 INFO:tasks.workunit.client.0.smithi063.stdout:4/334: dread d5/d3b/df/d1c/d29/d20/f44 [0,4194304] 0 2024-09-16T01:25:14.913 INFO:tasks.workunit.client.0.smithi063.stdout:0/369: creat d1/d2e/f96 x:0 0 0 2024-09-16T01:25:14.914 INFO:tasks.workunit.client.0.smithi063.stdout:4/335: read d5/d3b/df/d1c/d29/d32/f27 [321080,40789] 0 2024-09-16T01:25:14.914 INFO:tasks.workunit.client.0.smithi063.stdout:3/332: creat d2/d5b/f7a x:0 0 0 2024-09-16T01:25:14.915 INFO:tasks.workunit.client.0.smithi063.stdout:6/315: mknod d3/d10/d35/c75 0 2024-09-16T01:25:14.915 INFO:tasks.workunit.client.0.smithi063.stdout:0/370: truncate d1/df/d34/f79 320205 0 2024-09-16T01:25:14.916 INFO:tasks.workunit.client.0.smithi063.stdout:6/316: truncate d3/d48/f26 2132698 0 2024-09-16T01:25:14.916 INFO:tasks.workunit.client.0.smithi063.stdout:0/371: chown d1/c63 19426577 1 2024-09-16T01:25:14.917 INFO:tasks.workunit.client.0.smithi063.stdout:2/432: write d3/d7/d8/d19/f44 [2892897,33409] 0 2024-09-16T01:25:14.919 INFO:tasks.workunit.client.0.smithi063.stdout:6/317: write d3/d10/f23 [3243258,56536] 0 2024-09-16T01:25:14.926 INFO:tasks.workunit.client.0.smithi063.stdout:1/389: rename d1/d5/d63/d66 to d1/d5/d82 0 2024-09-16T01:25:14.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/333: chown d2/d11/d18/d41/c4f 7315 1 2024-09-16T01:25:14.927 INFO:tasks.workunit.client.0.smithi063.stdout:2/433: chown d3/d7/d8/d1f/d34/d39/d6f 126573300 1 2024-09-16T01:25:14.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/399: truncate d5/d18/d29/f7e 239735 0 2024-09-16T01:25:14.928 INFO:tasks.workunit.client.0.smithi063.stdout:8/237: creat d5/db/d12/d1a/f4b x:0 0 0 2024-09-16T01:25:14.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/336: unlink d5/f11 0 2024-09-16T01:25:14.929 INFO:tasks.workunit.client.0.smithi063.stdout:9/508: link d7/d4a/l4c d7/d4a/d4d/d50/lb3 0 2024-09-16T01:25:14.932 INFO:tasks.workunit.client.0.smithi063.stdout:5/400: write d5/d18/d4b/f5f [645225,85527] 0 2024-09-16T01:25:14.933 INFO:tasks.workunit.client.0.smithi063.stdout:1/390: mknod d1/d5/c83 0 2024-09-16T01:25:14.933 INFO:tasks.workunit.client.0.smithi063.stdout:4/337: chown d5/d3b/l15 101977529 1 2024-09-16T01:25:14.934 INFO:tasks.workunit.client.0.smithi063.stdout:3/334: symlink d2/d11/d37/d40/d5e/l7b 0 2024-09-16T01:25:14.934 INFO:tasks.workunit.client.0.smithi063.stdout:9/509: write d7/d9/f2a [1521679,44487] 0 2024-09-16T01:25:14.937 INFO:tasks.workunit.client.0.smithi063.stdout:0/372: dwrite d1/df/d2c/f39 [0,4194304] 0 2024-09-16T01:25:14.938 INFO:tasks.workunit.client.0.smithi063.stdout:8/238: symlink d5/db/d12/d1a/l4c 0 2024-09-16T01:25:14.938 INFO:tasks.workunit.client.0.smithi063.stdout:1/391: dread - d1/d5/d15/d18/d4c/f73 zero size 2024-09-16T01:25:14.939 INFO:tasks.workunit.client.0.smithi063.stdout:6/318: dwrite d3/d48/f26 [0,4194304] 0 2024-09-16T01:25:14.940 INFO:tasks.workunit.client.0.smithi063.stdout:5/401: fsync d5/f51 0 2024-09-16T01:25:14.943 INFO:tasks.workunit.client.0.smithi063.stdout:2/434: rmdir d3/d7/d8/d1f/d34/d39/d6f 0 2024-09-16T01:25:14.944 INFO:tasks.workunit.client.0.smithi063.stdout:1/392: mkdir d1/d12/d56/d84 0 2024-09-16T01:25:14.944 INFO:tasks.workunit.client.0.smithi063.stdout:5/402: chown d5/d18/d29/d48 12 1 2024-09-16T01:25:14.944 INFO:tasks.workunit.client.0.smithi063.stdout:6/319: stat d3/l61 0 2024-09-16T01:25:14.948 INFO:tasks.workunit.client.0.smithi063.stdout:8/239: creat d5/d3a/d40/d4a/f4d x:0 0 0 2024-09-16T01:25:14.951 INFO:tasks.workunit.client.0.smithi063.stdout:3/335: dwrite d2/d11/d18/d41/d30/f57 [0,4194304] 0 2024-09-16T01:25:14.952 INFO:tasks.workunit.client.0.smithi063.stdout:1/393: link d1/d5/d15/f62 d1/d5/d6f/f85 0 2024-09-16T01:25:14.954 INFO:tasks.workunit.client.0.smithi063.stdout:2/435: mknod d3/d7/d8/d19/d8c/d21/d28/d8a/c98 0 2024-09-16T01:25:14.957 INFO:tasks.workunit.client.0.smithi063.stdout:0/373: getdents d1/df/d2c 0 2024-09-16T01:25:14.958 INFO:tasks.workunit.client.0.smithi063.stdout:3/336: write d2/d11/d37/d40/d5e/f20 [809192,94121] 0 2024-09-16T01:25:14.960 INFO:tasks.workunit.client.0.smithi063.stdout:6/320: dwrite d3/f65 [0,4194304] 0 2024-09-16T01:25:14.961 INFO:tasks.workunit.client.0.smithi063.stdout:8/240: symlink d5/db/d12/d1a/l4e 0 2024-09-16T01:25:14.962 INFO:tasks.workunit.client.0.smithi063.stdout:5/403: rename d5/d18/d29/d5b/l70 to d5/d18/d29/d5b/d72/l89 0 2024-09-16T01:25:14.963 INFO:tasks.workunit.client.0.smithi063.stdout:4/338: dread d5/d3b/df/d1c/d29/f4a [0,4194304] 0 2024-09-16T01:25:14.965 INFO:tasks.workunit.client.0.smithi063.stdout:0/374: truncate d1/df/d17/f92 4842319 0 2024-09-16T01:25:14.965 INFO:tasks.workunit.client.0.smithi063.stdout:8/241: chown d5/db/d12/d3d 3295 1 2024-09-16T01:25:14.965 INFO:tasks.workunit.client.0.smithi063.stdout:1/394: mkdir d1/d5/d15/d1b/d31/d77/d86 0 2024-09-16T01:25:14.967 INFO:tasks.workunit.client.0.smithi063.stdout:4/339: fsync d5/f6 0 2024-09-16T01:25:14.967 INFO:tasks.workunit.client.0.smithi063.stdout:5/404: dread - d5/d18/d4b/f68 zero size 2024-09-16T01:25:14.969 INFO:tasks.workunit.client.0.smithi063.stdout:6/321: symlink d3/d10/d35/d5a/l76 0 2024-09-16T01:25:14.969 INFO:tasks.workunit.client.0.smithi063.stdout:3/337: symlink d2/d11/d37/d40/d5e/d3b/d45/l7c 0 2024-09-16T01:25:14.969 INFO:tasks.workunit.client.0.smithi063.stdout:0/375: chown d1/df/d17/l56 679 1 2024-09-16T01:25:14.971 INFO:tasks.workunit.client.0.smithi063.stdout:2/436: dwrite f2 [0,4194304] 0 2024-09-16T01:25:14.972 INFO:tasks.workunit.client.0.smithi063.stdout:6/322: write d3/f57 [201350,62424] 0 2024-09-16T01:25:14.972 INFO:tasks.workunit.client.0.smithi063.stdout:8/242: write d5/d9/d2f/f3f [121343,78855] 0 2024-09-16T01:25:14.975 INFO:tasks.workunit.client.0.smithi063.stdout:5/405: creat d5/d18/d29/d48/d66/f8a x:0 0 0 2024-09-16T01:25:14.980 INFO:tasks.workunit.client.0.smithi063.stdout:5/406: creat d5/d12/f8b x:0 0 0 2024-09-16T01:25:14.981 INFO:tasks.workunit.client.0.smithi063.stdout:8/243: mkdir d5/d9/d41/d4f 0 2024-09-16T01:25:14.982 INFO:tasks.workunit.client.0.smithi063.stdout:6/323: write d3/f13 [5094371,1839] 0 2024-09-16T01:25:14.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/376: getdents d1/df/d34 0 2024-09-16T01:25:14.984 INFO:tasks.workunit.client.0.smithi063.stdout:6/324: write d3/f57 [1037874,111109] 0 2024-09-16T01:25:14.985 INFO:tasks.workunit.client.0.smithi063.stdout:8/244: stat d5/c26 0 2024-09-16T01:25:14.986 INFO:tasks.workunit.client.0.smithi063.stdout:1/395: link d1/d12/l55 d1/d5/d15/d1b/l87 0 2024-09-16T01:25:14.987 INFO:tasks.workunit.client.0.smithi063.stdout:2/437: dread d3/f60 [0,4194304] 0 2024-09-16T01:25:14.989 INFO:tasks.workunit.client.0.smithi063.stdout:0/377: write d1/d30/d52/d5a/f3e [3560235,45758] 0 2024-09-16T01:25:14.991 INFO:tasks.workunit.client.0.smithi063.stdout:4/340: dread d5/d3b/f19 [0,4194304] 0 2024-09-16T01:25:14.991 INFO:tasks.workunit.client.0.smithi063.stdout:6/325: creat d3/d48/d28/f77 x:0 0 0 2024-09-16T01:25:14.991 INFO:tasks.workunit.client.0.smithi063.stdout:0/378: stat d1/fa 0 2024-09-16T01:25:14.992 INFO:tasks.workunit.client.0.smithi063.stdout:2/438: write d3/d7/d8/d1f/f64 [269484,66818] 0 2024-09-16T01:25:14.993 INFO:tasks.workunit.client.0.smithi063.stdout:5/407: dwrite d5/d18/d4b/f84 [0,4194304] 0 2024-09-16T01:25:14.995 INFO:tasks.workunit.client.0.smithi063.stdout:6/326: chown d3/d10/d35/d5a/l76 367 1 2024-09-16T01:25:14.995 INFO:tasks.workunit.client.0.smithi063.stdout:8/245: rename d5/db/d12/d1a/d1e/c34 to d5/d3a/d40/d4a/c50 0 2024-09-16T01:25:14.997 INFO:tasks.workunit.client.0.smithi063.stdout:5/408: creat d5/d18/d29/d5b/f8c x:0 0 0 2024-09-16T01:25:14.998 INFO:tasks.workunit.client.0.smithi063.stdout:8/246: write d5/f10 [2826144,68208] 0 2024-09-16T01:25:14.998 INFO:tasks.workunit.client.0.smithi063.stdout:6/327: write d3/d10/d35/f3a [5477781,47614] 0 2024-09-16T01:25:15.000 INFO:tasks.workunit.client.0.smithi063.stdout:4/341: write d5/d3b/df/d1c/d29/f5a [1231236,118176] 0 2024-09-16T01:25:15.001 INFO:tasks.workunit.client.0.smithi063.stdout:8/247: fsync d5/db/f47 0 2024-09-16T01:25:15.001 INFO:tasks.workunit.client.0.smithi063.stdout:5/409: write d5/d12/f49 [1660809,92576] 0 2024-09-16T01:25:15.003 INFO:tasks.workunit.client.0.smithi063.stdout:2/439: creat d3/d7/d8/d19/d8c/d21/f99 x:0 0 0 2024-09-16T01:25:15.006 INFO:tasks.workunit.client.0.smithi063.stdout:0/379: dwrite d1/df/f40 [0,4194304] 0 2024-09-16T01:25:15.006 INFO:tasks.workunit.client.0.smithi063.stdout:5/410: dread - d5/d12/f45 zero size 2024-09-16T01:25:15.007 INFO:tasks.workunit.client.0.smithi063.stdout:8/248: chown d5/d3a/c3e 28737655 1 2024-09-16T01:25:15.009 INFO:tasks.workunit.client.0.smithi063.stdout:6/328: creat d3/d30/f78 x:0 0 0 2024-09-16T01:25:15.009 INFO:tasks.workunit.client.0.smithi063.stdout:5/411: dread - d5/d18/f6e zero size 2024-09-16T01:25:15.011 INFO:tasks.workunit.client.0.smithi063.stdout:0/380: unlink d1/d30/d52/d5a/d36/d41/l83 0 2024-09-16T01:25:15.012 INFO:tasks.workunit.client.0.smithi063.stdout:8/249: creat d5/d3a/d40/f51 x:0 0 0 2024-09-16T01:25:15.014 INFO:tasks.workunit.client.0.smithi063.stdout:5/412: mknod d5/d18/d29/d48/d66/c8d 0 2024-09-16T01:25:15.014 INFO:tasks.workunit.client.0.smithi063.stdout:0/381: write d1/d2e/d50/d6f/f7b [649200,48419] 0 2024-09-16T01:25:15.015 INFO:tasks.workunit.client.0.smithi063.stdout:2/440: rename d3/d7/d8/d1f/d34/d39 to d3/d9a 0 2024-09-16T01:25:15.016 INFO:tasks.workunit.client.0.smithi063.stdout:4/342: getdents d5/d3b/df/d1c/d29 0 2024-09-16T01:25:15.017 INFO:tasks.workunit.client.0.smithi063.stdout:5/413: fsync d5/f3b 0 2024-09-16T01:25:15.018 INFO:tasks.workunit.client.0.smithi063.stdout:0/382: chown d1/df/d17/c21 222990 1 2024-09-16T01:25:15.019 INFO:tasks.workunit.client.0.smithi063.stdout:6/329: dwrite d3/d10/f20 [0,4194304] 0 2024-09-16T01:25:15.019 INFO:tasks.workunit.client.0.smithi063.stdout:2/441: chown d3/d7/c79 0 1 2024-09-16T01:25:15.020 INFO:tasks.workunit.client.0.smithi063.stdout:5/414: write d5/d12/d35/f86 [476783,113092] 0 2024-09-16T01:25:15.021 INFO:tasks.workunit.client.0.smithi063.stdout:6/330: fdatasync d3/d48/d28/f33 0 2024-09-16T01:25:15.024 INFO:tasks.workunit.client.0.smithi063.stdout:2/442: write d3/f4b [1678961,2605] 0 2024-09-16T01:25:15.026 INFO:tasks.workunit.client.0.smithi063.stdout:2/443: write d3/d7/d8/f1a [806233,45247] 0 2024-09-16T01:25:15.026 INFO:tasks.workunit.client.0.smithi063.stdout:4/343: rename d5/d3b/df/d1c/d29/f4f to d5/d3b/d57/f67 0 2024-09-16T01:25:15.029 INFO:tasks.workunit.client.0.smithi063.stdout:8/250: truncate d5/d9/f35 1359479 0 2024-09-16T01:25:15.031 INFO:tasks.workunit.client.0.smithi063.stdout:0/383: symlink d1/d30/d95/l97 0 2024-09-16T01:25:15.033 INFO:tasks.workunit.client.0.smithi063.stdout:4/344: mkdir d5/d3b/d57/d68 0 2024-09-16T01:25:15.034 INFO:tasks.workunit.client.0.smithi063.stdout:6/331: symlink d3/d30/l79 0 2024-09-16T01:25:15.035 INFO:tasks.workunit.client.0.smithi063.stdout:2/444: truncate d3/f6 842929 0 2024-09-16T01:25:15.035 INFO:tasks.workunit.client.0.smithi063.stdout:5/415: dread d5/f3b [0,4194304] 0 2024-09-16T01:25:15.036 INFO:tasks.workunit.client.0.smithi063.stdout:2/445: fdatasync d3/d7/d8/d19/d3c/d53/f83 0 2024-09-16T01:25:15.037 INFO:tasks.workunit.client.0.smithi063.stdout:6/332: creat d3/d41/f7a x:0 0 0 2024-09-16T01:25:15.041 INFO:tasks.workunit.client.0.smithi063.stdout:6/333: symlink d3/d48/d28/d3e/d44/l7b 0 2024-09-16T01:25:15.042 INFO:tasks.workunit.client.0.smithi063.stdout:0/384: getdents d1/df/d2c/d43/d89 0 2024-09-16T01:25:15.043 INFO:tasks.workunit.client.0.smithi063.stdout:5/416: dwrite d5/d12/d35/f59 [0,4194304] 0 2024-09-16T01:25:15.044 INFO:tasks.workunit.client.0.smithi063.stdout:0/385: write d1/d30/d52/d5a/f3e [2861302,100309] 0 2024-09-16T01:25:15.045 INFO:tasks.workunit.client.0.smithi063.stdout:5/417: write d5/d18/f6e [1009552,100150] 0 2024-09-16T01:25:15.048 INFO:tasks.workunit.client.0.smithi063.stdout:4/345: mknod d5/d3b/df/d1c/d29/c69 0 2024-09-16T01:25:15.048 INFO:tasks.workunit.client.0.smithi063.stdout:8/251: write d5/d9/f35 [1032410,123712] 0 2024-09-16T01:25:15.052 INFO:tasks.workunit.client.0.smithi063.stdout:0/386: creat d1/d2e/d48/f98 x:0 0 0 2024-09-16T01:25:15.053 INFO:tasks.workunit.client.0.smithi063.stdout:8/252: dread d5/db/d12/f15 [0,4194304] 0 2024-09-16T01:25:15.053 INFO:tasks.workunit.client.0.smithi063.stdout:8/253: dread - d5/f3b zero size 2024-09-16T01:25:15.054 INFO:tasks.workunit.client.0.smithi063.stdout:0/387: truncate d1/d30/d52/d5a/d44/f64 164291 0 2024-09-16T01:25:15.054 INFO:tasks.workunit.client.0.smithi063.stdout:2/446: rename d3/d7/d8/d1f/f3a to d3/d7/d8/d1f/d34/f9b 0 2024-09-16T01:25:15.054 INFO:tasks.workunit.client.0.smithi063.stdout:8/254: dread - d5/db/f47 zero size 2024-09-16T01:25:15.055 INFO:tasks.workunit.client.0.smithi063.stdout:5/418: symlink d5/d18/d4b/l8e 0 2024-09-16T01:25:15.056 INFO:tasks.workunit.client.0.smithi063.stdout:2/447: read f0 [216982,35129] 0 2024-09-16T01:25:15.056 INFO:tasks.workunit.client.0.smithi063.stdout:0/388: write d1/d30/d52/d5a/f3d [1560892,27573] 0 2024-09-16T01:25:15.057 INFO:tasks.workunit.client.0.smithi063.stdout:8/255: truncate d5/db/f2a 221971 0 2024-09-16T01:25:15.058 INFO:tasks.workunit.client.0.smithi063.stdout:4/346: dread - d5/d3b/df/d1c/d29/d20/d30/f4c zero size 2024-09-16T01:25:15.058 INFO:tasks.workunit.client.0.smithi063.stdout:5/419: write d5/d18/d4b/f68 [779031,95769] 0 2024-09-16T01:25:15.060 INFO:tasks.workunit.client.0.smithi063.stdout:5/420: truncate d5/f31 173486 0 2024-09-16T01:25:15.060 INFO:tasks.workunit.client.0.smithi063.stdout:0/389: symlink d1/d30/d95/l99 0 2024-09-16T01:25:15.060 INFO:tasks.workunit.client.0.smithi063.stdout:6/334: getdents d3/d48 0 2024-09-16T01:25:15.061 INFO:tasks.workunit.client.0.smithi063.stdout:8/256: mknod d5/d9/d41/c52 0 2024-09-16T01:25:15.063 INFO:tasks.workunit.client.0.smithi063.stdout:4/347: chown d5/d3b/df/d1c/d29/d32/f5b 15248196 1 2024-09-16T01:25:15.063 INFO:tasks.workunit.client.0.smithi063.stdout:4/348: dread - d5/d3b/d57/f67 zero size 2024-09-16T01:25:15.065 INFO:tasks.workunit.client.0.smithi063.stdout:4/349: dread - d5/d3b/df/d1c/d29/d32/f5e zero size 2024-09-16T01:25:15.065 INFO:tasks.workunit.client.0.smithi063.stdout:2/448: mkdir d3/d7/d8/d19/d8c/d21/d9c 0 2024-09-16T01:25:15.067 INFO:tasks.workunit.client.0.smithi063.stdout:8/257: rename d5/d9/d2f/c31 to d5/db/d12/d3d/c53 0 2024-09-16T01:25:15.068 INFO:tasks.workunit.client.0.smithi063.stdout:6/335: mknod d3/c7c 0 2024-09-16T01:25:15.069 INFO:tasks.workunit.client.0.smithi063.stdout:0/390: dwrite d1/f7 [0,4194304] 0 2024-09-16T01:25:15.069 INFO:tasks.workunit.client.0.smithi063.stdout:6/336: chown d3/d48/d28/c2c 8737255 1 2024-09-16T01:25:15.070 INFO:tasks.workunit.client.0.smithi063.stdout:4/350: symlink d5/d3b/df/d1c/d29/d32/d4e/l6a 0 2024-09-16T01:25:15.071 INFO:tasks.workunit.client.0.smithi063.stdout:2/449: symlink d3/d7/d8/l9d 0 2024-09-16T01:25:15.072 INFO:tasks.workunit.client.0.smithi063.stdout:8/258: dread d5/db/d12/f38 [0,4194304] 0 2024-09-16T01:25:15.072 INFO:tasks.workunit.client.0.smithi063.stdout:4/351: write d5/f6 [1965132,97233] 0 2024-09-16T01:25:15.072 INFO:tasks.workunit.client.0.smithi063.stdout:0/391: mkdir d1/df/d2c/d9a 0 2024-09-16T01:25:15.074 INFO:tasks.workunit.client.0.smithi063.stdout:6/337: mkdir d3/d10/d35/d5a/d6b/d7d 0 2024-09-16T01:25:15.076 INFO:tasks.workunit.client.0.smithi063.stdout:8/259: mkdir d5/db/d54 0 2024-09-16T01:25:15.078 INFO:tasks.workunit.client.0.smithi063.stdout:2/450: dwrite f2 [0,4194304] 0 2024-09-16T01:25:15.079 INFO:tasks.workunit.client.0.smithi063.stdout:4/352: symlink d5/d3b/df/d1c/d29/d32/l6b 0 2024-09-16T01:25:15.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/260: symlink d5/d9/l55 0 2024-09-16T01:25:15.081 INFO:tasks.workunit.client.0.smithi063.stdout:0/392: creat d1/d30/d52/d5a/f9b x:0 0 0 2024-09-16T01:25:15.081 INFO:tasks.workunit.client.0.smithi063.stdout:8/261: write d5/db/f47 [1045494,112112] 0 2024-09-16T01:25:15.083 INFO:tasks.workunit.client.0.smithi063.stdout:4/353: symlink d5/d3b/d57/l6c 0 2024-09-16T01:25:15.084 INFO:tasks.workunit.client.0.smithi063.stdout:6/338: dwrite d3/d10/f23 [4194304,4194304] 0 2024-09-16T01:25:15.086 INFO:tasks.workunit.client.0.smithi063.stdout:2/451: creat d3/d77/f9e x:0 0 0 2024-09-16T01:25:15.086 INFO:tasks.workunit.client.0.smithi063.stdout:4/354: creat d5/d3b/df/d1c/f6d x:0 0 0 2024-09-16T01:25:15.088 INFO:tasks.workunit.client.0.smithi063.stdout:6/339: mkdir d3/d48/d7e 0 2024-09-16T01:25:15.089 INFO:tasks.workunit.client.0.smithi063.stdout:0/393: creat d1/df/f9c x:0 0 0 2024-09-16T01:25:15.092 INFO:tasks.workunit.client.0.smithi063.stdout:4/355: unlink d5/d3b/df/d1c/d29/c69 0 2024-09-16T01:25:15.095 INFO:tasks.workunit.client.0.smithi063.stdout:0/394: mkdir d1/d30/d52/d9d 0 2024-09-16T01:25:15.096 INFO:tasks.workunit.client.0.smithi063.stdout:2/452: dwrite d3/d7/d8/d1f/f6c [0,4194304] 0 2024-09-16T01:25:15.099 INFO:tasks.workunit.client.0.smithi063.stdout:6/340: write d3/d48/d28/f2b [160481,35056] 0 2024-09-16T01:25:15.104 INFO:tasks.workunit.client.0.smithi063.stdout:6/341: write d3/d48/d28/d3e/f43 [4027180,80664] 0 2024-09-16T01:25:15.104 INFO:tasks.workunit.client.0.smithi063.stdout:2/453: dread - d3/d7/d8/f70 zero size 2024-09-16T01:25:15.104 INFO:tasks.workunit.client.0.smithi063.stdout:4/356: creat d5/d3b/d57/d66/f6e x:0 0 0 2024-09-16T01:25:15.104 INFO:tasks.workunit.client.0.smithi063.stdout:0/395: creat d1/d30/d52/d5a/f9e x:0 0 0 2024-09-16T01:25:15.105 INFO:tasks.workunit.client.0.smithi063.stdout:6/342: symlink d3/d10/d35/d56/l7f 0 2024-09-16T01:25:15.105 INFO:tasks.workunit.client.0.smithi063.stdout:6/343: readlink d3/d10/d35/d5a/l76 0 2024-09-16T01:25:15.106 INFO:tasks.workunit.client.0.smithi063.stdout:6/344: stat d3/d48 0 2024-09-16T01:25:15.106 INFO:tasks.workunit.client.0.smithi063.stdout:4/357: creat d5/d3b/df/d1c/d29/d32/d4e/f6f x:0 0 0 2024-09-16T01:25:15.108 INFO:tasks.workunit.client.0.smithi063.stdout:4/358: fdatasync d5/d3b/df/d1c/f53 0 2024-09-16T01:25:15.108 INFO:tasks.workunit.client.0.smithi063.stdout:2/454: mkdir d3/d7/d8/d1f/d34/d45/d6e/d9f 0 2024-09-16T01:25:15.110 INFO:tasks.workunit.client.0.smithi063.stdout:6/345: unlink d3/d10/d35/l74 0 2024-09-16T01:25:15.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/262: getdents d5/db 0 2024-09-16T01:25:15.115 INFO:tasks.workunit.client.0.smithi063.stdout:0/396: getdents d1/d2e 0 2024-09-16T01:25:15.116 INFO:tasks.workunit.client.0.smithi063.stdout:6/346: dread d3/d10/d49/f5c [0,4194304] 0 2024-09-16T01:25:15.116 INFO:tasks.workunit.client.0.smithi063.stdout:0/397: stat d1/d1c/l8c 0 2024-09-16T01:25:15.118 INFO:tasks.workunit.client.0.smithi063.stdout:2/455: creat d3/d7/d8/d19/d8c/d21/d28/d4e/fa0 x:0 0 0 2024-09-16T01:25:15.122 INFO:tasks.workunit.client.0.smithi063.stdout:0/398: creat d1/d30/d52/f9f x:0 0 0 2024-09-16T01:25:15.125 INFO:tasks.workunit.client.0.smithi063.stdout:4/359: getdents d5/d3b/df 0 2024-09-16T01:25:15.125 INFO:tasks.workunit.client.0.smithi063.stdout:2/456: rmdir d3/d7/d8/d19 39 2024-09-16T01:25:15.125 INFO:tasks.workunit.client.0.smithi063.stdout:8/263: dwrite d5/d3a/d40/d4a/f4d [0,4194304] 0 2024-09-16T01:25:15.127 INFO:tasks.workunit.client.0.smithi063.stdout:0/399: creat d1/df/d2c/d43/fa0 x:0 0 0 2024-09-16T01:25:15.127 INFO:tasks.workunit.client.0.smithi063.stdout:6/347: dwrite d3/d48/d28/f77 [0,4194304] 0 2024-09-16T01:25:15.128 INFO:tasks.workunit.client.0.smithi063.stdout:4/360: dread - d5/d3b/d57/f67 zero size 2024-09-16T01:25:15.129 INFO:tasks.workunit.client.0.smithi063.stdout:6/348: write d3/f62 [602272,129447] 0 2024-09-16T01:25:15.132 INFO:tasks.workunit.client.0.smithi063.stdout:0/400: write d1/df/d17/f92 [4371220,103565] 0 2024-09-16T01:25:15.134 INFO:tasks.workunit.client.0.smithi063.stdout:8/264: creat d5/d9/d41/d4f/f56 x:0 0 0 2024-09-16T01:25:15.136 INFO:tasks.workunit.client.0.smithi063.stdout:6/349: fsync f2 0 2024-09-16T01:25:15.137 INFO:tasks.workunit.client.0.smithi063.stdout:4/361: mknod d5/d3b/df/d1c/d29/d20/d30/c70 0 2024-09-16T01:25:15.138 INFO:tasks.workunit.client.0.smithi063.stdout:4/362: write d5/d3b/df/d1c/f39 [678622,35221] 0 2024-09-16T01:25:15.138 INFO:tasks.workunit.client.0.smithi063.stdout:2/457: rmdir d3/d7/d8/d1f/d34/d45/d6e/d9f 0 2024-09-16T01:25:15.140 INFO:tasks.workunit.client.0.smithi063.stdout:4/363: truncate d5/d3b/df/d1c/f53 290191 0 2024-09-16T01:25:15.140 INFO:tasks.workunit.client.0.smithi063.stdout:0/401: creat d1/df/d2c/d9a/fa1 x:0 0 0 2024-09-16T01:25:15.143 INFO:tasks.workunit.client.0.smithi063.stdout:6/350: symlink d3/d30/d39/d69/l80 0 2024-09-16T01:25:15.144 INFO:tasks.workunit.client.0.smithi063.stdout:4/364: mkdir d5/d3b/df/d1c/d29/d20/d30/d71 0 2024-09-16T01:25:15.147 INFO:tasks.workunit.client.0.smithi063.stdout:0/402: rename d1/d30/d52/d5a/c2a to d1/df/d2c/d9a/ca2 0 2024-09-16T01:25:15.148 INFO:tasks.workunit.client.0.smithi063.stdout:0/403: write d1/f31 [1253163,97925] 0 2024-09-16T01:25:15.151 INFO:tasks.workunit.client.0.smithi063.stdout:8/265: truncate d5/d9/d2f/f3f 33546 0 2024-09-16T01:25:15.152 INFO:tasks.workunit.client.0.smithi063.stdout:4/365: dwrite d5/d3b/df/d1c/d29/d32/f64 [0,4194304] 0 2024-09-16T01:25:15.152 INFO:tasks.workunit.client.0.smithi063.stdout:0/404: read d1/d1c/f4b [1109867,123269] 0 2024-09-16T01:25:15.153 INFO:tasks.workunit.client.0.smithi063.stdout:0/405: chown d1/d30/d52/d5a/f3d 3803876 1 2024-09-16T01:25:15.155 INFO:tasks.workunit.client.0.smithi063.stdout:2/458: truncate d3/f60 677020 0 2024-09-16T01:25:15.156 INFO:tasks.workunit.client.0.smithi063.stdout:8/266: creat d5/db/d12/f57 x:0 0 0 2024-09-16T01:25:15.158 INFO:tasks.workunit.client.0.smithi063.stdout:8/267: chown d5/db/d12/d1a/d1e/f32 2334 1 2024-09-16T01:25:15.160 INFO:tasks.workunit.client.0.smithi063.stdout:0/406: dwrite d1/fa [0,4194304] 0 2024-09-16T01:25:15.161 INFO:tasks.workunit.client.0.smithi063.stdout:6/351: getdents d3/d48/d28/d3e 0 2024-09-16T01:25:15.162 INFO:tasks.workunit.client.0.smithi063.stdout:4/366: rmdir d5/d3b/df/d1c 39 2024-09-16T01:25:15.165 INFO:tasks.workunit.client.0.smithi063.stdout:0/407: creat d1/d30/d52/fa3 x:0 0 0 2024-09-16T01:25:15.168 INFO:tasks.workunit.client.0.smithi063.stdout:6/352: mkdir d3/d10/d35/d5a/d81 0 2024-09-16T01:25:15.169 INFO:tasks.workunit.client.0.smithi063.stdout:2/459: truncate d3/f6 1536068 0 2024-09-16T01:25:15.170 INFO:tasks.workunit.client.0.smithi063.stdout:2/460: fdatasync d3/d7/d8/d1f/d37/f74 0 2024-09-16T01:25:15.171 INFO:tasks.workunit.client.0.smithi063.stdout:8/268: creat d5/f58 x:0 0 0 2024-09-16T01:25:15.173 INFO:tasks.workunit.client.0.smithi063.stdout:4/367: mkdir d5/d3b/df/d1c/d29/d72 0 2024-09-16T01:25:15.173 INFO:tasks.workunit.client.0.smithi063.stdout:8/269: write d5/f10 [3110310,27718] 0 2024-09-16T01:25:15.173 INFO:tasks.workunit.client.0.smithi063.stdout:7/278: sync 2024-09-16T01:25:15.175 INFO:tasks.workunit.client.0.smithi063.stdout:0/408: creat d1/df/fa4 x:0 0 0 2024-09-16T01:25:15.175 INFO:tasks.workunit.client.0.smithi063.stdout:4/368: dread - d5/d3b/df/d1c/d29/d20/d30/f4c zero size 2024-09-16T01:25:15.176 INFO:tasks.workunit.client.0.smithi063.stdout:0/409: fsync d1/df/d34/f79 0 2024-09-16T01:25:15.176 INFO:tasks.workunit.client.0.smithi063.stdout:7/279: read d7/d18/f45 [3346630,1539] 0 2024-09-16T01:25:15.177 INFO:tasks.workunit.client.0.smithi063.stdout:4/369: fdatasync d5/d3b/df/d1c/d29/d20/f23 0 2024-09-16T01:25:15.177 INFO:tasks.workunit.client.0.smithi063.stdout:0/410: chown d1/d30/d52/d5a/d36/d41 1939708 1 2024-09-16T01:25:15.183 INFO:tasks.workunit.client.0.smithi063.stdout:8/270: link d5/c26 d5/db/d12/d1a/d1e/c59 0 2024-09-16T01:25:15.184 INFO:tasks.workunit.client.0.smithi063.stdout:0/411: dwrite d1/d30/f93 [0,4194304] 0 2024-09-16T01:25:15.185 INFO:tasks.workunit.client.0.smithi063.stdout:4/370: mknod d5/d3b/df/d1c/d29/d72/c73 0 2024-09-16T01:25:15.186 INFO:tasks.workunit.client.0.smithi063.stdout:2/461: truncate d3/d7/f22 4934014 0 2024-09-16T01:25:15.188 INFO:tasks.workunit.client.0.smithi063.stdout:7/280: write d7/f14 [330319,116716] 0 2024-09-16T01:25:15.190 INFO:tasks.workunit.client.0.smithi063.stdout:8/271: rename d5/d9/d41/d4f to d5/db/d12/d1a/d5a 0 2024-09-16T01:25:15.192 INFO:tasks.workunit.client.0.smithi063.stdout:2/462: chown d3/d7/d8/d19/d3c/d58/c62 23 1 2024-09-16T01:25:15.194 INFO:tasks.workunit.client.0.smithi063.stdout:0/412: dwrite d1/df/d34/f5e [0,4194304] 0 2024-09-16T01:25:15.196 INFO:tasks.workunit.client.0.smithi063.stdout:7/281: symlink d7/d18/d25/l54 0 2024-09-16T01:25:15.196 INFO:tasks.workunit.client.0.smithi063.stdout:0/413: read - d1/d2e/d48/f98 zero size 2024-09-16T01:25:15.198 INFO:tasks.workunit.client.0.smithi063.stdout:8/272: symlink d5/d3a/d40/l5b 0 2024-09-16T01:25:15.198 INFO:tasks.workunit.client.0.smithi063.stdout:4/371: dwrite d5/d3b/f1d [4194304,4194304] 0 2024-09-16T01:25:15.200 INFO:tasks.workunit.client.0.smithi063.stdout:0/414: chown d1/d1c/c2b 41012173 1 2024-09-16T01:25:15.201 INFO:tasks.workunit.client.0.smithi063.stdout:4/372: write d5/d3b/f19 [1317463,6301] 0 2024-09-16T01:25:15.202 INFO:tasks.workunit.client.0.smithi063.stdout:8/273: chown d5/db/d12/d3d/c53 270839 1 2024-09-16T01:25:15.203 INFO:tasks.workunit.client.0.smithi063.stdout:2/463: write d3/f6 [763298,71155] 0 2024-09-16T01:25:15.204 INFO:tasks.workunit.client.0.smithi063.stdout:7/282: dread d7/ff [0,4194304] 0 2024-09-16T01:25:15.204 INFO:tasks.workunit.client.0.smithi063.stdout:0/415: truncate d1/d30/d52/d5a/f3d 2377664 0 2024-09-16T01:25:15.206 INFO:tasks.workunit.client.0.smithi063.stdout:8/274: mknod d5/d3a/d40/c5c 0 2024-09-16T01:25:15.206 INFO:tasks.workunit.client.0.smithi063.stdout:7/283: chown d7/d1c/d1f/d29/f3f 1 1 2024-09-16T01:25:15.208 INFO:tasks.workunit.client.0.smithi063.stdout:2/464: fdatasync d3/d7/f3f 0 2024-09-16T01:25:15.208 INFO:tasks.workunit.client.0.smithi063.stdout:7/284: dread d7/ff [0,4194304] 0 2024-09-16T01:25:15.215 INFO:tasks.workunit.client.0.smithi063.stdout:4/373: truncate d5/d3b/df/f3e 4272143 0 2024-09-16T01:25:15.215 INFO:tasks.workunit.client.0.smithi063.stdout:0/416: truncate d1/df/d17/f92 1334506 0 2024-09-16T01:25:15.216 INFO:tasks.workunit.client.0.smithi063.stdout:8/275: dwrite d5/db/f2a [0,4194304] 0 2024-09-16T01:25:15.218 INFO:tasks.workunit.client.0.smithi063.stdout:9/510: sync 2024-09-16T01:25:15.218 INFO:tasks.workunit.client.0.smithi063.stdout:8/276: fdatasync d5/f3b 0 2024-09-16T01:25:15.219 INFO:tasks.workunit.client.0.smithi063.stdout:2/465: rename d3/d9a to d3/d7/d8/d19/d8c/d21/d28/d8a/da1 0 2024-09-16T01:25:15.222 INFO:tasks.workunit.client.0.smithi063.stdout:7/285: dwrite d7/d18/f1a [4194304,4194304] 0 2024-09-16T01:25:15.222 INFO:tasks.workunit.client.0.smithi063.stdout:0/417: symlink d1/d2e/d50/la5 0 2024-09-16T01:25:15.224 INFO:tasks.workunit.client.0.smithi063.stdout:4/374: getdents d5/d3b/df/d1c/d29/d20/d30/d71 0 2024-09-16T01:25:15.225 INFO:tasks.workunit.client.0.smithi063.stdout:0/418: mkdir d1/df/d34/da6 0 2024-09-16T01:25:15.226 INFO:tasks.workunit.client.0.smithi063.stdout:7/286: truncate d7/d1c/d1f/f4d 1023454 0 2024-09-16T01:25:15.229 INFO:tasks.workunit.client.0.smithi063.stdout:2/466: symlink d3/d7/d8/d1f/d34/d72/la2 0 2024-09-16T01:25:15.231 INFO:tasks.workunit.client.0.smithi063.stdout:2/467: readlink d3/d7/d8/d1f/d37/d4f/l65 0 2024-09-16T01:25:15.234 INFO:tasks.workunit.client.0.smithi063.stdout:7/287: rename d7/d18/f36 to d7/d18/d25/f55 0 2024-09-16T01:25:15.234 INFO:tasks.workunit.client.0.smithi063.stdout:0/419: dwrite d1/df/d17/f68 [0,4194304] 0 2024-09-16T01:25:15.236 INFO:tasks.workunit.client.0.smithi063.stdout:9/511: link d7/d9/d12/d14/d34/f6b d7/d9/d12/d14/d63/d5f/fb4 0 2024-09-16T01:25:15.237 INFO:tasks.workunit.client.0.smithi063.stdout:7/288: dread d7/d1c/d1f/d29/f3f [0,4194304] 0 2024-09-16T01:25:15.239 INFO:tasks.workunit.client.0.smithi063.stdout:7/289: readlink d7/d1c/d1f/d29/l53 0 2024-09-16T01:25:15.239 INFO:tasks.workunit.client.0.smithi063.stdout:8/277: getdents d5/db/d12/d3d 0 2024-09-16T01:25:15.241 INFO:tasks.workunit.client.0.smithi063.stdout:2/468: creat d3/d7/d8/d19/d8c/d21/d28/d8a/da1/fa3 x:0 0 0 2024-09-16T01:25:15.243 INFO:tasks.workunit.client.0.smithi063.stdout:2/469: write d3/d7/d8/d19/d3c/d53/d7f/d80/f95 [858458,127065] 0 2024-09-16T01:25:15.245 INFO:tasks.workunit.client.0.smithi063.stdout:8/278: dread d5/db/f47 [0,4194304] 0 2024-09-16T01:25:15.246 INFO:tasks.workunit.client.0.smithi063.stdout:0/420: write d1/d2e/f37 [142530,117960] 0 2024-09-16T01:25:15.247 INFO:tasks.workunit.client.0.smithi063.stdout:8/279: write d5/db/d12/f57 [662510,102087] 0 2024-09-16T01:25:15.247 INFO:tasks.workunit.client.0.smithi063.stdout:9/512: rmdir d7/d9/d12/d14/d63/d5f 39 2024-09-16T01:25:15.249 INFO:tasks.workunit.client.0.smithi063.stdout:4/375: truncate d5/d3b/df/d1c/d29/d32/d60/d61/f52 150825 0 2024-09-16T01:25:15.249 INFO:tasks.workunit.client.0.smithi063.stdout:9/513: write d7/d9/d20/f79 [3783617,93801] 0 2024-09-16T01:25:15.250 INFO:tasks.workunit.client.0.smithi063.stdout:2/470: chown d3/d7/d8/l48 74 1 2024-09-16T01:25:15.254 INFO:tasks.workunit.client.0.smithi063.stdout:0/421: rename d1/d2e/d50/c7a to d1/df/ca7 0 2024-09-16T01:25:15.255 INFO:tasks.workunit.client.0.smithi063.stdout:9/514: creat d7/d4a/d4d/d96/da2/fb5 x:0 0 0 2024-09-16T01:25:15.255 INFO:tasks.workunit.client.0.smithi063.stdout:4/376: mknod d5/d3b/df/d1c/d29/d20/d30/c74 0 2024-09-16T01:25:15.256 INFO:tasks.workunit.client.0.smithi063.stdout:8/280: link d5/db/l37 d5/d9/d2f/l5d 0 2024-09-16T01:25:15.257 INFO:tasks.workunit.client.0.smithi063.stdout:7/290: dread d7/d18/d25/f31 [0,4194304] 0 2024-09-16T01:25:15.258 INFO:tasks.workunit.client.0.smithi063.stdout:0/422: unlink d1/d30/d52/d5a/f19 0 2024-09-16T01:25:15.259 INFO:tasks.workunit.client.0.smithi063.stdout:2/471: dwrite d3/d7/d8/d1f/f6c [0,4194304] 0 2024-09-16T01:25:15.261 INFO:tasks.workunit.client.0.smithi063.stdout:4/377: write d5/d3b/df/d1c/d29/f5a [1439866,2513] 0 2024-09-16T01:25:15.263 INFO:tasks.workunit.client.0.smithi063.stdout:7/291: write d7/f19 [4933774,81032] 0 2024-09-16T01:25:15.263 INFO:tasks.workunit.client.0.smithi063.stdout:0/423: mknod d1/d2e/d50/ca8 0 2024-09-16T01:25:15.265 INFO:tasks.workunit.client.0.smithi063.stdout:9/515: creat d7/d9/d12/d14/fb6 x:0 0 0 2024-09-16T01:25:15.266 INFO:tasks.workunit.client.0.smithi063.stdout:8/281: dread d5/d3a/d40/d4a/f4d [0,4194304] 0 2024-09-16T01:25:15.267 INFO:tasks.workunit.client.0.smithi063.stdout:7/292: chown d7/d18/d25/c2d 118216 1 2024-09-16T01:25:15.270 INFO:tasks.workunit.client.0.smithi063.stdout:8/282: stat d5/d9/l55 0 2024-09-16T01:25:15.270 INFO:tasks.workunit.client.0.smithi063.stdout:0/424: mknod d1/d30/d52/d5a/d36/d41/ca9 0 2024-09-16T01:25:15.271 INFO:tasks.workunit.client.0.smithi063.stdout:2/472: dwrite d3/f4b [4194304,4194304] 0 2024-09-16T01:25:15.273 INFO:tasks.workunit.client.0.smithi063.stdout:4/378: dwrite d5/d3b/f1d [4194304,4194304] 0 2024-09-16T01:25:15.274 INFO:tasks.workunit.client.0.smithi063.stdout:8/283: chown d5/d3a/d40/d4a/f4d 90812 1 2024-09-16T01:25:15.278 INFO:tasks.workunit.client.0.smithi063.stdout:7/293: rename d7/d18/d25 to d7/d56 0 2024-09-16T01:25:15.279 INFO:tasks.workunit.client.0.smithi063.stdout:8/284: fdatasync d5/f3b 0 2024-09-16T01:25:15.282 INFO:tasks.workunit.client.0.smithi063.stdout:4/379: dread d5/d3b/f16 [0,4194304] 0 2024-09-16T01:25:15.282 INFO:tasks.workunit.client.0.smithi063.stdout:9/516: rename d7/d9/f13 to d7/d4a/d4d/d50/d7f/fb7 0 2024-09-16T01:25:15.283 INFO:tasks.workunit.client.0.smithi063.stdout:2/473: unlink d3/d7/d8/d1f/f64 0 2024-09-16T01:25:15.284 INFO:tasks.workunit.client.0.smithi063.stdout:7/294: mkdir d7/d56/d57 0 2024-09-16T01:25:15.286 INFO:tasks.workunit.client.0.smithi063.stdout:0/425: truncate d1/d1c/f2d 614603 0 2024-09-16T01:25:15.286 INFO:tasks.workunit.client.0.smithi063.stdout:8/285: symlink d5/db/d12/d1a/d1e/l5e 0 2024-09-16T01:25:15.286 INFO:tasks.workunit.client.0.smithi063.stdout:7/295: chown d7/d1c/d1f/d29/l53 950466 1 2024-09-16T01:25:15.287 INFO:tasks.workunit.client.0.smithi063.stdout:4/380: rename d5/d3b/df/d1c/d29/d20/d30/d71 to d5/d3b/df/d1c/d75 0 2024-09-16T01:25:15.289 INFO:tasks.workunit.client.0.smithi063.stdout:8/286: write d5/d3a/f43 [56606,129539] 0 2024-09-16T01:25:15.291 INFO:tasks.workunit.client.0.smithi063.stdout:0/426: dread - d1/df/fa4 zero size 2024-09-16T01:25:15.292 INFO:tasks.workunit.client.0.smithi063.stdout:4/381: dread - d5/d3b/df/d1c/d29/d32/d4e/f6f zero size 2024-09-16T01:25:15.292 INFO:tasks.workunit.client.0.smithi063.stdout:9/517: dwrite d7/d9/d12/d14/f29 [0,4194304] 0 2024-09-16T01:25:15.292 INFO:tasks.workunit.client.0.smithi063.stdout:7/296: dread d7/d1c/d1f/f2b [0,4194304] 0 2024-09-16T01:25:15.293 INFO:tasks.workunit.client.0.smithi063.stdout:2/474: rename d3/d7/d8/d1f/d37/d4f/l65 to d3/d7/la4 0 2024-09-16T01:25:15.295 INFO:tasks.workunit.client.0.smithi063.stdout:0/427: fdatasync d1/df/d17/f81 0 2024-09-16T01:25:15.297 INFO:tasks.workunit.client.0.smithi063.stdout:8/287: unlink d5/d9/f46 0 2024-09-16T01:25:15.298 INFO:tasks.workunit.client.0.smithi063.stdout:8/288: chown d5/d9/f24 0 1 2024-09-16T01:25:15.299 INFO:tasks.workunit.client.0.smithi063.stdout:7/297: rmdir d7/d18 39 2024-09-16T01:25:15.300 INFO:tasks.workunit.client.0.smithi063.stdout:2/475: creat d3/d7/d8/d19/fa5 x:0 0 0 2024-09-16T01:25:15.301 INFO:tasks.workunit.client.0.smithi063.stdout:9/518: creat d7/d9/d12/fb8 x:0 0 0 2024-09-16T01:25:15.301 INFO:tasks.workunit.client.0.smithi063.stdout:7/298: chown d7/l17 1 1 2024-09-16T01:25:15.302 INFO:tasks.workunit.client.0.smithi063.stdout:0/428: creat d1/d30/faa x:0 0 0 2024-09-16T01:25:15.302 INFO:tasks.workunit.client.0.smithi063.stdout:4/382: dread d5/d3b/df/d1c/d29/d32/f3c [0,4194304] 0 2024-09-16T01:25:15.303 INFO:tasks.workunit.client.0.smithi063.stdout:7/299: write d7/f19 [6037595,8011] 0 2024-09-16T01:25:15.304 INFO:tasks.workunit.client.0.smithi063.stdout:8/289: dread d5/db/d12/f57 [0,4194304] 0 2024-09-16T01:25:15.305 INFO:tasks.workunit.client.0.smithi063.stdout:4/383: symlink d5/d3b/d57/l76 0 2024-09-16T01:25:15.307 INFO:tasks.workunit.client.0.smithi063.stdout:0/429: mkdir d1/d2e/dab 0 2024-09-16T01:25:15.311 INFO:tasks.workunit.client.0.smithi063.stdout:4/384: mknod d5/d3b/df/d1c/d29/d72/c77 0 2024-09-16T01:25:15.312 INFO:tasks.workunit.client.0.smithi063.stdout:4/385: chown d5/d3b/df/d1c/d29/d32/d4e 3 1 2024-09-16T01:25:15.312 INFO:tasks.workunit.client.0.smithi063.stdout:4/386: truncate d5/d3b/f1d 9200389 0 2024-09-16T01:25:15.316 INFO:tasks.workunit.client.0.smithi063.stdout:8/290: creat d5/db/d12/d1a/f5f x:0 0 0 2024-09-16T01:25:15.317 INFO:tasks.workunit.client.0.smithi063.stdout:4/387: mkdir d5/d3b/d57/d68/d78 0 2024-09-16T01:25:15.317 INFO:tasks.workunit.client.0.smithi063.stdout:8/291: readlink d5/db/d12/d1a/l1c 0 2024-09-16T01:25:15.318 INFO:tasks.workunit.client.0.smithi063.stdout:7/300: write d7/ff [595973,25828] 0 2024-09-16T01:25:15.321 INFO:tasks.workunit.client.0.smithi063.stdout:4/388: creat d5/d3b/d57/f79 x:0 0 0 2024-09-16T01:25:15.322 INFO:tasks.workunit.client.0.smithi063.stdout:0/430: truncate d1/df/d34/f45 232502 0 2024-09-16T01:25:15.323 INFO:tasks.workunit.client.0.smithi063.stdout:2/476: dwrite d3/d7/f22 [0,4194304] 0 2024-09-16T01:25:15.325 INFO:tasks.workunit.client.0.smithi063.stdout:7/301: creat d7/d18/d40/f58 x:0 0 0 2024-09-16T01:25:15.326 INFO:tasks.workunit.client.0.smithi063.stdout:0/431: write d1/d30/d52/d5a/d36/d41/f4d [22807,64362] 0 2024-09-16T01:25:15.327 INFO:tasks.workunit.client.0.smithi063.stdout:2/477: write d3/d77/f9e [544882,52487] 0 2024-09-16T01:25:15.332 INFO:tasks.workunit.client.0.smithi063.stdout:4/389: dwrite d5/d3b/f2d [4194304,4194304] 0 2024-09-16T01:25:15.334 INFO:tasks.workunit.client.0.smithi063.stdout:4/390: stat d5/d3b/d57/f67 0 2024-09-16T01:25:15.334 INFO:tasks.workunit.client.0.smithi063.stdout:8/292: dwrite d5/db/f47 [0,4194304] 0 2024-09-16T01:25:15.335 INFO:tasks.workunit.client.0.smithi063.stdout:2/478: mknod d3/d7/d8/d1f/ca6 0 2024-09-16T01:25:15.336 INFO:tasks.workunit.client.0.smithi063.stdout:2/479: chown d3 258275 1 2024-09-16T01:25:15.336 INFO:tasks.workunit.client.0.smithi063.stdout:7/302: link d7/c33 d7/d1c/d1f/c59 0 2024-09-16T01:25:15.338 INFO:tasks.workunit.client.0.smithi063.stdout:4/391: mkdir d5/d3b/df/d1c/d29/d72/d7a 0 2024-09-16T01:25:15.338 INFO:tasks.workunit.client.0.smithi063.stdout:0/432: creat d1/d30/d52/d5a/fac x:0 0 0 2024-09-16T01:25:15.340 INFO:tasks.workunit.client.0.smithi063.stdout:2/480: mkdir d3/d7/d8/d1f/d37/d4f/da7 0 2024-09-16T01:25:15.341 INFO:tasks.workunit.client.0.smithi063.stdout:0/433: creat d1/d1c/fad x:0 0 0 2024-09-16T01:25:15.341 INFO:tasks.workunit.client.0.smithi063.stdout:8/293: getdents d5/db 0 2024-09-16T01:25:15.342 INFO:tasks.workunit.client.0.smithi063.stdout:8/294: truncate d5/d9/f24 501641 0 2024-09-16T01:25:15.343 INFO:tasks.workunit.client.0.smithi063.stdout:4/392: symlink d5/l7b 0 2024-09-16T01:25:15.343 INFO:tasks.workunit.client.0.smithi063.stdout:4/393: fdatasync d5/f6 0 2024-09-16T01:25:15.344 INFO:tasks.workunit.client.0.smithi063.stdout:2/481: creat d3/d7/d8/d1f/d34/d45/d6e/fa8 x:0 0 0 2024-09-16T01:25:15.347 INFO:tasks.workunit.client.0.smithi063.stdout:0/434: rename d1/d30/d52/d5a/fac to d1/d30/d52/d5a/d44/fae 0 2024-09-16T01:25:15.348 INFO:tasks.workunit.client.0.smithi063.stdout:4/394: creat d5/d3b/d57/d66/f7c x:0 0 0 2024-09-16T01:25:15.349 INFO:tasks.workunit.client.0.smithi063.stdout:4/395: write d5/d3b/df/d1c/d29/d32/d4e/f54 [353746,54765] 0 2024-09-16T01:25:15.351 INFO:tasks.workunit.client.0.smithi063.stdout:2/482: mkdir d3/d7/d8/d19/d8c/d21/d28/d8a/da1/da9 0 2024-09-16T01:25:15.351 INFO:tasks.workunit.client.0.smithi063.stdout:4/396: truncate d5/d3b/d57/d66/f6e 1048356 0 2024-09-16T01:25:15.352 INFO:tasks.workunit.client.0.smithi063.stdout:0/435: creat d1/d2e/d48/faf x:0 0 0 2024-09-16T01:25:15.353 INFO:tasks.workunit.client.0.smithi063.stdout:4/397: fsync d5/d3b/df/d1c/d29/f5a 0 2024-09-16T01:25:15.355 INFO:tasks.workunit.client.0.smithi063.stdout:0/436: symlink d1/d2e/d50/d6f/lb0 0 2024-09-16T01:25:15.356 INFO:tasks.workunit.client.0.smithi063.stdout:4/398: creat d5/d3b/d57/f7d x:0 0 0 2024-09-16T01:25:15.357 INFO:tasks.workunit.client.0.smithi063.stdout:4/399: fsync d5/f2e 0 2024-09-16T01:25:15.358 INFO:tasks.workunit.client.0.smithi063.stdout:0/437: unlink d1/d2e/d50/d6f/lb0 0 2024-09-16T01:25:15.358 INFO:tasks.workunit.client.0.smithi063.stdout:2/483: dwrite d3/d7/d8/d1f/d34/d45/d6e/fa8 [0,4194304] 0 2024-09-16T01:25:15.359 INFO:tasks.workunit.client.0.smithi063.stdout:0/438: stat d1/d1c/l72 0 2024-09-16T01:25:15.359 INFO:tasks.workunit.client.0.smithi063.stdout:4/400: write d5/d3b/df/d1c/f36 [5165928,90276] 0 2024-09-16T01:25:15.361 INFO:tasks.workunit.client.0.smithi063.stdout:2/484: write d3/d7/d8/d1f/d34/d45/d6e/fa8 [1282144,94332] 0 2024-09-16T01:25:15.362 INFO:tasks.workunit.client.0.smithi063.stdout:0/439: mkdir d1/df/db1 0 2024-09-16T01:25:15.363 INFO:tasks.workunit.client.0.smithi063.stdout:4/401: truncate d5/d3b/df/d1c/d29/d32/f5e 749596 0 2024-09-16T01:25:15.363 INFO:tasks.workunit.client.0.smithi063.stdout:0/440: write d1/d1c/f3f [6009981,111533] 0 2024-09-16T01:25:15.363 INFO:tasks.workunit.client.0.smithi063.stdout:2/485: chown d3/d7/d8/d19/d8c/d21/d28/d8a/da1/fa3 656934 1 2024-09-16T01:25:15.364 INFO:tasks.workunit.client.0.smithi063.stdout:4/402: readlink d5/d3b/df/l1a 0 2024-09-16T01:25:15.365 INFO:tasks.workunit.client.0.smithi063.stdout:4/403: chown d5/d3b/df/d1c/d29 930 1 2024-09-16T01:25:15.366 INFO:tasks.workunit.client.0.smithi063.stdout:2/486: truncate d3/d7/d8/d19/d3c/d53/d7f/d80/f87 502724 0 2024-09-16T01:25:15.368 INFO:tasks.workunit.client.0.smithi063.stdout:4/404: write d5/d3b/df/d1c/d29/f26 [4859384,96167] 0 2024-09-16T01:25:15.370 INFO:tasks.workunit.client.0.smithi063.stdout:0/441: creat d1/d30/d52/d5a/d36/fb2 x:0 0 0 2024-09-16T01:25:15.371 INFO:tasks.workunit.client.0.smithi063.stdout:2/487: mknod d3/d7/d8/d1f/d37/d4f/da7/caa 0 2024-09-16T01:25:15.372 INFO:tasks.workunit.client.0.smithi063.stdout:2/488: fdatasync d3/f4b 0 2024-09-16T01:25:15.372 INFO:tasks.workunit.client.0.smithi063.stdout:0/442: truncate d1/d1c/f2d 897787 0 2024-09-16T01:25:15.374 INFO:tasks.workunit.client.0.smithi063.stdout:2/489: dread d3/f60 [0,4194304] 0 2024-09-16T01:25:15.375 INFO:tasks.workunit.client.0.smithi063.stdout:4/405: dread d5/d3b/df/d1c/d29/f4a [0,4194304] 0 2024-09-16T01:25:15.377 INFO:tasks.workunit.client.0.smithi063.stdout:4/406: dread d5/d3b/d57/d66/f6e [0,4194304] 0 2024-09-16T01:25:15.379 INFO:tasks.workunit.client.0.smithi063.stdout:4/407: chown d5/d3b/df/d1c/d29/d32/f5e 34089 1 2024-09-16T01:25:15.379 INFO:tasks.workunit.client.0.smithi063.stdout:4/408: chown d5/c2c 0 1 2024-09-16T01:25:15.381 INFO:tasks.workunit.client.0.smithi063.stdout:4/409: symlink d5/d3b/df/d1c/d29/d20/l7e 0 2024-09-16T01:25:15.383 INFO:tasks.workunit.client.0.smithi063.stdout:4/410: write d5/d3b/f41 [843409,70575] 0 2024-09-16T01:25:15.385 INFO:tasks.workunit.client.0.smithi063.stdout:0/443: dread d1/d2e/f37 [0,4194304] 0 2024-09-16T01:25:15.386 INFO:tasks.workunit.client.0.smithi063.stdout:0/444: dread - d1/d2e/d48/faf zero size 2024-09-16T01:25:15.386 INFO:tasks.workunit.client.0.smithi063.stdout:0/445: fsync d1/d1c/f78 0 2024-09-16T01:25:15.395 INFO:tasks.workunit.client.0.smithi063.stdout:8/295: truncate d5/f25 1447916 0 2024-09-16T01:25:15.396 INFO:tasks.workunit.client.0.smithi063.stdout:8/296: fsync d5/d3a/d40/d4a/f4d 0 2024-09-16T01:25:15.397 INFO:tasks.workunit.client.0.smithi063.stdout:8/297: chown d5/db/d12/f57 3 1 2024-09-16T01:25:15.400 INFO:tasks.workunit.client.0.smithi063.stdout:2/490: truncate d3/d7/d8/d1f/d34/f9b 3921918 0 2024-09-16T01:25:15.401 INFO:tasks.workunit.client.0.smithi063.stdout:4/411: write d5/d3b/df/d1c/d29/d20/f44 [1833055,26636] 0 2024-09-16T01:25:15.403 INFO:tasks.workunit.client.0.smithi063.stdout:8/298: dwrite d5/db/d12/d1a/d1e/f32 [0,4194304] 0 2024-09-16T01:25:15.405 INFO:tasks.workunit.client.0.smithi063.stdout:8/299: truncate d5/d9/f24 990862 0 2024-09-16T01:25:15.406 INFO:tasks.workunit.client.0.smithi063.stdout:4/412: mkdir d5/d3b/df/d1c/d29/d32/d7f 0 2024-09-16T01:25:15.410 INFO:tasks.workunit.client.0.smithi063.stdout:4/413: readlink d5/d3b/df/d1c/d29/d20/l50 0 2024-09-16T01:25:15.410 INFO:tasks.workunit.client.0.smithi063.stdout:8/300: mkdir d5/db/d12/d1a/d60 0 2024-09-16T01:25:15.411 INFO:tasks.workunit.client.0.smithi063.stdout:2/491: dwrite d3/d7/d8/d19/d8c/d21/d28/d8a/da1/fa3 [0,4194304] 0 2024-09-16T01:25:15.411 INFO:tasks.workunit.client.0.smithi063.stdout:4/414: readlink d5/d3b/df/d1c/l3a 0 2024-09-16T01:25:15.413 INFO:tasks.workunit.client.0.smithi063.stdout:8/301: rmdir d5/db/d12/d1a/d5a 39 2024-09-16T01:25:15.416 INFO:tasks.workunit.client.0.smithi063.stdout:4/415: creat d5/d3b/df/d1c/d29/d20/d30/f80 x:0 0 0 2024-09-16T01:25:15.416 INFO:tasks.workunit.client.0.smithi063.stdout:2/492: rename d3/d7/d8/d1f/l90 to d3/d7/d8/d1f/d34/d45/lab 0 2024-09-16T01:25:15.416 INFO:tasks.workunit.client.0.smithi063.stdout:4/416: stat d5/d3b/df/d1c/d29/d32/f5b 0 2024-09-16T01:25:15.418 INFO:tasks.workunit.client.0.smithi063.stdout:4/417: fsync d5/d3b/d57/f7d 0 2024-09-16T01:25:15.419 INFO:tasks.workunit.client.0.smithi063.stdout:3/338: sync 2024-09-16T01:25:15.419 INFO:tasks.workunit.client.0.smithi063.stdout:8/302: creat d5/db/d54/f61 x:0 0 0 2024-09-16T01:25:15.420 INFO:tasks.workunit.client.0.smithi063.stdout:8/303: chown d5/c48 180 1 2024-09-16T01:25:15.420 INFO:tasks.workunit.client.0.smithi063.stdout:2/493: truncate d3/d7/d8/d19/d8c/d21/d28/d8a/da1/f5e 123564 0 2024-09-16T01:25:15.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/418: mknod d5/d3b/d5c/c81 0 2024-09-16T01:25:15.421 INFO:tasks.workunit.client.0.smithi063.stdout:3/339: symlink d2/d11/d37/d40/d5e/d3b/l7d 0 2024-09-16T01:25:15.423 INFO:tasks.workunit.client.0.smithi063.stdout:4/419: mknod d5/d3b/c82 0 2024-09-16T01:25:15.423 INFO:tasks.workunit.client.0.smithi063.stdout:3/340: rmdir d2/d11/d18/d41/d30 39 2024-09-16T01:25:15.424 INFO:tasks.workunit.client.0.smithi063.stdout:2/494: creat d3/d7/d8/d1f/fac x:0 0 0 2024-09-16T01:25:15.425 INFO:tasks.workunit.client.0.smithi063.stdout:4/420: write d5/d3b/f16 [1921992,2418] 0 2024-09-16T01:25:15.426 INFO:tasks.workunit.client.0.smithi063.stdout:2/495: truncate d3/f60 1517298 0 2024-09-16T01:25:15.429 INFO:tasks.workunit.client.0.smithi063.stdout:4/421: dread d5/d3b/df/d1c/f39 [0,4194304] 0 2024-09-16T01:25:15.431 INFO:tasks.workunit.client.0.smithi063.stdout:3/341: dwrite d2/d11/d37/d40/f53 [0,4194304] 0 2024-09-16T01:25:15.432 INFO:tasks.workunit.client.0.smithi063.stdout:4/422: write d5/d3b/df/d1c/d29/d20/f44 [2402138,62202] 0 2024-09-16T01:25:15.434 INFO:tasks.workunit.client.0.smithi063.stdout:4/423: chown d5/d3b/df/d1c/d29/d32/f64 21982 1 2024-09-16T01:25:15.436 INFO:tasks.workunit.client.0.smithi063.stdout:3/342: dread d2/d11/d37/d40/f6a [0,4194304] 0 2024-09-16T01:25:15.438 INFO:tasks.workunit.client.0.smithi063.stdout:2/496: truncate d3/d7/d8/d1f/f6c 52640 0 2024-09-16T01:25:15.439 INFO:tasks.workunit.client.0.smithi063.stdout:2/497: fsync d3/d7/d8/d1f/d37/f74 0 2024-09-16T01:25:15.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/424: rmdir d5/d3b/df/d1c/d75 0 2024-09-16T01:25:15.441 INFO:tasks.workunit.client.0.smithi063.stdout:2/498: dread - d3/d7/d8/d19/d3c/d58/f93 zero size 2024-09-16T01:25:15.441 INFO:tasks.workunit.client.0.smithi063.stdout:2/499: readlink d3/d7/l25 0 2024-09-16T01:25:15.442 INFO:tasks.workunit.client.0.smithi063.stdout:4/425: creat d5/d3b/df/d1c/d29/d72/d7a/f83 x:0 0 0 2024-09-16T01:25:15.444 INFO:tasks.workunit.client.0.smithi063.stdout:2/500: symlink d3/d7/d8/d1f/d37/d4f/da7/lad 0 2024-09-16T01:25:15.445 INFO:tasks.workunit.client.0.smithi063.stdout:2/501: chown d3/d7/d8/d1f/d37 31713 1 2024-09-16T01:25:15.446 INFO:tasks.workunit.client.0.smithi063.stdout:4/426: link d5/d3b/c82 d5/d3b/d57/d68/c84 0 2024-09-16T01:25:15.446 INFO:tasks.workunit.client.0.smithi063.stdout:2/502: write d3/d7/d8/d1f/fac [845016,26726] 0 2024-09-16T01:25:15.449 INFO:tasks.workunit.client.0.smithi063.stdout:3/343: dread d2/d11/f1d [0,4194304] 0 2024-09-16T01:25:15.450 INFO:tasks.workunit.client.0.smithi063.stdout:3/344: write d2/d11/d37/d40/d5e/d3b/d45/f50 [610682,74525] 0 2024-09-16T01:25:15.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/427: rename d5/d3b/df/d1c/d29/d20/d30/f80 to d5/d3b/d57/d68/f85 0 2024-09-16T01:25:15.452 INFO:tasks.workunit.client.0.smithi063.stdout:4/428: write d5/d3b/f1d [1342232,114799] 0 2024-09-16T01:25:15.453 INFO:tasks.workunit.client.0.smithi063.stdout:4/429: dread - d5/d3b/d57/f79 zero size 2024-09-16T01:25:15.454 INFO:tasks.workunit.client.0.smithi063.stdout:2/503: rmdir d3/d7/d8/d19/d8c/d21/d28/d8a/da1/da9 0 2024-09-16T01:25:15.457 INFO:tasks.workunit.client.0.smithi063.stdout:2/504: truncate d3/d7/d8/d19/d8c/d21/f8b 100624 0 2024-09-16T01:25:15.460 INFO:tasks.workunit.client.0.smithi063.stdout:2/505: unlink d3/d7/c79 0 2024-09-16T01:25:15.461 INFO:tasks.workunit.client.0.smithi063.stdout:4/430: dwrite d5/d3b/df/d1c/d29/d32/d4e/f6f [0,4194304] 0 2024-09-16T01:25:15.465 INFO:tasks.workunit.client.0.smithi063.stdout:2/506: mknod d3/d7/d8/d19/d8c/d21/d28/d8a/cae 0 2024-09-16T01:25:15.465 INFO:tasks.workunit.client.0.smithi063.stdout:3/345: dwrite d2/d11/d37/f74 [0,4194304] 0 2024-09-16T01:25:15.467 INFO:tasks.workunit.client.0.smithi063.stdout:2/507: write d3/d7/d8/d19/d8c/d21/d28/d8a/da1/fa3 [377104,44618] 0 2024-09-16T01:25:15.472 INFO:tasks.workunit.client.0.smithi063.stdout:3/346: creat d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/f7e x:0 0 0 2024-09-16T01:25:15.473 INFO:tasks.workunit.client.0.smithi063.stdout:3/347: fsync d2/d11/d37/d40/d5e/f36 0 2024-09-16T01:25:15.473 INFO:tasks.workunit.client.0.smithi063.stdout:2/508: creat d3/d7/d8/d1f/d37/d4f/da7/faf x:0 0 0 2024-09-16T01:25:15.474 INFO:tasks.workunit.client.0.smithi063.stdout:4/431: link d5/d3b/df/f3e d5/d3b/df/d1c/d29/d32/d60/d61/f86 0 2024-09-16T01:25:15.474 INFO:tasks.workunit.client.0.smithi063.stdout:2/509: readlink d3/d7/d8/d1f/d37/l4d 0 2024-09-16T01:25:15.476 INFO:tasks.workunit.client.0.smithi063.stdout:4/432: rename d5/c2c to d5/d3b/d57/d68/d78/c87 0 2024-09-16T01:25:15.478 INFO:tasks.workunit.client.0.smithi063.stdout:3/348: mkdir d2/d11/d18/d41/d30/d7f 0 2024-09-16T01:25:15.478 INFO:tasks.workunit.client.0.smithi063.stdout:2/510: symlink d3/d7/d8/d1f/d37/d4f/lb0 0 2024-09-16T01:25:15.479 INFO:tasks.workunit.client.0.smithi063.stdout:4/433: symlink d5/d3b/d57/l88 0 2024-09-16T01:25:15.480 INFO:tasks.workunit.client.0.smithi063.stdout:3/349: chown d2/d11/d18/d41/f5c 6 1 2024-09-16T01:25:15.481 INFO:tasks.workunit.client.0.smithi063.stdout:2/511: mknod d3/d7/d8/d19/d8c/d21/d28/d8a/cb1 0 2024-09-16T01:25:15.481 INFO:tasks.workunit.client.0.smithi063.stdout:3/350: fsync d2/d11/d37/d40/d5e/f65 0 2024-09-16T01:25:15.481 INFO:tasks.workunit.client.0.smithi063.stdout:3/351: read - d2/f4e zero size 2024-09-16T01:25:15.483 INFO:tasks.workunit.client.0.smithi063.stdout:3/352: mkdir d2/d11/d69/d80 0 2024-09-16T01:25:15.483 INFO:tasks.workunit.client.0.smithi063.stdout:3/353: dread - d2/f4e zero size 2024-09-16T01:25:15.484 INFO:tasks.workunit.client.0.smithi063.stdout:4/434: getdents d5/d3b/df 0 2024-09-16T01:25:15.485 INFO:tasks.workunit.client.0.smithi063.stdout:4/435: write d5/f3f [1618069,10675] 0 2024-09-16T01:25:15.485 INFO:tasks.workunit.client.0.smithi063.stdout:3/354: chown d2/d11/d37/l61 2 1 2024-09-16T01:25:15.487 INFO:tasks.workunit.client.0.smithi063.stdout:4/436: creat d5/d3b/df/d1c/d29/d72/d7a/f89 x:0 0 0 2024-09-16T01:25:15.488 INFO:tasks.workunit.client.0.smithi063.stdout:3/355: rmdir d2/d11/d37/d40 39 2024-09-16T01:25:15.490 INFO:tasks.workunit.client.0.smithi063.stdout:3/356: creat d2/f81 x:0 0 0 2024-09-16T01:25:15.491 INFO:tasks.workunit.client.0.smithi063.stdout:4/437: link d5/d3b/df/d1c/d29/d32/f5e d5/d3b/df/d1c/d29/d72/f8a 0 2024-09-16T01:25:15.492 INFO:tasks.workunit.client.0.smithi063.stdout:4/438: write d5/f2e [3301215,115420] 0 2024-09-16T01:25:15.493 INFO:tasks.workunit.client.0.smithi063.stdout:3/357: symlink d2/d11/d37/d40/d5e/l82 0 2024-09-16T01:25:15.495 INFO:tasks.workunit.client.0.smithi063.stdout:3/358: creat d2/d11/d18/f83 x:0 0 0 2024-09-16T01:25:15.498 INFO:tasks.workunit.client.0.smithi063.stdout:3/359: rename d2/d11/d37/d40/d5e/f67 to d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/f84 0 2024-09-16T01:25:15.503 INFO:tasks.workunit.client.0.smithi063.stdout:3/360: dwrite d2/d11/d37/d40/d5e/d3b/d45/f50 [0,4194304] 0 2024-09-16T01:25:15.517 INFO:tasks.workunit.client.0.smithi063.stdout:3/361: truncate d2/d11/d18/f3f 27104 0 2024-09-16T01:25:15.517 INFO:tasks.workunit.client.0.smithi063.stdout:3/362: readlink d2/d11/d18/d41/d30/l48 0 2024-09-16T01:25:15.518 INFO:tasks.workunit.client.0.smithi063.stdout:3/363: truncate d2/d11/d18/f2d 800277 0 2024-09-16T01:25:15.519 INFO:tasks.workunit.client.0.smithi063.stdout:3/364: write d2/d11/d18/f42 [6369202,79732] 0 2024-09-16T01:25:15.520 INFO:tasks.workunit.client.0.smithi063.stdout:3/365: write d2/d11/d18/d41/f2f [3736901,38902] 0 2024-09-16T01:25:15.522 INFO:tasks.workunit.client.0.smithi063.stdout:3/366: mkdir d2/d11/d69/d85 0 2024-09-16T01:25:15.522 INFO:tasks.workunit.client.0.smithi063.stdout:3/367: stat d2/c2c 0 2024-09-16T01:25:15.528 INFO:tasks.workunit.client.0.smithi063.stdout:3/368: getdents d2/d11/d37/d40/d5e/d3b/d45 0 2024-09-16T01:25:15.532 INFO:tasks.workunit.client.0.smithi063.stdout:3/369: link d2/d11/f34 d2/d11/d18/d41/d30/d7f/f86 0 2024-09-16T01:25:15.534 INFO:tasks.workunit.client.0.smithi063.stdout:3/370: mknod d2/c87 0 2024-09-16T01:25:15.537 INFO:tasks.workunit.client.0.smithi063.stdout:3/371: creat d2/d11/d37/f88 x:0 0 0 2024-09-16T01:25:15.540 INFO:tasks.workunit.client.0.smithi063.stdout:3/372: creat d2/d11/d37/d40/d5e/d3b/f89 x:0 0 0 2024-09-16T01:25:15.575 INFO:tasks.workunit.client.0.smithi063.stdout:1/396: sync 2024-09-16T01:25:15.590 INFO:tasks.workunit.client.0.smithi063.stdout:3/373: dread d2/d11/d37/d40/d5e/d3b/d45/f6c [0,4194304] 0 2024-09-16T01:25:15.591 INFO:tasks.workunit.client.0.smithi063.stdout:3/374: dread - d2/d11/d18/d41/d30/d7f/f86 zero size 2024-09-16T01:25:15.591 INFO:tasks.workunit.client.0.smithi063.stdout:3/375: readlink d2/d11/d37/d40/d5e/l46 0 2024-09-16T01:25:15.592 INFO:tasks.workunit.client.0.smithi063.stdout:1/397: mknod d1/d5/d15/d18/d7c/c88 0 2024-09-16T01:25:15.595 INFO:tasks.workunit.client.0.smithi063.stdout:3/376: mkdir d2/d11/d69/d80/d8a 0 2024-09-16T01:25:15.596 INFO:tasks.workunit.client.0.smithi063.stdout:1/398: mknod d1/d5/d15/c89 0 2024-09-16T01:25:15.596 INFO:tasks.workunit.client.0.smithi063.stdout:1/399: fdatasync d1/dd/d3b/f58 0 2024-09-16T01:25:15.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/400: rename d1/d5/d15/d18/d4c to d1/d5/d15/d1b/d31/d77/d8a 0 2024-09-16T01:25:15.673 INFO:tasks.workunit.client.0.smithi063.stdout:3/377: dwrite d2/d11/d37/d40/d5e/d3b/d45/f50 [4194304,4194304] 0 2024-09-16T01:25:15.674 INFO:tasks.workunit.client.0.smithi063.stdout:3/378: read - d2/d11/f34 zero size 2024-09-16T01:25:15.675 INFO:tasks.workunit.client.0.smithi063.stdout:1/401: creat d1/d12/f8b x:0 0 0 2024-09-16T01:25:15.680 INFO:tasks.workunit.client.0.smithi063.stdout:1/402: rename d1/d5/d15/d1b/d31/d77/d8a/f73 to d1/d5/d63/f8c 0 2024-09-16T01:25:15.681 INFO:tasks.workunit.client.0.smithi063.stdout:3/379: dwrite d2/d11/d18/f5d [0,4194304] 0 2024-09-16T01:25:15.684 INFO:tasks.workunit.client.0.smithi063.stdout:1/403: creat d1/d5/d15/d1b/d31/d77/d7d/f8d x:0 0 0 2024-09-16T01:25:15.686 INFO:tasks.workunit.client.0.smithi063.stdout:1/404: mknod d1/d5/d15/d18/d7c/c8e 0 2024-09-16T01:25:15.689 INFO:tasks.workunit.client.0.smithi063.stdout:3/380: dwrite d2/d11/d37/d40/d5e/d3b/d45/f50 [4194304,4194304] 0 2024-09-16T01:25:15.689 INFO:tasks.workunit.client.0.smithi063.stdout:1/405: truncate d1/d5/d15/f19 4081190 0 2024-09-16T01:25:15.692 INFO:tasks.workunit.client.0.smithi063.stdout:1/406: unlink d1/d5/d15/c4a 0 2024-09-16T01:25:15.695 INFO:tasks.workunit.client.0.smithi063.stdout:1/407: mkdir d1/d5/d6f/d8f 0 2024-09-16T01:25:15.695 INFO:tasks.workunit.client.0.smithi063.stdout:1/408: chown d1/f8 0 1 2024-09-16T01:25:15.697 INFO:tasks.workunit.client.0.smithi063.stdout:1/409: read - d1/d5/d15/d18/d4b/f6e zero size 2024-09-16T01:25:15.701 INFO:tasks.workunit.client.0.smithi063.stdout:3/381: truncate d2/d11/d37/d40/d5e/d3b/d45/f50 6276179 0 2024-09-16T01:25:15.701 INFO:tasks.workunit.client.0.smithi063.stdout:1/410: write d1/f3 [830258,86802] 0 2024-09-16T01:25:15.703 INFO:tasks.workunit.client.0.smithi063.stdout:3/382: unlink d2/d11/d18/ca 0 2024-09-16T01:25:15.704 INFO:tasks.workunit.client.0.smithi063.stdout:3/383: write d2/d11/d18/f42 [2236424,1966] 0 2024-09-16T01:25:15.705 INFO:tasks.workunit.client.0.smithi063.stdout:1/411: creat d1/d5/f90 x:0 0 0 2024-09-16T01:25:15.705 INFO:tasks.workunit.client.0.smithi063.stdout:3/384: readlink d2/d11/d18/l5f 0 2024-09-16T01:25:15.705 INFO:tasks.workunit.client.0.smithi063.stdout:1/412: fsync d1/d5/f80 0 2024-09-16T01:25:15.706 INFO:tasks.workunit.client.0.smithi063.stdout:1/413: fdatasync d1/dd/d3b/f44 0 2024-09-16T01:25:15.707 INFO:tasks.workunit.client.0.smithi063.stdout:3/385: mknod d2/d11/d18/d41/d30/c8b 0 2024-09-16T01:25:15.709 INFO:tasks.workunit.client.0.smithi063.stdout:3/386: symlink d2/d11/d18/d41/d30/d7f/l8c 0 2024-09-16T01:25:15.709 INFO:tasks.workunit.client.0.smithi063.stdout:3/387: fdatasync d2/f22 0 2024-09-16T01:25:15.711 INFO:tasks.workunit.client.0.smithi063.stdout:3/388: mknod d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/c8d 0 2024-09-16T01:25:15.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/389: stat d2/d11/d18/d41/f4d 0 2024-09-16T01:25:15.713 INFO:tasks.workunit.client.0.smithi063.stdout:3/390: mkdir d2/d11/d69/d80/d8a/d8e 0 2024-09-16T01:25:15.716 INFO:tasks.workunit.client.0.smithi063.stdout:5/421: sync 2024-09-16T01:25:15.716 INFO:tasks.workunit.client.0.smithi063.stdout:3/391: link d2/f22 d2/d11/d18/d41/d30/d7f/f8f 0 2024-09-16T01:25:15.717 INFO:tasks.workunit.client.0.smithi063.stdout:5/422: write d5/d12/f4c [1970284,66970] 0 2024-09-16T01:25:15.723 INFO:tasks.workunit.client.0.smithi063.stdout:5/423: getdents d5/d12 0 2024-09-16T01:25:15.724 INFO:tasks.workunit.client.0.smithi063.stdout:3/392: dwrite d2/d11/d18/d41/d30/d7f/f8f [4194304,4194304] 0 2024-09-16T01:25:15.724 INFO:tasks.workunit.client.0.smithi063.stdout:5/424: stat d5/d18/d4b 0 2024-09-16T01:25:15.727 INFO:tasks.workunit.client.0.smithi063.stdout:3/393: unlink d2/l35 0 2024-09-16T01:25:15.729 INFO:tasks.workunit.client.0.smithi063.stdout:3/394: mkdir d2/d5b/d90 0 2024-09-16T01:25:15.732 INFO:tasks.workunit.client.0.smithi063.stdout:3/395: symlink d2/d11/d37/d40/d5e/d3b/d68/d6d/l91 0 2024-09-16T01:25:15.733 INFO:tasks.workunit.client.0.smithi063.stdout:5/425: truncate d5/d18/d4b/f68 505625 0 2024-09-16T01:25:15.736 INFO:tasks.workunit.client.0.smithi063.stdout:3/396: creat d2/d11/d18/f92 x:0 0 0 2024-09-16T01:25:15.738 INFO:tasks.workunit.client.0.smithi063.stdout:3/397: creat d2/d11/d37/d40/d5e/f93 x:0 0 0 2024-09-16T01:25:15.739 INFO:tasks.workunit.client.0.smithi063.stdout:3/398: chown d2/f33 170532900 1 2024-09-16T01:25:15.740 INFO:tasks.workunit.client.0.smithi063.stdout:5/426: rename d5/d12/f45 to d5/d18/d29/d52/f8f 0 2024-09-16T01:25:15.742 INFO:tasks.workunit.client.0.smithi063.stdout:3/399: rmdir d2/d11/d37/d40/d5e 39 2024-09-16T01:25:15.743 INFO:tasks.workunit.client.0.smithi063.stdout:3/400: truncate d2/d11/d18/f6f 469272 0 2024-09-16T01:25:15.743 INFO:tasks.workunit.client.0.smithi063.stdout:5/427: mkdir d5/d90 0 2024-09-16T01:25:15.747 INFO:tasks.workunit.client.0.smithi063.stdout:5/428: rename d5/d18/d29/d5b to d5/d12/d91 0 2024-09-16T01:25:15.753 INFO:tasks.workunit.client.0.smithi063.stdout:3/401: rename d2/d11/d18/d41 to d2/d11/d37/d40/d5e/d3b/d94 0 2024-09-16T01:25:15.756 INFO:tasks.workunit.client.0.smithi063.stdout:3/402: dread d2/d11/d18/f6f [0,4194304] 0 2024-09-16T01:25:15.756 INFO:tasks.workunit.client.0.smithi063.stdout:5/429: rename d5/f3b to d5/d12/d35/f92 0 2024-09-16T01:25:15.759 INFO:tasks.workunit.client.0.smithi063.stdout:3/403: dread d2/d11/d18/f6f [0,4194304] 0 2024-09-16T01:25:15.765 INFO:tasks.workunit.client.0.smithi063.stdout:3/404: link d2/d11/d37/d40/d5e/d3b/d68/l72 d2/d11/d69/d85/l95 0 2024-09-16T01:25:15.767 INFO:tasks.workunit.client.0.smithi063.stdout:5/430: dread d5/d18/d4b/f68 [0,4194304] 0 2024-09-16T01:25:15.768 INFO:tasks.workunit.client.0.smithi063.stdout:5/431: truncate d5/d12/f56 1723131 0 2024-09-16T01:25:15.769 INFO:tasks.workunit.client.0.smithi063.stdout:3/405: mknod d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/c96 0 2024-09-16T01:25:15.769 INFO:tasks.workunit.client.0.smithi063.stdout:3/406: dread - d2/d11/d18/f83 zero size 2024-09-16T01:25:15.773 INFO:tasks.workunit.client.0.smithi063.stdout:5/432: link d5/d18/f24 d5/d12/d91/d72/f93 0 2024-09-16T01:25:15.775 INFO:tasks.workunit.client.0.smithi063.stdout:3/407: dwrite d2/d11/d18/f83 [0,4194304] 0 2024-09-16T01:25:15.775 INFO:tasks.workunit.client.0.smithi063.stdout:5/433: write d5/d18/d4b/f84 [1664243,56028] 0 2024-09-16T01:25:15.777 INFO:tasks.workunit.client.0.smithi063.stdout:3/408: stat d2/d11/d37/d40/d5e/d3b/d94/f5c 0 2024-09-16T01:25:15.777 INFO:tasks.workunit.client.0.smithi063.stdout:3/409: chown d2/d11/d37/d40/d5e/l4a 1996 1 2024-09-16T01:25:15.779 INFO:tasks.workunit.client.0.smithi063.stdout:3/410: dread - d2/d11/d37/d40/d5e/d3b/d94/f77 zero size 2024-09-16T01:25:15.780 INFO:tasks.workunit.client.0.smithi063.stdout:3/411: chown d2/d11/d37/d40/d5e/d3b/d94/c4f 28667 1 2024-09-16T01:25:15.781 INFO:tasks.workunit.client.0.smithi063.stdout:5/434: unlink d5/d18/l73 0 2024-09-16T01:25:15.781 INFO:tasks.workunit.client.0.smithi063.stdout:5/435: fdatasync d5/d18/d4b/f5f 0 2024-09-16T01:25:15.782 INFO:tasks.workunit.client.0.smithi063.stdout:3/412: mkdir d2/d11/d37/d40/d5e/d97 0 2024-09-16T01:25:15.785 INFO:tasks.workunit.client.0.smithi063.stdout:3/413: getdents d2/d11/d37/d40/d5e/d97 0 2024-09-16T01:25:15.788 INFO:tasks.workunit.client.0.smithi063.stdout:3/414: link d2/d11/d37/c4c d2/d5b/d90/c98 0 2024-09-16T01:25:15.789 INFO:tasks.workunit.client.0.smithi063.stdout:5/436: rename d5/d12/d35 to d5/d18/d4b/d94 0 2024-09-16T01:25:15.792 INFO:tasks.workunit.client.0.smithi063.stdout:3/415: rename d2/d11/d37/d40/f6a to d2/d11/d37/d40/d5e/d3b/d94/d30/f99 0 2024-09-16T01:25:15.794 INFO:tasks.workunit.client.0.smithi063.stdout:5/437: creat d5/d18/d29/d48/d7b/f95 x:0 0 0 2024-09-16T01:25:15.795 INFO:tasks.workunit.client.0.smithi063.stdout:3/416: dread d2/d11/f1d [0,4194304] 0 2024-09-16T01:25:15.796 INFO:tasks.workunit.client.0.smithi063.stdout:3/417: read - d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/f84 zero size 2024-09-16T01:25:15.839 INFO:tasks.workunit.client.0.smithi063.stdout:6/353: sync 2024-09-16T01:25:15.842 INFO:tasks.workunit.client.0.smithi063.stdout:6/354: unlink d3/d48/f58 0 2024-09-16T01:25:15.842 INFO:tasks.workunit.client.0.smithi063.stdout:6/355: stat d3/d10/f20 0 2024-09-16T01:25:15.843 INFO:tasks.workunit.client.0.smithi063.stdout:6/356: chown d3/f16 1213635 1 2024-09-16T01:25:15.845 INFO:tasks.workunit.client.0.smithi063.stdout:6/357: creat d3/d10/d35/d5a/d6b/f82 x:0 0 0 2024-09-16T01:25:15.848 INFO:tasks.workunit.client.0.smithi063.stdout:6/358: creat d3/d10/d35/d5a/d6b/d7d/f83 x:0 0 0 2024-09-16T01:25:15.849 INFO:tasks.workunit.client.0.smithi063.stdout:6/359: creat d3/d48/d7e/f84 x:0 0 0 2024-09-16T01:25:15.851 INFO:tasks.workunit.client.0.smithi063.stdout:6/360: creat d3/d48/d28/d3e/f85 x:0 0 0 2024-09-16T01:25:15.866 INFO:tasks.workunit.client.0.smithi063.stdout:6/361: write d3/d10/f2a [4705607,100241] 0 2024-09-16T01:25:15.866 INFO:tasks.workunit.client.0.smithi063.stdout:6/362: readlink d3/d30/l79 0 2024-09-16T01:25:15.920 INFO:tasks.workunit.client.0.smithi063.stdout:6/363: dwrite d3/d48/d28/f2b [0,4194304] 0 2024-09-16T01:25:15.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/364: dwrite f2 [0,4194304] 0 2024-09-16T01:25:15.935 INFO:tasks.workunit.client.0.smithi063.stdout:6/365: read - d3/d48/d7e/f84 zero size 2024-09-16T01:25:15.950 INFO:tasks.workunit.client.0.smithi063.stdout:6/366: dread d3/d10/d35/f3a [4194304,4194304] 0 2024-09-16T01:25:15.952 INFO:tasks.workunit.client.0.smithi063.stdout:6/367: mknod d3/c86 0 2024-09-16T01:25:15.956 INFO:tasks.workunit.client.0.smithi063.stdout:6/368: write d3/d10/d35/f50 [788233,67083] 0 2024-09-16T01:25:15.956 INFO:tasks.workunit.client.0.smithi063.stdout:6/369: dread - d3/d48/d28/d3e/d44/f6a zero size 2024-09-16T01:25:15.961 INFO:tasks.workunit.client.0.smithi063.stdout:0/446: sync 2024-09-16T01:25:15.961 INFO:tasks.workunit.client.0.smithi063.stdout:9/519: sync 2024-09-16T01:25:15.961 INFO:tasks.workunit.client.0.smithi063.stdout:7/303: sync 2024-09-16T01:25:15.961 INFO:tasks.workunit.client.0.smithi063.stdout:6/370: dwrite f2 [0,4194304] 0 2024-09-16T01:25:15.963 INFO:tasks.workunit.client.0.smithi063.stdout:9/520: stat d7/d4a/d4d/d50/d7f/f9e 0 2024-09-16T01:25:15.964 INFO:tasks.workunit.client.0.smithi063.stdout:7/304: symlink d7/d18/d39/l5a 0 2024-09-16T01:25:15.964 INFO:tasks.workunit.client.0.smithi063.stdout:9/521: fsync f4 0 2024-09-16T01:25:15.965 INFO:tasks.workunit.client.0.smithi063.stdout:7/305: chown d7/d56/l54 216 1 2024-09-16T01:25:15.966 INFO:tasks.workunit.client.0.smithi063.stdout:0/447: rename d1/df/d2c/d9a to d1/d30/d52/db3 0 2024-09-16T01:25:15.966 INFO:tasks.workunit.client.0.smithi063.stdout:7/306: read - d7/f48 zero size 2024-09-16T01:25:15.967 INFO:tasks.workunit.client.0.smithi063.stdout:9/522: mknod d7/d9/d12/d14/d34/cb9 0 2024-09-16T01:25:15.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/448: dread d1/d2e/f37 [0,4194304] 0 2024-09-16T01:25:15.970 INFO:tasks.workunit.client.0.smithi063.stdout:9/523: chown d7/cc 568001 1 2024-09-16T01:25:15.971 INFO:tasks.workunit.client.0.smithi063.stdout:0/449: stat d1/d2e/d50/d6f 0 2024-09-16T01:25:15.971 INFO:tasks.workunit.client.0.smithi063.stdout:6/371: getdents d3/d10/d35 0 2024-09-16T01:25:15.973 INFO:tasks.workunit.client.0.smithi063.stdout:0/450: write d1/d2e/d50/d6f/f82 [4204666,6746] 0 2024-09-16T01:25:15.976 INFO:tasks.workunit.client.0.smithi063.stdout:6/372: getdents d3/d48/d28/d3e/d44 0 2024-09-16T01:25:15.978 INFO:tasks.workunit.client.0.smithi063.stdout:6/373: fdatasync d3/d10/d35/d5a/f6d 0 2024-09-16T01:25:15.978 INFO:tasks.workunit.client.0.smithi063.stdout:9/524: dwrite d7/d9/d12/f42 [0,4194304] 0 2024-09-16T01:25:15.979 INFO:tasks.workunit.client.0.smithi063.stdout:0/451: link d1/d1c/f2d d1/fb4 0 2024-09-16T01:25:15.980 INFO:tasks.workunit.client.0.smithi063.stdout:7/307: dread d7/fe [0,4194304] 0 2024-09-16T01:25:15.980 INFO:tasks.workunit.client.0.smithi063.stdout:9/525: chown d7/d4a/d4d/d50/d7f/fb7 1621 1 2024-09-16T01:25:15.982 INFO:tasks.workunit.client.0.smithi063.stdout:9/526: stat d7/d9/d12/d14/d38/f8b 0 2024-09-16T01:25:15.982 INFO:tasks.workunit.client.0.smithi063.stdout:0/452: chown d1/d1c/c2b 53 1 2024-09-16T01:25:15.982 INFO:tasks.workunit.client.0.smithi063.stdout:9/527: chown d7/d9/d12/d14 1 1 2024-09-16T01:25:15.983 INFO:tasks.workunit.client.0.smithi063.stdout:7/308: mkdir d7/d18/d39/d5b 0 2024-09-16T01:25:15.987 INFO:tasks.workunit.client.0.smithi063.stdout:0/453: mkdir d1/d30/d95/db5 0 2024-09-16T01:25:15.989 INFO:tasks.workunit.client.0.smithi063.stdout:7/309: creat d7/d56/d57/f5c x:0 0 0 2024-09-16T01:25:15.989 INFO:tasks.workunit.client.0.smithi063.stdout:4/439: sync 2024-09-16T01:25:15.989 INFO:tasks.workunit.client.0.smithi063.stdout:8/304: sync 2024-09-16T01:25:15.989 INFO:tasks.workunit.client.0.smithi063.stdout:2/512: sync 2024-09-16T01:25:15.990 INFO:tasks.workunit.client.0.smithi063.stdout:9/528: rmdir d7/d9/d12/d14/d23/d9c 0 2024-09-16T01:25:15.992 INFO:tasks.workunit.client.0.smithi063.stdout:0/454: mkdir d1/df/d2c/db6 0 2024-09-16T01:25:15.992 INFO:tasks.workunit.client.0.smithi063.stdout:7/310: rmdir d7/d1c 39 2024-09-16T01:25:15.992 INFO:tasks.workunit.client.0.smithi063.stdout:8/305: mknod d5/db/d12/d3d/c62 0 2024-09-16T01:25:15.993 INFO:tasks.workunit.client.0.smithi063.stdout:2/513: stat d3/d7/d8/d1f/d37/d4f/f94 0 2024-09-16T01:25:15.995 INFO:tasks.workunit.client.0.smithi063.stdout:6/374: dwrite d3/d48/d28/f2b [4194304,4194304] 0 2024-09-16T01:25:15.996 INFO:tasks.workunit.client.0.smithi063.stdout:8/306: chown d5/db/d12/d1a/l4e 124058 1 2024-09-16T01:25:15.996 INFO:tasks.workunit.client.0.smithi063.stdout:7/311: write d7/d1c/d1f/d29/f52 [297780,45666] 0 2024-09-16T01:25:15.998 INFO:tasks.workunit.client.0.smithi063.stdout:7/312: readlink d7/d18/l3c 0 2024-09-16T01:25:15.999 INFO:tasks.workunit.client.0.smithi063.stdout:6/375: creat d3/d10/d35/d56/f87 x:0 0 0 2024-09-16T01:25:16.000 INFO:tasks.workunit.client.0.smithi063.stdout:7/313: dread d7/ff [0,4194304] 0 2024-09-16T01:25:16.000 INFO:tasks.workunit.client.0.smithi063.stdout:6/376: fsync d3/f65 0 2024-09-16T01:25:16.003 INFO:tasks.workunit.client.0.smithi063.stdout:9/529: rename d7/d4a/d4d/d50 to d7/d4a/dba 0 2024-09-16T01:25:16.004 INFO:tasks.workunit.client.0.smithi063.stdout:4/440: rename d5/d3b/df/d1c/d29/d20 to d5/d3b/df/d1c/d29/d20/d30/d8b 22 2024-09-16T01:25:16.005 INFO:tasks.workunit.client.0.smithi063.stdout:0/455: link d1/d2e/d48/l5d d1/d30/lb7 0 2024-09-16T01:25:16.008 INFO:tasks.workunit.client.0.smithi063.stdout:0/456: write d1/d2e/d50/d6f/f82 [3105511,126580] 0 2024-09-16T01:25:16.009 INFO:tasks.workunit.client.0.smithi063.stdout:9/530: dread d7/fa9 [0,4194304] 0 2024-09-16T01:25:16.009 INFO:tasks.workunit.client.0.smithi063.stdout:7/314: write d7/d1c/d1f/f32 [923208,124235] 0 2024-09-16T01:25:16.011 INFO:tasks.workunit.client.0.smithi063.stdout:6/377: mknod d3/d48/c88 0 2024-09-16T01:25:16.013 INFO:tasks.workunit.client.0.smithi063.stdout:7/315: chown d7/d18/l35 12 1 2024-09-16T01:25:16.013 INFO:tasks.workunit.client.0.smithi063.stdout:8/307: rename d5/db/d12/d1a/d5a to d5/db/d12/d1a/d60/d63 0 2024-09-16T01:25:16.013 INFO:tasks.workunit.client.0.smithi063.stdout:0/457: unlink d1/df/d17/c67 0 2024-09-16T01:25:16.014 INFO:tasks.workunit.client.0.smithi063.stdout:7/316: fdatasync d7/d18/d39/f42 0 2024-09-16T01:25:16.015 INFO:tasks.workunit.client.0.smithi063.stdout:2/514: dwrite d3/f60 [0,4194304] 0 2024-09-16T01:25:16.015 INFO:tasks.workunit.client.0.smithi063.stdout:9/531: mkdir d7/d4a/dba/d7f/dbb 0 2024-09-16T01:25:16.016 INFO:tasks.workunit.client.0.smithi063.stdout:6/378: mkdir d3/d41/d89 0 2024-09-16T01:25:16.016 INFO:tasks.workunit.client.0.smithi063.stdout:8/308: write d5/d3a/d40/d4a/f4d [3871292,4079] 0 2024-09-16T01:25:16.017 INFO:tasks.workunit.client.0.smithi063.stdout:4/441: creat d5/f8c x:0 0 0 2024-09-16T01:25:16.018 INFO:tasks.workunit.client.0.smithi063.stdout:9/532: chown d7/d9/l68 545951 1 2024-09-16T01:25:16.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/309: read - d5/db/d12/d1a/f4b zero size 2024-09-16T01:25:16.021 INFO:tasks.workunit.client.0.smithi063.stdout:8/310: write d5/d9/f16 [389952,8013] 0 2024-09-16T01:25:16.021 INFO:tasks.workunit.client.0.smithi063.stdout:6/379: creat d3/d10/d35/d56/f8a x:0 0 0 2024-09-16T01:25:16.022 INFO:tasks.workunit.client.0.smithi063.stdout:9/533: creat d7/d4a/dba/d7f/fbc x:0 0 0 2024-09-16T01:25:16.023 INFO:tasks.workunit.client.0.smithi063.stdout:7/317: link d7/d18/f44 d7/d1c/d1f/f5d 0 2024-09-16T01:25:16.024 INFO:tasks.workunit.client.0.smithi063.stdout:4/442: mknod d5/d3b/df/d1c/d29/d32/d60/c8d 0 2024-09-16T01:25:16.024 INFO:tasks.workunit.client.0.smithi063.stdout:6/380: write d3/f57 [404993,115812] 0 2024-09-16T01:25:16.025 INFO:tasks.workunit.client.0.smithi063.stdout:7/318: stat d7/fe 0 2024-09-16T01:25:16.029 INFO:tasks.workunit.client.0.smithi063.stdout:2/515: creat d3/d7/d8/d19/d3c/fb2 x:0 0 0 2024-09-16T01:25:16.029 INFO:tasks.workunit.client.0.smithi063.stdout:9/534: chown d7/d9/d12/d14/f65 6 1 2024-09-16T01:25:16.029 INFO:tasks.workunit.client.0.smithi063.stdout:0/458: dwrite d1/d2e/f37 [4194304,4194304] 0 2024-09-16T01:25:16.029 INFO:tasks.workunit.client.0.smithi063.stdout:7/319: read - d7/f48 zero size 2024-09-16T01:25:16.029 INFO:tasks.workunit.client.0.smithi063.stdout:8/311: rename d5/db/d12/f15 to d5/db/d12/f64 0 2024-09-16T01:25:16.029 INFO:tasks.workunit.client.0.smithi063.stdout:4/443: chown d5/d3b/df/d1c/f36 14287 1 2024-09-16T01:25:16.030 INFO:tasks.workunit.client.0.smithi063.stdout:0/459: chown d1/d30/faa 45 1 2024-09-16T01:25:16.031 INFO:tasks.workunit.client.0.smithi063.stdout:6/381: symlink d3/d10/d35/d5a/d6b/d7d/l8b 0 2024-09-16T01:25:16.031 INFO:tasks.workunit.client.0.smithi063.stdout:4/444: dread - d5/d3b/d57/f79 zero size 2024-09-16T01:25:16.031 INFO:tasks.workunit.client.0.smithi063.stdout:8/312: write d5/d3a/d40/f51 [581213,52825] 0 2024-09-16T01:25:16.034 INFO:tasks.workunit.client.0.smithi063.stdout:0/460: dread d1/d30/d52/d5a/d44/f64 [0,4194304] 0 2024-09-16T01:25:16.038 INFO:tasks.workunit.client.0.smithi063.stdout:8/313: rmdir d5 39 2024-09-16T01:25:16.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/320: creat d7/f5e x:0 0 0 2024-09-16T01:25:16.042 INFO:tasks.workunit.client.0.smithi063.stdout:7/321: chown d7/d18/d39/d5b 49240946 1 2024-09-16T01:25:16.043 INFO:tasks.workunit.client.0.smithi063.stdout:8/314: write d5/db/f47 [4676529,30935] 0 2024-09-16T01:25:16.044 INFO:tasks.workunit.client.0.smithi063.stdout:9/535: getdents d7/d4a 0 2024-09-16T01:25:16.045 INFO:tasks.workunit.client.0.smithi063.stdout:4/445: creat d5/d3b/df/d1c/d29/f8e x:0 0 0 2024-09-16T01:25:16.046 INFO:tasks.workunit.client.0.smithi063.stdout:2/516: dread d3/d7/d8/d1f/f3e [0,4194304] 0 2024-09-16T01:25:16.047 INFO:tasks.workunit.client.0.smithi063.stdout:0/461: creat d1/fb8 x:0 0 0 2024-09-16T01:25:16.047 INFO:tasks.workunit.client.0.smithi063.stdout:6/382: getdents d3/d48/d28/d3e/d68 0 2024-09-16T01:25:16.080 INFO:tasks.workunit.client.0.smithi063.stdout:4/446: rmdir d5/d3b/df/d1c/d29/d32/d60 39 2024-09-16T01:25:16.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/315: write d5/db/d12/f38 [179821,7863] 0 2024-09-16T01:25:16.081 INFO:tasks.workunit.client.0.smithi063.stdout:2/517: write d3/d7/f22 [3853345,3225] 0 2024-09-16T01:25:16.081 INFO:tasks.workunit.client.0.smithi063.stdout:6/383: mkdir d3/d48/d28/d3e/d44/d8c 0 2024-09-16T01:25:16.082 INFO:tasks.workunit.client.0.smithi063.stdout:0/462: creat d1/df/d2c/db6/fb9 x:0 0 0 2024-09-16T01:25:16.083 INFO:tasks.workunit.client.0.smithi063.stdout:4/447: dread - d5/d3b/d57/d68/f85 zero size 2024-09-16T01:25:16.083 INFO:tasks.workunit.client.0.smithi063.stdout:0/463: stat d1/df/d2c/db6 0 2024-09-16T01:25:16.084 INFO:tasks.workunit.client.0.smithi063.stdout:6/384: mkdir d3/d30/d8d 0 2024-09-16T01:25:16.084 INFO:tasks.workunit.client.0.smithi063.stdout:8/316: symlink d5/d3a/d40/d4a/l65 0 2024-09-16T01:25:16.086 INFO:tasks.workunit.client.0.smithi063.stdout:6/385: read d3/f65 [844900,3038] 0 2024-09-16T01:25:16.086 INFO:tasks.workunit.client.0.smithi063.stdout:4/448: fdatasync d5/d3b/df/d1c/d29/f4a 0 2024-09-16T01:25:16.086 INFO:tasks.workunit.client.0.smithi063.stdout:8/317: dread - d5/db/d12/d1a/d60/d63/f56 zero size 2024-09-16T01:25:16.088 INFO:tasks.workunit.client.0.smithi063.stdout:4/449: fsync d5/d3b/df/d1c/f31 0 2024-09-16T01:25:16.088 INFO:tasks.workunit.client.0.smithi063.stdout:8/318: write d5/db/d12/f38 [149919,96341] 0 2024-09-16T01:25:16.089 INFO:tasks.workunit.client.0.smithi063.stdout:6/386: creat d3/d10/d35/d56/f8e x:0 0 0 2024-09-16T01:25:16.091 INFO:tasks.workunit.client.0.smithi063.stdout:8/319: mknod d5/d3a/c66 0 2024-09-16T01:25:16.092 INFO:tasks.workunit.client.0.smithi063.stdout:8/320: dread - d5/f3b zero size 2024-09-16T01:25:16.094 INFO:tasks.workunit.client.0.smithi063.stdout:4/450: rmdir d5/d3b/df/d1c/d29/d32/d7f 0 2024-09-16T01:25:16.095 INFO:tasks.workunit.client.0.smithi063.stdout:9/536: dread d7/d9/d12/db2/f90 [0,4194304] 0 2024-09-16T01:25:16.096 INFO:tasks.workunit.client.0.smithi063.stdout:2/518: dread f0 [0,4194304] 0 2024-09-16T01:25:16.097 INFO:tasks.workunit.client.0.smithi063.stdout:6/387: dwrite f2 [0,4194304] 0 2024-09-16T01:25:16.099 INFO:tasks.workunit.client.0.smithi063.stdout:8/321: getdents d5/db/d12/d1a 0 2024-09-16T01:25:16.100 INFO:tasks.workunit.client.0.smithi063.stdout:9/537: mknod d7/d4a/d4d/d96/cbd 0 2024-09-16T01:25:16.100 INFO:tasks.workunit.client.0.smithi063.stdout:2/519: symlink d3/lb3 0 2024-09-16T01:25:16.102 INFO:tasks.workunit.client.0.smithi063.stdout:4/451: fdatasync d5/d3b/df/d1c/d29/d32/d60/d61/f52 0 2024-09-16T01:25:16.103 INFO:tasks.workunit.client.0.smithi063.stdout:9/538: creat d7/d9/d12/d14/d38/fbe x:0 0 0 2024-09-16T01:25:16.104 INFO:tasks.workunit.client.0.smithi063.stdout:4/452: chown d5/d3b/df/d1c/c63 699 1 2024-09-16T01:25:16.105 INFO:tasks.workunit.client.0.smithi063.stdout:2/520: chown d3/d7/d8/d1f/d34/d45/lab 4 1 2024-09-16T01:25:16.106 INFO:tasks.workunit.client.0.smithi063.stdout:6/388: dwrite d3/d30/f40 [0,4194304] 0 2024-09-16T01:25:16.108 INFO:tasks.workunit.client.0.smithi063.stdout:6/389: chown d3/d48/d28/d3e/f85 46416315 1 2024-09-16T01:25:16.108 INFO:tasks.workunit.client.0.smithi063.stdout:6/390: stat d3/d48/d28/d3e/f43 0 2024-09-16T01:25:16.110 INFO:tasks.workunit.client.0.smithi063.stdout:2/521: creat d3/d7/d8/d19/d3c/d53/fb4 x:0 0 0 2024-09-16T01:25:16.110 INFO:tasks.workunit.client.0.smithi063.stdout:6/391: write d3/d10/d35/d5a/f6d [602269,114883] 0 2024-09-16T01:25:16.111 INFO:tasks.workunit.client.0.smithi063.stdout:4/453: rename d5/d3b/d57/l76 to d5/d3b/df/d1c/d29/d20/d30/l8f 0 2024-09-16T01:25:16.115 INFO:tasks.workunit.client.0.smithi063.stdout:2/522: unlink d3/d7/l1c 0 2024-09-16T01:25:16.117 INFO:tasks.workunit.client.0.smithi063.stdout:6/392: rmdir d3/d48/d7e 39 2024-09-16T01:25:16.118 INFO:tasks.workunit.client.0.smithi063.stdout:4/454: mkdir d5/d3b/d57/d68/d90 0 2024-09-16T01:25:16.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/523: rename d3/d7/d8/l4a to d3/d7/d8/d19/d3c/d53/d7f/d80/lb5 0 2024-09-16T01:25:16.124 INFO:tasks.workunit.client.0.smithi063.stdout:9/539: write d7/d9/d12/d14/f46 [1214984,62701] 0 2024-09-16T01:25:16.125 INFO:tasks.workunit.client.0.smithi063.stdout:6/393: creat d3/d30/d8d/f8f x:0 0 0 2024-09-16T01:25:16.126 INFO:tasks.workunit.client.0.smithi063.stdout:9/540: write d7/d9/d12/d14/d38/fbe [180607,112160] 0 2024-09-16T01:25:16.126 INFO:tasks.workunit.client.0.smithi063.stdout:4/455: truncate d5/d3b/df/d1c/d29/d20/f23 406137 0 2024-09-16T01:25:16.127 INFO:tasks.workunit.client.0.smithi063.stdout:2/524: mkdir d3/d7/d8/d19/d8c/d21/d28/d8a/da1/db6 0 2024-09-16T01:25:16.128 INFO:tasks.workunit.client.0.smithi063.stdout:2/525: dread - d3/d7/d8/d19/fa5 zero size 2024-09-16T01:25:16.130 INFO:tasks.workunit.client.0.smithi063.stdout:9/541: unlink d7/d9/d12/d14/d38/fa3 0 2024-09-16T01:25:16.130 INFO:tasks.workunit.client.0.smithi063.stdout:9/542: readlink d7/d9/l18 0 2024-09-16T01:25:16.131 INFO:tasks.workunit.client.0.smithi063.stdout:4/456: mknod d5/d3b/df/d1c/d29/d32/d60/d61/c91 0 2024-09-16T01:25:16.132 INFO:tasks.workunit.client.0.smithi063.stdout:6/394: dwrite d3/d48/d28/d3e/d44/d52/f53 [0,4194304] 0 2024-09-16T01:25:16.134 INFO:tasks.workunit.client.0.smithi063.stdout:2/526: mkdir d3/d7/d8/d19/d8c/d21/d28/d8a/db7 0 2024-09-16T01:25:16.136 INFO:tasks.workunit.client.0.smithi063.stdout:9/543: creat d7/d4a/fbf x:0 0 0 2024-09-16T01:25:16.137 INFO:tasks.workunit.client.0.smithi063.stdout:4/457: fdatasync d5/d3b/df/d1c/d29/f65 0 2024-09-16T01:25:16.139 INFO:tasks.workunit.client.0.smithi063.stdout:9/544: symlink d7/d9/d12/lc0 0 2024-09-16T01:25:16.139 INFO:tasks.workunit.client.0.smithi063.stdout:6/395: read d3/d10/f1d [1434059,117962] 0 2024-09-16T01:25:16.139 INFO:tasks.workunit.client.0.smithi063.stdout:2/527: symlink d3/d7/d8/d1f/d34/lb8 0 2024-09-16T01:25:16.140 INFO:tasks.workunit.client.0.smithi063.stdout:6/396: read d3/d10/d35/f3a [6016737,88768] 0 2024-09-16T01:25:16.141 INFO:tasks.workunit.client.0.smithi063.stdout:9/545: mkdir d7/d4a/dba/d7f/dc1 0 2024-09-16T01:25:16.142 INFO:tasks.workunit.client.0.smithi063.stdout:4/458: dread d5/d3b/f2d [4194304,4194304] 0 2024-09-16T01:25:16.142 INFO:tasks.workunit.client.0.smithi063.stdout:2/528: symlink d3/lb9 0 2024-09-16T01:25:16.143 INFO:tasks.workunit.client.0.smithi063.stdout:6/397: unlink d3/d48/d28/c2c 0 2024-09-16T01:25:16.145 INFO:tasks.workunit.client.0.smithi063.stdout:3/418: sync 2024-09-16T01:25:16.145 INFO:tasks.workunit.client.0.smithi063.stdout:5/438: sync 2024-09-16T01:25:16.145 INFO:tasks.workunit.client.0.smithi063.stdout:1/414: sync 2024-09-16T01:25:16.145 INFO:tasks.workunit.client.0.smithi063.stdout:2/529: symlink d3/d7/d8/d19/d8c/d21/d28/d8a/lba 0 2024-09-16T01:25:16.150 INFO:tasks.workunit.client.0.smithi063.stdout:1/415: write d1/f3e [1012065,58107] 0 2024-09-16T01:25:16.150 INFO:tasks.workunit.client.0.smithi063.stdout:3/419: creat d2/d5b/f9a x:0 0 0 2024-09-16T01:25:16.151 INFO:tasks.workunit.client.0.smithi063.stdout:9/546: dwrite d7/d4a/dba/f45 [0,4194304] 0 2024-09-16T01:25:16.152 INFO:tasks.workunit.client.0.smithi063.stdout:5/439: mknod d5/c96 0 2024-09-16T01:25:16.153 INFO:tasks.workunit.client.0.smithi063.stdout:4/459: dwrite d5/d3b/f19 [0,4194304] 0 2024-09-16T01:25:16.155 INFO:tasks.workunit.client.0.smithi063.stdout:2/530: creat d3/d7/d8/d19/d3c/d58/fbb x:0 0 0 2024-09-16T01:25:16.156 INFO:tasks.workunit.client.0.smithi063.stdout:1/416: mknod d1/dd/c91 0 2024-09-16T01:25:16.157 INFO:tasks.workunit.client.0.smithi063.stdout:4/460: write d5/d3b/df/d1c/d29/d32/f5b [1949542,54806] 0 2024-09-16T01:25:16.159 INFO:tasks.workunit.client.0.smithi063.stdout:9/547: rename d7/d1f/f2f to d7/d9/d12/fc2 0 2024-09-16T01:25:16.168 INFO:tasks.workunit.client.0.smithi063.stdout:4/461: mkdir d5/d3b/df/d1c/d29/d20/d30/d92 0 2024-09-16T01:25:16.169 INFO:tasks.workunit.client.0.smithi063.stdout:6/398: write d3/d10/f34 [636068,96413] 0 2024-09-16T01:25:16.170 INFO:tasks.workunit.client.0.smithi063.stdout:2/531: mkdir d3/dbc 0 2024-09-16T01:25:16.172 INFO:tasks.workunit.client.0.smithi063.stdout:1/417: creat d1/d12/d21/f92 x:0 0 0 2024-09-16T01:25:16.172 INFO:tasks.workunit.client.0.smithi063.stdout:9/548: symlink d7/d9/d12/d14/lc3 0 2024-09-16T01:25:16.173 INFO:tasks.workunit.client.0.smithi063.stdout:2/532: read d3/d7/d8/d1f/d37/f7a [3601777,18244] 0 2024-09-16T01:25:16.174 INFO:tasks.workunit.client.0.smithi063.stdout:4/462: symlink d5/d3b/df/d1c/d29/d20/d30/l93 0 2024-09-16T01:25:16.174 INFO:tasks.workunit.client.0.smithi063.stdout:1/418: stat d1/d5/d15/d18/f42 0 2024-09-16T01:25:16.175 INFO:tasks.workunit.client.0.smithi063.stdout:9/549: write d7/d9/f74 [3545036,96910] 0 2024-09-16T01:25:16.176 INFO:tasks.workunit.client.0.smithi063.stdout:1/419: dread - d1/d12/f8b zero size 2024-09-16T01:25:16.178 INFO:tasks.workunit.client.0.smithi063.stdout:5/440: dread d5/d18/f24 [0,4194304] 0 2024-09-16T01:25:16.178 INFO:tasks.workunit.client.0.smithi063.stdout:6/399: dread d3/d10/f60 [0,4194304] 0 2024-09-16T01:25:16.178 INFO:tasks.workunit.client.0.smithi063.stdout:3/420: truncate d2/d11/d18/f83 2319625 0 2024-09-16T01:25:16.178 INFO:tasks.workunit.client.0.smithi063.stdout:4/463: chown d5/d3b/df/d1c/f36 362 1 2024-09-16T01:25:16.180 INFO:tasks.workunit.client.0.smithi063.stdout:2/533: creat d3/d7/d8/d19/d3c/d53/d7f/d80/fbd x:0 0 0 2024-09-16T01:25:16.181 INFO:tasks.workunit.client.0.smithi063.stdout:9/550: symlink d7/d4a/d9d/lc4 0 2024-09-16T01:25:16.181 INFO:tasks.workunit.client.0.smithi063.stdout:1/420: truncate d1/d5/d15/d18/d4b/f6e 597930 0 2024-09-16T01:25:16.181 INFO:tasks.workunit.client.0.smithi063.stdout:3/421: write d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/f7e [700608,60236] 0 2024-09-16T01:25:16.182 INFO:tasks.workunit.client.0.smithi063.stdout:1/421: chown d1/d12/d21/l2f 202918617 1 2024-09-16T01:25:16.183 INFO:tasks.workunit.client.0.smithi063.stdout:6/400: creat d3/d10/d35/d5a/d6b/f90 x:0 0 0 2024-09-16T01:25:16.184 INFO:tasks.workunit.client.0.smithi063.stdout:9/551: mknod d7/d4a/cc5 0 2024-09-16T01:25:16.185 INFO:tasks.workunit.client.0.smithi063.stdout:5/441: creat d5/d18/d29/f97 x:0 0 0 2024-09-16T01:25:16.186 INFO:tasks.workunit.client.0.smithi063.stdout:9/552: write d7/d9/d12/d14/d38/f8b [4026727,62034] 0 2024-09-16T01:25:16.188 INFO:tasks.workunit.client.0.smithi063.stdout:2/534: rename d3/d7/d8/d19/d3c/d53/d7f/d80/lb5 to d3/d7/d8/d19/d8c/d21/d9c/lbe 0 2024-09-16T01:25:16.189 INFO:tasks.workunit.client.0.smithi063.stdout:1/422: symlink d1/d5/d15/d1b/d31/d77/d86/l93 0 2024-09-16T01:25:16.190 INFO:tasks.workunit.client.0.smithi063.stdout:2/535: chown d3/d7/d8/d19/d8c/d21/d28 7 1 2024-09-16T01:25:16.191 INFO:tasks.workunit.client.0.smithi063.stdout:4/464: getdents d5/d3b/df/d1c 0 2024-09-16T01:25:16.192 INFO:tasks.workunit.client.0.smithi063.stdout:3/422: rename d2/d11/d37/d40/d5e/d3b/d94/f62 to d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/f9b 0 2024-09-16T01:25:16.193 INFO:tasks.workunit.client.0.smithi063.stdout:1/423: read d1/d5/d15/d18/d4b/f6e [390016,91989] 0 2024-09-16T01:25:16.195 INFO:tasks.workunit.client.0.smithi063.stdout:4/465: symlink d5/d3b/df/d1c/d29/l94 0 2024-09-16T01:25:16.196 INFO:tasks.workunit.client.0.smithi063.stdout:9/553: dwrite d7/d4a/dba/f54 [0,4194304] 0 2024-09-16T01:25:16.198 INFO:tasks.workunit.client.0.smithi063.stdout:1/424: creat d1/d5/d15/d18/d4b/f94 x:0 0 0 2024-09-16T01:25:16.198 INFO:tasks.workunit.client.0.smithi063.stdout:6/401: rename d3/d10/d35/d56 to d3/d48/d7e/d91 0 2024-09-16T01:25:16.200 INFO:tasks.workunit.client.0.smithi063.stdout:4/466: creat d5/d3b/df/f95 x:0 0 0 2024-09-16T01:25:16.201 INFO:tasks.workunit.client.0.smithi063.stdout:6/402: fsync d3/f65 0 2024-09-16T01:25:16.202 INFO:tasks.workunit.client.0.smithi063.stdout:1/425: creat d1/d5/d6f/f95 x:0 0 0 2024-09-16T01:25:16.202 INFO:tasks.workunit.client.0.smithi063.stdout:2/536: dwrite d3/d7/d8/d19/f75 [0,4194304] 0 2024-09-16T01:25:16.204 INFO:tasks.workunit.client.0.smithi063.stdout:1/426: read - d1/d5/f70 zero size 2024-09-16T01:25:16.214 INFO:tasks.workunit.client.0.smithi063.stdout:6/403: rmdir d3/d10/d35/d5a/d6b/d7d 39 2024-09-16T01:25:16.216 INFO:tasks.workunit.client.0.smithi063.stdout:9/554: dread d7/d9/d12/f52 [0,4194304] 0 2024-09-16T01:25:16.217 INFO:tasks.workunit.client.0.smithi063.stdout:1/427: unlink d1/d5/d63/f8c 0 2024-09-16T01:25:16.217 INFO:tasks.workunit.client.0.smithi063.stdout:9/555: truncate d7/fa8 28417 0 2024-09-16T01:25:16.219 INFO:tasks.workunit.client.0.smithi063.stdout:2/537: creat d3/d7/d8/d19/d8c/d21/d28/d8a/fbf x:0 0 0 2024-09-16T01:25:16.220 INFO:tasks.workunit.client.0.smithi063.stdout:9/556: truncate d7/f71 276135 0 2024-09-16T01:25:16.221 INFO:tasks.workunit.client.0.smithi063.stdout:5/442: rename d5/d18/d4b to d5/d18/d29/d48/d98 0 2024-09-16T01:25:16.223 INFO:tasks.workunit.client.0.smithi063.stdout:9/557: write d7/d1f/f8c [522578,76621] 0 2024-09-16T01:25:16.225 INFO:tasks.workunit.client.0.smithi063.stdout:6/404: dread d3/d10/f34 [0,4194304] 0 2024-09-16T01:25:16.227 INFO:tasks.workunit.client.0.smithi063.stdout:2/538: unlink d3/d7/d8/d1f/d34/d45/f76 0 2024-09-16T01:25:16.227 INFO:tasks.workunit.client.0.smithi063.stdout:1/428: dwrite d1/d5/d15/d1b/f39 [0,4194304] 0 2024-09-16T01:25:16.231 INFO:tasks.workunit.client.0.smithi063.stdout:4/467: truncate d5/d3b/df/d1c/f31 422042 0 2024-09-16T01:25:16.232 INFO:tasks.workunit.client.0.smithi063.stdout:3/423: truncate d2/d11/d37/d40/d5e/d3b/d94/d30/f57 3020663 0 2024-09-16T01:25:16.233 INFO:tasks.workunit.client.0.smithi063.stdout:4/468: readlink d5/d3b/df/d1c/d29/d20/l7e 0 2024-09-16T01:25:16.236 INFO:tasks.workunit.client.0.smithi063.stdout:4/469: chown d5/l7b 84 1 2024-09-16T01:25:16.237 INFO:tasks.workunit.client.0.smithi063.stdout:4/470: truncate d5/d3b/d57/d66/f7c 70601 0 2024-09-16T01:25:16.238 INFO:tasks.workunit.client.0.smithi063.stdout:6/405: mknod d3/d48/d28/c92 0 2024-09-16T01:25:16.239 INFO:tasks.workunit.client.0.smithi063.stdout:1/429: symlink d1/d12/d21/l96 0 2024-09-16T01:25:16.240 INFO:tasks.workunit.client.0.smithi063.stdout:5/443: creat d5/d90/f99 x:0 0 0 2024-09-16T01:25:16.240 INFO:tasks.workunit.client.0.smithi063.stdout:9/558: dwrite d7/fa9 [0,4194304] 0 2024-09-16T01:25:16.240 INFO:tasks.workunit.client.0.smithi063.stdout:4/471: dread d5/d3b/df/d1c/f39 [0,4194304] 0 2024-09-16T01:25:16.242 INFO:tasks.workunit.client.0.smithi063.stdout:1/430: write d1/d12/d21/f46 [2320205,25005] 0 2024-09-16T01:25:16.242 INFO:tasks.workunit.client.0.smithi063.stdout:3/424: rmdir d2/d11/d37/d40/d5e/d3b/d94 39 2024-09-16T01:25:16.245 INFO:tasks.workunit.client.0.smithi063.stdout:6/406: creat d3/d48/d7e/f93 x:0 0 0 2024-09-16T01:25:16.245 INFO:tasks.workunit.client.0.smithi063.stdout:5/444: chown d5/d18/d29/d48/f54 462667066 1 2024-09-16T01:25:16.250 INFO:tasks.workunit.client.0.smithi063.stdout:4/472: mknod d5/d3b/df/d1c/d29/d32/d60/d61/c96 0 2024-09-16T01:25:16.253 INFO:tasks.workunit.client.0.smithi063.stdout:3/425: chown d2/d11/d37/d40/d5e/d3b/d94/d30/d7f 171 1 2024-09-16T01:25:16.253 INFO:tasks.workunit.client.0.smithi063.stdout:5/445: mknod d5/d18/d29/c9a 0 2024-09-16T01:25:16.253 INFO:tasks.workunit.client.0.smithi063.stdout:4/473: dread - d5/d3b/df/d1c/d29/d20/d30/f4c zero size 2024-09-16T01:25:16.253 INFO:tasks.workunit.client.0.smithi063.stdout:3/426: chown d2 1024 1 2024-09-16T01:25:16.254 INFO:tasks.workunit.client.0.smithi063.stdout:9/559: dwrite d7/d9/d12/f77 [0,4194304] 0 2024-09-16T01:25:16.256 INFO:tasks.workunit.client.0.smithi063.stdout:4/474: write d5/d3b/df/d1c/f6d [567166,80439] 0 2024-09-16T01:25:16.256 INFO:tasks.workunit.client.0.smithi063.stdout:6/407: rename d3/c7c to d3/d10/d35/d5a/d6b/c94 0 2024-09-16T01:25:16.258 INFO:tasks.workunit.client.0.smithi063.stdout:5/446: truncate d5/d18/f24 3640190 0 2024-09-16T01:25:16.260 INFO:tasks.workunit.client.0.smithi063.stdout:6/408: readlink d3/d48/d7e/d91/l7f 0 2024-09-16T01:25:16.260 INFO:tasks.workunit.client.0.smithi063.stdout:5/447: readlink d5/d12/l2b 0 2024-09-16T01:25:16.261 INFO:tasks.workunit.client.0.smithi063.stdout:4/475: chown d5/d3b/df/d1c/d29/d72/c77 48 1 2024-09-16T01:25:16.262 INFO:tasks.workunit.client.0.smithi063.stdout:9/560: rename d7/d4a/dba/d7f/dbb to d7/d9/d12/db2/dc6 0 2024-09-16T01:25:16.263 INFO:tasks.workunit.client.0.smithi063.stdout:6/409: write d3/d10/f23 [4943796,64873] 0 2024-09-16T01:25:16.265 INFO:tasks.workunit.client.0.smithi063.stdout:5/448: creat d5/d18/d29/d48/f9b x:0 0 0 2024-09-16T01:25:16.265 INFO:tasks.workunit.client.0.smithi063.stdout:1/431: dwrite d1/d5/d15/f29 [0,4194304] 0 2024-09-16T01:25:16.266 INFO:tasks.workunit.client.0.smithi063.stdout:3/427: getdents d2/d11/d37/d40/d5e/d3b/d68 0 2024-09-16T01:25:16.267 INFO:tasks.workunit.client.0.smithi063.stdout:9/561: truncate d7/d9/d12/d14/d34/f84 4500516 0 2024-09-16T01:25:16.267 INFO:tasks.workunit.client.0.smithi063.stdout:4/476: chown d5/d3b/df/d1c/f31 678465 1 2024-09-16T01:25:16.267 INFO:tasks.workunit.client.0.smithi063.stdout:5/449: dread - d5/d18/d29/d48/d7b/f65 zero size 2024-09-16T01:25:16.272 INFO:tasks.workunit.client.0.smithi063.stdout:1/432: stat d1/d12/c68 0 2024-09-16T01:25:16.273 INFO:tasks.workunit.client.0.smithi063.stdout:7/322: sync 2024-09-16T01:25:16.274 INFO:tasks.workunit.client.0.smithi063.stdout:6/410: getdents d3/d10/d35/d5a/d81 0 2024-09-16T01:25:16.275 INFO:tasks.workunit.client.0.smithi063.stdout:6/411: chown d3/d48/d7e 0 1 2024-09-16T01:25:16.276 INFO:tasks.workunit.client.0.smithi063.stdout:1/433: dread d1/f3e [0,4194304] 0 2024-09-16T01:25:16.276 INFO:tasks.workunit.client.0.smithi063.stdout:9/562: rmdir d7/d9 39 2024-09-16T01:25:16.276 INFO:tasks.workunit.client.0.smithi063.stdout:6/412: chown d3/d10/d49/f5c 1253 1 2024-09-16T01:25:16.276 INFO:tasks.workunit.client.0.smithi063.stdout:6/413: stat d3/d10/d35/f50 0 2024-09-16T01:25:16.277 INFO:tasks.workunit.client.0.smithi063.stdout:9/563: dread d7/fa8 [0,4194304] 0 2024-09-16T01:25:16.278 INFO:tasks.workunit.client.0.smithi063.stdout:4/477: unlink d5/d3b/df/d1c/d29/d20/d30/f4c 0 2024-09-16T01:25:16.278 INFO:tasks.workunit.client.0.smithi063.stdout:6/414: write d3/d48/d7e/d91/f8a [134184,121896] 0 2024-09-16T01:25:16.280 INFO:tasks.workunit.client.0.smithi063.stdout:9/564: dread - d7/d1f/f67 zero size 2024-09-16T01:25:16.282 INFO:tasks.workunit.client.0.smithi063.stdout:7/323: write d7/d1c/d1f/f2b [842465,106428] 0 2024-09-16T01:25:16.284 INFO:tasks.workunit.client.0.smithi063.stdout:3/428: creat d2/f9c x:0 0 0 2024-09-16T01:25:16.286 INFO:tasks.workunit.client.0.smithi063.stdout:7/324: read d7/d1c/d1f/d29/f52 [59561,85361] 0 2024-09-16T01:25:16.286 INFO:tasks.workunit.client.0.smithi063.stdout:1/434: dwrite d1/d5/f13 [4194304,4194304] 0 2024-09-16T01:25:16.288 INFO:tasks.workunit.client.0.smithi063.stdout:6/415: mkdir d3/d30/d39/d69/d95 0 2024-09-16T01:25:16.290 INFO:tasks.workunit.client.0.smithi063.stdout:4/478: dread d5/d3b/df/d1c/d29/d32/d4e/f6f [0,4194304] 0 2024-09-16T01:25:16.292 INFO:tasks.workunit.client.0.smithi063.stdout:3/429: creat d2/d11/d37/d40/d5e/f9d x:0 0 0 2024-09-16T01:25:16.293 INFO:tasks.workunit.client.0.smithi063.stdout:3/430: write d2/f10 [4375302,69133] 0 2024-09-16T01:25:16.293 INFO:tasks.workunit.client.0.smithi063.stdout:9/565: dread d7/d9/d12/d14/f29 [0,4194304] 0 2024-09-16T01:25:16.294 INFO:tasks.workunit.client.0.smithi063.stdout:5/450: getdents d5/d18/d29/d48/d98 0 2024-09-16T01:25:16.298 INFO:tasks.workunit.client.0.smithi063.stdout:6/416: mknod d3/d48/d28/d3e/d68/c96 0 2024-09-16T01:25:16.301 INFO:tasks.workunit.client.0.smithi063.stdout:4/479: dwrite d5/f2e [4194304,4194304] 0 2024-09-16T01:25:16.303 INFO:tasks.workunit.client.0.smithi063.stdout:1/435: write d1/d5/d6f/f85 [239907,57083] 0 2024-09-16T01:25:16.305 INFO:tasks.workunit.client.0.smithi063.stdout:7/325: dwrite d7/d56/f55 [0,4194304] 0 2024-09-16T01:25:16.307 INFO:tasks.workunit.client.0.smithi063.stdout:9/566: creat d7/d9/d12/d14/fc7 x:0 0 0 2024-09-16T01:25:16.309 INFO:tasks.workunit.client.0.smithi063.stdout:4/480: write d5/d3b/df/d1c/f39 [1539170,96200] 0 2024-09-16T01:25:16.310 INFO:tasks.workunit.client.0.smithi063.stdout:3/431: dwrite d2/d11/d18/f42 [4194304,4194304] 0 2024-09-16T01:25:16.311 INFO:tasks.workunit.client.0.smithi063.stdout:7/326: chown d7/d1c/d1f/f2b 68 1 2024-09-16T01:25:16.312 INFO:tasks.workunit.client.0.smithi063.stdout:1/436: creat d1/d5/d6f/d8f/f97 x:0 0 0 2024-09-16T01:25:16.315 INFO:tasks.workunit.client.0.smithi063.stdout:4/481: chown d5/d3b/d57/l6c 43000987 1 2024-09-16T01:25:16.316 INFO:tasks.workunit.client.0.smithi063.stdout:7/327: write d7/d1c/d1f/f38 [701353,11365] 0 2024-09-16T01:25:16.317 INFO:tasks.workunit.client.0.smithi063.stdout:1/437: symlink d1/d5/d6f/l98 0 2024-09-16T01:25:16.317 INFO:tasks.workunit.client.0.smithi063.stdout:6/417: dwrite d3/d10/d35/f50 [0,4194304] 0 2024-09-16T01:25:16.317 INFO:tasks.workunit.client.0.smithi063.stdout:3/432: truncate d2/d11/d37/f59 4330537 0 2024-09-16T01:25:16.319 INFO:tasks.workunit.client.0.smithi063.stdout:7/328: chown d7/d1c/d1f 1 1 2024-09-16T01:25:16.319 INFO:tasks.workunit.client.0.smithi063.stdout:5/451: dread d5/f15 [0,4194304] 0 2024-09-16T01:25:16.322 INFO:tasks.workunit.client.0.smithi063.stdout:3/433: symlink d2/d11/d37/d40/d5e/l9e 0 2024-09-16T01:25:16.322 INFO:tasks.workunit.client.0.smithi063.stdout:4/482: symlink d5/d3b/df/d1c/d29/d20/l97 0 2024-09-16T01:25:16.322 INFO:tasks.workunit.client.0.smithi063.stdout:1/438: rmdir d1/d5/d15/d1b 39 2024-09-16T01:25:16.391 INFO:tasks.workunit.client.0.smithi063.stdout:4/483: fdatasync d5/d3b/d57/f79 0 2024-09-16T01:25:16.391 INFO:tasks.workunit.client.0.smithi063.stdout:5/452: chown d5/d18/d29/f2f 28462807 1 2024-09-16T01:25:16.392 INFO:tasks.workunit.client.0.smithi063.stdout:4/484: read - d5/d3b/d57/f79 zero size 2024-09-16T01:25:16.392 INFO:tasks.workunit.client.0.smithi063.stdout:3/434: mkdir d2/d11/d37/d40/d5e/d3b/d45/d9f 0 2024-09-16T01:25:16.393 INFO:tasks.workunit.client.0.smithi063.stdout:4/485: stat d5/d3b/df/d1c/f39 0 2024-09-16T01:25:16.393 INFO:tasks.workunit.client.0.smithi063.stdout:7/329: creat d7/d18/d39/d5b/f5f x:0 0 0 2024-09-16T01:25:16.395 INFO:tasks.workunit.client.0.smithi063.stdout:3/435: dread d2/d11/d18/f6f [0,4194304] 0 2024-09-16T01:25:16.396 INFO:tasks.workunit.client.0.smithi063.stdout:6/418: rename d3/d48/d7e/f84 to d3/d48/f97 0 2024-09-16T01:25:16.397 INFO:tasks.workunit.client.0.smithi063.stdout:1/439: rmdir d1/d5 39 2024-09-16T01:25:16.398 INFO:tasks.workunit.client.0.smithi063.stdout:5/453: dwrite d5/d18/d29/d48/d98/d94/f59 [0,4194304] 0 2024-09-16T01:25:16.399 INFO:tasks.workunit.client.0.smithi063.stdout:4/486: mkdir d5/d3b/df/d1c/d29/d20/d98 0 2024-09-16T01:25:16.399 INFO:tasks.workunit.client.0.smithi063.stdout:1/440: write d1/dd/d3b/f58 [1938754,82249] 0 2024-09-16T01:25:16.400 INFO:tasks.workunit.client.0.smithi063.stdout:5/454: read d5/d18/d29/d48/d98/f68 [359310,75314] 0 2024-09-16T01:25:16.401 INFO:tasks.workunit.client.0.smithi063.stdout:5/455: chown d5/d18/d29/d48 0 1 2024-09-16T01:25:16.402 INFO:tasks.workunit.client.0.smithi063.stdout:3/436: dread d2/d11/d37/d40/d5e/d3b/d94/f5c [0,4194304] 0 2024-09-16T01:25:16.402 INFO:tasks.workunit.client.0.smithi063.stdout:5/456: stat d5/d18/d29/d48/d7b/l63 0 2024-09-16T01:25:16.403 INFO:tasks.workunit.client.0.smithi063.stdout:6/419: mknod d3/d48/d28/d3e/d44/d8c/c98 0 2024-09-16T01:25:16.404 INFO:tasks.workunit.client.0.smithi063.stdout:3/437: write d2/d11/d37/f74 [8986331,113498] 0 2024-09-16T01:25:16.405 INFO:tasks.workunit.client.0.smithi063.stdout:6/420: chown d3/d30/d39/d69/l80 90471160 1 2024-09-16T01:25:16.405 INFO:tasks.workunit.client.0.smithi063.stdout:1/441: write d1/d5/d6f/f95 [360164,17047] 0 2024-09-16T01:25:16.405 INFO:tasks.workunit.client.0.smithi063.stdout:4/487: creat d5/d3b/d57/d68/f99 x:0 0 0 2024-09-16T01:25:16.406 INFO:tasks.workunit.client.0.smithi063.stdout:3/438: stat d2/d11/d37/d40/d5e/f55 0 2024-09-16T01:25:16.406 INFO:tasks.workunit.client.0.smithi063.stdout:6/421: write d3/f57 [1334651,69794] 0 2024-09-16T01:25:16.409 INFO:tasks.workunit.client.0.smithi063.stdout:1/442: stat d1/d5/f11 0 2024-09-16T01:25:16.411 INFO:tasks.workunit.client.0.smithi063.stdout:4/488: mknod d5/d3b/d57/c9a 0 2024-09-16T01:25:16.412 INFO:tasks.workunit.client.0.smithi063.stdout:6/422: symlink d3/d10/d35/d5a/l99 0 2024-09-16T01:25:16.413 INFO:tasks.workunit.client.0.smithi063.stdout:4/489: dread d5/d3b/df/d1c/d29/d72/f8a [0,4194304] 0 2024-09-16T01:25:16.414 INFO:tasks.workunit.client.0.smithi063.stdout:1/443: fsync d1/d5/d15/d18/f6a 0 2024-09-16T01:25:16.419 INFO:tasks.workunit.client.0.smithi063.stdout:4/490: rename d5/d3b/df/d1c/d29/d72 to d5/d3b/d57/d66/d9b 0 2024-09-16T01:25:16.421 INFO:tasks.workunit.client.0.smithi063.stdout:6/423: link d3/d48/d28/f2e d3/d48/d28/d3e/d44/d52/f9a 0 2024-09-16T01:25:16.421 INFO:tasks.workunit.client.0.smithi063.stdout:7/330: truncate d7/f3e 120602 0 2024-09-16T01:25:16.422 INFO:tasks.workunit.client.0.smithi063.stdout:7/331: read - d7/f5e zero size 2024-09-16T01:25:16.422 INFO:tasks.workunit.client.0.smithi063.stdout:7/332: chown d7/d56/l54 31 1 2024-09-16T01:25:16.423 INFO:tasks.workunit.client.0.smithi063.stdout:4/491: symlink d5/d3b/df/d1c/l9c 0 2024-09-16T01:25:16.425 INFO:tasks.workunit.client.0.smithi063.stdout:4/492: chown d5/d3b/df/d1c/d29/d32/d60/d61/c96 35623 1 2024-09-16T01:25:16.426 INFO:tasks.workunit.client.0.smithi063.stdout:6/424: unlink d3/d48/f54 0 2024-09-16T01:25:16.428 INFO:tasks.workunit.client.0.smithi063.stdout:5/457: write d5/d18/d29/d48/d66/f82 [1596956,71272] 0 2024-09-16T01:25:16.428 INFO:tasks.workunit.client.0.smithi063.stdout:6/425: truncate d3/d48/d28/f77 4218890 0 2024-09-16T01:25:16.428 INFO:tasks.workunit.client.0.smithi063.stdout:3/439: truncate f0 3282269 0 2024-09-16T01:25:16.430 INFO:tasks.workunit.client.0.smithi063.stdout:1/444: getdents d1/d12/d21 0 2024-09-16T01:25:16.430 INFO:tasks.workunit.client.0.smithi063.stdout:4/493: unlink d5/d3b/df/d1c/d29/d20/d30/c74 0 2024-09-16T01:25:16.431 INFO:tasks.workunit.client.0.smithi063.stdout:6/426: mkdir d3/d41/d9b 0 2024-09-16T01:25:16.431 INFO:tasks.workunit.client.0.smithi063.stdout:5/458: write d5/d12/f23 [2921123,110081] 0 2024-09-16T01:25:16.433 INFO:tasks.workunit.client.0.smithi063.stdout:3/440: write d2/d11/d37/d40/d5e/d3b/d94/f4d [631352,37451] 0 2024-09-16T01:25:16.434 INFO:tasks.workunit.client.0.smithi063.stdout:4/494: creat d5/d3b/d5c/f9d x:0 0 0 2024-09-16T01:25:16.435 INFO:tasks.workunit.client.0.smithi063.stdout:3/441: readlink d2/d11/d37/d40/d5e/l82 0 2024-09-16T01:25:16.435 INFO:tasks.workunit.client.0.smithi063.stdout:6/427: chown d3/d41/c6f 30467379 1 2024-09-16T01:25:16.435 INFO:tasks.workunit.client.0.smithi063.stdout:1/445: mknod d1/d5/d6f/d8f/c99 0 2024-09-16T01:25:16.436 INFO:tasks.workunit.client.0.smithi063.stdout:7/333: dread d7/f9 [4194304,4194304] 0 2024-09-16T01:25:16.436 INFO:tasks.workunit.client.0.smithi063.stdout:4/495: stat d5/d3b/df/d1c/d29/f5a 0 2024-09-16T01:25:16.437 INFO:tasks.workunit.client.0.smithi063.stdout:5/459: creat d5/d18/d29/d48/d66/f9c x:0 0 0 2024-09-16T01:25:16.438 INFO:tasks.workunit.client.0.smithi063.stdout:3/442: truncate d2/d11/d37/d40/d5e/f36 802272 0 2024-09-16T01:25:16.439 INFO:tasks.workunit.client.0.smithi063.stdout:6/428: symlink d3/d48/d7e/l9c 0 2024-09-16T01:25:16.440 INFO:tasks.workunit.client.0.smithi063.stdout:6/429: write d3/d10/f2a [5450511,126297] 0 2024-09-16T01:25:16.440 INFO:tasks.workunit.client.0.smithi063.stdout:1/446: readlink d1/d5/d82/l7e 0 2024-09-16T01:25:16.441 INFO:tasks.workunit.client.0.smithi063.stdout:7/334: mkdir d7/d56/d57/d60 0 2024-09-16T01:25:16.446 INFO:tasks.workunit.client.0.smithi063.stdout:7/335: dwrite d7/d18/f1b [0,4194304] 0 2024-09-16T01:25:16.447 INFO:tasks.workunit.client.0.smithi063.stdout:6/430: symlink d3/d48/d28/d3e/d44/d8c/l9d 0 2024-09-16T01:25:16.448 INFO:tasks.workunit.client.0.smithi063.stdout:5/460: mknod d5/d18/d29/d52/c9d 0 2024-09-16T01:25:16.449 INFO:tasks.workunit.client.0.smithi063.stdout:4/496: mkdir d5/d3b/df/d1c/d29/d32/d9e 0 2024-09-16T01:25:16.450 INFO:tasks.workunit.client.0.smithi063.stdout:7/336: write d7/d1c/d1f/d29/f3d [2136259,104372] 0 2024-09-16T01:25:16.452 INFO:tasks.workunit.client.0.smithi063.stdout:6/431: chown d3/d30/c70 92 1 2024-09-16T01:25:16.455 INFO:tasks.workunit.client.0.smithi063.stdout:6/432: chown d3/d30/d8d/f8f 130818 1 2024-09-16T01:25:16.456 INFO:tasks.workunit.client.0.smithi063.stdout:1/447: dwrite d1/d5/d15/d1b/f52 [0,4194304] 0 2024-09-16T01:25:16.456 INFO:tasks.workunit.client.0.smithi063.stdout:4/497: creat d5/d3b/df/d1c/d29/d32/d4e/f9f x:0 0 0 2024-09-16T01:25:16.457 INFO:tasks.workunit.client.0.smithi063.stdout:6/433: truncate d3/d10/d35/d5a/d6b/f90 382002 0 2024-09-16T01:25:16.459 INFO:tasks.workunit.client.0.smithi063.stdout:5/461: link d5/d18/d29/d48/d66/f69 d5/d18/d29/d48/d98/f9e 0 2024-09-16T01:25:16.460 INFO:tasks.workunit.client.0.smithi063.stdout:5/462: chown d5/d18/d29/d48/d7b/l7a 115 1 2024-09-16T01:25:16.460 INFO:tasks.workunit.client.0.smithi063.stdout:0/464: sync 2024-09-16T01:25:16.460 INFO:tasks.workunit.client.0.smithi063.stdout:5/463: write d5/d12/f2d [2774203,24098] 0 2024-09-16T01:25:16.461 INFO:tasks.workunit.client.0.smithi063.stdout:0/465: write d1/d1c/f78 [657633,19726] 0 2024-09-16T01:25:16.461 INFO:tasks.workunit.client.0.smithi063.stdout:6/434: creat d3/d10/d49/f9e x:0 0 0 2024-09-16T01:25:16.464 INFO:tasks.workunit.client.0.smithi063.stdout:0/466: truncate d1/d30/d52/d5a/f9e 1008244 0 2024-09-16T01:25:16.469 INFO:tasks.workunit.client.0.smithi063.stdout:6/435: dwrite d3/f13 [4194304,4194304] 0 2024-09-16T01:25:16.469 INFO:tasks.workunit.client.0.smithi063.stdout:0/467: symlink d1/d2e/dab/lba 0 2024-09-16T01:25:16.472 INFO:tasks.workunit.client.0.smithi063.stdout:0/468: mkdir d1/df/d2c/db6/dbb 0 2024-09-16T01:25:16.479 INFO:tasks.workunit.client.0.smithi063.stdout:1/448: dwrite d1/d5/d15/f19 [4194304,4194304] 0 2024-09-16T01:25:16.480 INFO:tasks.workunit.client.0.smithi063.stdout:0/469: dread d1/d30/d52/d5a/d44/f64 [0,4194304] 0 2024-09-16T01:25:16.480 INFO:tasks.workunit.client.0.smithi063.stdout:6/436: dwrite d3/d48/d28/f33 [4194304,4194304] 0 2024-09-16T01:25:16.481 INFO:tasks.workunit.client.0.smithi063.stdout:5/464: dwrite d5/d18/d29/d48/d98/d94/f60 [0,4194304] 0 2024-09-16T01:25:16.482 INFO:tasks.workunit.client.0.smithi063.stdout:1/449: stat d1/d5/d15/d18/d7c 0 2024-09-16T01:25:16.486 INFO:tasks.workunit.client.0.smithi063.stdout:0/470: mkdir d1/d30/d52/d5a/d44/dbc 0 2024-09-16T01:25:16.488 INFO:tasks.workunit.client.0.smithi063.stdout:5/465: mknod d5/d12/c9f 0 2024-09-16T01:25:16.489 INFO:tasks.workunit.client.0.smithi063.stdout:1/450: unlink d1/d5/d15/d1b/d31/d77/d86/l93 0 2024-09-16T01:25:16.490 INFO:tasks.workunit.client.0.smithi063.stdout:6/437: creat d3/d30/d39/d69/d95/f9f x:0 0 0 2024-09-16T01:25:16.496 INFO:tasks.workunit.client.0.smithi063.stdout:1/451: rename d1/l7a to d1/d12/d56/l9a 0 2024-09-16T01:25:16.499 INFO:tasks.workunit.client.0.smithi063.stdout:5/466: dwrite d5/f15 [0,4194304] 0 2024-09-16T01:25:16.501 INFO:tasks.workunit.client.0.smithi063.stdout:6/438: dwrite d3/d10/d35/d5a/d6b/f82 [0,4194304] 0 2024-09-16T01:25:16.501 INFO:tasks.workunit.client.0.smithi063.stdout:0/471: dread d1/df/d34/f5e [0,4194304] 0 2024-09-16T01:25:16.502 INFO:tasks.workunit.client.0.smithi063.stdout:0/472: truncate d1/fb8 1032167 0 2024-09-16T01:25:16.504 INFO:tasks.workunit.client.0.smithi063.stdout:5/467: creat d5/d18/d29/d48/d66/fa0 x:0 0 0 2024-09-16T01:25:16.505 INFO:tasks.workunit.client.0.smithi063.stdout:5/468: dread - d5/d18/d29/d48/d7b/f95 zero size 2024-09-16T01:25:16.506 INFO:tasks.workunit.client.0.smithi063.stdout:0/473: mknod d1/d2e/d73/cbd 0 2024-09-16T01:25:16.506 INFO:tasks.workunit.client.0.smithi063.stdout:0/474: dread - d1/d1c/fad zero size 2024-09-16T01:25:16.507 INFO:tasks.workunit.client.0.smithi063.stdout:5/469: write d5/d18/f6f [596730,3774] 0 2024-09-16T01:25:16.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/452: rename d1/d5/d15/d1b/d31 to d1/d5/d82/d9b 0 2024-09-16T01:25:16.509 INFO:tasks.workunit.client.0.smithi063.stdout:5/470: dread - d5/d18/d29/d48/d66/f83 zero size 2024-09-16T01:25:16.509 INFO:tasks.workunit.client.0.smithi063.stdout:0/475: readlink d1/d30/lb7 0 2024-09-16T01:25:16.511 INFO:tasks.workunit.client.0.smithi063.stdout:0/476: write d1/d30/d52/d5a/d36/d41/f4d [1520206,117193] 0 2024-09-16T01:25:16.511 INFO:tasks.workunit.client.0.smithi063.stdout:6/439: rename d3/d41/c6f to d3/d41/d89/ca0 0 2024-09-16T01:25:16.512 INFO:tasks.workunit.client.0.smithi063.stdout:1/453: symlink d1/d5/d6f/d8f/l9c 0 2024-09-16T01:25:16.514 INFO:tasks.workunit.client.0.smithi063.stdout:1/454: write d1/d5/d15/d1b/f39 [136280,41046] 0 2024-09-16T01:25:16.514 INFO:tasks.workunit.client.0.smithi063.stdout:6/440: creat d3/d10/d49/fa1 x:0 0 0 2024-09-16T01:25:16.516 INFO:tasks.workunit.client.0.smithi063.stdout:0/477: creat d1/df/db1/fbe x:0 0 0 2024-09-16T01:25:16.517 INFO:tasks.workunit.client.0.smithi063.stdout:6/441: dread d3/d10/f1d [0,4194304] 0 2024-09-16T01:25:16.517 INFO:tasks.workunit.client.0.smithi063.stdout:0/478: readlink d1/d2e/d48/l5d 0 2024-09-16T01:25:16.522 INFO:tasks.workunit.client.0.smithi063.stdout:1/455: getdents d1/d5/d82/d9b 0 2024-09-16T01:25:16.523 INFO:tasks.workunit.client.0.smithi063.stdout:6/442: mkdir d3/d41/d9b/da2 0 2024-09-16T01:25:16.523 INFO:tasks.workunit.client.0.smithi063.stdout:1/456: fdatasync d1/d5/d6f/f85 0 2024-09-16T01:25:16.524 INFO:tasks.workunit.client.0.smithi063.stdout:5/471: truncate d5/d18/d29/d48/d98/d94/f62 15623 0 2024-09-16T01:25:16.525 INFO:tasks.workunit.client.0.smithi063.stdout:1/457: write d1/d5/f13 [3948359,21612] 0 2024-09-16T01:25:16.528 INFO:tasks.workunit.client.0.smithi063.stdout:1/458: mknod d1/d12/d56/c9d 0 2024-09-16T01:25:16.529 INFO:tasks.workunit.client.0.smithi063.stdout:1/459: stat d1/d5/le 0 2024-09-16T01:25:16.531 INFO:tasks.workunit.client.0.smithi063.stdout:1/460: dread - d1/d5/f80 zero size 2024-09-16T01:25:16.531 INFO:tasks.workunit.client.0.smithi063.stdout:6/443: dwrite d3/d10/f2a [0,4194304] 0 2024-09-16T01:25:16.534 INFO:tasks.workunit.client.0.smithi063.stdout:6/444: chown d3/d48/d28/d3e/d44/d8c 73 1 2024-09-16T01:25:16.534 INFO:tasks.workunit.client.0.smithi063.stdout:0/479: dread d1/d1c/f80 [0,4194304] 0 2024-09-16T01:25:16.535 INFO:tasks.workunit.client.0.smithi063.stdout:1/461: creat d1/d5/d82/d9b/f9e x:0 0 0 2024-09-16T01:25:16.538 INFO:tasks.workunit.client.0.smithi063.stdout:5/472: dwrite d5/d18/d29/d48/d98/d94/f62 [0,4194304] 0 2024-09-16T01:25:16.539 INFO:tasks.workunit.client.0.smithi063.stdout:0/480: rename d1/d30/d52/d5a/d44/f7c to d1/d30/d95/fbf 0 2024-09-16T01:25:16.540 INFO:tasks.workunit.client.0.smithi063.stdout:1/462: mknod d1/d5/d82/d9b/d77/d8a/c9f 0 2024-09-16T01:25:16.541 INFO:tasks.workunit.client.0.smithi063.stdout:6/445: dread d3/d48/d28/f2b [0,4194304] 0 2024-09-16T01:25:16.542 INFO:tasks.workunit.client.0.smithi063.stdout:0/481: symlink d1/d30/d52/d5a/d44/lc0 0 2024-09-16T01:25:16.543 INFO:tasks.workunit.client.0.smithi063.stdout:1/463: creat d1/dd/d3b/fa0 x:0 0 0 2024-09-16T01:25:16.546 INFO:tasks.workunit.client.0.smithi063.stdout:0/482: rmdir d1/d30 39 2024-09-16T01:25:16.548 INFO:tasks.workunit.client.0.smithi063.stdout:6/446: link d3/d10/d35/c75 d3/d30/ca3 0 2024-09-16T01:25:16.549 INFO:tasks.workunit.client.0.smithi063.stdout:6/447: write f2 [1228414,112533] 0 2024-09-16T01:25:16.550 INFO:tasks.workunit.client.0.smithi063.stdout:0/483: dread d1/d30/d52/d5a/f9e [0,4194304] 0 2024-09-16T01:25:16.552 INFO:tasks.workunit.client.0.smithi063.stdout:0/484: unlink d1/d30/d95/fbf 0 2024-09-16T01:25:16.554 INFO:tasks.workunit.client.0.smithi063.stdout:0/485: mkdir d1/d2e/dc1 0 2024-09-16T01:25:16.555 INFO:tasks.workunit.client.0.smithi063.stdout:1/464: dwrite d1/d5/d15/d18/f1e [0,4194304] 0 2024-09-16T01:25:16.556 INFO:tasks.workunit.client.0.smithi063.stdout:6/448: rename d3/d10/d35 to d3/d48/d28/d3e/d44/da4 0 2024-09-16T01:25:16.559 INFO:tasks.workunit.client.0.smithi063.stdout:6/449: creat d3/d48/d28/d3e/d44/da4/fa5 x:0 0 0 2024-09-16T01:25:16.563 INFO:tasks.workunit.client.0.smithi063.stdout:1/465: dwrite d1/d5/d6f/d8f/f97 [0,4194304] 0 2024-09-16T01:25:16.563 INFO:tasks.workunit.client.0.smithi063.stdout:0/486: truncate d1/d2e/f4a 1499848 0 2024-09-16T01:25:16.564 INFO:tasks.workunit.client.0.smithi063.stdout:6/450: mknod d3/d48/d28/d3e/d44/da4/ca6 0 2024-09-16T01:25:16.565 INFO:tasks.workunit.client.0.smithi063.stdout:1/466: stat d1/d5/d15/d18/d7c 0 2024-09-16T01:25:16.567 INFO:tasks.workunit.client.0.smithi063.stdout:1/467: truncate d1/d5/d6f/d8f/f97 4996887 0 2024-09-16T01:25:16.568 INFO:tasks.workunit.client.0.smithi063.stdout:0/487: rename d1/d30/d52/d5a/f9b to d1/d2e/d73/fc2 0 2024-09-16T01:25:16.569 INFO:tasks.workunit.client.0.smithi063.stdout:0/488: chown d1/df/d2c/db6 365 1 2024-09-16T01:25:16.570 INFO:tasks.workunit.client.0.smithi063.stdout:6/451: mkdir d3/d41/d9b/da2/da7 0 2024-09-16T01:25:16.572 INFO:tasks.workunit.client.0.smithi063.stdout:0/489: mkdir d1/d2e/d48/dc3 0 2024-09-16T01:25:16.572 INFO:tasks.workunit.client.0.smithi063.stdout:1/468: dwrite d1/d5/f10 [0,4194304] 0 2024-09-16T01:25:16.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:16 smithi063 ceph-mon[31070]: pgmap v393: 97 pgs: 97 active+clean; 595 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 70 MiB/s wr, 209 op/s 2024-09-16T01:25:16.621 INFO:tasks.workunit.client.0.smithi063.stdout:2/539: sync 2024-09-16T01:25:16.621 INFO:tasks.workunit.client.0.smithi063.stdout:8/322: sync 2024-09-16T01:25:16.638 INFO:tasks.workunit.client.0.smithi063.stdout:6/452: rename d3/d10/d49/fa1 to d3/d10/d49/fa8 0 2024-09-16T01:25:16.638 INFO:tasks.workunit.client.0.smithi063.stdout:8/323: fdatasync d5/d3a/f43 0 2024-09-16T01:25:16.638 INFO:tasks.workunit.client.0.smithi063.stdout:1/469: symlink d1/dd/d3b/la1 0 2024-09-16T01:25:16.640 INFO:tasks.workunit.client.0.smithi063.stdout:6/453: write d3/d10/f29 [228075,23452] 0 2024-09-16T01:25:16.640 INFO:tasks.workunit.client.0.smithi063.stdout:8/324: truncate d5/d9/f24 1445032 0 2024-09-16T01:25:16.642 INFO:tasks.workunit.client.0.smithi063.stdout:8/325: chown d5/db 38048 1 2024-09-16T01:25:16.642 INFO:tasks.workunit.client.0.smithi063.stdout:6/454: fsync d3/d30/d8d/f8f 0 2024-09-16T01:25:16.644 INFO:tasks.workunit.client.0.smithi063.stdout:6/455: chown d3/l5f 32711 1 2024-09-16T01:25:16.645 INFO:tasks.workunit.client.0.smithi063.stdout:0/490: dwrite d1/df/d2c/db6/fb9 [0,4194304] 0 2024-09-16T01:25:16.645 INFO:tasks.workunit.client.0.smithi063.stdout:6/456: stat d3/d48/f97 0 2024-09-16T01:25:16.645 INFO:tasks.workunit.client.0.smithi063.stdout:1/470: rename d1/d5/d82/d9b/l2c to d1/d12/d21/la2 0 2024-09-16T01:25:16.646 INFO:tasks.workunit.client.0.smithi063.stdout:0/491: chown d1/df/d17/f8a 55388645 1 2024-09-16T01:25:16.646 INFO:tasks.workunit.client.0.smithi063.stdout:6/457: chown d3/d48/d28/c4b 430991 1 2024-09-16T01:25:16.647 INFO:tasks.workunit.client.0.smithi063.stdout:1/471: write d1/dd/d3b/fa0 [669625,79707] 0 2024-09-16T01:25:16.648 INFO:tasks.workunit.client.0.smithi063.stdout:2/540: write d3/d7/d8/f10 [2690304,90353] 0 2024-09-16T01:25:16.652 INFO:tasks.workunit.client.0.smithi063.stdout:2/541: dread d3/d7/d8/d19/d8c/d21/d28/d8a/da1/f5e [0,4194304] 0 2024-09-16T01:25:16.654 INFO:tasks.workunit.client.0.smithi063.stdout:6/458: rename d3/d48/d28/d3e/d44/da4/d5a/l76 to d3/d48/la9 0 2024-09-16T01:25:16.657 INFO:tasks.workunit.client.0.smithi063.stdout:0/492: getdents d1/df/d2c/d43 0 2024-09-16T01:25:16.657 INFO:tasks.workunit.client.0.smithi063.stdout:0/493: chown d1/df/d2c/f39 255669 1 2024-09-16T01:25:16.657 INFO:tasks.workunit.client.0.smithi063.stdout:1/472: truncate d1/d5/f7 2590780 0 2024-09-16T01:25:16.660 INFO:tasks.workunit.client.0.smithi063.stdout:1/473: readlink d1/d5/d82/l7e 0 2024-09-16T01:25:16.661 INFO:tasks.workunit.client.0.smithi063.stdout:1/474: chown d1/d12/d56/d84 5 1 2024-09-16T01:25:16.662 INFO:tasks.workunit.client.0.smithi063.stdout:6/459: creat d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/faa x:0 0 0 2024-09-16T01:25:16.664 INFO:tasks.workunit.client.0.smithi063.stdout:2/542: creat d3/d7/d8/d19/d8c/d21/fc0 x:0 0 0 2024-09-16T01:25:16.664 INFO:tasks.workunit.client.0.smithi063.stdout:0/494: symlink d1/df/d34/da6/lc4 0 2024-09-16T01:25:16.665 INFO:tasks.workunit.client.0.smithi063.stdout:0/495: read d1/d30/d52/d5a/d44/f64 [64673,104927] 0 2024-09-16T01:25:16.665 INFO:tasks.workunit.client.0.smithi063.stdout:1/475: creat d1/d5/d82/d9b/fa3 x:0 0 0 2024-09-16T01:25:16.667 INFO:tasks.workunit.client.0.smithi063.stdout:0/496: write d1/df/db1/fbe [403741,102963] 0 2024-09-16T01:25:16.667 INFO:tasks.workunit.client.0.smithi063.stdout:6/460: symlink d3/d41/d9b/lab 0 2024-09-16T01:25:16.668 INFO:tasks.workunit.client.0.smithi063.stdout:1/476: symlink d1/dd/la4 0 2024-09-16T01:25:16.668 INFO:tasks.workunit.client.0.smithi063.stdout:0/497: readlink d1/df/d17/l56 0 2024-09-16T01:25:16.669 INFO:tasks.workunit.client.0.smithi063.stdout:1/477: chown d1/d5/d15/f19 62551 1 2024-09-16T01:25:16.670 INFO:tasks.workunit.client.0.smithi063.stdout:0/498: creat d1/d30/d95/fc5 x:0 0 0 2024-09-16T01:25:16.671 INFO:tasks.workunit.client.0.smithi063.stdout:1/478: mkdir d1/d5/d82/d9b/d77/d7d/da5 0 2024-09-16T01:25:16.672 INFO:tasks.workunit.client.0.smithi063.stdout:1/479: chown d1/d5/d82/d9b/f78 1642 1 2024-09-16T01:25:16.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:16 smithi192 ceph-mon[34775]: pgmap v393: 97 pgs: 97 active+clean; 595 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 70 MiB/s wr, 209 op/s 2024-09-16T01:25:16.674 INFO:tasks.workunit.client.0.smithi063.stdout:1/480: write d1/d5/d15/d18/d7c/f35 [1827276,32085] 0 2024-09-16T01:25:16.678 INFO:tasks.workunit.client.0.smithi063.stdout:2/543: dread d3/d7/d8/d1f/d37/f7a [0,4194304] 0 2024-09-16T01:25:16.678 INFO:tasks.workunit.client.0.smithi063.stdout:0/499: dwrite d1/f31 [0,4194304] 0 2024-09-16T01:25:16.681 INFO:tasks.workunit.client.0.smithi063.stdout:2/544: mknod d3/d7/d8/d19/d3c/d58/cc1 0 2024-09-16T01:25:16.682 INFO:tasks.workunit.client.0.smithi063.stdout:2/545: readlink d3/d7/d8/d19/d3c/d58/l91 0 2024-09-16T01:25:16.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:16 smithi162 ceph-mon[34539]: pgmap v393: 97 pgs: 97 active+clean; 595 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 70 MiB/s wr, 209 op/s 2024-09-16T01:25:16.684 INFO:tasks.workunit.client.0.smithi063.stdout:1/481: read d1/d5/f7 [1358510,20880] 0 2024-09-16T01:25:16.688 INFO:tasks.workunit.client.0.smithi063.stdout:2/546: dwrite d3/d7/d8/f70 [0,4194304] 0 2024-09-16T01:25:16.689 INFO:tasks.workunit.client.0.smithi063.stdout:1/482: creat d1/d5/d15/d18/fa6 x:0 0 0 2024-09-16T01:25:16.691 INFO:tasks.workunit.client.0.smithi063.stdout:2/547: write d3/d7/d8/f70 [981455,70412] 0 2024-09-16T01:25:16.693 INFO:tasks.workunit.client.0.smithi063.stdout:2/548: write d3/d7/d8/d19/d3c/d53/d7f/d80/fbd [309467,8874] 0 2024-09-16T01:25:16.694 INFO:tasks.workunit.client.0.smithi063.stdout:1/483: link d1/dd/d3b/f44 d1/d12/fa7 0 2024-09-16T01:25:16.703 INFO:tasks.workunit.client.0.smithi063.stdout:0/500: dwrite d1/d30/d52/d5a/d36/d41/f4d [0,4194304] 0 2024-09-16T01:25:16.704 INFO:tasks.workunit.client.0.smithi063.stdout:1/484: dread d1/d5/d6f/d8f/f97 [0,4194304] 0 2024-09-16T01:25:16.706 INFO:tasks.workunit.client.0.smithi063.stdout:2/549: dwrite d3/d7/d8/d19/d8c/d21/d28/d8a/da1/f5e [0,4194304] 0 2024-09-16T01:25:16.711 INFO:tasks.workunit.client.0.smithi063.stdout:2/550: mkdir d3/d7/d8/d1f/d34/dc2 0 2024-09-16T01:25:16.711 INFO:tasks.workunit.client.0.smithi063.stdout:0/501: write d1/df/d17/f92 [1908172,119753] 0 2024-09-16T01:25:16.714 INFO:tasks.workunit.client.0.smithi063.stdout:0/502: read d1/df/d34/f79 [44255,85973] 0 2024-09-16T01:25:16.714 INFO:tasks.workunit.client.0.smithi063.stdout:1/485: dwrite d1/dd/f74 [0,4194304] 0 2024-09-16T01:25:16.717 INFO:tasks.workunit.client.0.smithi063.stdout:1/486: unlink d1/dd/l51 0 2024-09-16T01:25:16.719 INFO:tasks.workunit.client.0.smithi063.stdout:2/551: getdents d3/d7/d8/d19/d8c 0 2024-09-16T01:25:16.720 INFO:tasks.workunit.client.0.smithi063.stdout:1/487: symlink d1/d5/la8 0 2024-09-16T01:25:16.722 INFO:tasks.workunit.client.0.smithi063.stdout:1/488: chown d1/d5/d82/l7e 0 1 2024-09-16T01:25:16.723 INFO:tasks.workunit.client.0.smithi063.stdout:2/552: mknod d3/d7/d8/cc3 0 2024-09-16T01:25:16.723 INFO:tasks.workunit.client.0.smithi063.stdout:0/503: dwrite d1/d30/d52/d5a/d36/d41/f47 [0,4194304] 0 2024-09-16T01:25:16.725 INFO:tasks.workunit.client.0.smithi063.stdout:0/504: fsync d1/df/db1/fbe 0 2024-09-16T01:25:16.725 INFO:tasks.workunit.client.0.smithi063.stdout:2/553: dread - d3/d7/d8/d1f/d37/d4f/da7/faf zero size 2024-09-16T01:25:16.725 INFO:tasks.workunit.client.0.smithi063.stdout:1/489: mknod d1/dd/ca9 0 2024-09-16T01:25:16.727 INFO:tasks.workunit.client.0.smithi063.stdout:0/505: symlink d1/d1c/lc6 0 2024-09-16T01:25:16.729 INFO:tasks.workunit.client.0.smithi063.stdout:1/490: fdatasync d1/dd/f74 0 2024-09-16T01:25:16.731 INFO:tasks.workunit.client.0.smithi063.stdout:2/554: dread d3/f6 [0,4194304] 0 2024-09-16T01:25:16.733 INFO:tasks.workunit.client.0.smithi063.stdout:1/491: chown d1/d12/l36 410 1 2024-09-16T01:25:16.735 INFO:tasks.workunit.client.0.smithi063.stdout:0/506: getdents d1/d2e/d73 0 2024-09-16T01:25:16.738 INFO:tasks.workunit.client.0.smithi063.stdout:2/555: rename d3/d7/d8/d1f/d34/f9b to d3/d7/d8/d1f/d34/d45/fc4 0 2024-09-16T01:25:16.783 INFO:tasks.workunit.client.0.smithi063.stdout:9/567: sync 2024-09-16T01:25:16.805 INFO:tasks.workunit.client.0.smithi063.stdout:0/507: dwrite d1/d1c/f3f [0,4194304] 0 2024-09-16T01:25:16.806 INFO:tasks.workunit.client.0.smithi063.stdout:9/568: unlink d7/d9/d12/d14/d23/l3c 0 2024-09-16T01:25:16.807 INFO:tasks.workunit.client.0.smithi063.stdout:0/508: mkdir d1/df/d2c/dc7 0 2024-09-16T01:25:16.811 INFO:tasks.workunit.client.0.smithi063.stdout:9/569: creat d7/d4a/dba/d7f/fc8 x:0 0 0 2024-09-16T01:25:16.812 INFO:tasks.workunit.client.0.smithi063.stdout:2/556: dwrite d3/d7/d8/d19/d8c/d21/d28/d8a/da1/f5a [0,4194304] 0 2024-09-16T01:25:16.812 INFO:tasks.workunit.client.0.smithi063.stdout:1/492: dread d1/d5/d82/d9b/f78 [0,4194304] 0 2024-09-16T01:25:16.816 INFO:tasks.workunit.client.0.smithi063.stdout:0/509: rename d1/df/d17/l56 to d1/d30/d52/d5a/d36/lc8 0 2024-09-16T01:25:16.817 INFO:tasks.workunit.client.0.smithi063.stdout:0/510: chown d1/fb8 7704054 1 2024-09-16T01:25:16.818 INFO:tasks.workunit.client.0.smithi063.stdout:2/557: creat d3/d7/d8/d19/d3c/d53/d7f/d80/fc5 x:0 0 0 2024-09-16T01:25:16.822 INFO:tasks.workunit.client.0.smithi063.stdout:2/558: truncate d3/d7/d8/d19/d8c/d21/f99 58665 0 2024-09-16T01:25:16.824 INFO:tasks.workunit.client.0.smithi063.stdout:0/511: dwrite d1/df/d2c/f55 [0,4194304] 0 2024-09-16T01:25:16.825 INFO:tasks.workunit.client.0.smithi063.stdout:0/512: chown d1/df/db1 1730970866 1 2024-09-16T01:25:16.827 INFO:tasks.workunit.client.0.smithi063.stdout:2/559: mknod d3/d7/d8/d19/d8c/d21/d28/cc6 0 2024-09-16T01:25:16.829 INFO:tasks.workunit.client.0.smithi063.stdout:0/513: symlink d1/df/d2c/d43/lc9 0 2024-09-16T01:25:16.831 INFO:tasks.workunit.client.0.smithi063.stdout:1/493: dread d1/d5/d15/d18/f6a [0,4194304] 0 2024-09-16T01:25:16.831 INFO:tasks.workunit.client.0.smithi063.stdout:2/560: creat d3/d7/d8/d1f/d37/d4f/fc7 x:0 0 0 2024-09-16T01:25:16.832 INFO:tasks.workunit.client.0.smithi063.stdout:2/561: chown d3/c2c 974606823 1 2024-09-16T01:25:16.833 INFO:tasks.workunit.client.0.smithi063.stdout:1/494: truncate d1/d5/d15/d18/fa6 644244 0 2024-09-16T01:25:16.833 INFO:tasks.workunit.client.0.smithi063.stdout:0/514: mkdir d1/d2e/d48/dc3/dca 0 2024-09-16T01:25:16.834 INFO:tasks.workunit.client.0.smithi063.stdout:9/570: dread d7/d9/d12/d14/d34/f6b [4194304,4194304] 0 2024-09-16T01:25:16.835 INFO:tasks.workunit.client.0.smithi063.stdout:0/515: truncate d1/d30/d52/fa3 490896 0 2024-09-16T01:25:16.837 INFO:tasks.workunit.client.0.smithi063.stdout:9/571: truncate d7/d9/d12/d14/d23/faf 618421 0 2024-09-16T01:25:16.837 INFO:tasks.workunit.client.0.smithi063.stdout:0/516: mkdir d1/d2e/d48/dcb 0 2024-09-16T01:25:16.838 INFO:tasks.workunit.client.0.smithi063.stdout:9/572: chown d7/d4a/f53 4649349 1 2024-09-16T01:25:16.839 INFO:tasks.workunit.client.0.smithi063.stdout:2/562: creat d3/d7/d8/fc8 x:0 0 0 2024-09-16T01:25:16.839 INFO:tasks.workunit.client.0.smithi063.stdout:9/573: write d7/d1f/fa0 [409228,106694] 0 2024-09-16T01:25:16.841 INFO:tasks.workunit.client.0.smithi063.stdout:0/517: symlink d1/df/d2c/dc7/lcc 0 2024-09-16T01:25:16.841 INFO:tasks.workunit.client.0.smithi063.stdout:2/563: write d3/d7/d8/d1f/d37/f7a [1445767,93426] 0 2024-09-16T01:25:16.841 INFO:tasks.workunit.client.0.smithi063.stdout:9/574: dread - d7/d9/d12/d14/fc7 zero size 2024-09-16T01:25:16.843 INFO:tasks.workunit.client.0.smithi063.stdout:9/575: read - d7/d4a/f93 zero size 2024-09-16T01:25:16.843 INFO:tasks.workunit.client.0.smithi063.stdout:0/518: mkdir d1/d1c/dcd 0 2024-09-16T01:25:16.844 INFO:tasks.workunit.client.0.smithi063.stdout:9/576: mknod d7/d1f/cc9 0 2024-09-16T01:25:16.844 INFO:tasks.workunit.client.0.smithi063.stdout:0/519: dread - d1/df/d17/f81 zero size 2024-09-16T01:25:16.845 INFO:tasks.workunit.client.0.smithi063.stdout:2/564: mknod d3/d7/d8/d19/d8c/d21/d28/d8a/cc9 0 2024-09-16T01:25:16.846 INFO:tasks.workunit.client.0.smithi063.stdout:1/495: dread d1/d5/d15/d18/d7c/f37 [0,4194304] 0 2024-09-16T01:25:16.846 INFO:tasks.workunit.client.0.smithi063.stdout:9/577: write d7/d4a/dba/d7f/f9e [37564,82084] 0 2024-09-16T01:25:16.847 INFO:tasks.workunit.client.0.smithi063.stdout:0/520: mknod d1/d30/d52/db3/cce 0 2024-09-16T01:25:16.847 INFO:tasks.workunit.client.0.smithi063.stdout:1/496: chown d1/d5/d6f/f85 61281376 1 2024-09-16T01:25:16.848 INFO:tasks.workunit.client.0.smithi063.stdout:2/565: creat d3/fca x:0 0 0 2024-09-16T01:25:16.848 INFO:tasks.workunit.client.0.smithi063.stdout:9/578: chown d7/d9/d12/d14/d23/l82 27283780 1 2024-09-16T01:25:16.849 INFO:tasks.workunit.client.0.smithi063.stdout:0/521: mkdir d1/d30/d52/d9d/dcf 0 2024-09-16T01:25:16.850 INFO:tasks.workunit.client.0.smithi063.stdout:9/579: mkdir d7/d9/d12/db2/dca 0 2024-09-16T01:25:16.851 INFO:tasks.workunit.client.0.smithi063.stdout:0/522: write d1/d30/d52/db3/fa1 [362124,119808] 0 2024-09-16T01:25:16.851 INFO:tasks.workunit.client.0.smithi063.stdout:9/580: chown d7/d4a/d9d/lc4 6 1 2024-09-16T01:25:16.852 INFO:tasks.workunit.client.0.smithi063.stdout:9/581: stat d7/d4a 0 2024-09-16T01:25:16.855 INFO:tasks.workunit.client.0.smithi063.stdout:9/582: unlink d7/d1f/c88 0 2024-09-16T01:25:16.855 INFO:tasks.workunit.client.0.smithi063.stdout:0/523: dread d1/d1c/f78 [0,4194304] 0 2024-09-16T01:25:16.855 INFO:tasks.workunit.client.0.smithi063.stdout:2/566: dwrite d3/f6 [0,4194304] 0 2024-09-16T01:25:16.856 INFO:tasks.workunit.client.0.smithi063.stdout:0/524: chown d1/df/f54 119 1 2024-09-16T01:25:16.858 INFO:tasks.workunit.client.0.smithi063.stdout:0/525: chown d1/df/d17/f6d 97501987 1 2024-09-16T01:25:16.858 INFO:tasks.workunit.client.0.smithi063.stdout:2/567: truncate d3/f51 578459 0 2024-09-16T01:25:16.858 INFO:tasks.workunit.client.0.smithi063.stdout:9/583: mknod d7/d4a/d4d/d96/ccb 0 2024-09-16T01:25:16.863 INFO:tasks.workunit.client.0.smithi063.stdout:0/526: creat d1/d2e/d48/dcb/fd0 x:0 0 0 2024-09-16T01:25:16.864 INFO:tasks.workunit.client.0.smithi063.stdout:2/568: dwrite d3/ff [0,4194304] 0 2024-09-16T01:25:16.866 INFO:tasks.workunit.client.0.smithi063.stdout:9/584: rmdir d7/d9 39 2024-09-16T01:25:16.871 INFO:tasks.workunit.client.0.smithi063.stdout:2/569: dwrite d3/d7/d8/d19/d3c/d58/fbb [0,4194304] 0 2024-09-16T01:25:16.872 INFO:tasks.workunit.client.0.smithi063.stdout:9/585: mknod d7/d9/d20/ccc 0 2024-09-16T01:25:16.873 INFO:tasks.workunit.client.0.smithi063.stdout:9/586: stat d7/d9/d20/ccc 0 2024-09-16T01:25:16.880 INFO:tasks.workunit.client.0.smithi063.stdout:0/527: dwrite d1/d30/d52/d5a/d44/f64 [0,4194304] 0 2024-09-16T01:25:16.881 INFO:tasks.workunit.client.0.smithi063.stdout:0/528: stat d1/d30/f93 0 2024-09-16T01:25:16.882 INFO:tasks.workunit.client.0.smithi063.stdout:0/529: readlink d1/l25 0 2024-09-16T01:25:16.885 INFO:tasks.workunit.client.0.smithi063.stdout:0/530: rename d1/d1c/l72 to d1/d30/d95/db5/ld1 0 2024-09-16T01:25:16.888 INFO:tasks.workunit.client.0.smithi063.stdout:2/570: dread d3/d7/d8/d1f/d34/d45/d6e/fa8 [0,4194304] 0 2024-09-16T01:25:16.889 INFO:tasks.workunit.client.0.smithi063.stdout:0/531: dread d1/d1c/f80 [0,4194304] 0 2024-09-16T01:25:16.890 INFO:tasks.workunit.client.0.smithi063.stdout:0/532: chown d1/d1c/l28 3474686 1 2024-09-16T01:25:16.890 INFO:tasks.workunit.client.0.smithi063.stdout:2/571: write d3/d7/d8/d1f/d37/d4f/f94 [8645,6574] 0 2024-09-16T01:25:16.891 INFO:tasks.workunit.client.0.smithi063.stdout:0/533: fsync d1/fa 0 2024-09-16T01:25:16.892 INFO:tasks.workunit.client.0.smithi063.stdout:2/572: write d3/d7/d8/d19/d8c/d21/d28/d8a/da1/fa3 [4912728,52872] 0 2024-09-16T01:25:16.892 INFO:tasks.workunit.client.0.smithi063.stdout:0/534: chown d1/d30/lb7 816524 1 2024-09-16T01:25:16.896 INFO:tasks.workunit.client.0.smithi063.stdout:2/573: dread d3/d7/d8/d19/d3c/d53/d7f/d80/fbd [0,4194304] 0 2024-09-16T01:25:16.896 INFO:tasks.workunit.client.0.smithi063.stdout:0/535: rename d1/l8 to d1/d30/d52/d5a/d44/ld2 0 2024-09-16T01:25:16.899 INFO:tasks.workunit.client.0.smithi063.stdout:2/574: dread d3/d7/d8/d1f/fac [0,4194304] 0 2024-09-16T01:25:16.901 INFO:tasks.workunit.client.0.smithi063.stdout:2/575: fdatasync d3/d7/d8/d19/d8c/d21/d28/d8a/da1/f5e 0 2024-09-16T01:25:16.902 INFO:tasks.workunit.client.0.smithi063.stdout:0/536: dwrite d1/fa [0,4194304] 0 2024-09-16T01:25:16.902 INFO:tasks.workunit.client.0.smithi063.stdout:2/576: chown d3/d7/d8/l48 20650595 1 2024-09-16T01:25:16.905 INFO:tasks.workunit.client.0.smithi063.stdout:0/537: unlink d1/d30/d52/d5a/f3e 0 2024-09-16T01:25:16.906 INFO:tasks.workunit.client.0.smithi063.stdout:0/538: write d1/f31 [3603175,106525] 0 2024-09-16T01:25:16.906 INFO:tasks.workunit.client.0.smithi063.stdout:2/577: unlink d3/d7/d8/d19/d8c/d21/f8b 0 2024-09-16T01:25:16.907 INFO:tasks.workunit.client.0.smithi063.stdout:2/578: chown d3/d7/d8/d19/d8c/d21/l57 146815056 1 2024-09-16T01:25:16.910 INFO:tasks.workunit.client.0.smithi063.stdout:0/539: chown d1/df/l18 121 1 2024-09-16T01:25:16.911 INFO:tasks.workunit.client.0.smithi063.stdout:0/540: chown d1/df/d34/f45 51 1 2024-09-16T01:25:16.913 INFO:tasks.workunit.client.0.smithi063.stdout:0/541: truncate d1/df/d2c/f55 4432039 0 2024-09-16T01:25:16.915 INFO:tasks.workunit.client.0.smithi063.stdout:0/542: creat d1/df/fd3 x:0 0 0 2024-09-16T01:25:16.916 INFO:tasks.workunit.client.0.smithi063.stdout:0/543: dread d1/df/d34/f79 [0,4194304] 0 2024-09-16T01:25:16.921 INFO:tasks.workunit.client.0.smithi063.stdout:0/544: truncate d1/fc 964300 0 2024-09-16T01:25:16.928 INFO:tasks.workunit.client.0.smithi063.stdout:3/443: sync 2024-09-16T01:25:16.928 INFO:tasks.workunit.client.0.smithi063.stdout:0/545: dwrite d1/d30/d52/d5a/f9e [0,4194304] 0 2024-09-16T01:25:16.929 INFO:tasks.workunit.client.0.smithi063.stdout:3/444: write d2/f54 [191211,51299] 0 2024-09-16T01:25:16.937 INFO:tasks.workunit.client.0.smithi063.stdout:0/546: write d1/d2e/d73/f74 [577169,37176] 0 2024-09-16T01:25:16.943 INFO:tasks.workunit.client.0.smithi063.stdout:3/445: dread d2/d11/d37/d40/d5e/f55 [0,4194304] 0 2024-09-16T01:25:16.945 INFO:tasks.workunit.client.0.smithi063.stdout:0/547: dwrite d1/d2e/d73/f74 [0,4194304] 0 2024-09-16T01:25:16.948 INFO:tasks.workunit.client.0.smithi063.stdout:0/548: rmdir d1/d30/d95 39 2024-09-16T01:25:16.949 INFO:tasks.workunit.client.0.smithi063.stdout:0/549: creat d1/d2e/d50/fd4 x:0 0 0 2024-09-16T01:25:16.950 INFO:tasks.workunit.client.0.smithi063.stdout:3/446: write d2/d11/d18/f6f [707756,64899] 0 2024-09-16T01:25:16.951 INFO:tasks.workunit.client.0.smithi063.stdout:3/447: write d2/d5b/f7a [995760,83110] 0 2024-09-16T01:25:16.952 INFO:tasks.workunit.client.0.smithi063.stdout:0/550: write d1/d2e/d73/fc2 [491031,21068] 0 2024-09-16T01:25:16.956 INFO:tasks.workunit.client.0.smithi063.stdout:0/551: write d1/df/d34/f45 [631233,126110] 0 2024-09-16T01:25:16.957 INFO:tasks.workunit.client.0.smithi063.stdout:3/448: dwrite d2/d11/d37/f59 [0,4194304] 0 2024-09-16T01:25:16.959 INFO:tasks.workunit.client.0.smithi063.stdout:0/552: creat d1/d2e/d73/fd5 x:0 0 0 2024-09-16T01:25:16.961 INFO:tasks.workunit.client.0.smithi063.stdout:3/449: creat d2/fa0 x:0 0 0 2024-09-16T01:25:16.963 INFO:tasks.workunit.client.0.smithi063.stdout:3/450: read - d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/f84 zero size 2024-09-16T01:25:16.966 INFO:tasks.workunit.client.0.smithi063.stdout:0/553: dwrite d1/d30/d52/d5a/d36/fb2 [0,4194304] 0 2024-09-16T01:25:16.968 INFO:tasks.workunit.client.0.smithi063.stdout:0/554: stat d1/d2e/d50/d6f/f7b 0 2024-09-16T01:25:16.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/555: chown d1/df/d17/f8a 781771514 1 2024-09-16T01:25:16.971 INFO:tasks.workunit.client.0.smithi063.stdout:3/451: dwrite d2/f75 [0,4194304] 0 2024-09-16T01:25:16.974 INFO:tasks.workunit.client.0.smithi063.stdout:0/556: mknod d1/d30/d52/d5a/d36/d41/cd6 0 2024-09-16T01:25:16.974 INFO:tasks.workunit.client.0.smithi063.stdout:0/557: dread - d1/df/fd3 zero size 2024-09-16T01:25:16.975 INFO:tasks.workunit.client.0.smithi063.stdout:3/452: mkdir d2/d11/d37/d40/d5e/d3b/da1 0 2024-09-16T01:25:16.979 INFO:tasks.workunit.client.0.smithi063.stdout:0/558: getdents d1/d2e/d50 0 2024-09-16T01:25:16.980 INFO:tasks.workunit.client.0.smithi063.stdout:3/453: creat d2/d11/d37/d40/d5e/d3b/d94/fa2 x:0 0 0 2024-09-16T01:25:16.980 INFO:tasks.workunit.client.0.smithi063.stdout:0/559: rmdir d1/df/d2c/dc7 39 2024-09-16T01:25:16.983 INFO:tasks.workunit.client.0.smithi063.stdout:0/560: mknod d1/d30/d52/d5a/d36/d41/cd7 0 2024-09-16T01:25:16.984 INFO:tasks.workunit.client.0.smithi063.stdout:3/454: creat d2/d11/d37/d40/d5e/d3b/d68/d6b/fa3 x:0 0 0 2024-09-16T01:25:16.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/561: truncate d1/df/d17/f6d 4377750 0 2024-09-16T01:25:16.986 INFO:tasks.workunit.client.0.smithi063.stdout:0/562: truncate d1/d30/d52/d5a/f3d 3209759 0 2024-09-16T01:25:16.987 INFO:tasks.workunit.client.0.smithi063.stdout:3/455: rename d2/d11/d18/f3d to d2/d5b/fa4 0 2024-09-16T01:25:16.989 INFO:tasks.workunit.client.0.smithi063.stdout:3/456: write d2/d11/d37/d40/d5e/d3b/d94/fa2 [623368,106449] 0 2024-09-16T01:25:16.990 INFO:tasks.workunit.client.0.smithi063.stdout:0/563: getdents d1/df/d2c/dc7 0 2024-09-16T01:25:16.995 INFO:tasks.workunit.client.0.smithi063.stdout:3/457: dwrite d2/d11/d37/d40/d5e/f20 [4194304,4194304] 0 2024-09-16T01:25:17.065 INFO:tasks.workunit.client.0.smithi063.stdout:7/337: sync 2024-09-16T01:25:17.065 INFO:tasks.workunit.client.0.smithi063.stdout:5/473: sync 2024-09-16T01:25:17.065 INFO:tasks.workunit.client.0.smithi063.stdout:4/498: sync 2024-09-16T01:25:17.066 INFO:tasks.workunit.client.0.smithi063.stdout:7/338: chown d7/d18/d39/d5b/f5f 1714415 1 2024-09-16T01:25:17.066 INFO:tasks.workunit.client.0.smithi063.stdout:4/499: read d5/f3f [2998650,66312] 0 2024-09-16T01:25:17.067 INFO:tasks.workunit.client.0.smithi063.stdout:4/500: read - d5/d3b/df/d1c/d29/f65 zero size 2024-09-16T01:25:17.068 INFO:tasks.workunit.client.0.smithi063.stdout:5/474: creat d5/fa1 x:0 0 0 2024-09-16T01:25:17.069 INFO:tasks.workunit.client.0.smithi063.stdout:7/339: creat d7/d56/d57/d60/f61 x:0 0 0 2024-09-16T01:25:17.070 INFO:tasks.workunit.client.0.smithi063.stdout:5/475: write d5/d18/d29/d48/d7b/f95 [1040275,52166] 0 2024-09-16T01:25:17.072 INFO:tasks.workunit.client.0.smithi063.stdout:5/476: chown d5/d18/d29/d48/d98/d94/f86 11265599 1 2024-09-16T01:25:17.073 INFO:tasks.workunit.client.0.smithi063.stdout:4/501: dwrite d5/f8c [0,4194304] 0 2024-09-16T01:25:17.074 INFO:tasks.workunit.client.0.smithi063.stdout:7/340: getdents d7/d18/d39 0 2024-09-16T01:25:17.076 INFO:tasks.workunit.client.0.smithi063.stdout:4/502: write d5/d3b/f2d [3755862,86921] 0 2024-09-16T01:25:17.078 INFO:tasks.workunit.client.0.smithi063.stdout:5/477: dread d5/f38 [0,4194304] 0 2024-09-16T01:25:17.079 INFO:tasks.workunit.client.0.smithi063.stdout:7/341: rmdir d7 39 2024-09-16T01:25:17.080 INFO:tasks.workunit.client.0.smithi063.stdout:7/342: readlink d7/ld 0 2024-09-16T01:25:17.080 INFO:tasks.workunit.client.0.smithi063.stdout:5/478: dread d5/d18/d29/d48/d98/f68 [0,4194304] 0 2024-09-16T01:25:17.081 INFO:tasks.workunit.client.0.smithi063.stdout:7/343: write d7/d1c/d1f/d29/f4e [269218,119108] 0 2024-09-16T01:25:17.083 INFO:tasks.workunit.client.0.smithi063.stdout:4/503: link d5/d3b/c82 d5/d3b/d57/d66/d9b/ca0 0 2024-09-16T01:25:17.084 INFO:tasks.workunit.client.0.smithi063.stdout:7/344: symlink d7/d18/d39/d5b/l62 0 2024-09-16T01:25:17.085 INFO:tasks.workunit.client.0.smithi063.stdout:5/479: link d5/d18/d29/d48/f80 d5/d18/d29/d48/fa2 0 2024-09-16T01:25:17.086 INFO:tasks.workunit.client.0.smithi063.stdout:4/504: symlink d5/d3b/df/d1c/d29/d20/la1 0 2024-09-16T01:25:17.086 INFO:tasks.workunit.client.0.smithi063.stdout:4/505: dread - d5/d3b/d57/f67 zero size 2024-09-16T01:25:17.087 INFO:tasks.workunit.client.0.smithi063.stdout:4/506: write d5/d3b/f2d [6935903,28764] 0 2024-09-16T01:25:17.089 INFO:tasks.workunit.client.0.smithi063.stdout:4/507: getdents d5/d3b/df/d1c/d29/d20/d30/d92 0 2024-09-16T01:25:17.093 INFO:tasks.workunit.client.0.smithi063.stdout:4/508: mknod d5/d3b/df/d1c/d29/ca2 0 2024-09-16T01:25:17.094 INFO:tasks.workunit.client.0.smithi063.stdout:5/480: truncate d5/d18/d29/d48/d98/d94/f60 265226 0 2024-09-16T01:25:17.095 INFO:tasks.workunit.client.0.smithi063.stdout:5/481: dread - d5/d90/f99 zero size 2024-09-16T01:25:17.096 INFO:tasks.workunit.client.0.smithi063.stdout:5/482: chown d5/d18/f42 15 1 2024-09-16T01:25:17.101 INFO:tasks.workunit.client.0.smithi063.stdout:5/483: write d5/d12/f4a [6393051,110918] 0 2024-09-16T01:25:17.103 INFO:tasks.workunit.client.0.smithi063.stdout:5/484: mkdir d5/d7f/da3 0 2024-09-16T01:25:17.104 INFO:tasks.workunit.client.0.smithi063.stdout:5/485: rmdir d5/d7f 39 2024-09-16T01:25:17.105 INFO:tasks.workunit.client.0.smithi063.stdout:5/486: write d5/d18/d29/d48/d7b/f65 [224817,11307] 0 2024-09-16T01:25:17.106 INFO:tasks.workunit.client.0.smithi063.stdout:5/487: creat d5/d12/fa4 x:0 0 0 2024-09-16T01:25:17.110 INFO:tasks.workunit.client.0.smithi063.stdout:5/488: dread d5/d18/f6f [0,4194304] 0 2024-09-16T01:25:17.112 INFO:tasks.workunit.client.0.smithi063.stdout:5/489: truncate d5/d18/d29/f7e 697295 0 2024-09-16T01:25:17.117 INFO:tasks.workunit.client.0.smithi063.stdout:5/490: truncate d5/d18/d29/d48/d66/f82 1735277 0 2024-09-16T01:25:17.118 INFO:tasks.workunit.client.0.smithi063.stdout:5/491: chown d5/c96 25 1 2024-09-16T01:25:17.119 INFO:tasks.workunit.client.0.smithi063.stdout:5/492: symlink d5/d18/d29/d48/d66/la5 0 2024-09-16T01:25:17.124 INFO:tasks.workunit.client.0.smithi063.stdout:5/493: write d5/d18/d29/d48/d98/f68 [444619,11443] 0 2024-09-16T01:25:17.126 INFO:tasks.workunit.client.0.smithi063.stdout:5/494: mknod d5/d18/d29/d48/ca6 0 2024-09-16T01:25:17.127 INFO:tasks.workunit.client.0.smithi063.stdout:5/495: mknod d5/d12/d91/d72/ca7 0 2024-09-16T01:25:17.130 INFO:tasks.workunit.client.0.smithi063.stdout:5/496: getdents d5/d18/d29/d52 0 2024-09-16T01:25:17.135 INFO:tasks.workunit.client.0.smithi063.stdout:5/497: dwrite d5/d12/f4c [4194304,4194304] 0 2024-09-16T01:25:17.137 INFO:tasks.workunit.client.0.smithi063.stdout:5/498: write d5/d18/f6f [1248261,32832] 0 2024-09-16T01:25:17.140 INFO:tasks.workunit.client.0.smithi063.stdout:5/499: mknod d5/d12/ca8 0 2024-09-16T01:25:17.140 INFO:tasks.workunit.client.0.smithi063.stdout:5/500: fdatasync d5/d12/f2d 0 2024-09-16T01:25:17.142 INFO:tasks.workunit.client.0.smithi063.stdout:5/501: readlink d5/d18/l27 0 2024-09-16T01:25:17.144 INFO:tasks.workunit.client.0.smithi063.stdout:5/502: symlink d5/d18/d29/d48/d98/la9 0 2024-09-16T01:25:17.145 INFO:tasks.workunit.client.0.smithi063.stdout:5/503: chown d5/d12/c9f 0 1 2024-09-16T01:25:17.149 INFO:tasks.workunit.client.0.smithi063.stdout:5/504: link d5/d18/d29/d48/d98/d94/c36 d5/caa 0 2024-09-16T01:25:17.151 INFO:tasks.workunit.client.0.smithi063.stdout:5/505: symlink d5/lab 0 2024-09-16T01:25:17.153 INFO:tasks.workunit.client.0.smithi063.stdout:5/506: dread - d5/d18/f78 zero size 2024-09-16T01:25:17.153 INFO:tasks.workunit.client.0.smithi063.stdout:5/507: stat d5/d12/d91/c6d 0 2024-09-16T01:25:17.157 INFO:tasks.workunit.client.0.smithi063.stdout:8/326: sync 2024-09-16T01:25:17.157 INFO:tasks.workunit.client.0.smithi063.stdout:5/508: unlink d5/d18/d29/d48/d66/f9c 0 2024-09-16T01:25:17.160 INFO:tasks.workunit.client.0.smithi063.stdout:8/327: mknod d5/db/d12/d1a/d1e/c67 0 2024-09-16T01:25:17.161 INFO:tasks.workunit.client.0.smithi063.stdout:5/509: creat d5/d18/d29/d52/fac x:0 0 0 2024-09-16T01:25:17.161 INFO:tasks.workunit.client.0.smithi063.stdout:8/328: mkdir d5/db/d12/d1a/d1e/d68 0 2024-09-16T01:25:17.164 INFO:tasks.workunit.client.0.smithi063.stdout:8/329: mkdir d5/db/d12/d3d/d69 0 2024-09-16T01:25:17.166 INFO:tasks.workunit.client.0.smithi063.stdout:8/330: mknod d5/db/d12/d3d/c6a 0 2024-09-16T01:25:17.169 INFO:tasks.workunit.client.0.smithi063.stdout:8/331: rename d5/d9/f24 to d5/d9/d41/f6b 0 2024-09-16T01:25:17.171 INFO:tasks.workunit.client.0.smithi063.stdout:8/332: dread d5/d9/d2f/f3f [0,4194304] 0 2024-09-16T01:25:17.179 INFO:tasks.workunit.client.0.smithi063.stdout:5/510: dwrite d5/d18/f42 [0,4194304] 0 2024-09-16T01:25:17.179 INFO:tasks.workunit.client.0.smithi063.stdout:8/333: dread d5/f25 [0,4194304] 0 2024-09-16T01:25:17.180 INFO:tasks.workunit.client.0.smithi063.stdout:5/511: stat d5/d12/d91/c6d 0 2024-09-16T01:25:17.180 INFO:tasks.workunit.client.0.smithi063.stdout:8/334: chown d5/d3a/d40/l5b 4598685 1 2024-09-16T01:25:17.182 INFO:tasks.workunit.client.0.smithi063.stdout:5/512: unlink d5/d12/c9f 0 2024-09-16T01:25:17.183 INFO:tasks.workunit.client.0.smithi063.stdout:0/564: sync 2024-09-16T01:25:17.183 INFO:tasks.workunit.client.0.smithi063.stdout:3/458: sync 2024-09-16T01:25:17.183 INFO:tasks.workunit.client.0.smithi063.stdout:2/579: sync 2024-09-16T01:25:17.184 INFO:tasks.workunit.client.0.smithi063.stdout:6/461: sync 2024-09-16T01:25:17.184 INFO:tasks.workunit.client.0.smithi063.stdout:9/587: sync 2024-09-16T01:25:17.184 INFO:tasks.workunit.client.0.smithi063.stdout:7/345: sync 2024-09-16T01:25:17.184 INFO:tasks.workunit.client.0.smithi063.stdout:1/497: sync 2024-09-16T01:25:17.184 INFO:tasks.workunit.client.0.smithi063.stdout:8/335: rename d5/d9/d2f/f3f to d5/d9/f6c 0 2024-09-16T01:25:17.185 INFO:tasks.workunit.client.0.smithi063.stdout:5/513: write d5/d18/d29/d48/d98/d94/f60 [2663500,83037] 0 2024-09-16T01:25:17.186 INFO:tasks.workunit.client.0.smithi063.stdout:6/462: rmdir d3 39 2024-09-16T01:25:17.187 INFO:tasks.workunit.client.0.smithi063.stdout:1/498: dread - d1/d5/d15/d18/d4b/f94 zero size 2024-09-16T01:25:17.188 INFO:tasks.workunit.client.0.smithi063.stdout:7/346: rmdir d7/d56 39 2024-09-16T01:25:17.190 INFO:tasks.workunit.client.0.smithi063.stdout:0/565: unlink d1/df/d2c/d43/lc9 0 2024-09-16T01:25:17.191 INFO:tasks.workunit.client.0.smithi063.stdout:0/566: stat d1/df/d17/f68 0 2024-09-16T01:25:17.192 INFO:tasks.workunit.client.0.smithi063.stdout:9/588: mkdir d7/d4a/d4d/dcd 0 2024-09-16T01:25:17.193 INFO:tasks.workunit.client.0.smithi063.stdout:2/580: creat d3/fcb x:0 0 0 2024-09-16T01:25:17.194 INFO:tasks.workunit.client.0.smithi063.stdout:2/581: stat d3/d7/l25 0 2024-09-16T01:25:17.194 INFO:tasks.workunit.client.0.smithi063.stdout:5/514: mkdir d5/d18/d29/d48/dad 0 2024-09-16T01:25:17.195 INFO:tasks.workunit.client.0.smithi063.stdout:8/336: rmdir d5/db/d12/d1a/d1e 39 2024-09-16T01:25:17.200 INFO:tasks.workunit.client.0.smithi063.stdout:0/567: rename d1/d2e/d73/fc2 to d1/d30/d52/db3/fd8 0 2024-09-16T01:25:17.201 INFO:tasks.workunit.client.0.smithi063.stdout:6/463: chown d3/d30/ca3 24311 1 2024-09-16T01:25:17.203 INFO:tasks.workunit.client.0.smithi063.stdout:2/582: mkdir d3/d7/d8/d19/d8c/dcc 0 2024-09-16T01:25:17.203 INFO:tasks.workunit.client.0.smithi063.stdout:1/499: dwrite d1/d5/d82/d9b/f79 [0,4194304] 0 2024-09-16T01:25:17.204 INFO:tasks.workunit.client.0.smithi063.stdout:5/515: creat d5/d12/fae x:0 0 0 2024-09-16T01:25:17.204 INFO:tasks.workunit.client.0.smithi063.stdout:3/459: symlink d2/d11/d37/d40/d5e/d3b/d45/d9f/la5 0 2024-09-16T01:25:17.206 INFO:tasks.workunit.client.0.smithi063.stdout:7/347: creat d7/d56/d57/d60/f63 x:0 0 0 2024-09-16T01:25:17.206 INFO:tasks.workunit.client.0.smithi063.stdout:8/337: rmdir d5 39 2024-09-16T01:25:17.207 INFO:tasks.workunit.client.0.smithi063.stdout:9/589: dread d7/d9/d12/d14/f46 [0,4194304] 0 2024-09-16T01:25:17.207 INFO:tasks.workunit.client.0.smithi063.stdout:6/464: mkdir d3/d30/d39/dac 0 2024-09-16T01:25:17.208 INFO:tasks.workunit.client.0.smithi063.stdout:1/500: fdatasync d1/d5/d82/d9b/fa3 0 2024-09-16T01:25:17.209 INFO:tasks.workunit.client.0.smithi063.stdout:5/516: stat d5/d7f/c81 0 2024-09-16T01:25:17.209 INFO:tasks.workunit.client.0.smithi063.stdout:7/348: fdatasync d7/ff 0 2024-09-16T01:25:17.215 INFO:tasks.workunit.client.0.smithi063.stdout:2/583: rename d3/d7/d8/d1f/d37/l4d to d3/d7/d8/d19/d8c/lcd 0 2024-09-16T01:25:17.217 INFO:tasks.workunit.client.0.smithi063.stdout:3/460: dwrite d2/f33 [0,4194304] 0 2024-09-16T01:25:17.221 INFO:tasks.workunit.client.0.smithi063.stdout:9/590: mknod d7/d9/d12/d14/cce 0 2024-09-16T01:25:17.222 INFO:tasks.workunit.client.0.smithi063.stdout:6/465: dwrite d3/d48/d28/d3e/d44/da4/f50 [0,4194304] 0 2024-09-16T01:25:17.225 INFO:tasks.workunit.client.0.smithi063.stdout:1/501: dread d1/d5/f13 [0,4194304] 0 2024-09-16T01:25:17.226 INFO:tasks.workunit.client.0.smithi063.stdout:7/349: rename d7/f30 to d7/d56/f64 0 2024-09-16T01:25:17.227 INFO:tasks.workunit.client.0.smithi063.stdout:2/584: mkdir d3/d7/d8/d1f/d37/d4f/dce 0 2024-09-16T01:25:17.228 INFO:tasks.workunit.client.0.smithi063.stdout:3/461: mkdir d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6 0 2024-09-16T01:25:17.230 INFO:tasks.workunit.client.0.smithi063.stdout:5/517: fsync d5/d18/d29/d48/d98/d94/f92 0 2024-09-16T01:25:17.231 INFO:tasks.workunit.client.0.smithi063.stdout:9/591: creat d7/d9/d12/d14/d23/fcf x:0 0 0 2024-09-16T01:25:17.233 INFO:tasks.workunit.client.0.smithi063.stdout:8/338: dwrite d5/db/d12/d1a/d1e/f32 [0,4194304] 0 2024-09-16T01:25:17.233 INFO:tasks.workunit.client.0.smithi063.stdout:5/518: dread - d5/d18/d29/d48/d66/f69 zero size 2024-09-16T01:25:17.236 INFO:tasks.workunit.client.0.smithi063.stdout:0/568: truncate d1/d30/d52/d5a/d36/d41/f47 2024913 0 2024-09-16T01:25:17.237 INFO:tasks.workunit.client.0.smithi063.stdout:6/466: rename d3/d48/d28/d3e/d44/da4/f3c to d3/d41/d9b/da2/fad 0 2024-09-16T01:25:17.238 INFO:tasks.workunit.client.0.smithi063.stdout:1/502: read - d1/d12/f5b zero size 2024-09-16T01:25:17.238 INFO:tasks.workunit.client.0.smithi063.stdout:7/350: rmdir d7/d18/d40 39 2024-09-16T01:25:17.239 INFO:tasks.workunit.client.0.smithi063.stdout:0/569: chown d1/d2e/d48/dcb 158718237 1 2024-09-16T01:25:17.241 INFO:tasks.workunit.client.0.smithi063.stdout:3/462: dwrite d2/d11/d18/f92 [0,4194304] 0 2024-09-16T01:25:17.242 INFO:tasks.workunit.client.0.smithi063.stdout:9/592: creat d7/d9/d20/fd0 x:0 0 0 2024-09-16T01:25:17.242 INFO:tasks.workunit.client.0.smithi063.stdout:1/503: chown d1/d5/d15/d18/d4b/f5f 715110588 1 2024-09-16T01:25:17.246 INFO:tasks.workunit.client.0.smithi063.stdout:5/519: creat d5/d18/d29/d52/faf x:0 0 0 2024-09-16T01:25:17.247 INFO:tasks.workunit.client.0.smithi063.stdout:6/467: stat d3/d48/f26 0 2024-09-16T01:25:17.249 INFO:tasks.workunit.client.0.smithi063.stdout:6/468: write d3/d41/f7a [50972,81389] 0 2024-09-16T01:25:17.249 INFO:tasks.workunit.client.0.smithi063.stdout:0/570: dwrite d1/d1c/f3f [0,4194304] 0 2024-09-16T01:25:17.250 INFO:tasks.workunit.client.0.smithi063.stdout:2/585: creat d3/d7/d8/d19/d8c/d21/d28/d8a/db7/fcf x:0 0 0 2024-09-16T01:25:17.251 INFO:tasks.workunit.client.0.smithi063.stdout:7/351: mkdir d7/d18/d39/d65 0 2024-09-16T01:25:17.254 INFO:tasks.workunit.client.0.smithi063.stdout:1/504: creat d1/d5/d82/faa x:0 0 0 2024-09-16T01:25:17.255 INFO:tasks.workunit.client.0.smithi063.stdout:8/339: write d5/f8 [4331600,30342] 0 2024-09-16T01:25:17.257 INFO:tasks.workunit.client.0.smithi063.stdout:5/520: rename d5/d18/f42 to d5/d7f/fb0 0 2024-09-16T01:25:17.259 INFO:tasks.workunit.client.0.smithi063.stdout:6/469: symlink d3/d30/d39/d69/d95/lae 0 2024-09-16T01:25:17.261 INFO:tasks.workunit.client.0.smithi063.stdout:3/463: mknod d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6/ca7 0 2024-09-16T01:25:17.262 INFO:tasks.workunit.client.0.smithi063.stdout:3/464: stat d2/d5b 0 2024-09-16T01:25:17.265 INFO:tasks.workunit.client.0.smithi063.stdout:4/509: sync 2024-09-16T01:25:17.265 INFO:tasks.workunit.client.0.smithi063.stdout:2/586: unlink d3/d7/la4 0 2024-09-16T01:25:17.268 INFO:tasks.workunit.client.0.smithi063.stdout:5/521: mkdir d5/d18/d29/d48/d66/db1 0 2024-09-16T01:25:17.269 INFO:tasks.workunit.client.0.smithi063.stdout:1/505: dread d1/d5/d15/d18/d4b/f5f [0,4194304] 0 2024-09-16T01:25:17.269 INFO:tasks.workunit.client.0.smithi063.stdout:7/352: dread d7/d1c/d1f/f2e [0,4194304] 0 2024-09-16T01:25:17.269 INFO:tasks.workunit.client.0.smithi063.stdout:5/522: dread - d5/d12/fa4 zero size 2024-09-16T01:25:17.269 INFO:tasks.workunit.client.0.smithi063.stdout:9/593: mkdir d7/d9/d12/d14/d63/d5f/dab/dd1 0 2024-09-16T01:25:17.273 INFO:tasks.workunit.client.0.smithi063.stdout:2/587: write d3/d7/d8/d19/f24 [4736054,15832] 0 2024-09-16T01:25:17.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/510: symlink d5/d3b/df/d1c/d29/d20/d30/la3 0 2024-09-16T01:25:17.275 INFO:tasks.workunit.client.0.smithi063.stdout:7/353: mkdir d7/d1c/d1f/d66 0 2024-09-16T01:25:17.276 INFO:tasks.workunit.client.0.smithi063.stdout:1/506: mkdir d1/d5/d6f/dab 0 2024-09-16T01:25:17.277 INFO:tasks.workunit.client.0.smithi063.stdout:6/470: dread d3/d48/f26 [0,4194304] 0 2024-09-16T01:25:17.279 INFO:tasks.workunit.client.0.smithi063.stdout:8/340: getdents d5/db 0 2024-09-16T01:25:17.279 INFO:tasks.workunit.client.0.smithi063.stdout:2/588: creat d3/d7/d8/d1f/d34/d45/fd0 x:0 0 0 2024-09-16T01:25:17.280 INFO:tasks.workunit.client.0.smithi063.stdout:0/571: rename d1/d30/d52/d5a/d36/d41/f47 to d1/d30/d52/d5a/fd9 0 2024-09-16T01:25:17.283 INFO:tasks.workunit.client.0.smithi063.stdout:4/511: creat d5/d3b/df/d1c/d29/d32/d60/d61/fa4 x:0 0 0 2024-09-16T01:25:17.283 INFO:tasks.workunit.client.0.smithi063.stdout:7/354: symlink d7/d56/d57/l67 0 2024-09-16T01:25:17.285 INFO:tasks.workunit.client.0.smithi063.stdout:3/465: dread d2/d11/d37/d40/d5e/d3b/d94/d30/f57 [0,4194304] 0 2024-09-16T01:25:17.287 INFO:tasks.workunit.client.0.smithi063.stdout:7/355: chown d7/d18/l35 15 1 2024-09-16T01:25:17.288 INFO:tasks.workunit.client.0.smithi063.stdout:5/523: truncate d5/d18/d29/d48/d98/f68 325978 0 2024-09-16T01:25:17.289 INFO:tasks.workunit.client.0.smithi063.stdout:9/594: dread d7/d4a/dba/f45 [0,4194304] 0 2024-09-16T01:25:17.292 INFO:tasks.workunit.client.0.smithi063.stdout:1/507: dwrite d1/f57 [0,4194304] 0 2024-09-16T01:25:17.293 INFO:tasks.workunit.client.0.smithi063.stdout:0/572: link d1/df/l18 d1/d2e/d48/dc3/lda 0 2024-09-16T01:25:17.296 INFO:tasks.workunit.client.0.smithi063.stdout:6/471: link d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/l8b d3/d30/laf 0 2024-09-16T01:25:17.297 INFO:tasks.workunit.client.0.smithi063.stdout:9/595: chown d7/d9/d12/d14/c97 151 1 2024-09-16T01:25:17.298 INFO:tasks.workunit.client.0.smithi063.stdout:2/589: dwrite d3/d7/d8/d1f/f3e [0,4194304] 0 2024-09-16T01:25:17.298 INFO:tasks.workunit.client.0.smithi063.stdout:5/524: unlink d5/d18/d29/d52/faf 0 2024-09-16T01:25:17.300 INFO:tasks.workunit.client.0.smithi063.stdout:8/341: dwrite d5/d9/f35 [0,4194304] 0 2024-09-16T01:25:17.300 INFO:tasks.workunit.client.0.smithi063.stdout:3/466: link d2/f81 d2/d11/d69/d80/d8a/fa8 0 2024-09-16T01:25:17.304 INFO:tasks.workunit.client.0.smithi063.stdout:0/573: write d1/d30/d52/d5a/d44/f64 [737238,71837] 0 2024-09-16T01:25:17.304 INFO:tasks.workunit.client.0.smithi063.stdout:5/525: unlink d5/f31 0 2024-09-16T01:25:17.308 INFO:tasks.workunit.client.0.smithi063.stdout:6/472: write d3/d30/d8d/f8f [796048,47032] 0 2024-09-16T01:25:17.310 INFO:tasks.workunit.client.0.smithi063.stdout:3/467: symlink d2/d11/d37/d40/d5e/d3b/d68/la9 0 2024-09-16T01:25:17.310 INFO:tasks.workunit.client.0.smithi063.stdout:9/596: truncate d7/d1f/f83 1039703 0 2024-09-16T01:25:17.311 INFO:tasks.workunit.client.0.smithi063.stdout:5/526: write d5/d12/d91/f8c [522500,120456] 0 2024-09-16T01:25:17.312 INFO:tasks.workunit.client.0.smithi063.stdout:0/574: mknod d1/d2e/d48/dc3/cdb 0 2024-09-16T01:25:17.313 INFO:tasks.workunit.client.0.smithi063.stdout:2/590: write d3/d7/d8/d1f/d34/d45/d6e/fa8 [4365487,121423] 0 2024-09-16T01:25:17.314 INFO:tasks.workunit.client.0.smithi063.stdout:1/508: dread d1/d5/d15/d18/f1e [0,4194304] 0 2024-09-16T01:25:17.314 INFO:tasks.workunit.client.0.smithi063.stdout:3/468: stat d2/d11/d37/f59 0 2024-09-16T01:25:17.315 INFO:tasks.workunit.client.0.smithi063.stdout:9/597: readlink d7/d9/d12/l4f 0 2024-09-16T01:25:17.315 INFO:tasks.workunit.client.0.smithi063.stdout:8/342: rename d5/db/f47 to d5/db/d12/d3d/d69/f6d 0 2024-09-16T01:25:17.318 INFO:tasks.workunit.client.0.smithi063.stdout:2/591: write d3/f51 [294741,38833] 0 2024-09-16T01:25:17.320 INFO:tasks.workunit.client.0.smithi063.stdout:5/527: mknod d5/d18/d29/d48/d98/d94/cb2 0 2024-09-16T01:25:17.320 INFO:tasks.workunit.client.0.smithi063.stdout:7/356: dread d7/f12 [0,4194304] 0 2024-09-16T01:25:17.321 INFO:tasks.workunit.client.0.smithi063.stdout:1/509: write d1/d5/d82/d9b/f9e [35368,89653] 0 2024-09-16T01:25:17.321 INFO:tasks.workunit.client.0.smithi063.stdout:8/343: symlink d5/db/d12/d3d/d69/l6e 0 2024-09-16T01:25:17.322 INFO:tasks.workunit.client.0.smithi063.stdout:9/598: read d7/d9/d12/d14/f29 [1181655,55801] 0 2024-09-16T01:25:17.322 INFO:tasks.workunit.client.0.smithi063.stdout:4/512: dread d5/d3b/df/d1c/d29/d32/d60/d61/f86 [0,4194304] 0 2024-09-16T01:25:17.323 INFO:tasks.workunit.client.0.smithi063.stdout:3/469: symlink d2/d11/d37/d40/d5e/d97/laa 0 2024-09-16T01:25:17.325 INFO:tasks.workunit.client.0.smithi063.stdout:0/575: creat d1/d30/d52/d5a/d36/fdc x:0 0 0 2024-09-16T01:25:17.327 INFO:tasks.workunit.client.0.smithi063.stdout:8/344: symlink d5/d3a/d40/d4a/l6f 0 2024-09-16T01:25:17.328 INFO:tasks.workunit.client.0.smithi063.stdout:7/357: dread d7/ff [0,4194304] 0 2024-09-16T01:25:17.328 INFO:tasks.workunit.client.0.smithi063.stdout:1/510: creat d1/d5/fac x:0 0 0 2024-09-16T01:25:17.330 INFO:tasks.workunit.client.0.smithi063.stdout:4/513: creat d5/d3b/df/d1c/d29/d20/fa5 x:0 0 0 2024-09-16T01:25:17.331 INFO:tasks.workunit.client.0.smithi063.stdout:1/511: stat d1/d5/d15/f19 0 2024-09-16T01:25:17.332 INFO:tasks.workunit.client.0.smithi063.stdout:8/345: chown d5/d3a/d40/d4a/f4d 781203 1 2024-09-16T01:25:17.333 INFO:tasks.workunit.client.0.smithi063.stdout:2/592: link d3/d7/d8/d1f/d37/d4f/lb0 d3/d7/d8/d19/d3c/d53/ld1 0 2024-09-16T01:25:17.335 INFO:tasks.workunit.client.0.smithi063.stdout:7/358: symlink d7/d18/d39/l68 0 2024-09-16T01:25:17.335 INFO:tasks.workunit.client.0.smithi063.stdout:3/470: dread d2/d11/d37/d40/d5e/d3b/d94/f5c [0,4194304] 0 2024-09-16T01:25:17.336 INFO:tasks.workunit.client.0.smithi063.stdout:6/473: dread d3/d10/f60 [0,4194304] 0 2024-09-16T01:25:17.340 INFO:tasks.workunit.client.0.smithi063.stdout:8/346: mknod d5/c70 0 2024-09-16T01:25:17.340 INFO:tasks.workunit.client.0.smithi063.stdout:2/593: write d3/d7/d8/d19/d3c/fb2 [790535,86099] 0 2024-09-16T01:25:17.342 INFO:tasks.workunit.client.0.smithi063.stdout:8/347: readlink d5/d9/l55 0 2024-09-16T01:25:17.342 INFO:tasks.workunit.client.0.smithi063.stdout:7/359: creat d7/d18/d39/d5b/f69 x:0 0 0 2024-09-16T01:25:17.345 INFO:tasks.workunit.client.0.smithi063.stdout:0/576: dwrite d1/df/d2c/db6/fb9 [0,4194304] 0 2024-09-16T01:25:17.345 INFO:tasks.workunit.client.0.smithi063.stdout:5/528: dread d5/d18/f2a [4194304,4194304] 0 2024-09-16T01:25:17.345 INFO:tasks.workunit.client.0.smithi063.stdout:9/599: dread d7/d9/d12/d14/f91 [0,4194304] 0 2024-09-16T01:25:17.346 INFO:tasks.workunit.client.0.smithi063.stdout:3/471: unlink d2/d11/d37/d40/d5e/d3b/d68/d6b/fa3 0 2024-09-16T01:25:17.347 INFO:tasks.workunit.client.0.smithi063.stdout:7/360: write d7/d1c/d1f/f38 [1394543,102889] 0 2024-09-16T01:25:17.347 INFO:tasks.workunit.client.0.smithi063.stdout:2/594: rmdir d3 39 2024-09-16T01:25:17.349 INFO:tasks.workunit.client.0.smithi063.stdout:9/600: dread - d7/d4a/f93 zero size 2024-09-16T01:25:17.352 INFO:tasks.workunit.client.0.smithi063.stdout:4/514: truncate d5/d3b/df/d1c/d29/d32/d60/d61/f86 2760388 0 2024-09-16T01:25:17.354 INFO:tasks.workunit.client.0.smithi063.stdout:0/577: unlink d1/d2e/d50/la5 0 2024-09-16T01:25:17.354 INFO:tasks.workunit.client.0.smithi063.stdout:6/474: write d3/d48/d28/f2e [5171322,102506] 0 2024-09-16T01:25:17.357 INFO:tasks.workunit.client.0.smithi063.stdout:9/601: chown d7/d4a/l4c 6302 1 2024-09-16T01:25:17.357 INFO:tasks.workunit.client.0.smithi063.stdout:5/529: creat d5/d12/d91/d72/fb3 x:0 0 0 2024-09-16T01:25:17.361 INFO:tasks.workunit.client.0.smithi063.stdout:0/578: mknod d1/d1c/dcd/cdd 0 2024-09-16T01:25:17.364 INFO:tasks.workunit.client.0.smithi063.stdout:5/530: fsync d5/d18/f2a 0 2024-09-16T01:25:17.364 INFO:tasks.workunit.client.0.smithi063.stdout:8/348: dwrite d5/f58 [0,4194304] 0 2024-09-16T01:25:17.365 INFO:tasks.workunit.client.0.smithi063.stdout:1/512: dread d1/d5/d15/d1b/f39 [0,4194304] 0 2024-09-16T01:25:17.365 INFO:tasks.workunit.client.0.smithi063.stdout:9/602: creat d7/d4a/d4d/d96/fd2 x:0 0 0 2024-09-16T01:25:17.369 INFO:tasks.workunit.client.0.smithi063.stdout:3/472: dread d2/f33 [0,4194304] 0 2024-09-16T01:25:17.370 INFO:tasks.workunit.client.0.smithi063.stdout:0/579: mkdir d1/df/d2c/dde 0 2024-09-16T01:25:17.372 INFO:tasks.workunit.client.0.smithi063.stdout:2/595: mknod d3/d7/d8/d1f/d37/d4f/dce/cd2 0 2024-09-16T01:25:17.373 INFO:tasks.workunit.client.0.smithi063.stdout:8/349: write d5/f3b [599140,9897] 0 2024-09-16T01:25:17.374 INFO:tasks.workunit.client.0.smithi063.stdout:7/361: dread d7/f19 [0,4194304] 0 2024-09-16T01:25:17.377 INFO:tasks.workunit.client.0.smithi063.stdout:2/596: unlink d3/f60 0 2024-09-16T01:25:17.378 INFO:tasks.workunit.client.0.smithi063.stdout:1/513: rename d1/d12/d56 to d1/d5/d15/d18/d7c/dad 0 2024-09-16T01:25:17.379 INFO:tasks.workunit.client.0.smithi063.stdout:9/603: rmdir d7/d4a/dba/d7f/dc1 0 2024-09-16T01:25:17.380 INFO:tasks.workunit.client.0.smithi063.stdout:4/515: truncate d5/d3b/df/d1c/d29/d32/d60/d61/f52 728921 0 2024-09-16T01:25:17.382 INFO:tasks.workunit.client.0.smithi063.stdout:8/350: truncate d5/f25 1118674 0 2024-09-16T01:25:17.383 INFO:tasks.workunit.client.0.smithi063.stdout:5/531: dwrite d5/f67 [0,4194304] 0 2024-09-16T01:25:17.384 INFO:tasks.workunit.client.0.smithi063.stdout:6/475: dwrite d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/f83 [0,4194304] 0 2024-09-16T01:25:17.385 INFO:tasks.workunit.client.0.smithi063.stdout:1/514: write d1/d5/d15/d18/f6a [1968672,60185] 0 2024-09-16T01:25:17.388 INFO:tasks.workunit.client.0.smithi063.stdout:9/604: write d7/d4a/d4d/f80 [282341,90990] 0 2024-09-16T01:25:17.390 INFO:tasks.workunit.client.0.smithi063.stdout:0/580: getdents d1/d2e/dab 0 2024-09-16T01:25:17.393 INFO:tasks.workunit.client.0.smithi063.stdout:8/351: symlink d5/d9/d41/l71 0 2024-09-16T01:25:17.393 INFO:tasks.workunit.client.0.smithi063.stdout:5/532: mknod d5/d12/cb4 0 2024-09-16T01:25:17.395 INFO:tasks.workunit.client.0.smithi063.stdout:6/476: mkdir d3/d30/d39/d69/d95/db0 0 2024-09-16T01:25:17.395 INFO:tasks.workunit.client.0.smithi063.stdout:7/362: dwrite d7/d56/d57/f5c [0,4194304] 0 2024-09-16T01:25:17.401 INFO:tasks.workunit.client.0.smithi063.stdout:4/516: dwrite d5/d3b/df/f95 [0,4194304] 0 2024-09-16T01:25:17.401 INFO:tasks.workunit.client.0.smithi063.stdout:6/477: chown d3/d48/d7e/d91/l7f 0 1 2024-09-16T01:25:17.404 INFO:tasks.workunit.client.0.smithi063.stdout:1/515: dwrite d1/d5/f11 [0,4194304] 0 2024-09-16T01:25:17.404 INFO:tasks.workunit.client.0.smithi063.stdout:3/473: truncate d2/d11/d37/d40/d5e/d3b/d94/fa2 253620 0 2024-09-16T01:25:17.405 INFO:tasks.workunit.client.0.smithi063.stdout:5/533: chown d5/d12/d91/d72/l89 247362 1 2024-09-16T01:25:17.409 INFO:tasks.workunit.client.0.smithi063.stdout:2/597: rename d3/d7/d8/d19/d8c/d21/d28/d8a/cb1 to d3/d7/d8/d1f/d34/cd3 0 2024-09-16T01:25:17.409 INFO:tasks.workunit.client.0.smithi063.stdout:8/352: dread d5/db/d12/d1a/d1e/f32 [0,4194304] 0 2024-09-16T01:25:17.411 INFO:tasks.workunit.client.0.smithi063.stdout:4/517: creat d5/d3b/d57/fa6 x:0 0 0 2024-09-16T01:25:17.412 INFO:tasks.workunit.client.0.smithi063.stdout:1/516: truncate d1/d5/d15/d18/d4b/f94 947903 0 2024-09-16T01:25:17.414 INFO:tasks.workunit.client.0.smithi063.stdout:6/478: symlink d3/d48/d28/d3e/d68/lb1 0 2024-09-16T01:25:17.415 INFO:tasks.workunit.client.0.smithi063.stdout:1/517: chown d1/d5/d15/d18/d7c 1201 1 2024-09-16T01:25:17.417 INFO:tasks.workunit.client.0.smithi063.stdout:6/479: chown d3/d48/d28/d3e/d44/d52/l63 98319 1 2024-09-16T01:25:17.417 INFO:tasks.workunit.client.0.smithi063.stdout:9/605: creat d7/d9/d12/d14/d63/fd3 x:0 0 0 2024-09-16T01:25:17.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/598: dwrite d3/d7/d8/f10 [8388608,4194304] 0 2024-09-16T01:25:17.423 INFO:tasks.workunit.client.0.smithi063.stdout:0/581: rename d1/fb8 to d1/df/db1/fdf 0 2024-09-16T01:25:17.424 INFO:tasks.workunit.client.0.smithi063.stdout:0/582: chown d1/df/f9c 33251 1 2024-09-16T01:25:17.425 INFO:tasks.workunit.client.0.smithi063.stdout:0/583: write d1/df/d17/f92 [2368081,95669] 0 2024-09-16T01:25:17.426 INFO:tasks.workunit.client.0.smithi063.stdout:7/363: link d7/d1c/c46 d7/d18/d39/c6a 0 2024-09-16T01:25:17.427 INFO:tasks.workunit.client.0.smithi063.stdout:1/518: mkdir d1/d5/d15/d18/d4b/dae 0 2024-09-16T01:25:17.428 INFO:tasks.workunit.client.0.smithi063.stdout:5/534: truncate d5/d18/d29/d48/d98/f68 289103 0 2024-09-16T01:25:17.431 INFO:tasks.workunit.client.0.smithi063.stdout:2/599: mkdir d3/d7/d8/d19/d8c/d21/d9c/dd4 0 2024-09-16T01:25:17.433 INFO:tasks.workunit.client.0.smithi063.stdout:4/518: rename d5/d3b/d57/d68/d78 to d5/d3b/d5c/da7 0 2024-09-16T01:25:17.434 INFO:tasks.workunit.client.0.smithi063.stdout:0/584: dwrite d1/df/fa4 [0,4194304] 0 2024-09-16T01:25:17.436 INFO:tasks.workunit.client.0.smithi063.stdout:7/364: mkdir d7/d56/d6b 0 2024-09-16T01:25:17.440 INFO:tasks.workunit.client.0.smithi063.stdout:3/474: dwrite d2/d11/d37/d40/d5e/d3b/d94/d30/f57 [0,4194304] 0 2024-09-16T01:25:17.441 INFO:tasks.workunit.client.0.smithi063.stdout:6/480: rename d3/d30/c3b to d3/d30/d8d/cb2 0 2024-09-16T01:25:17.446 INFO:tasks.workunit.client.0.smithi063.stdout:9/606: dwrite d7/d9/d12/fc2 [4194304,4194304] 0 2024-09-16T01:25:17.449 INFO:tasks.workunit.client.0.smithi063.stdout:8/353: getdents d5/d9 0 2024-09-16T01:25:17.450 INFO:tasks.workunit.client.0.smithi063.stdout:1/519: rename d1/d5/d15/d18/c3d to d1/d5/d63/caf 0 2024-09-16T01:25:17.451 INFO:tasks.workunit.client.0.smithi063.stdout:9/607: dread d7/f71 [0,4194304] 0 2024-09-16T01:25:17.451 INFO:tasks.workunit.client.0.smithi063.stdout:6/481: write d3/d48/d28/d3e/d44/da4/f50 [5144606,96742] 0 2024-09-16T01:25:17.452 INFO:tasks.workunit.client.0.smithi063.stdout:7/365: mkdir d7/d18/d40/d6c 0 2024-09-16T01:25:17.452 INFO:tasks.workunit.client.0.smithi063.stdout:2/600: dread d3/d7/d8/d19/d3c/d53/d7f/d80/f95 [0,4194304] 0 2024-09-16T01:25:17.453 INFO:tasks.workunit.client.0.smithi063.stdout:5/535: creat d5/fb5 x:0 0 0 2024-09-16T01:25:17.456 INFO:tasks.workunit.client.0.smithi063.stdout:0/585: link d1/fa d1/d1c/dcd/fe0 0 2024-09-16T01:25:17.458 INFO:tasks.workunit.client.0.smithi063.stdout:4/519: truncate d5/d3b/df/f3e 2436170 0 2024-09-16T01:25:17.460 INFO:tasks.workunit.client.0.smithi063.stdout:4/520: truncate d5/d3b/d57/f67 557220 0 2024-09-16T01:25:17.460 INFO:tasks.workunit.client.0.smithi063.stdout:4/521: stat d5/d3b/df/d1c/d29/d20/l34 0 2024-09-16T01:25:17.461 INFO:tasks.workunit.client.0.smithi063.stdout:3/475: mkdir d2/d11/d37/dab 0 2024-09-16T01:25:17.463 INFO:tasks.workunit.client.0.smithi063.stdout:9/608: symlink d7/d4a/d9d/ld4 0 2024-09-16T01:25:17.465 INFO:tasks.workunit.client.0.smithi063.stdout:1/520: mknod d1/d5/d15/d18/cb0 0 2024-09-16T01:25:17.467 INFO:tasks.workunit.client.0.smithi063.stdout:1/521: fdatasync d1/d5/d82/faa 0 2024-09-16T01:25:17.467 INFO:tasks.workunit.client.0.smithi063.stdout:2/601: creat d3/d7/d8/d1f/d37/fd5 x:0 0 0 2024-09-16T01:25:17.468 INFO:tasks.workunit.client.0.smithi063.stdout:5/536: mknod d5/d18/d29/d48/d98/cb6 0 2024-09-16T01:25:17.468 INFO:tasks.workunit.client.0.smithi063.stdout:3/476: dwrite d2/d11/d37/f88 [0,4194304] 0 2024-09-16T01:25:17.469 INFO:tasks.workunit.client.0.smithi063.stdout:0/586: creat d1/d2e/d48/dc3/fe1 x:0 0 0 2024-09-16T01:25:17.470 INFO:tasks.workunit.client.0.smithi063.stdout:8/354: symlink d5/db/d12/d1a/d1e/d68/l72 0 2024-09-16T01:25:17.471 INFO:tasks.workunit.client.0.smithi063.stdout:6/482: mknod d3/d48/cb3 0 2024-09-16T01:25:17.472 INFO:tasks.workunit.client.0.smithi063.stdout:8/355: chown d5/d9/d41 2 1 2024-09-16T01:25:17.473 INFO:tasks.workunit.client.0.smithi063.stdout:2/602: truncate d3/d7/d8/d19/d3c/d58/f93 924494 0 2024-09-16T01:25:17.475 INFO:tasks.workunit.client.0.smithi063.stdout:9/609: rename d7/d1f/cc9 to d7/d9/d12/d14/d38/cd5 0 2024-09-16T01:25:17.476 INFO:tasks.workunit.client.0.smithi063.stdout:4/522: dread d5/d3b/df/d1c/d29/d32/f64 [0,4194304] 0 2024-09-16T01:25:17.477 INFO:tasks.workunit.client.0.smithi063.stdout:3/477: chown f0 79 1 2024-09-16T01:25:17.479 INFO:tasks.workunit.client.0.smithi063.stdout:5/537: creat d5/d12/fb7 x:0 0 0 2024-09-16T01:25:17.480 INFO:tasks.workunit.client.0.smithi063.stdout:1/522: rmdir d1/d5/d82/d9b 39 2024-09-16T01:25:17.482 INFO:tasks.workunit.client.0.smithi063.stdout:6/483: mkdir d3/d48/d28/d3e/d68/db4 0 2024-09-16T01:25:17.482 INFO:tasks.workunit.client.0.smithi063.stdout:8/356: mknod d5/d9/d41/c73 0 2024-09-16T01:25:17.483 INFO:tasks.workunit.client.0.smithi063.stdout:1/523: dread d1/d5/d15/d18/f1e [0,4194304] 0 2024-09-16T01:25:17.484 INFO:tasks.workunit.client.0.smithi063.stdout:1/524: dread - d1/d12/f8b zero size 2024-09-16T01:25:17.485 INFO:tasks.workunit.client.0.smithi063.stdout:4/523: fdatasync d5/f3f 0 2024-09-16T01:25:17.485 INFO:tasks.workunit.client.0.smithi063.stdout:1/525: write d1/d5/d15/d18/d4b/f94 [1456800,47378] 0 2024-09-16T01:25:17.486 INFO:tasks.workunit.client.0.smithi063.stdout:3/478: rmdir d2/d11/d69/d80/d8a 39 2024-09-16T01:25:17.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/610: rmdir d7 39 2024-09-16T01:25:17.488 INFO:tasks.workunit.client.0.smithi063.stdout:3/479: read d2/d11/d37/d40/d5e/d3b/d94/f2f [130028,103784] 0 2024-09-16T01:25:17.489 INFO:tasks.workunit.client.0.smithi063.stdout:6/484: chown d3/d30/l3d 3111 1 2024-09-16T01:25:17.490 INFO:tasks.workunit.client.0.smithi063.stdout:5/538: rmdir d5/d18/d29/d52 39 2024-09-16T01:25:17.491 INFO:tasks.workunit.client.0.smithi063.stdout:7/366: getdents d7/d18/d39/d5b 0 2024-09-16T01:25:17.491 INFO:tasks.workunit.client.0.smithi063.stdout:8/357: mkdir d5/d9/d41/d74 0 2024-09-16T01:25:17.493 INFO:tasks.workunit.client.0.smithi063.stdout:2/603: truncate d3/f4b 6676338 0 2024-09-16T01:25:17.493 INFO:tasks.workunit.client.0.smithi063.stdout:2/604: chown d3/d77 6706 1 2024-09-16T01:25:17.496 INFO:tasks.workunit.client.0.smithi063.stdout:1/526: creat d1/d5/d15/d18/d4b/fb1 x:0 0 0 2024-09-16T01:25:17.499 INFO:tasks.workunit.client.0.smithi063.stdout:7/367: chown d7/d1c/c46 50239190 1 2024-09-16T01:25:17.499 INFO:tasks.workunit.client.0.smithi063.stdout:8/358: mknod d5/db/d12/d3d/d69/c75 0 2024-09-16T01:25:17.501 INFO:tasks.workunit.client.0.smithi063.stdout:8/359: write d5/d9/f35 [2129922,39715] 0 2024-09-16T01:25:17.502 INFO:tasks.workunit.client.0.smithi063.stdout:9/611: dwrite d7/d9/f2a [0,4194304] 0 2024-09-16T01:25:17.504 INFO:tasks.workunit.client.0.smithi063.stdout:0/587: getdents d1/d30/d52/db3 0 2024-09-16T01:25:17.506 INFO:tasks.workunit.client.0.smithi063.stdout:9/612: chown d7/d4a/d4d/d96/ccb 8611216 1 2024-09-16T01:25:17.508 INFO:tasks.workunit.client.0.smithi063.stdout:8/360: dread d5/f3b [0,4194304] 0 2024-09-16T01:25:17.510 INFO:tasks.workunit.client.0.smithi063.stdout:7/368: dread d7/f10 [0,4194304] 0 2024-09-16T01:25:17.510 INFO:tasks.workunit.client.0.smithi063.stdout:8/361: fdatasync d5/d3a/f43 0 2024-09-16T01:25:17.511 INFO:tasks.workunit.client.0.smithi063.stdout:4/524: rename d5/d3b/df/d1c/d29/d20/d30/l8f to d5/d3b/df/d1c/d29/d32/la8 0 2024-09-16T01:25:17.513 INFO:tasks.workunit.client.0.smithi063.stdout:2/605: truncate d3/d7/f3f 720757 0 2024-09-16T01:25:17.514 INFO:tasks.workunit.client.0.smithi063.stdout:3/480: dwrite d2/d11/f34 [0,4194304] 0 2024-09-16T01:25:17.515 INFO:tasks.workunit.client.0.smithi063.stdout:6/485: rename d3/d41/d9b/da2 to d3/d30/d39/dac/db5 0 2024-09-16T01:25:17.524 INFO:tasks.workunit.client.0.smithi063.stdout:2/606: symlink d3/d7/d8/d19/d8c/d21/d28/d8a/da1/ld6 0 2024-09-16T01:25:17.525 INFO:tasks.workunit.client.0.smithi063.stdout:3/481: creat d2/d11/d37/d40/d5e/d97/fac x:0 0 0 2024-09-16T01:25:17.527 INFO:tasks.workunit.client.0.smithi063.stdout:4/525: creat d5/d3b/df/d1c/d29/fa9 x:0 0 0 2024-09-16T01:25:17.528 INFO:tasks.workunit.client.0.smithi063.stdout:7/369: dwrite d7/ff [0,4194304] 0 2024-09-16T01:25:17.528 INFO:tasks.workunit.client.0.smithi063.stdout:1/527: rename d1/d5/d82/f6c to d1/d5/d15/fb2 0 2024-09-16T01:25:17.530 INFO:tasks.workunit.client.0.smithi063.stdout:6/486: dread d3/d10/f34 [0,4194304] 0 2024-09-16T01:25:17.532 INFO:tasks.workunit.client.0.smithi063.stdout:3/482: rmdir d2/d11 39 2024-09-16T01:25:17.532 INFO:tasks.workunit.client.0.smithi063.stdout:4/526: stat d5/d3b/df/d1c/d29/f4a 0 2024-09-16T01:25:17.536 INFO:tasks.workunit.client.0.smithi063.stdout:0/588: dwrite d1/d1c/dcd/fe0 [0,4194304] 0 2024-09-16T01:25:17.538 INFO:tasks.workunit.client.0.smithi063.stdout:9/613: rename f5 to d7/d9/d12/d14/fd6 0 2024-09-16T01:25:17.539 INFO:tasks.workunit.client.0.smithi063.stdout:8/362: dread d5/db/d12/d1a/f2c [0,4194304] 0 2024-09-16T01:25:17.539 INFO:tasks.workunit.client.0.smithi063.stdout:4/527: write d5/d3b/d57/f79 [593423,114549] 0 2024-09-16T01:25:17.540 INFO:tasks.workunit.client.0.smithi063.stdout:6/487: mknod d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/cb6 0 2024-09-16T01:25:17.544 INFO:tasks.workunit.client.0.smithi063.stdout:7/370: rename d7/d1c/d1f/d29/l53 to d7/d56/d57/l6d 0 2024-09-16T01:25:17.544 INFO:tasks.workunit.client.0.smithi063.stdout:6/488: rmdir d3/d41 39 2024-09-16T01:25:17.546 INFO:tasks.workunit.client.0.smithi063.stdout:2/607: dwrite d3/d7/d8/d1f/d37/d4f/f94 [0,4194304] 0 2024-09-16T01:25:17.547 INFO:tasks.workunit.client.0.smithi063.stdout:9/614: write d7/d9/d12/d14/f91 [3762103,4098] 0 2024-09-16T01:25:17.549 INFO:tasks.workunit.client.0.smithi063.stdout:4/528: creat d5/d3b/d57/d68/d90/faa x:0 0 0 2024-09-16T01:25:17.551 INFO:tasks.workunit.client.0.smithi063.stdout:7/371: rename d7/f19 to d7/d18/d40/d6c/f6e 0 2024-09-16T01:25:17.552 INFO:tasks.workunit.client.0.smithi063.stdout:6/489: stat d3/d48/d28/d3e/d44/da4/d5a/l99 0 2024-09-16T01:25:17.552 INFO:tasks.workunit.client.0.smithi063.stdout:9/615: stat d7/d4a/dba/f45 0 2024-09-16T01:25:17.552 INFO:tasks.workunit.client.0.smithi063.stdout:0/589: dwrite d1/d1c/fad [0,4194304] 0 2024-09-16T01:25:17.555 INFO:tasks.workunit.client.0.smithi063.stdout:8/363: getdents d5/db/d12 0 2024-09-16T01:25:17.559 INFO:tasks.workunit.client.0.smithi063.stdout:7/372: creat d7/d18/d39/f6f x:0 0 0 2024-09-16T01:25:17.561 INFO:tasks.workunit.client.0.smithi063.stdout:6/490: dwrite d3/d48/d28/f2e [4194304,4194304] 0 2024-09-16T01:25:17.562 INFO:tasks.workunit.client.0.smithi063.stdout:2/608: symlink d3/d7/d8/d19/d8c/d21/d9c/dd4/ld7 0 2024-09-16T01:25:17.565 INFO:tasks.workunit.client.0.smithi063.stdout:7/373: mkdir d7/d1c/d1f/d66/d70 0 2024-09-16T01:25:17.565 INFO:tasks.workunit.client.0.smithi063.stdout:6/491: write d3/d48/d28/d3e/d44/da4/f50 [4431743,43957] 0 2024-09-16T01:25:17.569 INFO:tasks.workunit.client.0.smithi063.stdout:7/374: unlink d7/d56/l27 0 2024-09-16T01:25:17.572 INFO:tasks.workunit.client.0.smithi063.stdout:8/364: write d5/db/d12/d1a/d1e/f36 [20719,47931] 0 2024-09-16T01:25:17.573 INFO:tasks.workunit.client.0.smithi063.stdout:2/609: getdents d3/d7/d8/d19/d3c/d53 0 2024-09-16T01:25:17.573 INFO:tasks.workunit.client.0.smithi063.stdout:7/375: creat d7/d56/f71 x:0 0 0 2024-09-16T01:25:17.577 INFO:tasks.workunit.client.0.smithi063.stdout:2/610: dread - d3/d7/d8/fc8 zero size 2024-09-16T01:25:17.578 INFO:tasks.workunit.client.0.smithi063.stdout:0/590: dread d1/d30/d52/d5a/d44/f64 [0,4194304] 0 2024-09-16T01:25:17.579 INFO:tasks.workunit.client.0.smithi063.stdout:8/365: read d5/db/d12/d3d/d69/f6d [319263,75151] 0 2024-09-16T01:25:17.579 INFO:tasks.workunit.client.0.smithi063.stdout:6/492: dwrite d3/d10/f2a [4194304,4194304] 0 2024-09-16T01:25:17.579 INFO:tasks.workunit.client.0.smithi063.stdout:7/376: mkdir d7/d1c/d1f/d29/d72 0 2024-09-16T01:25:17.579 INFO:tasks.workunit.client.0.smithi063.stdout:4/529: dwrite d5/d3b/df/d1c/f31 [0,4194304] 0 2024-09-16T01:25:17.582 INFO:tasks.workunit.client.0.smithi063.stdout:7/377: fdatasync d7/d18/f4b 0 2024-09-16T01:25:17.584 INFO:tasks.workunit.client.0.smithi063.stdout:6/493: rmdir d3/d48/d28/d3e/d44 39 2024-09-16T01:25:17.584 INFO:tasks.workunit.client.0.smithi063.stdout:7/378: chown d7/c51 7 1 2024-09-16T01:25:17.588 INFO:tasks.workunit.client.0.smithi063.stdout:4/530: mknod d5/d3b/df/d1c/d29/d32/d60/d61/cab 0 2024-09-16T01:25:17.589 INFO:tasks.workunit.client.0.smithi063.stdout:8/366: dread d5/db/d12/f57 [0,4194304] 0 2024-09-16T01:25:17.591 INFO:tasks.workunit.client.0.smithi063.stdout:6/494: chown d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/faa 1 1 2024-09-16T01:25:17.591 INFO:tasks.workunit.client.0.smithi063.stdout:0/591: dwrite d1/d30/f93 [4194304,4194304] 0 2024-09-16T01:25:17.593 INFO:tasks.workunit.client.0.smithi063.stdout:0/592: fdatasync d1/df/d2c/db6/fb9 0 2024-09-16T01:25:17.594 INFO:tasks.workunit.client.0.smithi063.stdout:0/593: readlink d1/d1c/l29 0 2024-09-16T01:25:17.597 INFO:tasks.workunit.client.0.smithi063.stdout:6/495: creat d3/d48/d28/d3e/d44/da4/fb7 x:0 0 0 2024-09-16T01:25:17.599 INFO:tasks.workunit.client.0.smithi063.stdout:6/496: truncate d3/d10/d49/f5c 1838754 0 2024-09-16T01:25:17.600 INFO:tasks.workunit.client.0.smithi063.stdout:7/379: truncate d7/d18/f1a 7543583 0 2024-09-16T01:25:17.601 INFO:tasks.workunit.client.0.smithi063.stdout:2/611: link d3/d7/d8/d19/d8c/d21/d9c/lbe d3/d7/d8/d1f/d37/d4f/da7/ld8 0 2024-09-16T01:25:17.603 INFO:tasks.workunit.client.0.smithi063.stdout:0/594: rename d1/df/d17/c3c to d1/d2e/d48/ce2 0 2024-09-16T01:25:17.603 INFO:tasks.workunit.client.0.smithi063.stdout:2/612: write d3/d7/d8/d19/d3c/d58/f93 [1858107,13743] 0 2024-09-16T01:25:17.604 INFO:tasks.workunit.client.0.smithi063.stdout:7/380: mkdir d7/d56/d57/d73 0 2024-09-16T01:25:17.605 INFO:tasks.workunit.client.0.smithi063.stdout:6/497: mknod d3/cb8 0 2024-09-16T01:25:17.607 INFO:tasks.workunit.client.0.smithi063.stdout:2/613: chown d3/d7/f16 845631456 1 2024-09-16T01:25:17.607 INFO:tasks.workunit.client.0.smithi063.stdout:0/595: symlink d1/d30/d52/d5a/d44/dbc/le3 0 2024-09-16T01:25:17.610 INFO:tasks.workunit.client.0.smithi063.stdout:7/381: link d7/ff d7/d56/d57/f74 0 2024-09-16T01:25:17.610 INFO:tasks.workunit.client.0.smithi063.stdout:8/367: dread d5/db/d12/f2d [0,4194304] 0 2024-09-16T01:25:17.610 INFO:tasks.workunit.client.0.smithi063.stdout:2/614: chown d3/d7/d8/d19/d8c/c61 212021975 1 2024-09-16T01:25:17.610 INFO:tasks.workunit.client.0.smithi063.stdout:4/531: dread d5/f2e [4194304,4194304] 0 2024-09-16T01:25:17.611 INFO:tasks.workunit.client.0.smithi063.stdout:0/596: creat d1/d2e/d48/dc3/fe4 x:0 0 0 2024-09-16T01:25:17.612 INFO:tasks.workunit.client.0.smithi063.stdout:6/498: link d3/d48/d28/d3e/d44/d52/f53 d3/d30/d39/d69/fb9 0 2024-09-16T01:25:17.612 INFO:tasks.workunit.client.0.smithi063.stdout:4/532: dread - d5/d3b/d57/fa6 zero size 2024-09-16T01:25:17.613 INFO:tasks.workunit.client.0.smithi063.stdout:2/615: write d3/d7/d8/d19/f24 [4082861,81304] 0 2024-09-16T01:25:17.615 INFO:tasks.workunit.client.0.smithi063.stdout:8/368: rename d5/c48 to d5/db/d12/c76 0 2024-09-16T01:25:17.615 INFO:tasks.workunit.client.0.smithi063.stdout:6/499: read - d3/d48/d7e/d91/f87 zero size 2024-09-16T01:25:17.615 INFO:tasks.workunit.client.0.smithi063.stdout:4/533: write d5/d3b/f16 [5064799,20921] 0 2024-09-16T01:25:17.617 INFO:tasks.workunit.client.0.smithi063.stdout:2/616: creat d3/d77/fd9 x:0 0 0 2024-09-16T01:25:17.624 INFO:tasks.workunit.client.0.smithi063.stdout:7/382: truncate d7/d56/d57/f74 3132150 0 2024-09-16T01:25:17.626 INFO:tasks.workunit.client.0.smithi063.stdout:8/369: dwrite d5/d9/f35 [0,4194304] 0 2024-09-16T01:25:17.626 INFO:tasks.workunit.client.0.smithi063.stdout:4/534: dwrite d5/d3b/d57/fa6 [0,4194304] 0 2024-09-16T01:25:17.633 INFO:tasks.workunit.client.0.smithi063.stdout:0/597: dread d1/f7 [0,4194304] 0 2024-09-16T01:25:17.635 INFO:tasks.workunit.client.0.smithi063.stdout:7/383: creat d7/d56/d57/d73/f75 x:0 0 0 2024-09-16T01:25:17.637 INFO:tasks.workunit.client.0.smithi063.stdout:2/617: truncate d3/d7/d8/d1f/d37/d4f/f94 1621632 0 2024-09-16T01:25:17.638 INFO:tasks.workunit.client.0.smithi063.stdout:0/598: unlink d1/d2e/d73/cbd 0 2024-09-16T01:25:17.638 INFO:tasks.workunit.client.0.smithi063.stdout:8/370: dwrite d5/d9/f35 [0,4194304] 0 2024-09-16T01:25:17.642 INFO:tasks.workunit.client.0.smithi063.stdout:2/618: chown d3/d7/d8/d19/d8c/d21/d28/d8a/cae 40799 1 2024-09-16T01:25:17.643 INFO:tasks.workunit.client.0.smithi063.stdout:8/371: symlink d5/db/l77 0 2024-09-16T01:25:17.643 INFO:tasks.workunit.client.0.smithi063.stdout:7/384: rename d7/d1c/d1f/d29/c47 to d7/d56/d57/d73/c76 0 2024-09-16T01:25:17.644 INFO:tasks.workunit.client.0.smithi063.stdout:4/535: dwrite d5/d3b/df/d1c/f53 [0,4194304] 0 2024-09-16T01:25:17.645 INFO:tasks.workunit.client.0.smithi063.stdout:0/599: creat d1/d2e/d50/d6f/fe5 x:0 0 0 2024-09-16T01:25:17.645 INFO:tasks.workunit.client.0.smithi063.stdout:2/619: dread - d3/d7/d8/d19/d3c/d53/f83 zero size 2024-09-16T01:25:17.649 INFO:tasks.workunit.client.0.smithi063.stdout:8/372: chown d5/l42 126 1 2024-09-16T01:25:17.649 INFO:tasks.workunit.client.0.smithi063.stdout:0/600: stat d1/d30/d52/d5a/d36 0 2024-09-16T01:25:17.653 INFO:tasks.workunit.client.0.smithi063.stdout:0/601: truncate d1/d2e/d48/f98 23850 0 2024-09-16T01:25:17.653 INFO:tasks.workunit.client.0.smithi063.stdout:8/373: symlink d5/db/d54/l78 0 2024-09-16T01:25:17.654 INFO:tasks.workunit.client.0.smithi063.stdout:7/385: dread d7/d1c/d1f/f38 [0,4194304] 0 2024-09-16T01:25:17.655 INFO:tasks.workunit.client.0.smithi063.stdout:2/620: mkdir d3/d7/d8/d19/d8c/d21/d28/d8a/dda 0 2024-09-16T01:25:17.656 INFO:tasks.workunit.client.0.smithi063.stdout:2/621: chown d3/d7/d8/d19/d8c/d21/d28/d4e 10 1 2024-09-16T01:25:17.658 INFO:tasks.workunit.client.0.smithi063.stdout:8/374: creat d5/db/d12/d3d/f79 x:0 0 0 2024-09-16T01:25:17.659 INFO:tasks.workunit.client.0.smithi063.stdout:2/622: creat d3/d7/d8/d1f/d34/d45/d6e/fdb x:0 0 0 2024-09-16T01:25:17.660 INFO:tasks.workunit.client.0.smithi063.stdout:8/375: readlink d5/db/d12/d1a/d1e/l5e 0 2024-09-16T01:25:17.662 INFO:tasks.workunit.client.0.smithi063.stdout:4/536: dwrite d5/d3b/df/d1c/d29/d32/f5e [0,4194304] 0 2024-09-16T01:25:17.664 INFO:tasks.workunit.client.0.smithi063.stdout:2/623: chown d3/c12 5807 1 2024-09-16T01:25:17.664 INFO:tasks.workunit.client.0.smithi063.stdout:7/386: link d7/ff d7/f77 0 2024-09-16T01:25:17.665 INFO:tasks.workunit.client.0.smithi063.stdout:0/602: truncate d1/df/d17/f92 1814131 0 2024-09-16T01:25:17.665 INFO:tasks.workunit.client.0.smithi063.stdout:2/624: readlink d3/d7/d8/d19/l4c 0 2024-09-16T01:25:17.667 INFO:tasks.workunit.client.0.smithi063.stdout:8/376: mkdir d5/db/d12/d1a/d60/d7a 0 2024-09-16T01:25:17.668 INFO:tasks.workunit.client.0.smithi063.stdout:0/603: read d1/d1c/f3f [432507,15292] 0 2024-09-16T01:25:17.668 INFO:tasks.workunit.client.0.smithi063.stdout:7/387: fdatasync d7/f12 0 2024-09-16T01:25:17.670 INFO:tasks.workunit.client.0.smithi063.stdout:4/537: dwrite d5/d3b/f1d [4194304,4194304] 0 2024-09-16T01:25:17.671 INFO:tasks.workunit.client.0.smithi063.stdout:8/377: creat d5/d9/f7b x:0 0 0 2024-09-16T01:25:17.671 INFO:tasks.workunit.client.0.smithi063.stdout:2/625: creat d3/d7/d8/d19/d8c/d21/d28/d4e/fdc x:0 0 0 2024-09-16T01:25:17.672 INFO:tasks.workunit.client.0.smithi063.stdout:7/388: creat d7/d56/d57/f78 x:0 0 0 2024-09-16T01:25:17.673 INFO:tasks.workunit.client.0.smithi063.stdout:0/604: symlink d1/d2e/d48/le6 0 2024-09-16T01:25:17.676 INFO:tasks.workunit.client.0.smithi063.stdout:8/378: write d5/f3b [728343,90412] 0 2024-09-16T01:25:17.676 INFO:tasks.workunit.client.0.smithi063.stdout:7/389: fsync d7/d1c/d1f/f2b 0 2024-09-16T01:25:17.676 INFO:tasks.workunit.client.0.smithi063.stdout:2/626: truncate d3/d7/d8/d19/d3c/d53/fb4 346151 0 2024-09-16T01:25:17.677 INFO:tasks.workunit.client.0.smithi063.stdout:8/379: symlink d5/db/d12/d1a/d60/l7c 0 2024-09-16T01:25:17.681 INFO:tasks.workunit.client.0.smithi063.stdout:7/390: symlink d7/d18/d39/d65/l79 0 2024-09-16T01:25:17.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/391: write d7/f5e [992676,28683] 0 2024-09-16T01:25:17.682 INFO:tasks.workunit.client.0.smithi063.stdout:8/380: symlink d5/d3a/d40/d4a/l7d 0 2024-09-16T01:25:17.682 INFO:tasks.workunit.client.0.smithi063.stdout:4/538: link d5/d3b/df/d1c/d29/d32/d4e/l56 d5/d3b/d5c/da7/lac 0 2024-09-16T01:25:17.684 INFO:tasks.workunit.client.0.smithi063.stdout:2/627: fsync d3/d7/d8/d1f/d37/d4f/f94 0 2024-09-16T01:25:17.685 INFO:tasks.workunit.client.0.smithi063.stdout:7/392: unlink d7/d18/l3c 0 2024-09-16T01:25:17.688 INFO:tasks.workunit.client.0.smithi063.stdout:8/381: stat d5/db/d12/c76 0 2024-09-16T01:25:17.688 INFO:tasks.workunit.client.0.smithi063.stdout:0/605: dread d1/df/f40 [0,4194304] 0 2024-09-16T01:25:17.689 INFO:tasks.workunit.client.0.smithi063.stdout:0/606: stat d1/d30/d52/d5a/f3d 0 2024-09-16T01:25:17.691 INFO:tasks.workunit.client.0.smithi063.stdout:8/382: mknod d5/d9/c7e 0 2024-09-16T01:25:17.693 INFO:tasks.workunit.client.0.smithi063.stdout:7/393: mknod d7/d1c/d1f/d29/d72/c7a 0 2024-09-16T01:25:17.693 INFO:tasks.workunit.client.0.smithi063.stdout:8/383: readlink d5/db/d12/d3d/d69/l6e 0 2024-09-16T01:25:17.695 INFO:tasks.workunit.client.0.smithi063.stdout:4/539: dwrite d5/d3b/df/d1c/d29/d32/f64 [0,4194304] 0 2024-09-16T01:25:17.695 INFO:tasks.workunit.client.0.smithi063.stdout:8/384: write d5/d9/f35 [90753,102981] 0 2024-09-16T01:25:17.696 INFO:tasks.workunit.client.0.smithi063.stdout:4/540: fsync d5/f8c 0 2024-09-16T01:25:17.700 INFO:tasks.workunit.client.0.smithi063.stdout:8/385: symlink d5/db/d54/l7f 0 2024-09-16T01:25:17.701 INFO:tasks.workunit.client.0.smithi063.stdout:4/541: dread d5/d3b/d57/f67 [0,4194304] 0 2024-09-16T01:25:17.705 INFO:tasks.workunit.client.0.smithi063.stdout:7/394: rename d7/cb to d7/d1c/c7b 0 2024-09-16T01:25:17.707 INFO:tasks.workunit.client.0.smithi063.stdout:4/542: chown d5/d3b/df/d1c/d29/d32/d4e/l56 30667731 1 2024-09-16T01:25:17.707 INFO:tasks.workunit.client.0.smithi063.stdout:0/607: dread d1/d30/d52/d5a/f9e [0,4194304] 0 2024-09-16T01:25:17.708 INFO:tasks.workunit.client.0.smithi063.stdout:4/543: fsync d5/d3b/df/d1c/f31 0 2024-09-16T01:25:17.708 INFO:tasks.workunit.client.0.smithi063.stdout:8/386: creat d5/d9/d41/d74/f80 x:0 0 0 2024-09-16T01:25:17.709 INFO:tasks.workunit.client.0.smithi063.stdout:7/395: mknod d7/d1c/d1f/d29/c7c 0 2024-09-16T01:25:17.710 INFO:tasks.workunit.client.0.smithi063.stdout:4/544: dread - d5/d3b/df/d1c/d29/f8e zero size 2024-09-16T01:25:17.710 INFO:tasks.workunit.client.0.smithi063.stdout:8/387: write d5/d3a/f43 [891163,45647] 0 2024-09-16T01:25:17.711 INFO:tasks.workunit.client.0.smithi063.stdout:8/388: chown d5/db/d12 2456584 1 2024-09-16T01:25:17.713 INFO:tasks.workunit.client.0.smithi063.stdout:7/396: symlink d7/d1c/d1f/d66/l7d 0 2024-09-16T01:25:17.714 INFO:tasks.workunit.client.0.smithi063.stdout:8/389: rmdir d5/d9/d41 39 2024-09-16T01:25:17.715 INFO:tasks.workunit.client.0.smithi063.stdout:4/545: dread d5/d3b/df/d1c/f31 [0,4194304] 0 2024-09-16T01:25:17.715 INFO:tasks.workunit.client.0.smithi063.stdout:7/397: truncate d7/d56/d57/d60/f63 802426 0 2024-09-16T01:25:17.717 INFO:tasks.workunit.client.0.smithi063.stdout:4/546: write d5/d3b/df/f95 [1748077,85722] 0 2024-09-16T01:25:17.719 INFO:tasks.workunit.client.0.smithi063.stdout:0/608: getdents d1/d2e/d73 0 2024-09-16T01:25:17.721 INFO:tasks.workunit.client.0.smithi063.stdout:7/398: link d7/d18/d40/f58 d7/d56/d57/d73/f7e 0 2024-09-16T01:25:17.724 INFO:tasks.workunit.client.0.smithi063.stdout:7/399: dread - d7/d18/d40/f58 zero size 2024-09-16T01:25:17.725 INFO:tasks.workunit.client.0.smithi063.stdout:8/390: dwrite d5/db/d12/f57 [0,4194304] 0 2024-09-16T01:25:17.725 INFO:tasks.workunit.client.0.smithi063.stdout:0/609: read d1/d2e/d50/d6f/f82 [1824344,130425] 0 2024-09-16T01:25:17.728 INFO:tasks.workunit.client.0.smithi063.stdout:4/547: dwrite d5/d3b/df/d1c/f39 [0,4194304] 0 2024-09-16T01:25:17.731 INFO:tasks.workunit.client.0.smithi063.stdout:7/400: rename d7/f10 to d7/d1c/d1f/d66/f7f 0 2024-09-16T01:25:17.732 INFO:tasks.workunit.client.0.smithi063.stdout:0/610: unlink d1/d30/f93 0 2024-09-16T01:25:17.733 INFO:tasks.workunit.client.0.smithi063.stdout:8/391: creat d5/db/d12/d1a/d60/d63/f81 x:0 0 0 2024-09-16T01:25:17.734 INFO:tasks.workunit.client.0.smithi063.stdout:4/548: symlink d5/d3b/df/d1c/d29/d32/d60/lad 0 2024-09-16T01:25:17.737 INFO:tasks.workunit.client.0.smithi063.stdout:4/549: rename d5/c28 to d5/d3b/df/d1c/d29/d20/cae 0 2024-09-16T01:25:17.739 INFO:tasks.workunit.client.0.smithi063.stdout:0/611: getdents d1/d30/d52/d5a/d44/dbc 0 2024-09-16T01:25:17.739 INFO:tasks.workunit.client.0.smithi063.stdout:8/392: link l2 d5/db/d12/d1a/d1e/l82 0 2024-09-16T01:25:17.740 INFO:tasks.workunit.client.0.smithi063.stdout:0/612: dread - d1/df/d2c/d43/f77 zero size 2024-09-16T01:25:17.742 INFO:tasks.workunit.client.0.smithi063.stdout:8/393: creat d5/f83 x:0 0 0 2024-09-16T01:25:17.747 INFO:tasks.workunit.client.0.smithi063.stdout:0/613: dwrite d1/d1c/f80 [0,4194304] 0 2024-09-16T01:25:17.748 INFO:tasks.workunit.client.0.smithi063.stdout:8/394: rename d5/d9/d41/f6b to d5/db/d12/d1a/d1e/d68/f84 0 2024-09-16T01:25:17.752 INFO:tasks.workunit.client.0.smithi063.stdout:4/550: dread d5/d3b/df/d1c/d29/d32/d4e/f6f [0,4194304] 0 2024-09-16T01:25:17.753 INFO:tasks.workunit.client.0.smithi063.stdout:8/395: dread d5/f3b [0,4194304] 0 2024-09-16T01:25:17.758 INFO:tasks.workunit.client.0.smithi063.stdout:0/614: write d1/fc [1685203,66131] 0 2024-09-16T01:25:17.759 INFO:tasks.workunit.client.0.smithi063.stdout:8/396: getdents d5/d9/d41/d74 0 2024-09-16T01:25:17.759 INFO:tasks.workunit.client.0.smithi063.stdout:4/551: dwrite d5/d3b/df/d1c/f31 [0,4194304] 0 2024-09-16T01:25:17.760 INFO:tasks.workunit.client.0.smithi063.stdout:0/615: chown d1/d30/d52/d5a/d36/d41 1 1 2024-09-16T01:25:17.761 INFO:tasks.workunit.client.0.smithi063.stdout:8/397: creat d5/d9/d2f/f85 x:0 0 0 2024-09-16T01:25:17.762 INFO:tasks.workunit.client.0.smithi063.stdout:4/552: chown d5/d3b/d57/l88 479722347 1 2024-09-16T01:25:17.762 INFO:tasks.workunit.client.0.smithi063.stdout:8/398: chown d5/db 1582600 1 2024-09-16T01:25:17.764 INFO:tasks.workunit.client.0.smithi063.stdout:4/553: creat d5/d3b/d57/faf x:0 0 0 2024-09-16T01:25:17.765 INFO:tasks.workunit.client.0.smithi063.stdout:0/616: truncate d1/fb 2137338 0 2024-09-16T01:25:17.768 INFO:tasks.workunit.client.0.smithi063.stdout:4/554: creat d5/d3b/d57/d68/fb0 x:0 0 0 2024-09-16T01:25:17.769 INFO:tasks.workunit.client.0.smithi063.stdout:0/617: mknod d1/df/d2c/ce7 0 2024-09-16T01:25:17.769 INFO:tasks.workunit.client.0.smithi063.stdout:0/618: stat d1/df/d2c/db6/fb9 0 2024-09-16T01:25:17.770 INFO:tasks.workunit.client.0.smithi063.stdout:8/399: dread d5/f25 [0,4194304] 0 2024-09-16T01:25:17.773 INFO:tasks.workunit.client.0.smithi063.stdout:0/619: creat d1/d2e/d48/dc3/dca/fe8 x:0 0 0 2024-09-16T01:25:17.774 INFO:tasks.workunit.client.0.smithi063.stdout:8/400: dread d5/db/d12/f38 [0,4194304] 0 2024-09-16T01:25:17.775 INFO:tasks.workunit.client.0.smithi063.stdout:8/401: chown d5/d9/d2f 0 1 2024-09-16T01:25:17.777 INFO:tasks.workunit.client.0.smithi063.stdout:0/620: link d1/df/d2c/f39 d1/d30/d52/d5a/d36/fe9 0 2024-09-16T01:25:17.779 INFO:tasks.workunit.client.0.smithi063.stdout:0/621: write d1/d30/d52/d5a/f3d [2310814,40870] 0 2024-09-16T01:25:17.782 INFO:tasks.workunit.client.0.smithi063.stdout:8/402: dwrite d5/d9/d2f/f85 [0,4194304] 0 2024-09-16T01:25:17.787 INFO:tasks.workunit.client.0.smithi063.stdout:8/403: dread - d5/db/d12/d1a/d60/d63/f56 zero size 2024-09-16T01:25:17.790 INFO:tasks.workunit.client.0.smithi063.stdout:8/404: write d5/db/d12/f2d [943867,130578] 0 2024-09-16T01:25:17.795 INFO:tasks.workunit.client.0.smithi063.stdout:0/622: dread d1/df/d2c/f55 [0,4194304] 0 2024-09-16T01:25:17.795 INFO:tasks.workunit.client.0.smithi063.stdout:8/405: dread d5/db/d12/f57 [0,4194304] 0 2024-09-16T01:25:17.795 INFO:tasks.workunit.client.0.smithi063.stdout:0/623: fdatasync d1/df/fd3 0 2024-09-16T01:25:17.796 INFO:tasks.workunit.client.0.smithi063.stdout:8/406: rmdir d5/db 39 2024-09-16T01:25:17.797 INFO:tasks.workunit.client.0.smithi063.stdout:0/624: mknod d1/d30/d52/d5a/d36/d41/cea 0 2024-09-16T01:25:17.798 INFO:tasks.workunit.client.0.smithi063.stdout:8/407: mkdir d5/d86 0 2024-09-16T01:25:17.800 INFO:tasks.workunit.client.0.smithi063.stdout:8/408: mkdir d5/d9/d41/d74/d87 0 2024-09-16T01:25:17.802 INFO:tasks.workunit.client.0.smithi063.stdout:8/409: unlink d5/d3a/d40/d4a/c50 0 2024-09-16T01:25:17.804 INFO:tasks.workunit.client.0.smithi063.stdout:8/410: readlink d5/db/d12/d1a/d1e/d68/l72 0 2024-09-16T01:25:17.807 INFO:tasks.workunit.client.0.smithi063.stdout:8/411: creat d5/d9/f88 x:0 0 0 2024-09-16T01:25:17.808 INFO:tasks.workunit.client.0.smithi063.stdout:8/412: write d5/db/d54/f61 [932797,127649] 0 2024-09-16T01:25:17.809 INFO:tasks.workunit.client.0.smithi063.stdout:8/413: fsync d5/db/d12/d1a/d60/d63/f56 0 2024-09-16T01:25:17.811 INFO:tasks.workunit.client.0.smithi063.stdout:8/414: rename d5/d3a/d40/d4a/f4d to d5/d86/f89 0 2024-09-16T01:25:17.814 INFO:tasks.workunit.client.0.smithi063.stdout:8/415: link d5/l42 d5/d9/l8a 0 2024-09-16T01:25:17.816 INFO:tasks.workunit.client.0.smithi063.stdout:8/416: creat d5/d3a/d40/d4a/f8b x:0 0 0 2024-09-16T01:25:17.826 INFO:tasks.workunit.client.0.smithi063.stdout:8/417: rename d5/d9/d41 to d5/d8c 0 2024-09-16T01:25:17.827 INFO:tasks.workunit.client.0.smithi063.stdout:8/418: readlink d5/db/d12/d1a/l1c 0 2024-09-16T01:25:17.829 INFO:tasks.workunit.client.0.smithi063.stdout:8/419: mknod d5/db/d12/d1a/c8d 0 2024-09-16T01:25:17.829 INFO:tasks.workunit.client.0.smithi063.stdout:8/420: chown d5/f3b 1301865 1 2024-09-16T01:25:17.831 INFO:tasks.workunit.client.0.smithi063.stdout:8/421: unlink d5/db/d12/d3d/d69/c75 0 2024-09-16T01:25:17.833 INFO:tasks.workunit.client.0.smithi063.stdout:8/422: symlink d5/d9/l8e 0 2024-09-16T01:25:17.835 INFO:tasks.workunit.client.0.smithi063.stdout:8/423: rename d5/db/cd to d5/d86/c8f 0 2024-09-16T01:25:17.836 INFO:tasks.workunit.client.0.smithi063.stdout:8/424: rmdir d5/db/d54 39 2024-09-16T01:25:17.841 INFO:tasks.workunit.client.0.smithi063.stdout:8/425: dwrite d5/db/d12/f57 [0,4194304] 0 2024-09-16T01:25:17.845 INFO:tasks.workunit.client.0.smithi063.stdout:8/426: getdents d5/d9/d2f 0 2024-09-16T01:25:17.846 INFO:tasks.workunit.client.0.smithi063.stdout:8/427: unlink d5/d9/l11 0 2024-09-16T01:25:17.854 INFO:tasks.workunit.client.0.smithi063.stdout:8/428: truncate d5/d86/f89 1605678 0 2024-09-16T01:25:17.858 INFO:tasks.workunit.client.0.smithi063.stdout:8/429: dread d5/db/d54/f61 [0,4194304] 0 2024-09-16T01:25:17.860 INFO:tasks.workunit.client.0.smithi063.stdout:8/430: unlink d5/db/d12/d3d/c6a 0 2024-09-16T01:25:17.872 INFO:tasks.workunit.client.0.smithi063.stdout:8/431: dread d5/db/d12/f64 [0,4194304] 0 2024-09-16T01:25:17.882 INFO:tasks.workunit.client.0.smithi063.stdout:8/432: dwrite d5/d86/f89 [0,4194304] 0 2024-09-16T01:25:17.886 INFO:tasks.workunit.client.0.smithi063.stdout:8/433: dread d5/db/d12/d1a/f2c [0,4194304] 0 2024-09-16T01:25:17.888 INFO:tasks.workunit.client.0.smithi063.stdout:8/434: fdatasync d5/db/d54/f61 0 2024-09-16T01:25:17.890 INFO:tasks.workunit.client.0.smithi063.stdout:8/435: creat d5/d3a/f90 x:0 0 0 2024-09-16T01:25:17.893 INFO:tasks.workunit.client.0.smithi063.stdout:8/436: creat d5/db/d12/d1a/d60/f91 x:0 0 0 2024-09-16T01:25:17.894 INFO:tasks.workunit.client.0.smithi063.stdout:8/437: mknod d5/d8c/d74/c92 0 2024-09-16T01:25:17.926 INFO:tasks.workunit.client.0.smithi063.stdout:5/539: sync 2024-09-16T01:25:17.932 INFO:tasks.workunit.client.0.smithi063.stdout:5/540: dwrite d5/d18/f24 [0,4194304] 0 2024-09-16T01:25:17.935 INFO:tasks.workunit.client.0.smithi063.stdout:5/541: symlink d5/d18/d29/d48/d7b/d85/lb8 0 2024-09-16T01:25:17.940 INFO:tasks.workunit.client.0.smithi063.stdout:5/542: creat d5/d12/d91/d72/fb9 x:0 0 0 2024-09-16T01:25:17.941 INFO:tasks.workunit.client.0.smithi063.stdout:5/543: truncate d5/d18/f78 110888 0 2024-09-16T01:25:17.941 INFO:tasks.workunit.client.0.smithi063.stdout:5/544: read - d5/d12/d91/d72/fb3 zero size 2024-09-16T01:25:17.943 INFO:tasks.workunit.client.0.smithi063.stdout:5/545: unlink d5/d7f/fb0 0 2024-09-16T01:25:17.945 INFO:tasks.workunit.client.0.smithi063.stdout:5/546: write d5/d18/d29/d48/d66/f8a [251405,74924] 0 2024-09-16T01:25:17.945 INFO:tasks.workunit.client.0.smithi063.stdout:5/547: chown d5/d18/d29/d48/d98/cb6 0 1 2024-09-16T01:25:17.946 INFO:tasks.workunit.client.0.smithi063.stdout:5/548: chown d5/f15 615569 1 2024-09-16T01:25:17.947 INFO:tasks.workunit.client.0.smithi063.stdout:5/549: creat d5/d12/fba x:0 0 0 2024-09-16T01:25:17.949 INFO:tasks.workunit.client.0.smithi063.stdout:5/550: fsync d5/f51 0 2024-09-16T01:25:17.950 INFO:tasks.workunit.client.0.smithi063.stdout:5/551: chown d5/d18/d29/d48/f9b 8017 1 2024-09-16T01:25:17.953 INFO:tasks.workunit.client.0.smithi063.stdout:5/552: dread d5/d18/d29/f7e [0,4194304] 0 2024-09-16T01:25:17.955 INFO:tasks.workunit.client.0.smithi063.stdout:5/553: creat d5/d18/fbb x:0 0 0 2024-09-16T01:25:18.011 INFO:tasks.workunit.client.0.smithi063.stdout:1/528: sync 2024-09-16T01:25:18.015 INFO:tasks.workunit.client.0.smithi063.stdout:1/529: truncate d1/f3 731571 0 2024-09-16T01:25:18.023 INFO:tasks.workunit.client.0.smithi063.stdout:1/530: dread d1/f3 [0,4194304] 0 2024-09-16T01:25:18.024 INFO:tasks.workunit.client.0.smithi063.stdout:1/531: fdatasync d1/d5/d15/f19 0 2024-09-16T01:25:18.025 INFO:tasks.workunit.client.0.smithi063.stdout:1/532: readlink d1/d5/l4f 0 2024-09-16T01:25:18.027 INFO:tasks.workunit.client.0.smithi063.stdout:1/533: unlink d1/d5/d63/caf 0 2024-09-16T01:25:18.028 INFO:tasks.workunit.client.0.smithi063.stdout:1/534: stat d1/d5/d15/d18/f6a 0 2024-09-16T01:25:18.028 INFO:tasks.workunit.client.0.smithi063.stdout:1/535: chown d1/d12/l36 1866 1 2024-09-16T01:25:18.098 INFO:tasks.workunit.client.0.smithi063.stdout:1/536: unlink d1/d5/d82/d9b/d77/d7d/f8d 0 2024-09-16T01:25:18.098 INFO:tasks.workunit.client.0.smithi063.stdout:1/537: stat d1/d5/f1a 0 2024-09-16T01:25:18.105 INFO:tasks.workunit.client.0.smithi063.stdout:1/538: write d1/f3e [220742,100517] 0 2024-09-16T01:25:18.112 INFO:tasks.workunit.client.0.smithi063.stdout:1/539: dwrite d1/d5/d82/d9b/fa3 [0,4194304] 0 2024-09-16T01:25:18.116 INFO:tasks.workunit.client.0.smithi063.stdout:1/540: unlink d1/d12/d21/l96 0 2024-09-16T01:25:18.119 INFO:tasks.workunit.client.0.smithi063.stdout:1/541: mkdir d1/dd/d3b/db3 0 2024-09-16T01:25:18.124 INFO:tasks.workunit.client.0.smithi063.stdout:1/542: getdents d1/dd/d3b/db3 0 2024-09-16T01:25:18.128 INFO:tasks.workunit.client.0.smithi063.stdout:1/543: creat d1/d5/d82/fb4 x:0 0 0 2024-09-16T01:25:18.129 INFO:tasks.workunit.client.0.smithi063.stdout:3/483: sync 2024-09-16T01:25:18.130 INFO:tasks.workunit.client.0.smithi063.stdout:1/544: write d1/f3 [506372,75405] 0 2024-09-16T01:25:18.131 INFO:tasks.workunit.client.0.smithi063.stdout:1/545: chown d1/d5/d15/d1b/f52 3542 1 2024-09-16T01:25:18.132 INFO:tasks.workunit.client.0.smithi063.stdout:1/546: truncate d1/d5/f10 4915062 0 2024-09-16T01:25:18.140 INFO:tasks.workunit.client.0.smithi063.stdout:3/484: rename d2/d11/d37/d40/d5e/d3b/l66 to d2/d11/d69/lad 0 2024-09-16T01:25:18.141 INFO:tasks.workunit.client.0.smithi063.stdout:1/547: creat d1/d5/fb5 x:0 0 0 2024-09-16T01:25:18.142 INFO:tasks.workunit.client.0.smithi063.stdout:3/485: fsync d2/d11/d37/d40/f53 0 2024-09-16T01:25:18.144 INFO:tasks.workunit.client.0.smithi063.stdout:3/486: dread d2/d11/d18/f2d [0,4194304] 0 2024-09-16T01:25:18.149 INFO:tasks.workunit.client.0.smithi063.stdout:1/548: rmdir d1/d5/d15/d18/d7c/dad/d84 0 2024-09-16T01:25:18.155 INFO:tasks.workunit.client.0.smithi063.stdout:1/549: dwrite d1/d5/f80 [0,4194304] 0 2024-09-16T01:25:18.175 INFO:tasks.workunit.client.0.smithi063.stdout:3/487: unlink d2/d11/d37/d40/d5e/f9d 0 2024-09-16T01:25:18.175 INFO:tasks.workunit.client.0.smithi063.stdout:3/488: fdatasync d2/f10 0 2024-09-16T01:25:18.178 INFO:tasks.workunit.client.0.smithi063.stdout:1/550: mkdir d1/d5/d15/d18/db6 0 2024-09-16T01:25:18.180 INFO:tasks.workunit.client.0.smithi063.stdout:3/489: dwrite d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/f8f [0,4194304] 0 2024-09-16T01:25:18.183 INFO:tasks.workunit.client.0.smithi063.stdout:1/551: dread d1/d5/d15/f62 [0,4194304] 0 2024-09-16T01:25:18.193 INFO:tasks.workunit.client.0.smithi063.stdout:3/490: dread d2/d11/d18/f42 [0,4194304] 0 2024-09-16T01:25:18.194 INFO:tasks.workunit.client.0.smithi063.stdout:3/491: stat d2/d11/d37/dab 0 2024-09-16T01:25:18.195 INFO:tasks.workunit.client.0.smithi063.stdout:3/492: stat d2/d11/d37/d40/d5e/l46 0 2024-09-16T01:25:18.197 INFO:tasks.workunit.client.0.smithi063.stdout:3/493: dread - d2/d11/d37/d40/d5e/d97/fac zero size 2024-09-16T01:25:18.199 INFO:tasks.workunit.client.0.smithi063.stdout:3/494: creat d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/fae x:0 0 0 2024-09-16T01:25:18.230 INFO:tasks.workunit.client.0.smithi063.stdout:6/500: sync 2024-09-16T01:25:18.231 INFO:tasks.workunit.client.0.smithi063.stdout:9/616: sync 2024-09-16T01:25:18.300 INFO:tasks.workunit.client.0.smithi063.stdout:9/617: symlink d7/d4a/d4d/d96/ld7 0 2024-09-16T01:25:18.303 INFO:tasks.workunit.client.0.smithi063.stdout:9/618: symlink d7/d9/d12/d14/ld8 0 2024-09-16T01:25:18.304 INFO:tasks.workunit.client.0.smithi063.stdout:9/619: write d7/d1f/f2c [2720348,112802] 0 2024-09-16T01:25:18.304 INFO:tasks.workunit.client.0.smithi063.stdout:6/501: dwrite d3/d10/f1d [0,4194304] 0 2024-09-16T01:25:18.323 INFO:tasks.workunit.client.0.smithi063.stdout:6/502: rename d3/l61 to d3/d41/lba 0 2024-09-16T01:25:18.324 INFO:tasks.workunit.client.0.smithi063.stdout:6/503: rmdir d3/d30/d39/dac/db5 39 2024-09-16T01:25:18.325 INFO:tasks.workunit.client.0.smithi063.stdout:6/504: read d3/d10/f2a [4329485,19369] 0 2024-09-16T01:25:18.325 INFO:tasks.workunit.client.0.smithi063.stdout:6/505: fdatasync d3/d48/d28/d3e/d44/da4/d5a/d6b/f82 0 2024-09-16T01:25:18.335 INFO:tasks.workunit.client.0.smithi063.stdout:6/506: dread d3/d48/d28/f77 [0,4194304] 0 2024-09-16T01:25:18.337 INFO:tasks.workunit.client.0.smithi063.stdout:6/507: mknod d3/d48/d28/d3e/d68/db4/cbb 0 2024-09-16T01:25:18.338 INFO:tasks.workunit.client.0.smithi063.stdout:6/508: creat d3/d41/fbc x:0 0 0 2024-09-16T01:25:18.342 INFO:tasks.workunit.client.0.smithi063.stdout:6/509: link d3/d48/d7e/d91/l66 d3/d48/d28/d3e/d68/db4/lbd 0 2024-09-16T01:25:18.353 INFO:tasks.workunit.client.0.smithi063.stdout:6/510: dread d3/d10/f60 [0,4194304] 0 2024-09-16T01:25:18.356 INFO:tasks.workunit.client.0.smithi063.stdout:6/511: symlink d3/d30/d39/dac/db5/da7/lbe 0 2024-09-16T01:25:18.358 INFO:tasks.workunit.client.0.smithi063.stdout:6/512: symlink d3/d30/lbf 0 2024-09-16T01:25:18.365 INFO:tasks.workunit.client.0.smithi063.stdout:6/513: truncate d3/d48/d28/d3e/d44/da4/f50 1123674 0 2024-09-16T01:25:18.377 INFO:tasks.workunit.client.0.smithi063.stdout:6/514: dread d3/d48/d28/d3e/d44/da4/d5a/d6b/f82 [0,4194304] 0 2024-09-16T01:25:18.378 INFO:tasks.workunit.client.0.smithi063.stdout:6/515: chown d3/d48/d28/d3e/d68/l73 73590670 1 2024-09-16T01:25:18.386 INFO:tasks.workunit.client.0.smithi063.stdout:2/628: sync 2024-09-16T01:25:18.386 INFO:tasks.workunit.client.0.smithi063.stdout:7/401: sync 2024-09-16T01:25:18.388 INFO:tasks.workunit.client.0.smithi063.stdout:2/629: chown d3/d7/d8/d19/d8c/d21/d28/d8a/lba 355240945 1 2024-09-16T01:25:18.388 INFO:tasks.workunit.client.0.smithi063.stdout:2/630: readlink d3/d7/d8/d19/d8c/l41 0 2024-09-16T01:25:18.391 INFO:tasks.workunit.client.0.smithi063.stdout:2/631: unlink d3/d7/d8/d19/l4c 0 2024-09-16T01:25:18.391 INFO:tasks.workunit.client.0.smithi063.stdout:6/516: dread d3/d48/d28/f2b [0,4194304] 0 2024-09-16T01:25:18.394 INFO:tasks.workunit.client.0.smithi063.stdout:6/517: truncate d3/d41/f7a 196397 0 2024-09-16T01:25:18.394 INFO:tasks.workunit.client.0.smithi063.stdout:7/402: dwrite d7/d1c/d1f/f2e [0,4194304] 0 2024-09-16T01:25:18.394 INFO:tasks.workunit.client.0.smithi063.stdout:2/632: unlink d3/f6 0 2024-09-16T01:25:18.396 INFO:tasks.workunit.client.0.smithi063.stdout:7/403: fsync d7/d1c/d1f/d29/f52 0 2024-09-16T01:25:18.397 INFO:tasks.workunit.client.0.smithi063.stdout:2/633: creat d3/d7/d8/d19/d3c/d53/d7f/d80/fdd x:0 0 0 2024-09-16T01:25:18.402 INFO:tasks.workunit.client.0.smithi063.stdout:2/634: mkdir d3/d7/d8/d1f/d34/dc2/dde 0 2024-09-16T01:25:18.403 INFO:tasks.workunit.client.0.smithi063.stdout:7/404: dread d7/f5e [0,4194304] 0 2024-09-16T01:25:18.404 INFO:tasks.workunit.client.0.smithi063.stdout:2/635: truncate d3/d7/d8/d1f/d37/d4f/da7/faf 607755 0 2024-09-16T01:25:18.405 INFO:tasks.workunit.client.0.smithi063.stdout:7/405: fsync d7/d18/d40/f58 0 2024-09-16T01:25:18.407 INFO:tasks.workunit.client.0.smithi063.stdout:2/636: symlink d3/d7/d8/d19/d8c/d21/ldf 0 2024-09-16T01:25:18.408 INFO:tasks.workunit.client.0.smithi063.stdout:7/406: mknod d7/d18/c80 0 2024-09-16T01:25:18.408 INFO:tasks.workunit.client.0.smithi063.stdout:2/637: write d3/d7/d8/d1f/d34/d45/d6e/fa8 [4496795,16225] 0 2024-09-16T01:25:18.409 INFO:tasks.workunit.client.0.smithi063.stdout:2/638: fsync d3/d7/d8/d19/d3c/d53/f83 0 2024-09-16T01:25:18.410 INFO:tasks.workunit.client.0.smithi063.stdout:7/407: symlink d7/d18/d39/d65/l81 0 2024-09-16T01:25:18.411 INFO:tasks.workunit.client.0.smithi063.stdout:2/639: read d3/d7/d8/d19/d3c/d58/f93 [91167,73148] 0 2024-09-16T01:25:18.412 INFO:tasks.workunit.client.0.smithi063.stdout:7/408: creat d7/d1c/d1f/d66/f82 x:0 0 0 2024-09-16T01:25:18.413 INFO:tasks.workunit.client.0.smithi063.stdout:2/640: creat d3/d7/d8/d19/d8c/d21/d9c/dd4/fe0 x:0 0 0 2024-09-16T01:25:18.414 INFO:tasks.workunit.client.0.smithi063.stdout:7/409: creat d7/d18/d40/f83 x:0 0 0 2024-09-16T01:25:18.416 INFO:tasks.workunit.client.0.smithi063.stdout:7/410: symlink d7/d18/d40/l84 0 2024-09-16T01:25:18.416 INFO:tasks.workunit.client.0.smithi063.stdout:7/411: fdatasync d7/d56/d57/d73/f75 0 2024-09-16T01:25:18.418 INFO:tasks.workunit.client.0.smithi063.stdout:9/620: getdents d7/d4a 0 2024-09-16T01:25:18.418 INFO:tasks.workunit.client.0.smithi063.stdout:7/412: fdatasync d7/f3e 0 2024-09-16T01:25:18.421 INFO:tasks.workunit.client.0.smithi063.stdout:7/413: creat d7/d18/d39/d5b/f85 x:0 0 0 2024-09-16T01:25:18.422 INFO:tasks.workunit.client.0.smithi063.stdout:7/414: write d7/d1c/d1f/f32 [2089502,116484] 0 2024-09-16T01:25:18.423 INFO:tasks.workunit.client.0.smithi063.stdout:7/415: readlink d7/d56/l54 0 2024-09-16T01:25:18.423 INFO:tasks.workunit.client.0.smithi063.stdout:7/416: read - d7/d18/d39/f42 zero size 2024-09-16T01:25:18.467 INFO:tasks.workunit.client.0.smithi063.stdout:7/417: rename d7/d18/d39/d5b to d7/d56/d6b/d86 0 2024-09-16T01:25:18.468 INFO:tasks.workunit.client.0.smithi063.stdout:7/418: chown d7/d56/d6b/d86/f5f 1 1 2024-09-16T01:25:18.470 INFO:tasks.workunit.client.0.smithi063.stdout:7/419: dread - d7/d56/d57/d73/f75 zero size 2024-09-16T01:25:18.471 INFO:tasks.workunit.client.0.smithi063.stdout:7/420: read d7/d18/d40/d6c/f6e [2771873,92121] 0 2024-09-16T01:25:18.472 INFO:tasks.workunit.client.0.smithi063.stdout:7/421: chown d7/d56/d57/f78 28224816 1 2024-09-16T01:25:18.513 INFO:tasks.workunit.client.0.smithi063.stdout:8/438: sync 2024-09-16T01:25:18.513 INFO:tasks.workunit.client.0.smithi063.stdout:0/625: sync 2024-09-16T01:25:18.513 INFO:tasks.workunit.client.0.smithi063.stdout:4/555: sync 2024-09-16T01:25:18.515 INFO:tasks.workunit.client.0.smithi063.stdout:8/439: truncate d5/d3a/f90 995752 0 2024-09-16T01:25:18.595 INFO:tasks.workunit.client.0.smithi063.stdout:1/552: sync 2024-09-16T01:25:18.595 INFO:tasks.workunit.client.0.smithi063.stdout:5/554: sync 2024-09-16T01:25:18.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:18 smithi063 ceph-mon[31070]: pgmap v394: 97 pgs: 97 active+clean; 1.0 GiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 151 MiB/s wr, 303 op/s 2024-09-16T01:25:18.642 INFO:tasks.workunit.client.0.smithi063.stdout:2/641: sync 2024-09-16T01:25:18.642 INFO:tasks.workunit.client.0.smithi063.stdout:3/495: sync 2024-09-16T01:25:18.642 INFO:tasks.workunit.client.0.smithi063.stdout:9/621: sync 2024-09-16T01:25:18.642 INFO:tasks.workunit.client.0.smithi063.stdout:6/518: sync 2024-09-16T01:25:18.643 INFO:tasks.workunit.client.0.smithi063.stdout:2/642: chown d3/d7/c5b 39261906 1 2024-09-16T01:25:18.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/496: chown d2/d11/d37/d40/d5e/d3b/d94 449 1 2024-09-16T01:25:18.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:18 smithi192 ceph-mon[34775]: pgmap v394: 97 pgs: 97 active+clean; 1.0 GiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 151 MiB/s wr, 303 op/s 2024-09-16T01:25:18.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:18 smithi162 ceph-mon[34539]: pgmap v394: 97 pgs: 97 active+clean; 1.0 GiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 151 MiB/s wr, 303 op/s 2024-09-16T01:25:18.777 INFO:tasks.workunit.client.0.smithi063.stdout:7/422: unlink d7/d18/d39/f42 0 2024-09-16T01:25:18.778 INFO:tasks.workunit.client.0.smithi063.stdout:4/556: rename d5/d3b/l1e to d5/d3b/d5c/da7/lb1 0 2024-09-16T01:25:18.781 INFO:tasks.workunit.client.0.smithi063.stdout:6/519: creat d3/d48/d28/d3e/d68/db4/fc0 x:0 0 0 2024-09-16T01:25:18.781 INFO:tasks.workunit.client.0.smithi063.stdout:6/520: readlink d3/d48/d28/d3e/d44/da4/l37 0 2024-09-16T01:25:18.782 INFO:tasks.workunit.client.0.smithi063.stdout:0/626: dwrite d1/d30/d52/d5a/f9e [0,4194304] 0 2024-09-16T01:25:18.784 INFO:tasks.workunit.client.0.smithi063.stdout:7/423: creat d7/d56/d6b/f87 x:0 0 0 2024-09-16T01:25:18.784 INFO:tasks.workunit.client.0.smithi063.stdout:8/440: mkdir d5/db/d12/d1a/d1e/d93 0 2024-09-16T01:25:18.785 INFO:tasks.workunit.client.0.smithi063.stdout:7/424: read d7/fe [4438801,75620] 0 2024-09-16T01:25:18.786 INFO:tasks.workunit.client.0.smithi063.stdout:9/622: rename d7/d9/d12/l57 to d7/d9/d12/d14/d34/ld9 0 2024-09-16T01:25:18.787 INFO:tasks.workunit.client.0.smithi063.stdout:3/497: creat d2/d11/d37/d40/d5e/d3b/da1/faf x:0 0 0 2024-09-16T01:25:18.787 INFO:tasks.workunit.client.0.smithi063.stdout:9/623: write d7/f81 [923318,102536] 0 2024-09-16T01:25:18.787 INFO:tasks.workunit.client.0.smithi063.stdout:6/521: symlink d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/lc1 0 2024-09-16T01:25:18.788 INFO:tasks.workunit.client.0.smithi063.stdout:9/624: stat d7/d4a/fbf 0 2024-09-16T01:25:18.788 INFO:tasks.workunit.client.0.smithi063.stdout:4/557: symlink d5/d3b/lb2 0 2024-09-16T01:25:18.792 INFO:tasks.workunit.client.0.smithi063.stdout:8/441: rename d5/d8c/d74/f80 to d5/f94 0 2024-09-16T01:25:18.796 INFO:tasks.workunit.client.0.smithi063.stdout:4/558: dwrite d5/d3b/d57/f7d [0,4194304] 0 2024-09-16T01:25:18.797 INFO:tasks.workunit.client.0.smithi063.stdout:3/498: creat d2/d11/d37/fb0 x:0 0 0 2024-09-16T01:25:18.802 INFO:tasks.workunit.client.0.smithi063.stdout:6/522: rename d3/d48/d28/d3e/d44/d8c/c98 to d3/d30/d39/d69/d95/db0/cc2 0 2024-09-16T01:25:18.806 INFO:tasks.workunit.client.0.smithi063.stdout:8/442: dwrite d5/d3a/f43 [0,4194304] 0 2024-09-16T01:25:18.811 INFO:tasks.workunit.client.0.smithi063.stdout:8/443: creat d5/d86/f95 x:0 0 0 2024-09-16T01:25:18.813 INFO:tasks.workunit.client.0.smithi063.stdout:7/425: dwrite d7/d18/d40/f58 [0,4194304] 0 2024-09-16T01:25:18.814 INFO:tasks.workunit.client.0.smithi063.stdout:3/499: dwrite d2/d11/d37/f88 [0,4194304] 0 2024-09-16T01:25:18.814 INFO:tasks.workunit.client.0.smithi063.stdout:8/444: fdatasync d5/d3a/f90 0 2024-09-16T01:25:18.816 INFO:tasks.workunit.client.0.smithi063.stdout:8/445: write d5/d9/f35 [789043,108081] 0 2024-09-16T01:25:18.817 INFO:tasks.workunit.client.0.smithi063.stdout:6/523: dwrite d3/d30/f4e [0,4194304] 0 2024-09-16T01:25:18.818 INFO:tasks.workunit.client.0.smithi063.stdout:8/446: read d5/db/d12/f64 [2352929,9373] 0 2024-09-16T01:25:18.818 INFO:tasks.workunit.client.0.smithi063.stdout:7/426: mkdir d7/d1c/d1f/d29/d88 0 2024-09-16T01:25:18.820 INFO:tasks.workunit.client.0.smithi063.stdout:3/500: mkdir d2/d11/d37/db1 0 2024-09-16T01:25:18.822 INFO:tasks.workunit.client.0.smithi063.stdout:6/524: creat d3/d30/d39/dac/db5/da7/fc3 x:0 0 0 2024-09-16T01:25:18.824 INFO:tasks.workunit.client.0.smithi063.stdout:6/525: read - d3/d48/d28/d3e/d44/f6a zero size 2024-09-16T01:25:18.824 INFO:tasks.workunit.client.0.smithi063.stdout:8/447: fdatasync d5/db/d12/f64 0 2024-09-16T01:25:18.829 INFO:tasks.workunit.client.0.smithi063.stdout:6/526: write d3/d30/f40 [816451,20349] 0 2024-09-16T01:25:18.829 INFO:tasks.workunit.client.0.smithi063.stdout:7/427: link f5 d7/d18/d40/f89 0 2024-09-16T01:25:18.831 INFO:tasks.workunit.client.0.smithi063.stdout:6/527: chown d3/l1c 29293 1 2024-09-16T01:25:18.835 INFO:tasks.workunit.client.0.smithi063.stdout:7/428: write d7/d18/f45 [3945994,104590] 0 2024-09-16T01:25:18.836 INFO:tasks.workunit.client.0.smithi063.stdout:8/448: dwrite d5/d9/f88 [0,4194304] 0 2024-09-16T01:25:18.836 INFO:tasks.workunit.client.0.smithi063.stdout:6/528: mkdir d3/d10/dc4 0 2024-09-16T01:25:18.838 INFO:tasks.workunit.client.0.smithi063.stdout:3/501: dread d2/d11/d37/d40/d5e/d3b/d94/d30/f57 [0,4194304] 0 2024-09-16T01:25:18.839 INFO:tasks.workunit.client.0.smithi063.stdout:8/449: write d5/db/d12/d1a/d60/d63/f56 [960517,84140] 0 2024-09-16T01:25:18.840 INFO:tasks.workunit.client.0.smithi063.stdout:7/429: creat d7/d1c/d1f/d29/d88/f8a x:0 0 0 2024-09-16T01:25:18.843 INFO:tasks.workunit.client.0.smithi063.stdout:8/450: unlink d5/d9/l55 0 2024-09-16T01:25:18.844 INFO:tasks.workunit.client.0.smithi063.stdout:6/529: rename d3/d41/lba to d3/d48/d28/d3e/d44/da4/d5a/d81/lc5 0 2024-09-16T01:25:18.845 INFO:tasks.workunit.client.0.smithi063.stdout:2/643: sync 2024-09-16T01:25:18.846 INFO:tasks.workunit.client.0.smithi063.stdout:3/502: link d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/f8f d2/d11/d37/d40/d5e/fb2 0 2024-09-16T01:25:18.849 INFO:tasks.workunit.client.0.smithi063.stdout:7/430: dwrite d7/d18/f1b [0,4194304] 0 2024-09-16T01:25:18.853 INFO:tasks.workunit.client.0.smithi063.stdout:2/644: getdents d3/d7/d8/d19/d8c/d21/d28/d8a/da1/db6 0 2024-09-16T01:25:18.856 INFO:tasks.workunit.client.0.smithi063.stdout:6/530: dwrite d3/d48/d28/f2e [0,4194304] 0 2024-09-16T01:25:18.857 INFO:tasks.workunit.client.0.smithi063.stdout:3/503: write d2/d11/d37/d40/d5e/d3b/d94/fa2 [601178,11032] 0 2024-09-16T01:25:18.859 INFO:tasks.workunit.client.0.smithi063.stdout:2/645: write d3/d7/d8/d1f/d37/d4f/f63 [543193,76264] 0 2024-09-16T01:25:18.860 INFO:tasks.workunit.client.0.smithi063.stdout:1/553: dwrite d1/d5/d82/d9b/f78 [0,4194304] 0 2024-09-16T01:25:18.862 INFO:tasks.workunit.client.0.smithi063.stdout:6/531: fdatasync d3/d48/d28/d3e/d44/da4/d5a/f6d 0 2024-09-16T01:25:18.864 INFO:tasks.workunit.client.0.smithi063.stdout:7/431: dwrite d7/d1c/d1f/f28 [0,4194304] 0 2024-09-16T01:25:18.864 INFO:tasks.workunit.client.0.smithi063.stdout:6/532: chown d3/d30/d39/dac/db5/da7/lbe 16 1 2024-09-16T01:25:18.865 INFO:tasks.workunit.client.0.smithi063.stdout:3/504: creat d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/fb3 x:0 0 0 2024-09-16T01:25:18.866 INFO:tasks.workunit.client.0.smithi063.stdout:2/646: symlink d3/d7/d8/d1f/d34/dc2/le1 0 2024-09-16T01:25:18.867 INFO:tasks.workunit.client.0.smithi063.stdout:1/554: creat d1/d5/d82/d9b/d77/d7d/fb7 x:0 0 0 2024-09-16T01:25:18.867 INFO:tasks.workunit.client.0.smithi063.stdout:6/533: write d3/d30/d8d/f8f [1445103,93825] 0 2024-09-16T01:25:18.869 INFO:tasks.workunit.client.0.smithi063.stdout:7/432: creat d7/d1c/d1f/d66/f8b x:0 0 0 2024-09-16T01:25:18.871 INFO:tasks.workunit.client.0.smithi063.stdout:7/433: write d7/f12 [3635917,16158] 0 2024-09-16T01:25:18.872 INFO:tasks.workunit.client.0.smithi063.stdout:2/647: unlink d3/d7/d8/d19/d3c/c84 0 2024-09-16T01:25:18.872 INFO:tasks.workunit.client.0.smithi063.stdout:1/555: symlink d1/d5/d6f/dab/lb8 0 2024-09-16T01:25:18.874 INFO:tasks.workunit.client.0.smithi063.stdout:3/505: write d2/d11/d37/d40/d5e/d3b/d45/f50 [5340183,56609] 0 2024-09-16T01:25:18.875 INFO:tasks.workunit.client.0.smithi063.stdout:9/625: getdents d7/d9/d12/d14/d63 0 2024-09-16T01:25:18.876 INFO:tasks.workunit.client.0.smithi063.stdout:4/559: getdents d5/d3b/df 0 2024-09-16T01:25:18.876 INFO:tasks.workunit.client.0.smithi063.stdout:1/556: write d1/d5/d15/d18/f6a [4275004,47829] 0 2024-09-16T01:25:18.876 INFO:tasks.workunit.client.0.smithi063.stdout:7/434: rename d7/d18/d40/l84 to d7/d18/d40/d6c/l8c 0 2024-09-16T01:25:18.877 INFO:tasks.workunit.client.0.smithi063.stdout:8/451: rmdir d5 39 2024-09-16T01:25:18.880 INFO:tasks.workunit.client.0.smithi063.stdout:9/626: chown d7/d9/d20/ccc 520872065 1 2024-09-16T01:25:18.881 INFO:tasks.workunit.client.0.smithi063.stdout:1/557: readlink d1/d5/l14 0 2024-09-16T01:25:18.884 INFO:tasks.workunit.client.0.smithi063.stdout:6/534: dwrite d3/d48/d28/f2b [4194304,4194304] 0 2024-09-16T01:25:18.884 INFO:tasks.workunit.client.0.smithi063.stdout:1/558: creat d1/dd/fb9 x:0 0 0 2024-09-16T01:25:18.885 INFO:tasks.workunit.client.0.smithi063.stdout:9/627: read d7/d9/d20/f79 [2268169,25261] 0 2024-09-16T01:25:18.890 INFO:tasks.workunit.client.0.smithi063.stdout:9/628: dread - d7/d4a/dba/d7f/fc8 zero size 2024-09-16T01:25:18.893 INFO:tasks.workunit.client.0.smithi063.stdout:3/506: dwrite d2/d11/d37/d40/d5e/d3b/f76 [0,4194304] 0 2024-09-16T01:25:18.893 INFO:tasks.workunit.client.0.smithi063.stdout:4/560: dwrite d5/d3b/df/f95 [4194304,4194304] 0 2024-09-16T01:25:18.895 INFO:tasks.workunit.client.0.smithi063.stdout:9/629: read - d7/d4a/dba/f6d zero size 2024-09-16T01:25:18.897 INFO:tasks.workunit.client.0.smithi063.stdout:3/507: fsync d2/f9c 0 2024-09-16T01:25:18.902 INFO:tasks.workunit.client.0.smithi063.stdout:4/561: read d5/f42 [1124556,89703] 0 2024-09-16T01:25:18.902 INFO:tasks.workunit.client.0.smithi063.stdout:2/648: truncate d3/d7/d8/f10 8543514 0 2024-09-16T01:25:18.902 INFO:tasks.workunit.client.0.smithi063.stdout:7/435: truncate d7/d56/f64 478025 0 2024-09-16T01:25:18.902 INFO:tasks.workunit.client.0.smithi063.stdout:1/559: dwrite d1/d5/d15/d18/fa6 [0,4194304] 0 2024-09-16T01:25:18.902 INFO:tasks.workunit.client.0.smithi063.stdout:6/535: truncate d3/d30/f40 1456599 0 2024-09-16T01:25:18.903 INFO:tasks.workunit.client.0.smithi063.stdout:8/452: getdents d5/db/d12 0 2024-09-16T01:25:18.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/560: write d1/d5/d15/d18/fa6 [3163271,102712] 0 2024-09-16T01:25:18.906 INFO:tasks.workunit.client.0.smithi063.stdout:1/561: dread - d1/d5/d15/d18/d7c/dad/f65 zero size 2024-09-16T01:25:18.907 INFO:tasks.workunit.client.0.smithi063.stdout:1/562: stat d1/d5/d82/d9b/d77/d8a/f7f 0 2024-09-16T01:25:18.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/563: chown d1/d5/f7 259817 1 2024-09-16T01:25:18.909 INFO:tasks.workunit.client.0.smithi063.stdout:4/562: mknod d5/d3b/df/d1c/d29/d32/cb3 0 2024-09-16T01:25:18.914 INFO:tasks.workunit.client.0.smithi063.stdout:8/453: creat d5/d8c/d74/f96 x:0 0 0 2024-09-16T01:25:18.915 INFO:tasks.workunit.client.0.smithi063.stdout:8/454: chown d5/db 1092907678 1 2024-09-16T01:25:18.917 INFO:tasks.workunit.client.0.smithi063.stdout:1/564: dwrite d1/d12/f41 [0,4194304] 0 2024-09-16T01:25:18.919 INFO:tasks.workunit.client.0.smithi063.stdout:1/565: chown d1/dd/fb9 151354111 1 2024-09-16T01:25:18.920 INFO:tasks.workunit.client.0.smithi063.stdout:1/566: fsync d1/d5/fb5 0 2024-09-16T01:25:18.929 INFO:tasks.workunit.client.0.smithi063.stdout:1/567: dwrite d1/d5/d15/d18/f6a [4194304,4194304] 0 2024-09-16T01:25:18.931 INFO:tasks.workunit.client.0.smithi063.stdout:4/563: dread d5/d3b/df/d1c/d29/d32/f5b [0,4194304] 0 2024-09-16T01:25:18.934 INFO:tasks.workunit.client.0.smithi063.stdout:4/564: fdatasync d5/d3b/df/d1c/d29/d32/d60/d61/fa4 0 2024-09-16T01:25:18.935 INFO:tasks.workunit.client.0.smithi063.stdout:1/568: getdents d1/d5/d82 0 2024-09-16T01:25:18.943 INFO:tasks.workunit.client.0.smithi063.stdout:2/649: symlink d3/d7/d8/d19/d8c/d21/d28/d8a/da1/db6/le2 0 2024-09-16T01:25:18.954 INFO:tasks.workunit.client.0.smithi063.stdout:3/508: getdents d2/d5b/d90 0 2024-09-16T01:25:18.955 INFO:tasks.workunit.client.0.smithi063.stdout:9/630: rename d7/c8a to d7/d9/d12/d14/cda 0 2024-09-16T01:25:18.956 INFO:tasks.workunit.client.0.smithi063.stdout:9/631: dread - d7/d4a/f93 zero size 2024-09-16T01:25:18.956 INFO:tasks.workunit.client.0.smithi063.stdout:8/455: creat d5/d3a/f97 x:0 0 0 2024-09-16T01:25:18.957 INFO:tasks.workunit.client.0.smithi063.stdout:4/565: symlink d5/d3b/d5c/da7/lb4 0 2024-09-16T01:25:18.964 INFO:tasks.workunit.client.0.smithi063.stdout:3/509: write d2/d11/d37/d40/d5e/f55 [1883571,3015] 0 2024-09-16T01:25:18.964 INFO:tasks.workunit.client.0.smithi063.stdout:5/555: dwrite d5/d18/f24 [0,4194304] 0 2024-09-16T01:25:18.965 INFO:tasks.workunit.client.0.smithi063.stdout:7/436: rename d7/d18/d39/l68 to d7/d18/d39/d65/l8d 0 2024-09-16T01:25:18.966 INFO:tasks.workunit.client.0.smithi063.stdout:3/510: fdatasync d2/d11/d37/f74 0 2024-09-16T01:25:18.966 INFO:tasks.workunit.client.0.smithi063.stdout:6/536: getdents d3/d30/d39/d69/d95/db0 0 2024-09-16T01:25:18.966 INFO:tasks.workunit.client.0.smithi063.stdout:8/456: mkdir d5/d9/d98 0 2024-09-16T01:25:18.967 INFO:tasks.workunit.client.0.smithi063.stdout:7/437: dread - d7/d56/d6b/d86/f69 zero size 2024-09-16T01:25:18.968 INFO:tasks.workunit.client.0.smithi063.stdout:6/537: write d3/d48/d7e/f93 [370767,123838] 0 2024-09-16T01:25:18.969 INFO:tasks.workunit.client.0.smithi063.stdout:9/632: rename d7/d4a/d4d/dcd to d7/d9/d12/db2/dc6/ddb 0 2024-09-16T01:25:18.970 INFO:tasks.workunit.client.0.smithi063.stdout:3/511: mkdir d2/d5b/db4 0 2024-09-16T01:25:18.973 INFO:tasks.workunit.client.0.smithi063.stdout:4/566: rename d5/d3b/df/d1c/l3a to d5/d3b/df/d1c/d29/d32/d4e/lb5 0 2024-09-16T01:25:18.975 INFO:tasks.workunit.client.0.smithi063.stdout:3/512: dwrite d2/d11/f1d [0,4194304] 0 2024-09-16T01:25:18.975 INFO:tasks.workunit.client.0.smithi063.stdout:8/457: symlink d5/db/d12/d1a/d1e/d93/l99 0 2024-09-16T01:25:18.977 INFO:tasks.workunit.client.0.smithi063.stdout:7/438: link d7/d1c/d1f/d29/d72/c7a d7/d18/d39/d65/c8e 0 2024-09-16T01:25:18.977 INFO:tasks.workunit.client.0.smithi063.stdout:0/627: rename d1/d2e/d50/d6f to d1/d30/d52/d9d/deb 0 2024-09-16T01:25:18.978 INFO:tasks.workunit.client.0.smithi063.stdout:3/513: mknod d2/d5b/cb5 0 2024-09-16T01:25:18.979 INFO:tasks.workunit.client.0.smithi063.stdout:4/567: mknod d5/d3b/df/d1c/d29/d32/cb6 0 2024-09-16T01:25:18.980 INFO:tasks.workunit.client.0.smithi063.stdout:8/458: creat d5/db/d12/d1a/d1e/d93/f9a x:0 0 0 2024-09-16T01:25:18.981 INFO:tasks.workunit.client.0.smithi063.stdout:0/628: fdatasync d1/df/d2c/f55 0 2024-09-16T01:25:18.981 INFO:tasks.workunit.client.0.smithi063.stdout:7/439: read d7/d1c/d1f/d66/f7f [274710,19051] 0 2024-09-16T01:25:18.982 INFO:tasks.workunit.client.0.smithi063.stdout:3/514: readlink d2/d11/d37/d40/d5e/l46 0 2024-09-16T01:25:18.984 INFO:tasks.workunit.client.0.smithi063.stdout:0/629: stat d1/d30/d52/d9d/deb 0 2024-09-16T01:25:18.984 INFO:tasks.workunit.client.0.smithi063.stdout:8/459: chown d5/d3a/d40/d4a/l65 61189309 1 2024-09-16T01:25:18.985 INFO:tasks.workunit.client.0.smithi063.stdout:7/440: chown d7/d18/d40/f58 318110189 1 2024-09-16T01:25:18.985 INFO:tasks.workunit.client.0.smithi063.stdout:4/568: write d5/d3b/df/d1c/d29/d32/d4e/f9f [55884,65378] 0 2024-09-16T01:25:18.986 INFO:tasks.workunit.client.0.smithi063.stdout:3/515: mkdir d2/d11/d37/db6 0 2024-09-16T01:25:18.986 INFO:tasks.workunit.client.0.smithi063.stdout:5/556: dwrite d5/d18/d29/d48/d7b/f65 [0,4194304] 0 2024-09-16T01:25:18.987 INFO:tasks.workunit.client.0.smithi063.stdout:8/460: write d5/d8c/d74/f96 [920619,33170] 0 2024-09-16T01:25:18.988 INFO:tasks.workunit.client.0.smithi063.stdout:7/441: write d7/f9 [1980236,69570] 0 2024-09-16T01:25:18.990 INFO:tasks.workunit.client.0.smithi063.stdout:4/569: chown d5/d3b/df/d1c/d29/d32/d4e/l56 74354 1 2024-09-16T01:25:18.991 INFO:tasks.workunit.client.0.smithi063.stdout:8/461: creat d5/d3a/f9b x:0 0 0 2024-09-16T01:25:18.992 INFO:tasks.workunit.client.0.smithi063.stdout:4/570: dread - d5/d3b/d57/faf zero size 2024-09-16T01:25:18.993 INFO:tasks.workunit.client.0.smithi063.stdout:0/630: symlink d1/d30/d52/d5a/d76/lec 0 2024-09-16T01:25:18.994 INFO:tasks.workunit.client.0.smithi063.stdout:7/442: truncate d7/d56/d57/d73/f75 286262 0 2024-09-16T01:25:18.995 INFO:tasks.workunit.client.0.smithi063.stdout:3/516: rename d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/c8d to d2/d5b/d90/cb7 0 2024-09-16T01:25:18.998 INFO:tasks.workunit.client.0.smithi063.stdout:0/631: fsync d1/d30/d52/d5a/d36/fe9 0 2024-09-16T01:25:19.000 INFO:tasks.workunit.client.0.smithi063.stdout:8/462: link d5/d9/d2f/f85 d5/db/d12/d3d/f9c 0 2024-09-16T01:25:19.000 INFO:tasks.workunit.client.0.smithi063.stdout:5/557: dwrite d5/d18/d29/d48/f9b [0,4194304] 0 2024-09-16T01:25:19.001 INFO:tasks.workunit.client.0.smithi063.stdout:7/443: rename d7/d18/l41 to d7/d1c/d1f/d29/l8f 0 2024-09-16T01:25:19.004 INFO:tasks.workunit.client.0.smithi063.stdout:5/558: mknod d5/d12/cbc 0 2024-09-16T01:25:19.004 INFO:tasks.workunit.client.0.smithi063.stdout:8/463: write d5/db/d12/d1a/d1e/f32 [3400490,112795] 0 2024-09-16T01:25:19.005 INFO:tasks.workunit.client.0.smithi063.stdout:0/632: creat d1/d30/d52/d5a/d36/d41/fed x:0 0 0 2024-09-16T01:25:19.005 INFO:tasks.workunit.client.0.smithi063.stdout:3/517: symlink d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/lb8 0 2024-09-16T01:25:19.006 INFO:tasks.workunit.client.0.smithi063.stdout:4/571: dwrite d5/d3b/df/f95 [4194304,4194304] 0 2024-09-16T01:25:19.006 INFO:tasks.workunit.client.0.smithi063.stdout:5/559: dread - d5/d18/d29/d48/f71 zero size 2024-09-16T01:25:19.007 INFO:tasks.workunit.client.0.smithi063.stdout:7/444: mknod d7/d1c/d1f/d29/c90 0 2024-09-16T01:25:19.009 INFO:tasks.workunit.client.0.smithi063.stdout:8/464: write d5/db/d12/d1a/f4b [677146,28312] 0 2024-09-16T01:25:19.079 INFO:tasks.workunit.client.0.smithi063.stdout:3/518: unlink d2/d11/d37/d40/d5e/d3b/d45/f6c 0 2024-09-16T01:25:19.081 INFO:tasks.workunit.client.0.smithi063.stdout:8/465: read d5/d86/f89 [1177364,18229] 0 2024-09-16T01:25:19.082 INFO:tasks.workunit.client.0.smithi063.stdout:7/445: dread d7/d1c/d1f/d29/f4e [0,4194304] 0 2024-09-16T01:25:19.083 INFO:tasks.workunit.client.0.smithi063.stdout:8/466: write d5/db/d12/d1a/f4b [1074489,2948] 0 2024-09-16T01:25:19.085 INFO:tasks.workunit.client.0.smithi063.stdout:8/467: fsync d5/db/d12/d1a/d60/f91 0 2024-09-16T01:25:19.093 INFO:tasks.workunit.client.0.smithi063.stdout:4/572: truncate d5/d3b/df/d1c/d29/d20/f23 1346575 0 2024-09-16T01:25:19.094 INFO:tasks.workunit.client.0.smithi063.stdout:3/519: mknod d2/d11/d37/d40/d5e/d3b/d68/cb9 0 2024-09-16T01:25:19.094 INFO:tasks.workunit.client.0.smithi063.stdout:4/573: fsync d5/d3b/f16 0 2024-09-16T01:25:19.094 INFO:tasks.workunit.client.0.smithi063.stdout:5/560: creat d5/d18/d29/fbd x:0 0 0 2024-09-16T01:25:19.096 INFO:tasks.workunit.client.0.smithi063.stdout:8/468: dread d5/db/f2a [0,4194304] 0 2024-09-16T01:25:19.097 INFO:tasks.workunit.client.0.smithi063.stdout:4/574: mkdir d5/d3b/d57/d66/db7 0 2024-09-16T01:25:19.098 INFO:tasks.workunit.client.0.smithi063.stdout:7/446: getdents d7/d1c/d1f/d29 0 2024-09-16T01:25:19.099 INFO:tasks.workunit.client.0.smithi063.stdout:2/650: fdatasync d3/d7/d8/d1f/f6c 0 2024-09-16T01:25:19.102 INFO:tasks.workunit.client.0.smithi063.stdout:2/651: symlink d3/d7/d8/d1f/d37/d4f/le3 0 2024-09-16T01:25:19.104 INFO:tasks.workunit.client.0.smithi063.stdout:7/447: write d7/d1c/d1f/d29/f3f [169753,41455] 0 2024-09-16T01:25:19.104 INFO:tasks.workunit.client.0.smithi063.stdout:8/469: link d5/d3a/d40/d4a/l6f d5/d8c/d74/d87/l9d 0 2024-09-16T01:25:19.106 INFO:tasks.workunit.client.0.smithi063.stdout:4/575: dwrite d5/f2e [0,4194304] 0 2024-09-16T01:25:19.107 INFO:tasks.workunit.client.0.smithi063.stdout:2/652: readlink d3/d7/d8/d19/d8c/d21/d28/d8a/da1/l5f 0 2024-09-16T01:25:19.107 INFO:tasks.workunit.client.0.smithi063.stdout:8/470: dread d5/d9/f6c [0,4194304] 0 2024-09-16T01:25:19.108 INFO:tasks.workunit.client.0.smithi063.stdout:5/561: dwrite d5/d18/d29/d48/d98/f9e [0,4194304] 0 2024-09-16T01:25:19.111 INFO:tasks.workunit.client.0.smithi063.stdout:2/653: symlink d3/d7/d8/d1f/d37/d4f/le4 0 2024-09-16T01:25:19.117 INFO:tasks.workunit.client.0.smithi063.stdout:4/576: dwrite d5/d3b/d57/fa6 [0,4194304] 0 2024-09-16T01:25:19.122 INFO:tasks.workunit.client.0.smithi063.stdout:5/562: dwrite d5/d18/d29/f97 [0,4194304] 0 2024-09-16T01:25:19.128 INFO:tasks.workunit.client.0.smithi063.stdout:5/563: chown d5/d12/c14 1 1 2024-09-16T01:25:19.129 INFO:tasks.workunit.client.0.smithi063.stdout:8/471: dwrite d5/db/d12/f64 [0,4194304] 0 2024-09-16T01:25:19.134 INFO:tasks.workunit.client.0.smithi063.stdout:5/564: rename d5/f10 to d5/d7f/da3/fbe 0 2024-09-16T01:25:19.136 INFO:tasks.workunit.client.0.smithi063.stdout:2/654: dwrite d3/d7/d8/d1f/d37/d4f/f94 [0,4194304] 0 2024-09-16T01:25:19.141 INFO:tasks.workunit.client.0.smithi063.stdout:4/577: dwrite d5/d3b/f16 [4194304,4194304] 0 2024-09-16T01:25:19.141 INFO:tasks.workunit.client.0.smithi063.stdout:2/655: chown d3/d7/d8/d19/d3c/c7d 15 1 2024-09-16T01:25:19.141 INFO:tasks.workunit.client.0.smithi063.stdout:4/578: dread - d5/d3b/df/d1c/d29/d32/d60/d61/fa4 zero size 2024-09-16T01:25:19.141 INFO:tasks.workunit.client.0.smithi063.stdout:4/579: chown d5/d3b/d57/d66/d9b 950 1 2024-09-16T01:25:19.141 INFO:tasks.workunit.client.0.smithi063.stdout:5/565: chown d5/d18/d29/l44 1004 1 2024-09-16T01:25:19.145 INFO:tasks.workunit.client.0.smithi063.stdout:5/566: truncate d5/d18/d29/d48/d98/d94/f92 1895536 0 2024-09-16T01:25:19.145 INFO:tasks.workunit.client.0.smithi063.stdout:2/656: dread d3/d7/d8/d19/d3c/d58/f93 [0,4194304] 0 2024-09-16T01:25:19.149 INFO:tasks.workunit.client.0.smithi063.stdout:2/657: creat d3/d7/d8/d19/d8c/d21/d28/d8a/da1/db6/fe5 x:0 0 0 2024-09-16T01:25:19.150 INFO:tasks.workunit.client.0.smithi063.stdout:5/567: creat d5/d12/fbf x:0 0 0 2024-09-16T01:25:19.152 INFO:tasks.workunit.client.0.smithi063.stdout:5/568: fdatasync d5/d7f/da3/fbe 0 2024-09-16T01:25:19.154 INFO:tasks.workunit.client.0.smithi063.stdout:5/569: fsync d5/d18/d29/f32 0 2024-09-16T01:25:19.156 INFO:tasks.workunit.client.0.smithi063.stdout:5/570: mkdir d5/d7f/dc0 0 2024-09-16T01:25:19.157 INFO:tasks.workunit.client.0.smithi063.stdout:5/571: readlink d5/d12/d91/d72/l89 0 2024-09-16T01:25:19.161 INFO:tasks.workunit.client.0.smithi063.stdout:4/580: dread d5/d3b/f16 [0,4194304] 0 2024-09-16T01:25:19.163 INFO:tasks.workunit.client.0.smithi063.stdout:4/581: write d5/d3b/d57/d66/d9b/d7a/f89 [487430,86302] 0 2024-09-16T01:25:19.164 INFO:tasks.workunit.client.0.smithi063.stdout:5/572: dread d5/d18/d29/d48/d98/f5f [0,4194304] 0 2024-09-16T01:25:19.166 INFO:tasks.workunit.client.0.smithi063.stdout:5/573: creat d5/d12/fc1 x:0 0 0 2024-09-16T01:25:19.173 INFO:tasks.workunit.client.0.smithi063.stdout:5/574: dwrite d5/fb5 [0,4194304] 0 2024-09-16T01:25:19.177 INFO:tasks.workunit.client.0.smithi063.stdout:5/575: mkdir d5/d18/d29/d48/d7b/dc2 0 2024-09-16T01:25:19.181 INFO:tasks.workunit.client.0.smithi063.stdout:5/576: rmdir d5/d90 39 2024-09-16T01:25:19.230 INFO:tasks.workunit.client.0.smithi063.stdout:6/538: sync 2024-09-16T01:25:19.230 INFO:tasks.workunit.client.0.smithi063.stdout:1/569: sync 2024-09-16T01:25:19.231 INFO:tasks.workunit.client.0.smithi063.stdout:1/570: dread d1/d5/d6f/f85 [0,4194304] 0 2024-09-16T01:25:19.232 INFO:tasks.workunit.client.0.smithi063.stdout:6/539: mknod d3/d48/d28/d3e/d44/da4/d5a/cc6 0 2024-09-16T01:25:19.234 INFO:tasks.workunit.client.0.smithi063.stdout:6/540: mkdir d3/d48/d28/d3e/d68/dc7 0 2024-09-16T01:25:19.235 INFO:tasks.workunit.client.0.smithi063.stdout:1/571: link d1/d12/d21/l59 d1/d5/d15/d18/d7c/lba 0 2024-09-16T01:25:19.236 INFO:tasks.workunit.client.0.smithi063.stdout:1/572: rmdir d1/d5/d6f 39 2024-09-16T01:25:19.237 INFO:tasks.workunit.client.0.smithi063.stdout:6/541: link d3/d48/d28/d3e/d44/da4/fb7 d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/fc8 0 2024-09-16T01:25:19.238 INFO:tasks.workunit.client.0.smithi063.stdout:6/542: read d3/d10/f1d [976935,84774] 0 2024-09-16T01:25:19.238 INFO:tasks.workunit.client.0.smithi063.stdout:1/573: creat d1/d5/d6f/dab/fbb x:0 0 0 2024-09-16T01:25:19.240 INFO:tasks.workunit.client.0.smithi063.stdout:6/543: creat d3/d41/fc9 x:0 0 0 2024-09-16T01:25:19.242 INFO:tasks.workunit.client.0.smithi063.stdout:1/574: getdents d1/dd 0 2024-09-16T01:25:19.244 INFO:tasks.workunit.client.0.smithi063.stdout:6/544: rename d3/d48/d28/d3e/d68/l73 to d3/d48/d28/d3e/d44/da4/d5a/lca 0 2024-09-16T01:25:19.247 INFO:tasks.workunit.client.0.smithi063.stdout:1/575: dwrite d1/d5/d15/f19 [4194304,4194304] 0 2024-09-16T01:25:19.248 INFO:tasks.workunit.client.0.smithi063.stdout:6/545: dread d3/d48/d7e/d91/f8a [0,4194304] 0 2024-09-16T01:25:19.249 INFO:tasks.workunit.client.0.smithi063.stdout:6/546: chown d3/d30/d39/d69/fb9 3456485 1 2024-09-16T01:25:19.251 INFO:tasks.workunit.client.0.smithi063.stdout:6/547: creat d3/d41/d89/fcb x:0 0 0 2024-09-16T01:25:19.252 INFO:tasks.workunit.client.0.smithi063.stdout:6/548: write d3/d48/d7e/d91/f8a [623583,100560] 0 2024-09-16T01:25:19.253 INFO:tasks.workunit.client.0.smithi063.stdout:6/549: fdatasync d3/d10/f20 0 2024-09-16T01:25:19.257 INFO:tasks.workunit.client.0.smithi063.stdout:1/576: dwrite d1/dd/d3b/f44 [4194304,4194304] 0 2024-09-16T01:25:19.258 INFO:tasks.workunit.client.0.smithi063.stdout:6/550: truncate d3/f16 3556417 0 2024-09-16T01:25:19.259 INFO:tasks.workunit.client.0.smithi063.stdout:1/577: creat d1/d5/d82/fbc x:0 0 0 2024-09-16T01:25:19.262 INFO:tasks.workunit.client.0.smithi063.stdout:1/578: write d1/d5/f70 [578810,82295] 0 2024-09-16T01:25:19.262 INFO:tasks.workunit.client.0.smithi063.stdout:6/551: rename d3/d48/d28/f4f to d3/d48/fcc 0 2024-09-16T01:25:19.265 INFO:tasks.workunit.client.0.smithi063.stdout:1/579: creat d1/d5/d15/d18/d4b/fbd x:0 0 0 2024-09-16T01:25:19.267 INFO:tasks.workunit.client.0.smithi063.stdout:1/580: mkdir d1/dd/d3b/dbe 0 2024-09-16T01:25:19.268 INFO:tasks.workunit.client.0.smithi063.stdout:1/581: write d1/d5/d82/faa [711224,39918] 0 2024-09-16T01:25:19.269 INFO:tasks.workunit.client.0.smithi063.stdout:1/582: read d1/d5/f1a [3223934,101952] 0 2024-09-16T01:25:19.270 INFO:tasks.workunit.client.0.smithi063.stdout:1/583: truncate d1/d5/d6f/f85 770823 0 2024-09-16T01:25:19.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/584: getdents d1/d5/d15 0 2024-09-16T01:25:19.275 INFO:tasks.workunit.client.0.smithi063.stdout:1/585: mknod d1/d5/d15/cbf 0 2024-09-16T01:25:19.280 INFO:tasks.workunit.client.0.smithi063.stdout:1/586: truncate d1/d12/f41 7215928 0 2024-09-16T01:25:19.283 INFO:tasks.workunit.client.0.smithi063.stdout:1/587: unlink d1/d12/d21/l59 0 2024-09-16T01:25:19.284 INFO:tasks.workunit.client.0.smithi063.stdout:1/588: write d1/d5/fb5 [985594,121254] 0 2024-09-16T01:25:19.286 INFO:tasks.workunit.client.0.smithi063.stdout:1/589: truncate d1/d5/d15/f62 1231281 0 2024-09-16T01:25:19.287 INFO:tasks.workunit.client.0.smithi063.stdout:1/590: read - d1/d5/d15/fb2 zero size 2024-09-16T01:25:19.292 INFO:tasks.workunit.client.0.smithi063.stdout:1/591: dwrite d1/d5/f1a [0,4194304] 0 2024-09-16T01:25:19.294 INFO:tasks.workunit.client.0.smithi063.stdout:1/592: symlink d1/lc0 0 2024-09-16T01:25:19.296 INFO:tasks.workunit.client.0.smithi063.stdout:1/593: dread d1/f3 [0,4194304] 0 2024-09-16T01:25:19.298 INFO:tasks.workunit.client.0.smithi063.stdout:1/594: rmdir d1/d5/d63 39 2024-09-16T01:25:19.299 INFO:tasks.workunit.client.0.smithi063.stdout:1/595: write d1/d5/d15/f19 [2390578,58172] 0 2024-09-16T01:25:19.308 INFO:tasks.workunit.client.0.smithi063.stdout:1/596: dwrite d1/d5/d82/faa [0,4194304] 0 2024-09-16T01:25:19.308 INFO:tasks.workunit.client.0.smithi063.stdout:1/597: readlink d1/d5/d15/d18/l5e 0 2024-09-16T01:25:19.309 INFO:tasks.workunit.client.0.smithi063.stdout:1/598: chown d1/d5/d6f/d8f/c99 775 1 2024-09-16T01:25:19.313 INFO:tasks.workunit.client.0.smithi063.stdout:1/599: dread d1/d5/d15/d18/f42 [0,4194304] 0 2024-09-16T01:25:19.315 INFO:tasks.workunit.client.0.smithi063.stdout:1/600: rename d1/d5/f80 to d1/d5/d15/d18/db6/fc1 0 2024-09-16T01:25:19.323 INFO:tasks.workunit.client.0.smithi063.stdout:1/601: rename d1/d5/d15/d18/d7c to d1/d5/d82/d9b/d77/d7d/dc2 0 2024-09-16T01:25:19.325 INFO:tasks.workunit.client.0.smithi063.stdout:1/602: symlink d1/d12/d21/lc3 0 2024-09-16T01:25:19.328 INFO:tasks.workunit.client.0.smithi063.stdout:1/603: creat d1/d5/d6f/d8f/fc4 x:0 0 0 2024-09-16T01:25:19.330 INFO:tasks.workunit.client.0.smithi063.stdout:1/604: mkdir d1/d5/dc5 0 2024-09-16T01:25:19.336 INFO:tasks.workunit.client.0.smithi063.stdout:1/605: dwrite d1/d5/d82/fbc [0,4194304] 0 2024-09-16T01:25:19.337 INFO:tasks.workunit.client.0.smithi063.stdout:9/633: sync 2024-09-16T01:25:19.340 INFO:tasks.workunit.client.0.smithi063.stdout:1/606: unlink d1/d5/d82/d9b/d77/d7d/dc2/c8e 0 2024-09-16T01:25:19.341 INFO:tasks.workunit.client.0.smithi063.stdout:9/634: rmdir d7/d4a/dba/d7f 39 2024-09-16T01:25:19.342 INFO:tasks.workunit.client.0.smithi063.stdout:9/635: fdatasync d7/d9/d12/f24 0 2024-09-16T01:25:19.347 INFO:tasks.workunit.client.0.smithi063.stdout:9/636: rename d7/d9/l18 to d7/d9/ldc 0 2024-09-16T01:25:19.347 INFO:tasks.workunit.client.0.smithi063.stdout:1/607: dwrite d1/f57 [0,4194304] 0 2024-09-16T01:25:19.349 INFO:tasks.workunit.client.0.smithi063.stdout:9/637: getdents d7/d9/d12/db2/dca 0 2024-09-16T01:25:19.350 INFO:tasks.workunit.client.0.smithi063.stdout:1/608: unlink d1/d5/d6f/d8f/f97 0 2024-09-16T01:25:19.353 INFO:tasks.workunit.client.0.smithi063.stdout:3/520: sync 2024-09-16T01:25:19.353 INFO:tasks.workunit.client.0.smithi063.stdout:5/577: sync 2024-09-16T01:25:19.353 INFO:tasks.workunit.client.0.smithi063.stdout:0/633: sync 2024-09-16T01:25:19.353 INFO:tasks.workunit.client.0.smithi063.stdout:8/472: sync 2024-09-16T01:25:19.353 INFO:tasks.workunit.client.0.smithi063.stdout:2/658: sync 2024-09-16T01:25:19.353 INFO:tasks.workunit.client.0.smithi063.stdout:6/552: sync 2024-09-16T01:25:19.353 INFO:tasks.workunit.client.0.smithi063.stdout:4/582: sync 2024-09-16T01:25:19.353 INFO:tasks.workunit.client.0.smithi063.stdout:7/448: sync 2024-09-16T01:25:19.355 INFO:tasks.workunit.client.0.smithi063.stdout:9/638: link d7/d1f/f98 d7/d9/d12/d14/d63/d5f/dab/dd1/fdd 0 2024-09-16T01:25:19.356 INFO:tasks.workunit.client.0.smithi063.stdout:3/521: fsync d2/d11/f34 0 2024-09-16T01:25:19.356 INFO:tasks.workunit.client.0.smithi063.stdout:6/553: unlink d3/ca 0 2024-09-16T01:25:19.357 INFO:tasks.workunit.client.0.smithi063.stdout:8/473: mknod d5/d8c/d74/c9e 0 2024-09-16T01:25:19.358 INFO:tasks.workunit.client.0.smithi063.stdout:4/583: chown d5/d3b/df/d1c/d29/d32/d60/d61 2 1 2024-09-16T01:25:19.358 INFO:tasks.workunit.client.0.smithi063.stdout:9/639: chown d7/d4a/l6a 3572 1 2024-09-16T01:25:19.359 INFO:tasks.workunit.client.0.smithi063.stdout:2/659: symlink d3/d7/d8/d1f/d34/d45/le6 0 2024-09-16T01:25:19.360 INFO:tasks.workunit.client.0.smithi063.stdout:0/634: creat d1/df/d2c/fee x:0 0 0 2024-09-16T01:25:19.362 INFO:tasks.workunit.client.0.smithi063.stdout:5/578: mkdir d5/d7f/da3/dc3 0 2024-09-16T01:25:19.366 INFO:tasks.workunit.client.0.smithi063.stdout:9/640: fsync d7/d9/d12/d14/d38/fbe 0 2024-09-16T01:25:19.367 INFO:tasks.workunit.client.0.smithi063.stdout:1/609: dwrite d1/d5/d6f/f85 [0,4194304] 0 2024-09-16T01:25:19.371 INFO:tasks.workunit.client.0.smithi063.stdout:4/584: unlink d5/d3b/d57/c9a 0 2024-09-16T01:25:19.372 INFO:tasks.workunit.client.0.smithi063.stdout:7/449: dwrite d7/d18/d39/f6f [0,4194304] 0 2024-09-16T01:25:19.373 INFO:tasks.workunit.client.0.smithi063.stdout:2/660: truncate d3/d7/d8/d1f/d37/f74 7465762 0 2024-09-16T01:25:19.375 INFO:tasks.workunit.client.0.smithi063.stdout:6/554: rmdir d3/d10/dc4 0 2024-09-16T01:25:19.378 INFO:tasks.workunit.client.0.smithi063.stdout:6/555: stat d3/d48/d28/f2e 0 2024-09-16T01:25:19.379 INFO:tasks.workunit.client.0.smithi063.stdout:3/522: dwrite d2/d11/d37/d40/d5e/d3b/d94/d30/f3c [0,4194304] 0 2024-09-16T01:25:19.383 INFO:tasks.workunit.client.0.smithi063.stdout:3/523: fsync d2/f54 0 2024-09-16T01:25:19.383 INFO:tasks.workunit.client.0.smithi063.stdout:9/641: symlink d7/d1f/lde 0 2024-09-16T01:25:19.388 INFO:tasks.workunit.client.0.smithi063.stdout:1/610: dwrite d1/d5/f90 [0,4194304] 0 2024-09-16T01:25:19.389 INFO:tasks.workunit.client.0.smithi063.stdout:7/450: mkdir d7/d56/d57/d73/d91 0 2024-09-16T01:25:19.390 INFO:tasks.workunit.client.0.smithi063.stdout:2/661: truncate d3/d7/d8/f10 7948612 0 2024-09-16T01:25:19.391 INFO:tasks.workunit.client.0.smithi063.stdout:8/474: creat d5/db/d12/d1a/d60/d7a/f9f x:0 0 0 2024-09-16T01:25:19.393 INFO:tasks.workunit.client.0.smithi063.stdout:0/635: dwrite d1/df/d17/f92 [0,4194304] 0 2024-09-16T01:25:19.395 INFO:tasks.workunit.client.0.smithi063.stdout:6/556: mknod d3/d48/d28/d3e/ccd 0 2024-09-16T01:25:19.395 INFO:tasks.workunit.client.0.smithi063.stdout:7/451: chown d7/d1c/d1f/f32 162 1 2024-09-16T01:25:19.396 INFO:tasks.workunit.client.0.smithi063.stdout:5/579: creat d5/d18/d29/d48/d7b/dc2/fc4 x:0 0 0 2024-09-16T01:25:19.396 INFO:tasks.workunit.client.0.smithi063.stdout:4/585: dwrite d5/d3b/df/d1c/f31 [0,4194304] 0 2024-09-16T01:25:19.398 INFO:tasks.workunit.client.0.smithi063.stdout:1/611: chown d1/d5/d82/d9b/d77/d7d/dc2 83704 1 2024-09-16T01:25:19.400 INFO:tasks.workunit.client.0.smithi063.stdout:9/642: getdents d7/d9/d12/db2/dc6 0 2024-09-16T01:25:19.401 INFO:tasks.workunit.client.0.smithi063.stdout:2/662: unlink d3/d7/d8/d1f/d37/l71 0 2024-09-16T01:25:19.402 INFO:tasks.workunit.client.0.smithi063.stdout:0/636: dread d1/d30/d52/fa3 [0,4194304] 0 2024-09-16T01:25:19.402 INFO:tasks.workunit.client.0.smithi063.stdout:7/452: truncate d7/d1c/d1f/f5d 1071714 0 2024-09-16T01:25:19.405 INFO:tasks.workunit.client.0.smithi063.stdout:5/580: stat d5/d12/f43 0 2024-09-16T01:25:19.405 INFO:tasks.workunit.client.0.smithi063.stdout:6/557: creat d3/d48/d28/d3e/d68/db4/fce x:0 0 0 2024-09-16T01:25:19.408 INFO:tasks.workunit.client.0.smithi063.stdout:9/643: mknod d7/d4a/d4d/d96/cdf 0 2024-09-16T01:25:19.408 INFO:tasks.workunit.client.0.smithi063.stdout:3/524: dwrite d2/d11/f29 [0,4194304] 0 2024-09-16T01:25:19.409 INFO:tasks.workunit.client.0.smithi063.stdout:4/586: creat d5/fb8 x:0 0 0 2024-09-16T01:25:19.410 INFO:tasks.workunit.client.0.smithi063.stdout:0/637: symlink d1/df/lef 0 2024-09-16T01:25:19.410 INFO:tasks.workunit.client.0.smithi063.stdout:6/558: dread - d3/d48/d7e/d91/f87 zero size 2024-09-16T01:25:19.411 INFO:tasks.workunit.client.0.smithi063.stdout:7/453: mknod d7/d18/c92 0 2024-09-16T01:25:19.412 INFO:tasks.workunit.client.0.smithi063.stdout:3/525: chown d2/d11/d37 169 1 2024-09-16T01:25:19.413 INFO:tasks.workunit.client.0.smithi063.stdout:4/587: stat d5/d3b/d57/d66 0 2024-09-16T01:25:19.413 INFO:tasks.workunit.client.0.smithi063.stdout:8/475: dwrite d5/db/d12/d3d/d69/f6d [0,4194304] 0 2024-09-16T01:25:19.414 INFO:tasks.workunit.client.0.smithi063.stdout:2/663: rename d3/d7/d8/d19/d8c/d21/fc0 to d3/d7/d8/d1f/d34/d45/fe7 0 2024-09-16T01:25:19.414 INFO:tasks.workunit.client.0.smithi063.stdout:0/638: fsync d1/d1c/f80 0 2024-09-16T01:25:19.414 INFO:tasks.workunit.client.0.smithi063.stdout:6/559: fsync d3/d10/f20 0 2024-09-16T01:25:19.415 INFO:tasks.workunit.client.0.smithi063.stdout:5/581: truncate d5/d18/d29/fbd 472615 0 2024-09-16T01:25:19.416 INFO:tasks.workunit.client.0.smithi063.stdout:9/644: symlink d7/d9/d12/d14/le0 0 2024-09-16T01:25:19.417 INFO:tasks.workunit.client.0.smithi063.stdout:7/454: dread - d7/d56/d6b/d86/f69 zero size 2024-09-16T01:25:19.417 INFO:tasks.workunit.client.0.smithi063.stdout:1/612: truncate d1/d5/d82/d9b/f79 823491 0 2024-09-16T01:25:19.418 INFO:tasks.workunit.client.0.smithi063.stdout:2/664: stat d3/d7/d8/d1f/d37/d4f/c7b 0 2024-09-16T01:25:19.419 INFO:tasks.workunit.client.0.smithi063.stdout:1/613: fsync d1/f8 0 2024-09-16T01:25:19.420 INFO:tasks.workunit.client.0.smithi063.stdout:9/645: fdatasync d7/d9/d12/db2/f94 0 2024-09-16T01:25:19.421 INFO:tasks.workunit.client.0.smithi063.stdout:0/639: mknod d1/df/d2c/d43/d90/cf0 0 2024-09-16T01:25:19.421 INFO:tasks.workunit.client.0.smithi063.stdout:7/455: fdatasync d7/d56/d57/d73/f75 0 2024-09-16T01:25:19.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/588: write d5/d3b/df/d1c/d29/d20/f44 [1636104,30982] 0 2024-09-16T01:25:19.424 INFO:tasks.workunit.client.0.smithi063.stdout:3/526: getdents d2/d11/d37/d40/d5e/d97 0 2024-09-16T01:25:19.425 INFO:tasks.workunit.client.0.smithi063.stdout:2/665: symlink d3/d7/d8/d19/d3c/d53/d7f/le8 0 2024-09-16T01:25:19.426 INFO:tasks.workunit.client.0.smithi063.stdout:1/614: mkdir d1/d5/d82/d9b/d77/d86/dc6 0 2024-09-16T01:25:19.427 INFO:tasks.workunit.client.0.smithi063.stdout:5/582: rename d5/d18/d29/l44 to d5/d18/d29/d48/d98/lc5 0 2024-09-16T01:25:19.431 INFO:tasks.workunit.client.0.smithi063.stdout:9/646: rename d7/d4a/f59 to d7/d4a/d4d/d96/da2/fe1 0 2024-09-16T01:25:19.432 INFO:tasks.workunit.client.0.smithi063.stdout:7/456: getdents d7/d18 0 2024-09-16T01:25:19.432 INFO:tasks.workunit.client.0.smithi063.stdout:2/666: write d3/d7/d8/d19/d3c/d53/d7f/d80/f95 [2000052,5460] 0 2024-09-16T01:25:19.436 INFO:tasks.workunit.client.0.smithi063.stdout:3/527: truncate d2/d11/d37/d40/d5e/f31 667745 0 2024-09-16T01:25:19.437 INFO:tasks.workunit.client.0.smithi063.stdout:5/583: rename d5/d12/cb4 to d5/d18/d29/d48/d7b/d85/cc6 0 2024-09-16T01:25:19.438 INFO:tasks.workunit.client.0.smithi063.stdout:4/589: dwrite d5/d3b/d57/d68/d90/faa [0,4194304] 0 2024-09-16T01:25:19.439 INFO:tasks.workunit.client.0.smithi063.stdout:8/476: dread d5/db/d12/d3d/f9c [0,4194304] 0 2024-09-16T01:25:19.440 INFO:tasks.workunit.client.0.smithi063.stdout:9/647: chown d7/d9/d12/d14/d63/d5f/c8d 6701 1 2024-09-16T01:25:19.442 INFO:tasks.workunit.client.0.smithi063.stdout:7/457: symlink d7/d1c/d1f/d29/d88/l93 0 2024-09-16T01:25:19.443 INFO:tasks.workunit.client.0.smithi063.stdout:9/648: write d7/d4a/fbf [200031,67486] 0 2024-09-16T01:25:19.446 INFO:tasks.workunit.client.0.smithi063.stdout:4/590: mknod d5/d3b/df/d1c/d29/d32/cb9 0 2024-09-16T01:25:19.448 INFO:tasks.workunit.client.0.smithi063.stdout:8/477: creat d5/db/d12/d1a/fa0 x:0 0 0 2024-09-16T01:25:19.449 INFO:tasks.workunit.client.0.smithi063.stdout:3/528: fsync d2/d11/d37/d40/d5e/f31 0 2024-09-16T01:25:19.452 INFO:tasks.workunit.client.0.smithi063.stdout:5/584: dwrite d5/d12/f23 [0,4194304] 0 2024-09-16T01:25:19.453 INFO:tasks.workunit.client.0.smithi063.stdout:1/615: dread d1/d5/d15/d1b/f52 [0,4194304] 0 2024-09-16T01:25:19.453 INFO:tasks.workunit.client.0.smithi063.stdout:2/667: dwrite d3/d7/d8/d1f/d37/d4f/fc7 [0,4194304] 0 2024-09-16T01:25:19.454 INFO:tasks.workunit.client.0.smithi063.stdout:7/458: creat d7/d1c/d1f/d66/d70/f94 x:0 0 0 2024-09-16T01:25:19.457 INFO:tasks.workunit.client.0.smithi063.stdout:8/478: fdatasync d5/db/d12/d1a/f2c 0 2024-09-16T01:25:19.457 INFO:tasks.workunit.client.0.smithi063.stdout:3/529: unlink d2/d11/d37/d40/d5e/l9e 0 2024-09-16T01:25:19.459 INFO:tasks.workunit.client.0.smithi063.stdout:5/585: mkdir d5/d18/d29/d48/dad/dc7 0 2024-09-16T01:25:19.459 INFO:tasks.workunit.client.0.smithi063.stdout:2/668: chown d3/d7/d8/d1f/d37/fd5 29373 1 2024-09-16T01:25:19.460 INFO:tasks.workunit.client.0.smithi063.stdout:1/616: symlink d1/d5/d82/d9b/d77/d7d/da5/lc7 0 2024-09-16T01:25:19.460 INFO:tasks.workunit.client.0.smithi063.stdout:4/591: rmdir d5/d3b/df/d1c/d29/d20/d30/d92 0 2024-09-16T01:25:19.461 INFO:tasks.workunit.client.0.smithi063.stdout:8/479: dread - d5/d3a/d40/d4a/f8b zero size 2024-09-16T01:25:19.462 INFO:tasks.workunit.client.0.smithi063.stdout:9/649: dwrite d7/d9/d12/d14/d23/faf [0,4194304] 0 2024-09-16T01:25:19.464 INFO:tasks.workunit.client.0.smithi063.stdout:1/617: readlink d1/d5/d15/d18/l5e 0 2024-09-16T01:25:19.464 INFO:tasks.workunit.client.0.smithi063.stdout:9/650: stat d7/d1f/ca4 0 2024-09-16T01:25:19.466 INFO:tasks.workunit.client.0.smithi063.stdout:4/592: fsync d5/d3b/d57/d68/d90/faa 0 2024-09-16T01:25:19.467 INFO:tasks.workunit.client.0.smithi063.stdout:3/530: mknod d2/d5b/db4/cba 0 2024-09-16T01:25:19.469 INFO:tasks.workunit.client.0.smithi063.stdout:5/586: creat d5/d7f/da3/dc3/fc8 x:0 0 0 2024-09-16T01:25:19.469 INFO:tasks.workunit.client.0.smithi063.stdout:7/459: dread d7/d18/f1b [0,4194304] 0 2024-09-16T01:25:19.472 INFO:tasks.workunit.client.0.smithi063.stdout:9/651: symlink d7/le2 0 2024-09-16T01:25:19.473 INFO:tasks.workunit.client.0.smithi063.stdout:3/531: mknod d2/d11/d69/cbb 0 2024-09-16T01:25:19.473 INFO:tasks.workunit.client.0.smithi063.stdout:4/593: stat d5/d3b/df/d1c/d29/d32/d9e 0 2024-09-16T01:25:19.474 INFO:tasks.workunit.client.0.smithi063.stdout:5/587: dread - d5/d12/d91/d72/fb9 zero size 2024-09-16T01:25:19.474 INFO:tasks.workunit.client.0.smithi063.stdout:7/460: chown d7/d56/c49 1658 1 2024-09-16T01:25:19.478 INFO:tasks.workunit.client.0.smithi063.stdout:8/480: truncate d5/d9/f16 1754071 0 2024-09-16T01:25:19.479 INFO:tasks.workunit.client.0.smithi063.stdout:2/669: dwrite d3/fca [0,4194304] 0 2024-09-16T01:25:19.479 INFO:tasks.workunit.client.0.smithi063.stdout:4/594: stat d5/d3b/df/d1c/d29/d32/d4e/f9f 0 2024-09-16T01:25:19.479 INFO:tasks.workunit.client.0.smithi063.stdout:9/652: write d7/d9/d12/d14/d38/fbe [751875,121295] 0 2024-09-16T01:25:19.480 INFO:tasks.workunit.client.0.smithi063.stdout:5/588: mkdir d5/d12/d91/d72/dc9 0 2024-09-16T01:25:19.483 INFO:tasks.workunit.client.0.smithi063.stdout:7/461: creat d7/d18/d40/d6c/f95 x:0 0 0 2024-09-16T01:25:19.484 INFO:tasks.workunit.client.0.smithi063.stdout:3/532: mknod d2/d11/d37/d40/d5e/d3b/d94/cbc 0 2024-09-16T01:25:19.485 INFO:tasks.workunit.client.0.smithi063.stdout:9/653: stat d7/d4a/d4d/d96/da2/fb5 0 2024-09-16T01:25:19.485 INFO:tasks.workunit.client.0.smithi063.stdout:8/481: mknod d5/db/d12/ca1 0 2024-09-16T01:25:19.485 INFO:tasks.workunit.client.0.smithi063.stdout:1/618: dwrite d1/d5/fac [0,4194304] 0 2024-09-16T01:25:19.487 INFO:tasks.workunit.client.0.smithi063.stdout:4/595: write d5/d3b/d57/d66/d9b/f8a [2070693,82750] 0 2024-09-16T01:25:19.489 INFO:tasks.workunit.client.0.smithi063.stdout:1/619: fsync d1/dd/f74 0 2024-09-16T01:25:19.493 INFO:tasks.workunit.client.0.smithi063.stdout:9/654: unlink d7/d4a/dba/d7f/fbc 0 2024-09-16T01:25:19.495 INFO:tasks.workunit.client.0.smithi063.stdout:3/533: creat d2/d11/d37/d40/d5e/d3b/da1/fbd x:0 0 0 2024-09-16T01:25:19.496 INFO:tasks.workunit.client.0.smithi063.stdout:1/620: rename d1/d12/l36 to d1/d5/d6f/lc8 0 2024-09-16T01:25:19.498 INFO:tasks.workunit.client.0.smithi063.stdout:4/596: creat d5/d3b/d5c/da7/fba x:0 0 0 2024-09-16T01:25:19.499 INFO:tasks.workunit.client.0.smithi063.stdout:9/655: mkdir d7/d9/d20/de3 0 2024-09-16T01:25:19.502 INFO:tasks.workunit.client.0.smithi063.stdout:1/621: rmdir d1/d12 39 2024-09-16T01:25:19.503 INFO:tasks.workunit.client.0.smithi063.stdout:2/670: dwrite d3/d7/d8/d19/d3c/d58/f5d [0,4194304] 0 2024-09-16T01:25:19.504 INFO:tasks.workunit.client.0.smithi063.stdout:5/589: dwrite d5/d12/f13 [0,4194304] 0 2024-09-16T01:25:19.504 INFO:tasks.workunit.client.0.smithi063.stdout:8/482: getdents d5/db/d12/d1a/d60/d7a 0 2024-09-16T01:25:19.506 INFO:tasks.workunit.client.0.smithi063.stdout:7/462: dwrite d7/d1c/d1f/d29/f4e [0,4194304] 0 2024-09-16T01:25:19.508 INFO:tasks.workunit.client.0.smithi063.stdout:1/622: chown d1/d5/d15/fb2 83775441 1 2024-09-16T01:25:19.513 INFO:tasks.workunit.client.0.smithi063.stdout:5/590: symlink d5/d18/d29/d48/dad/lca 0 2024-09-16T01:25:19.513 INFO:tasks.workunit.client.0.smithi063.stdout:2/671: stat c1 0 2024-09-16T01:25:19.515 INFO:tasks.workunit.client.0.smithi063.stdout:8/483: write d5/d9/f6c [1063704,36446] 0 2024-09-16T01:25:19.518 INFO:tasks.workunit.client.0.smithi063.stdout:3/534: dwrite d2/d5b/f7a [0,4194304] 0 2024-09-16T01:25:19.519 INFO:tasks.workunit.client.0.smithi063.stdout:5/591: read - d5/d18/d29/d48/d66/fa0 zero size 2024-09-16T01:25:19.519 INFO:tasks.workunit.client.0.smithi063.stdout:1/623: creat d1/d5/d82/d9b/d77/d86/fc9 x:0 0 0 2024-09-16T01:25:19.524 INFO:tasks.workunit.client.0.smithi063.stdout:3/535: mknod d2/d5b/d90/cbe 0 2024-09-16T01:25:19.525 INFO:tasks.workunit.client.0.smithi063.stdout:5/592: mkdir d5/d7f/dcb 0 2024-09-16T01:25:19.525 INFO:tasks.workunit.client.0.smithi063.stdout:8/484: dread d5/db/d12/f38 [0,4194304] 0 2024-09-16T01:25:19.526 INFO:tasks.workunit.client.0.smithi063.stdout:9/656: dread f4 [0,4194304] 0 2024-09-16T01:25:19.526 INFO:tasks.workunit.client.0.smithi063.stdout:4/597: dwrite d5/d3b/df/d1c/d29/d32/d60/d61/f86 [0,4194304] 0 2024-09-16T01:25:19.531 INFO:tasks.workunit.client.0.smithi063.stdout:4/598: dread - d5/d3b/d57/d68/f85 zero size 2024-09-16T01:25:19.532 INFO:tasks.workunit.client.0.smithi063.stdout:5/593: symlink d5/d18/d29/d48/d66/db1/lcc 0 2024-09-16T01:25:19.532 INFO:tasks.workunit.client.0.smithi063.stdout:8/485: rename d5/db/d12 to d5/db/d12/d1a/d1e/d93/da2 22 2024-09-16T01:25:19.533 INFO:tasks.workunit.client.0.smithi063.stdout:2/672: dwrite d3/d7/d8/d19/d3c/d53/fb4 [0,4194304] 0 2024-09-16T01:25:19.535 INFO:tasks.workunit.client.0.smithi063.stdout:1/624: write d1/d12/f41 [460277,32689] 0 2024-09-16T01:25:19.535 INFO:tasks.workunit.client.0.smithi063.stdout:7/463: dread d7/d18/d40/f89 [0,4194304] 0 2024-09-16T01:25:19.538 INFO:tasks.workunit.client.0.smithi063.stdout:9/657: rename d7/d9/d12/d14/f1c to d7/d9/d12/d14/d34/fe4 0 2024-09-16T01:25:19.538 INFO:tasks.workunit.client.0.smithi063.stdout:2/673: write d3/d7/d8/d19/f75 [4396257,100905] 0 2024-09-16T01:25:19.539 INFO:tasks.workunit.client.0.smithi063.stdout:8/486: write d5/f94 [322729,99955] 0 2024-09-16T01:25:19.540 INFO:tasks.workunit.client.0.smithi063.stdout:5/594: creat d5/d18/d29/d52/fcd x:0 0 0 2024-09-16T01:25:19.541 INFO:tasks.workunit.client.0.smithi063.stdout:7/464: fdatasync d7/d18/f22 0 2024-09-16T01:25:19.541 INFO:tasks.workunit.client.0.smithi063.stdout:1/625: chown d1/d5/d6f/d8f/l9c 123206 1 2024-09-16T01:25:19.543 INFO:tasks.workunit.client.0.smithi063.stdout:3/536: link d2/d11/d37/d40/d5e/d3b/d94/f4d d2/fbf 0 2024-09-16T01:25:19.544 INFO:tasks.workunit.client.0.smithi063.stdout:8/487: read - d5/d3a/f9b zero size 2024-09-16T01:25:19.545 INFO:tasks.workunit.client.0.smithi063.stdout:7/465: read d7/d56/f55 [618277,4741] 0 2024-09-16T01:25:19.546 INFO:tasks.workunit.client.0.smithi063.stdout:1/626: chown d1/d5/d82/d9b/d77/d7d 2789 1 2024-09-16T01:25:19.546 INFO:tasks.workunit.client.0.smithi063.stdout:2/674: mknod d3/d7/d8/d1f/d37/d4f/ce9 0 2024-09-16T01:25:19.547 INFO:tasks.workunit.client.0.smithi063.stdout:9/658: symlink d7/d9/d12/d14/d63/d5f/dab/dd1/le5 0 2024-09-16T01:25:19.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/675: creat d3/d7/d8/d19/d8c/d21/d28/d8a/db7/fea x:0 0 0 2024-09-16T01:25:19.555 INFO:tasks.workunit.client.0.smithi063.stdout:1/627: dwrite d1/f3 [0,4194304] 0 2024-09-16T01:25:19.558 INFO:tasks.workunit.client.0.smithi063.stdout:7/466: dwrite d7/d1c/d1f/d66/f7f [0,4194304] 0 2024-09-16T01:25:19.560 INFO:tasks.workunit.client.0.smithi063.stdout:9/659: rename d7/d9/d12/d14/d63/fd3 to d7/d4a/d4d/d96/da2/fe6 0 2024-09-16T01:25:19.561 INFO:tasks.workunit.client.0.smithi063.stdout:8/488: link d5/d9/le d5/d3a/d40/d4a/la3 0 2024-09-16T01:25:19.562 INFO:tasks.workunit.client.0.smithi063.stdout:8/489: chown d5/db/d12/f38 720 1 2024-09-16T01:25:19.562 INFO:tasks.workunit.client.0.smithi063.stdout:1/628: truncate d1/d12/fa7 2157699 0 2024-09-16T01:25:19.562 INFO:tasks.workunit.client.0.smithi063.stdout:4/599: truncate d5/d3b/df/d1c/d29/d32/d60/d61/f86 2911596 0 2024-09-16T01:25:19.563 INFO:tasks.workunit.client.0.smithi063.stdout:2/676: rename d3/d7/d8/d19/d8c/c17 to d3/d7/d8/d1f/d34/d45/ceb 0 2024-09-16T01:25:19.565 INFO:tasks.workunit.client.0.smithi063.stdout:2/677: chown d3/d7/d8/d19/d8c/d21/d28/d8a/fbf 0 1 2024-09-16T01:25:19.566 INFO:tasks.workunit.client.0.smithi063.stdout:3/537: truncate d2/d11/d37/f59 3308394 0 2024-09-16T01:25:19.567 INFO:tasks.workunit.client.0.smithi063.stdout:7/467: mkdir d7/d1c/d1f/d29/d88/d96 0 2024-09-16T01:25:19.568 INFO:tasks.workunit.client.0.smithi063.stdout:7/468: fsync d7/f48 0 2024-09-16T01:25:19.568 INFO:tasks.workunit.client.0.smithi063.stdout:3/538: truncate d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/fb3 950074 0 2024-09-16T01:25:19.622 INFO:tasks.workunit.client.0.smithi063.stdout:9/660: rename d7/d9/d12 to d7/d9/d20/de3/de7 0 2024-09-16T01:25:19.626 INFO:tasks.workunit.client.0.smithi063.stdout:1/629: rename d1/d5/d15/d1b/f52 to d1/d5/d15/d18/fca 0 2024-09-16T01:25:19.628 INFO:tasks.workunit.client.0.smithi063.stdout:3/539: write d2/d11/d37/d40/d5e/f31 [651986,35955] 0 2024-09-16T01:25:19.629 INFO:tasks.workunit.client.0.smithi063.stdout:1/630: rmdir d1/d12 39 2024-09-16T01:25:19.630 INFO:tasks.workunit.client.0.smithi063.stdout:9/661: creat d7/d9/d20/de3/de7/db2/dca/fe8 x:0 0 0 2024-09-16T01:25:19.631 INFO:tasks.workunit.client.0.smithi063.stdout:8/490: dwrite d5/f3b [0,4194304] 0 2024-09-16T01:25:19.633 INFO:tasks.workunit.client.0.smithi063.stdout:7/469: dwrite d7/d1c/d1f/f2b [0,4194304] 0 2024-09-16T01:25:19.633 INFO:tasks.workunit.client.0.smithi063.stdout:2/678: dread d3/d7/d8/d19/f24 [0,4194304] 0 2024-09-16T01:25:19.634 INFO:tasks.workunit.client.0.smithi063.stdout:8/491: fsync d5/f94 0 2024-09-16T01:25:19.635 INFO:tasks.workunit.client.0.smithi063.stdout:1/631: write d1/d12/f41 [3858403,84937] 0 2024-09-16T01:25:19.640 INFO:tasks.workunit.client.0.smithi063.stdout:8/492: creat d5/d9/d98/fa4 x:0 0 0 2024-09-16T01:25:19.641 INFO:tasks.workunit.client.0.smithi063.stdout:7/470: symlink d7/d1c/d1f/d29/l97 0 2024-09-16T01:25:19.644 INFO:tasks.workunit.client.0.smithi063.stdout:2/679: creat d3/d7/d8/d19/d8c/d21/d9c/fec x:0 0 0 2024-09-16T01:25:19.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/540: dwrite d2/d11/d37/f74 [4194304,4194304] 0 2024-09-16T01:25:19.647 INFO:tasks.workunit.client.0.smithi063.stdout:9/662: dwrite d7/fa9 [0,4194304] 0 2024-09-16T01:25:19.648 INFO:tasks.workunit.client.0.smithi063.stdout:1/632: write d1/d5/d82/d9b/f4e [488827,62734] 0 2024-09-16T01:25:19.650 INFO:tasks.workunit.client.0.smithi063.stdout:2/680: truncate d3/fca 4351160 0 2024-09-16T01:25:19.651 INFO:tasks.workunit.client.0.smithi063.stdout:8/493: write d5/d9/f16 [1401284,40787] 0 2024-09-16T01:25:19.655 INFO:tasks.workunit.client.0.smithi063.stdout:1/633: rmdir d1/d5/dc5 0 2024-09-16T01:25:19.655 INFO:tasks.workunit.client.0.smithi063.stdout:8/494: write d5/f83 [807544,68555] 0 2024-09-16T01:25:19.658 INFO:tasks.workunit.client.0.smithi063.stdout:9/663: creat d7/d9/d20/de3/de7/d14/d23/fe9 x:0 0 0 2024-09-16T01:25:19.658 INFO:tasks.workunit.client.0.smithi063.stdout:3/541: dread d2/d11/d18/fd [4194304,4194304] 0 2024-09-16T01:25:19.659 INFO:tasks.workunit.client.0.smithi063.stdout:7/471: dwrite d7/d1c/d1f/d66/f82 [0,4194304] 0 2024-09-16T01:25:19.660 INFO:tasks.workunit.client.0.smithi063.stdout:3/542: chown d2/f22 1438 1 2024-09-16T01:25:19.662 INFO:tasks.workunit.client.0.smithi063.stdout:9/664: chown d7/c1a 37051 1 2024-09-16T01:25:19.662 INFO:tasks.workunit.client.0.smithi063.stdout:2/681: dread d3/fca [0,4194304] 0 2024-09-16T01:25:19.663 INFO:tasks.workunit.client.0.smithi063.stdout:7/472: rmdir d7/d18/d40/d6c 39 2024-09-16T01:25:19.664 INFO:tasks.workunit.client.0.smithi063.stdout:1/634: fsync d1/d5/d82/d9b/d77/d7d/dc2/f37 0 2024-09-16T01:25:19.664 INFO:tasks.workunit.client.0.smithi063.stdout:8/495: creat d5/d8c/d74/d87/fa5 x:0 0 0 2024-09-16T01:25:19.665 INFO:tasks.workunit.client.0.smithi063.stdout:3/543: mknod d2/d11/d37/d40/d5e/d3b/da1/cc0 0 2024-09-16T01:25:19.666 INFO:tasks.workunit.client.0.smithi063.stdout:9/665: rename d7/f71 to d7/d1f/fea 0 2024-09-16T01:25:19.667 INFO:tasks.workunit.client.0.smithi063.stdout:8/496: chown d5/db/d12/d1a/d1e/d68 633 1 2024-09-16T01:25:19.667 INFO:tasks.workunit.client.0.smithi063.stdout:7/473: read d7/d1c/d1f/f32 [4195880,95659] 0 2024-09-16T01:25:19.669 INFO:tasks.workunit.client.0.smithi063.stdout:3/544: mkdir d2/dc1 0 2024-09-16T01:25:19.669 INFO:tasks.workunit.client.0.smithi063.stdout:1/635: stat d1/d5/d82/d9b/d77/d7d/dc2/dad/f65 0 2024-09-16T01:25:19.670 INFO:tasks.workunit.client.0.smithi063.stdout:2/682: dread d3/d7/d8/d1f/fac [0,4194304] 0 2024-09-16T01:25:19.671 INFO:tasks.workunit.client.0.smithi063.stdout:7/474: unlink d7/d18/f44 0 2024-09-16T01:25:19.671 INFO:tasks.workunit.client.0.smithi063.stdout:8/497: chown d5/db/d12/d1a/l4c 15077905 1 2024-09-16T01:25:19.673 INFO:tasks.workunit.client.0.smithi063.stdout:3/545: mkdir d2/d11/d37/db1/dc2 0 2024-09-16T01:25:19.673 INFO:tasks.workunit.client.0.smithi063.stdout:2/683: stat d3/d7/d8/d19/f44 0 2024-09-16T01:25:19.673 INFO:tasks.workunit.client.0.smithi063.stdout:1/636: mkdir d1/d5/d82/d9b/d77/d7d/dcb 0 2024-09-16T01:25:19.676 INFO:tasks.workunit.client.0.smithi063.stdout:7/475: read d7/d1c/d1f/f5d [673878,111984] 0 2024-09-16T01:25:19.677 INFO:tasks.workunit.client.0.smithi063.stdout:5/595: sync 2024-09-16T01:25:19.678 INFO:tasks.workunit.client.0.smithi063.stdout:0/640: sync 2024-09-16T01:25:19.678 INFO:tasks.workunit.client.0.smithi063.stdout:6/560: sync 2024-09-16T01:25:19.678 INFO:tasks.workunit.client.0.smithi063.stdout:1/637: creat d1/d12/d21/fcc x:0 0 0 2024-09-16T01:25:19.679 INFO:tasks.workunit.client.0.smithi063.stdout:9/666: dwrite d7/d9/d20/de3/de7/db2/f94 [0,4194304] 0 2024-09-16T01:25:19.679 INFO:tasks.workunit.client.0.smithi063.stdout:8/498: creat d5/db/d12/d1a/fa6 x:0 0 0 2024-09-16T01:25:19.681 INFO:tasks.workunit.client.0.smithi063.stdout:6/561: chown d3/c72 2466710 1 2024-09-16T01:25:19.682 INFO:tasks.workunit.client.0.smithi063.stdout:7/476: write d7/d56/d6b/d86/f69 [635652,108326] 0 2024-09-16T01:25:19.684 INFO:tasks.workunit.client.0.smithi063.stdout:8/499: creat d5/db/d12/fa7 x:0 0 0 2024-09-16T01:25:19.684 INFO:tasks.workunit.client.0.smithi063.stdout:5/596: unlink d5/d12/d91/l6a 0 2024-09-16T01:25:19.685 INFO:tasks.workunit.client.0.smithi063.stdout:0/641: dread d1/d1c/f2d [0,4194304] 0 2024-09-16T01:25:19.686 INFO:tasks.workunit.client.0.smithi063.stdout:1/638: creat d1/d5/d82/d9b/d77/d7d/fcd x:0 0 0 2024-09-16T01:25:19.687 INFO:tasks.workunit.client.0.smithi063.stdout:5/597: fdatasync d5/d18/d29/d48/d66/f83 0 2024-09-16T01:25:19.687 INFO:tasks.workunit.client.0.smithi063.stdout:2/684: dread d3/d7/d8/d19/d3c/d58/f5d [0,4194304] 0 2024-09-16T01:25:19.688 INFO:tasks.workunit.client.0.smithi063.stdout:1/639: chown d1/d5/d15/d18/d4b/fb1 537768 1 2024-09-16T01:25:19.690 INFO:tasks.workunit.client.0.smithi063.stdout:5/598: chown d5/d18/d29/d48/dad 335700 1 2024-09-16T01:25:19.690 INFO:tasks.workunit.client.0.smithi063.stdout:3/546: link d2/d11/d18/l64 d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/lc3 0 2024-09-16T01:25:19.690 INFO:tasks.workunit.client.0.smithi063.stdout:0/642: creat d1/df/ff1 x:0 0 0 2024-09-16T01:25:19.692 INFO:tasks.workunit.client.0.smithi063.stdout:1/640: write d1/dd/d3b/f58 [1529544,40359] 0 2024-09-16T01:25:19.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/667: symlink d7/d9/d20/de3/de7/d14/d63/d5f/dab/leb 0 2024-09-16T01:25:19.694 INFO:tasks.workunit.client.0.smithi063.stdout:5/599: symlink d5/d12/d91/d72/lce 0 2024-09-16T01:25:19.695 INFO:tasks.workunit.client.0.smithi063.stdout:8/500: getdents d5/d9/d98 0 2024-09-16T01:25:19.695 INFO:tasks.workunit.client.0.smithi063.stdout:0/643: rmdir d1/d30/d52/db3 39 2024-09-16T01:25:19.695 INFO:tasks.workunit.client.0.smithi063.stdout:7/477: chown d7/d1c/d1f/d29/f3d 3310 1 2024-09-16T01:25:19.697 INFO:tasks.workunit.client.0.smithi063.stdout:1/641: symlink d1/dd/d3b/db3/lce 0 2024-09-16T01:25:19.697 INFO:tasks.workunit.client.0.smithi063.stdout:3/547: write d2/f81 [193645,119495] 0 2024-09-16T01:25:19.701 INFO:tasks.workunit.client.0.smithi063.stdout:0/644: creat d1/d2e/d48/dc3/ff2 x:0 0 0 2024-09-16T01:25:19.701 INFO:tasks.workunit.client.0.smithi063.stdout:8/501: mkdir d5/db/d12/d1a/d60/da8 0 2024-09-16T01:25:19.703 INFO:tasks.workunit.client.0.smithi063.stdout:2/685: dwrite d3/d7/d8/d19/d8c/d21/d28/d4e/fdc [0,4194304] 0 2024-09-16T01:25:19.704 INFO:tasks.workunit.client.0.smithi063.stdout:8/502: dread - d5/d9/d98/fa4 zero size 2024-09-16T01:25:19.707 INFO:tasks.workunit.client.0.smithi063.stdout:1/642: creat d1/d5/d82/d9b/d77/d86/dc6/fcf x:0 0 0 2024-09-16T01:25:19.708 INFO:tasks.workunit.client.0.smithi063.stdout:9/668: dwrite d7/d1f/f67 [0,4194304] 0 2024-09-16T01:25:19.709 INFO:tasks.workunit.client.0.smithi063.stdout:5/600: rename d5/d18/d29/d48/d66/f69 to d5/d12/fcf 0 2024-09-16T01:25:19.717 INFO:tasks.workunit.client.0.smithi063.stdout:3/548: rename d2/d11/d37/d40/d5e/d97/fac to d2/d11/d37/d40/d5e/fc4 0 2024-09-16T01:25:19.718 INFO:tasks.workunit.client.0.smithi063.stdout:5/601: creat d5/d18/d29/d52/fd0 x:0 0 0 2024-09-16T01:25:19.718 INFO:tasks.workunit.client.0.smithi063.stdout:9/669: creat d7/d1f/fec x:0 0 0 2024-09-16T01:25:19.718 INFO:tasks.workunit.client.0.smithi063.stdout:1/643: mknod d1/d5/d82/d9b/d77/d86/dc6/cd0 0 2024-09-16T01:25:19.718 INFO:tasks.workunit.client.0.smithi063.stdout:7/478: dwrite d7/d1c/d1f/d29/f52 [0,4194304] 0 2024-09-16T01:25:19.718 INFO:tasks.workunit.client.0.smithi063.stdout:2/686: dread d3/d7/d8/d19/f24 [0,4194304] 0 2024-09-16T01:25:19.719 INFO:tasks.workunit.client.0.smithi063.stdout:3/549: stat d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/fae 0 2024-09-16T01:25:19.719 INFO:tasks.workunit.client.0.smithi063.stdout:5/602: write d5/d7f/da3/dc3/fc8 [225070,130427] 0 2024-09-16T01:25:19.722 INFO:tasks.workunit.client.0.smithi063.stdout:8/503: dwrite d5/d3a/f90 [0,4194304] 0 2024-09-16T01:25:19.724 INFO:tasks.workunit.client.0.smithi063.stdout:2/687: write d3/d77/f89 [398501,2925] 0 2024-09-16T01:25:19.724 INFO:tasks.workunit.client.0.smithi063.stdout:1/644: creat d1/d5/d15/fd1 x:0 0 0 2024-09-16T01:25:19.725 INFO:tasks.workunit.client.0.smithi063.stdout:9/670: creat d7/d9/d20/de3/de7/db2/dca/fed x:0 0 0 2024-09-16T01:25:19.725 INFO:tasks.workunit.client.0.smithi063.stdout:7/479: mkdir d7/d1c/d1f/d29/d88/d98 0 2024-09-16T01:25:19.729 INFO:tasks.workunit.client.0.smithi063.stdout:1/645: mkdir d1/d5/d6f/dd2 0 2024-09-16T01:25:19.735 INFO:tasks.workunit.client.0.smithi063.stdout:2/688: creat d3/d7/d8/d1f/d37/d4f/dce/fed x:0 0 0 2024-09-16T01:25:19.735 INFO:tasks.workunit.client.0.smithi063.stdout:7/480: dread d7/d56/f64 [0,4194304] 0 2024-09-16T01:25:19.735 INFO:tasks.workunit.client.0.smithi063.stdout:1/646: rename d1/d5/d6f to d1/d5/d6f/dd3 22 2024-09-16T01:25:19.735 INFO:tasks.workunit.client.0.smithi063.stdout:9/671: rmdir d7/d9/d20/de3/de7/d14/d23 39 2024-09-16T01:25:19.737 INFO:tasks.workunit.client.0.smithi063.stdout:5/603: dwrite d5/d18/f24 [4194304,4194304] 0 2024-09-16T01:25:19.741 INFO:tasks.workunit.client.0.smithi063.stdout:3/550: dwrite d2/d11/d18/f6f [0,4194304] 0 2024-09-16T01:25:19.743 INFO:tasks.workunit.client.0.smithi063.stdout:8/504: dwrite d5/d3a/f43 [4194304,4194304] 0 2024-09-16T01:25:19.748 INFO:tasks.workunit.client.0.smithi063.stdout:9/672: creat d7/d4a/dba/fee x:0 0 0 2024-09-16T01:25:19.750 INFO:tasks.workunit.client.0.smithi063.stdout:2/689: dread d3/d7/d8/d19/d3c/d53/d7f/d80/f87 [0,4194304] 0 2024-09-16T01:25:19.751 INFO:tasks.workunit.client.0.smithi063.stdout:5/604: symlink d5/d7f/da3/dc3/ld1 0 2024-09-16T01:25:19.754 INFO:tasks.workunit.client.0.smithi063.stdout:8/505: creat d5/db/d12/d1a/d1e/fa9 x:0 0 0 2024-09-16T01:25:19.755 INFO:tasks.workunit.client.0.smithi063.stdout:9/673: readlink d7/d9/d20/de3/de7/d14/d63/d5f/l7b 0 2024-09-16T01:25:19.756 INFO:tasks.workunit.client.0.smithi063.stdout:7/481: link d7/d1c/d1f/d66/l7d d7/d1c/d1f/d66/l99 0 2024-09-16T01:25:19.757 INFO:tasks.workunit.client.0.smithi063.stdout:1/647: dwrite d1/d5/f90 [0,4194304] 0 2024-09-16T01:25:19.760 INFO:tasks.workunit.client.0.smithi063.stdout:3/551: link d2/d11/d37/d40/d5e/d3b/f89 d2/d11/d69/d80/d8a/fc5 0 2024-09-16T01:25:19.761 INFO:tasks.workunit.client.0.smithi063.stdout:2/690: rename d3/d7/d8/d19/d3c/c88 to d3/d7/d8/d1f/d34/cee 0 2024-09-16T01:25:19.761 INFO:tasks.workunit.client.0.smithi063.stdout:9/674: dread - d7/d9/d20/de3/de7/db2/f92 zero size 2024-09-16T01:25:19.761 INFO:tasks.workunit.client.0.smithi063.stdout:5/605: dread d5/d18/d29/f7e [0,4194304] 0 2024-09-16T01:25:19.762 INFO:tasks.workunit.client.0.smithi063.stdout:7/482: chown d7/d18/d39/l3a 5320 1 2024-09-16T01:25:19.762 INFO:tasks.workunit.client.0.smithi063.stdout:3/552: dread - d2/d5b/f9a zero size 2024-09-16T01:25:19.762 INFO:tasks.workunit.client.0.smithi063.stdout:1/648: write d1/d5/d15/d1b/f39 [4522237,115468] 0 2024-09-16T01:25:19.763 INFO:tasks.workunit.client.0.smithi063.stdout:5/606: chown d5/d18/d29/d48/d7b 0 1 2024-09-16T01:25:19.765 INFO:tasks.workunit.client.0.smithi063.stdout:9/675: dread - d7/d4a/d4d/d96/da2/fe6 zero size 2024-09-16T01:25:19.766 INFO:tasks.workunit.client.0.smithi063.stdout:1/649: mkdir d1/dd/d3b/dbe/dd4 0 2024-09-16T01:25:19.767 INFO:tasks.workunit.client.0.smithi063.stdout:3/553: getdents d2/d5b/db4 0 2024-09-16T01:25:19.767 INFO:tasks.workunit.client.0.smithi063.stdout:5/607: symlink d5/d18/d29/d48/d66/ld2 0 2024-09-16T01:25:19.767 INFO:tasks.workunit.client.0.smithi063.stdout:9/676: rmdir d7/d4a/d4d/d96/da2 39 2024-09-16T01:25:19.768 INFO:tasks.workunit.client.0.smithi063.stdout:2/691: truncate d3/d7/d8/d19/d3c/d53/d7f/d80/fdd 33218 0 2024-09-16T01:25:19.770 INFO:tasks.workunit.client.0.smithi063.stdout:9/677: symlink d7/lef 0 2024-09-16T01:25:19.770 INFO:tasks.workunit.client.0.smithi063.stdout:5/608: mknod d5/d18/d29/cd3 0 2024-09-16T01:25:19.771 INFO:tasks.workunit.client.0.smithi063.stdout:7/483: dread d7/d18/d40/f89 [0,4194304] 0 2024-09-16T01:25:19.771 INFO:tasks.workunit.client.0.smithi063.stdout:2/692: unlink d3/d7/f3f 0 2024-09-16T01:25:19.772 INFO:tasks.workunit.client.0.smithi063.stdout:3/554: symlink d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/lc6 0 2024-09-16T01:25:19.775 INFO:tasks.workunit.client.0.smithi063.stdout:2/693: chown d3/d7/d8/d1f/d37/d4f/l8f 4 1 2024-09-16T01:25:19.777 INFO:tasks.workunit.client.0.smithi063.stdout:3/555: rename d2/d11/d37/d40/d5e/f93 to d2/d5b/d90/fc7 0 2024-09-16T01:25:19.777 INFO:tasks.workunit.client.0.smithi063.stdout:2/694: read d3/d7/d8/d19/d3c/d58/f5d [143005,45289] 0 2024-09-16T01:25:19.779 INFO:tasks.workunit.client.0.smithi063.stdout:5/609: dwrite d5/d18/f78 [0,4194304] 0 2024-09-16T01:25:19.781 INFO:tasks.workunit.client.0.smithi063.stdout:2/695: write d3/d7/d8/d1f/d37/d4f/f63 [2278996,127792] 0 2024-09-16T01:25:19.782 INFO:tasks.workunit.client.0.smithi063.stdout:3/556: creat d2/d11/d37/d40/d5e/d3b/d68/d6d/fc8 x:0 0 0 2024-09-16T01:25:19.783 INFO:tasks.workunit.client.0.smithi063.stdout:7/484: truncate f5 1438832 0 2024-09-16T01:25:19.784 INFO:tasks.workunit.client.0.smithi063.stdout:5/610: write d5/d18/d29/f97 [804986,64500] 0 2024-09-16T01:25:19.785 INFO:tasks.workunit.client.0.smithi063.stdout:4/600: sync 2024-09-16T01:25:19.785 INFO:tasks.workunit.client.0.smithi063.stdout:1/650: dread d1/d5/d15/d18/f1e [0,4194304] 0 2024-09-16T01:25:19.788 INFO:tasks.workunit.client.0.smithi063.stdout:5/611: chown d5/d18/d29/d52/c9d 14 1 2024-09-16T01:25:19.788 INFO:tasks.workunit.client.0.smithi063.stdout:3/557: creat d2/d11/d37/d40/d5e/d97/fc9 x:0 0 0 2024-09-16T01:25:19.791 INFO:tasks.workunit.client.0.smithi063.stdout:9/678: dwrite d7/fa8 [0,4194304] 0 2024-09-16T01:25:19.791 INFO:tasks.workunit.client.0.smithi063.stdout:2/696: write d3/ff [5120843,37283] 0 2024-09-16T01:25:19.792 INFO:tasks.workunit.client.0.smithi063.stdout:1/651: symlink d1/d5/d82/ld5 0 2024-09-16T01:25:19.795 INFO:tasks.workunit.client.0.smithi063.stdout:3/558: creat d2/d11/d69/fca x:0 0 0 2024-09-16T01:25:19.802 INFO:tasks.workunit.client.0.smithi063.stdout:7/485: dwrite d7/d1c/d1f/d29/d88/f8a [0,4194304] 0 2024-09-16T01:25:19.802 INFO:tasks.workunit.client.0.smithi063.stdout:4/601: dwrite d5/d3b/d5c/f9d [0,4194304] 0 2024-09-16T01:25:19.804 INFO:tasks.workunit.client.0.smithi063.stdout:1/652: truncate d1/d5/d82/d9b/f9e 226370 0 2024-09-16T01:25:19.808 INFO:tasks.workunit.client.0.smithi063.stdout:4/602: chown d5/d3b/l15 128345600 1 2024-09-16T01:25:19.811 INFO:tasks.workunit.client.0.smithi063.stdout:5/612: dwrite d5/d7f/da3/dc3/fc8 [0,4194304] 0 2024-09-16T01:25:19.813 INFO:tasks.workunit.client.0.smithi063.stdout:7/486: mknod d7/d1c/d1f/d29/d88/d96/c9a 0 2024-09-16T01:25:19.818 INFO:tasks.workunit.client.0.smithi063.stdout:9/679: dwrite d7/d9/d20/de3/de7/db2/dca/fe8 [0,4194304] 0 2024-09-16T01:25:19.819 INFO:tasks.workunit.client.0.smithi063.stdout:4/603: write d5/d3b/d57/d68/f99 [874681,6981] 0 2024-09-16T01:25:19.819 INFO:tasks.workunit.client.0.smithi063.stdout:2/697: dwrite d3/f4b [0,4194304] 0 2024-09-16T01:25:19.820 INFO:tasks.workunit.client.0.smithi063.stdout:5/613: rmdir d5/d18/d29/d48/d66 39 2024-09-16T01:25:19.822 INFO:tasks.workunit.client.0.smithi063.stdout:7/487: creat d7/d18/d39/d65/f9b x:0 0 0 2024-09-16T01:25:19.822 INFO:tasks.workunit.client.0.smithi063.stdout:9/680: stat d7/d1f/fec 0 2024-09-16T01:25:19.823 INFO:tasks.workunit.client.0.smithi063.stdout:3/559: dwrite d2/d11/d37/d40/d5e/d3b/d68/d6d/fc8 [0,4194304] 0 2024-09-16T01:25:19.824 INFO:tasks.workunit.client.0.smithi063.stdout:5/614: chown d5/d12/f43 251566 1 2024-09-16T01:25:19.825 INFO:tasks.workunit.client.0.smithi063.stdout:1/653: dwrite d1/f57 [0,4194304] 0 2024-09-16T01:25:19.827 INFO:tasks.workunit.client.0.smithi063.stdout:2/698: write d3/d7/d8/d19/d8c/d21/d28/d8a/da1/f47 [1640093,99112] 0 2024-09-16T01:25:19.829 INFO:tasks.workunit.client.0.smithi063.stdout:9/681: readlink d7/d9/d20/de3/de7/d14/d63/d5f/dab/dd1/le5 0 2024-09-16T01:25:19.830 INFO:tasks.workunit.client.0.smithi063.stdout:3/560: read - d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/f84 zero size 2024-09-16T01:25:19.831 INFO:tasks.workunit.client.0.smithi063.stdout:5/615: fsync d5/f67 0 2024-09-16T01:25:19.837 INFO:tasks.workunit.client.0.smithi063.stdout:2/699: mknod d3/d7/d8/d19/d3c/cef 0 2024-09-16T01:25:19.838 INFO:tasks.workunit.client.0.smithi063.stdout:5/616: symlink d5/d18/d29/d48/d7b/ld4 0 2024-09-16T01:25:19.838 INFO:tasks.workunit.client.0.smithi063.stdout:9/682: creat d7/d4a/dba/d7f/ff0 x:0 0 0 2024-09-16T01:25:19.840 INFO:tasks.workunit.client.0.smithi063.stdout:4/604: link d5/d3b/df/d1c/d29/d32/d60/d61/f86 d5/d3b/d57/d66/d9b/d7a/fbb 0 2024-09-16T01:25:19.841 INFO:tasks.workunit.client.0.smithi063.stdout:4/605: readlink d5/l2f 0 2024-09-16T01:25:19.842 INFO:tasks.workunit.client.0.smithi063.stdout:5/617: chown d5/c96 786590 1 2024-09-16T01:25:19.842 INFO:tasks.workunit.client.0.smithi063.stdout:1/654: dwrite d1/d5/f76 [0,4194304] 0 2024-09-16T01:25:19.844 INFO:tasks.workunit.client.0.smithi063.stdout:7/488: dread d7/d1c/d1f/f2b [0,4194304] 0 2024-09-16T01:25:19.845 INFO:tasks.workunit.client.0.smithi063.stdout:3/561: rename d2/d11/d18/f3f to d2/d11/d37/db1/fcb 0 2024-09-16T01:25:19.847 INFO:tasks.workunit.client.0.smithi063.stdout:4/606: write d5/d3b/df/d1c/d29/f65 [700798,51387] 0 2024-09-16T01:25:19.849 INFO:tasks.workunit.client.0.smithi063.stdout:9/683: dread d7/fa9 [0,4194304] 0 2024-09-16T01:25:19.850 INFO:tasks.workunit.client.0.smithi063.stdout:7/489: creat d7/f9c x:0 0 0 2024-09-16T01:25:19.853 INFO:tasks.workunit.client.0.smithi063.stdout:1/655: getdents d1/d5/d15/d18/db6 0 2024-09-16T01:25:19.853 INFO:tasks.workunit.client.0.smithi063.stdout:3/562: write d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/fae [144069,14020] 0 2024-09-16T01:25:19.853 INFO:tasks.workunit.client.0.smithi063.stdout:7/490: fdatasync d7/d56/d57/f5c 0 2024-09-16T01:25:19.855 INFO:tasks.workunit.client.0.smithi063.stdout:4/607: mkdir d5/d3b/df/d1c/d29/d32/d9e/dbc 0 2024-09-16T01:25:19.856 INFO:tasks.workunit.client.0.smithi063.stdout:1/656: write d1/d12/f8b [895013,121516] 0 2024-09-16T01:25:19.857 INFO:tasks.workunit.client.0.smithi063.stdout:2/700: dread d3/d7/d8/d19/d3c/d58/fbb [0,4194304] 0 2024-09-16T01:25:19.857 INFO:tasks.workunit.client.0.smithi063.stdout:5/618: rename d5/ca to d5/d18/d29/d48/cd5 0 2024-09-16T01:25:19.860 INFO:tasks.workunit.client.0.smithi063.stdout:3/563: creat d2/fcc x:0 0 0 2024-09-16T01:25:19.865 INFO:tasks.workunit.client.0.smithi063.stdout:1/657: rename d1/d5/d6f/l98 to d1/d5/d82/d9b/d77/d8a/ld6 0 2024-09-16T01:25:19.866 INFO:tasks.workunit.client.0.smithi063.stdout:7/491: dwrite d7/d18/d40/f58 [0,4194304] 0 2024-09-16T01:25:19.869 INFO:tasks.workunit.client.0.smithi063.stdout:4/608: dwrite d5/f2e [4194304,4194304] 0 2024-09-16T01:25:19.870 INFO:tasks.workunit.client.0.smithi063.stdout:7/492: fdatasync d7/d56/d57/d60/f63 0 2024-09-16T01:25:19.870 INFO:tasks.workunit.client.0.smithi063.stdout:3/564: creat d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6/fcd x:0 0 0 2024-09-16T01:25:19.873 INFO:tasks.workunit.client.0.smithi063.stdout:1/658: creat d1/d5/d6f/dd2/fd7 x:0 0 0 2024-09-16T01:25:19.873 INFO:tasks.workunit.client.0.smithi063.stdout:7/493: chown d7/d1c/d1f 1718681 1 2024-09-16T01:25:19.873 INFO:tasks.workunit.client.0.smithi063.stdout:9/684: dwrite d7/d9/d20/de3/de7/d14/d38/f70 [0,4194304] 0 2024-09-16T01:25:19.877 INFO:tasks.workunit.client.0.smithi063.stdout:3/565: mkdir d2/d11/d37/dce 0 2024-09-16T01:25:19.883 INFO:tasks.workunit.client.0.smithi063.stdout:2/701: dread d3/ff [4194304,4194304] 0 2024-09-16T01:25:19.883 INFO:tasks.workunit.client.0.smithi063.stdout:9/685: write d7/d9/d20/de3/de7/fb8 [127842,81659] 0 2024-09-16T01:25:19.884 INFO:tasks.workunit.client.0.smithi063.stdout:4/609: link d5/f2e d5/d3b/df/d1c/d29/d20/d98/fbd 0 2024-09-16T01:25:19.887 INFO:tasks.workunit.client.0.smithi063.stdout:5/619: dwrite d5/d18/d29/f2f [0,4194304] 0 2024-09-16T01:25:19.887 INFO:tasks.workunit.client.0.smithi063.stdout:3/566: mknod d2/d11/ccf 0 2024-09-16T01:25:19.891 INFO:tasks.workunit.client.0.smithi063.stdout:9/686: readlink d7/d9/d20/de3/de7/lc0 0 2024-09-16T01:25:19.892 INFO:tasks.workunit.client.0.smithi063.stdout:1/659: dread d1/d5/f1a [0,4194304] 0 2024-09-16T01:25:19.894 INFO:tasks.workunit.client.0.smithi063.stdout:3/567: mknod d2/d11/d37/db1/dc2/cd0 0 2024-09-16T01:25:19.894 INFO:tasks.workunit.client.0.smithi063.stdout:7/494: dwrite d7/d1c/d1f/d66/f82 [0,4194304] 0 2024-09-16T01:25:19.894 INFO:tasks.workunit.client.0.smithi063.stdout:9/687: mkdir d7/d1f/df1 0 2024-09-16T01:25:19.897 INFO:tasks.workunit.client.0.smithi063.stdout:5/620: truncate d5/d12/fa4 55960 0 2024-09-16T01:25:19.897 INFO:tasks.workunit.client.0.smithi063.stdout:9/688: mkdir d7/d4a/df2 0 2024-09-16T01:25:19.898 INFO:tasks.workunit.client.0.smithi063.stdout:1/660: mknod d1/dd/d3b/db3/cd8 0 2024-09-16T01:25:19.899 INFO:tasks.workunit.client.0.smithi063.stdout:3/568: write d2/d11/d37/d40/d5e/f65 [107544,97411] 0 2024-09-16T01:25:19.900 INFO:tasks.workunit.client.0.smithi063.stdout:2/702: dwrite d3/d7/d8/d19/fa5 [0,4194304] 0 2024-09-16T01:25:19.902 INFO:tasks.workunit.client.0.smithi063.stdout:7/495: truncate d7/d1c/d1f/d66/f82 4271230 0 2024-09-16T01:25:19.904 INFO:tasks.workunit.client.0.smithi063.stdout:9/689: creat d7/d9/d20/de3/ff3 x:0 0 0 2024-09-16T01:25:19.906 INFO:tasks.workunit.client.0.smithi063.stdout:7/496: fsync d7/f12 0 2024-09-16T01:25:19.907 INFO:tasks.workunit.client.0.smithi063.stdout:2/703: dread - d3/d7/d8/d19/d8c/d21/d9c/dd4/fe0 zero size 2024-09-16T01:25:19.907 INFO:tasks.workunit.client.0.smithi063.stdout:1/661: mknod d1/d5/d82/d9b/d77/d7d/cd9 0 2024-09-16T01:25:19.911 INFO:tasks.workunit.client.0.smithi063.stdout:5/621: creat d5/d12/fd6 x:0 0 0 2024-09-16T01:25:19.912 INFO:tasks.workunit.client.0.smithi063.stdout:7/497: mkdir d7/d18/d39/d9d 0 2024-09-16T01:25:19.913 INFO:tasks.workunit.client.0.smithi063.stdout:3/569: dread d2/d11/d37/d40/d5e/f55 [0,4194304] 0 2024-09-16T01:25:19.916 INFO:tasks.workunit.client.0.smithi063.stdout:2/704: creat d3/d7/d8/d19/d8c/d21/d28/d8a/ff0 x:0 0 0 2024-09-16T01:25:19.920 INFO:tasks.workunit.client.0.smithi063.stdout:6/562: sync 2024-09-16T01:25:19.920 INFO:tasks.workunit.client.0.smithi063.stdout:4/610: dread d5/d3b/df/d1c/d29/f26 [0,4194304] 0 2024-09-16T01:25:19.920 INFO:tasks.workunit.client.0.smithi063.stdout:2/705: mkdir d3/d7/d8/df1 0 2024-09-16T01:25:19.922 INFO:tasks.workunit.client.0.smithi063.stdout:5/622: creat d5/d7f/dc0/fd7 x:0 0 0 2024-09-16T01:25:19.922 INFO:tasks.workunit.client.0.smithi063.stdout:1/662: dwrite d1/dd/d3b/f58 [4194304,4194304] 0 2024-09-16T01:25:19.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/498: getdents d7/d1c/d1f/d29 0 2024-09-16T01:25:19.924 INFO:tasks.workunit.client.0.smithi063.stdout:6/563: write d3/f62 [1453482,123571] 0 2024-09-16T01:25:19.928 INFO:tasks.workunit.client.0.smithi063.stdout:4/611: symlink d5/d3b/d57/d66/d9b/lbe 0 2024-09-16T01:25:19.929 INFO:tasks.workunit.client.0.smithi063.stdout:9/690: dwrite d7/d9/d20/de3/de7/d14/f65 [0,4194304] 0 2024-09-16T01:25:19.931 INFO:tasks.workunit.client.0.smithi063.stdout:7/499: mkdir d7/d1c/d1f/d29/d72/d9e 0 2024-09-16T01:25:19.932 INFO:tasks.workunit.client.0.smithi063.stdout:6/564: mkdir d3/d30/d39/dac/db5/dcf 0 2024-09-16T01:25:19.933 INFO:tasks.workunit.client.0.smithi063.stdout:3/570: dwrite d2/d11/d37/d40/d5e/fb2 [0,4194304] 0 2024-09-16T01:25:19.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/565: chown d3/c4 11597 1 2024-09-16T01:25:19.936 INFO:tasks.workunit.client.0.smithi063.stdout:5/623: rename d5/d12/fb7 to d5/d7f/da3/dc3/fd8 0 2024-09-16T01:25:19.936 INFO:tasks.workunit.client.0.smithi063.stdout:9/691: rmdir d7/d9/d20/de3/de7/d14/d63/d5f/dab 39 2024-09-16T01:25:19.939 INFO:tasks.workunit.client.0.smithi063.stdout:6/566: creat d3/d30/d8d/fd0 x:0 0 0 2024-09-16T01:25:19.941 INFO:tasks.workunit.client.0.smithi063.stdout:2/706: rename d3/d7/d8/d19/f24 to d3/d7/d8/d1f/d34/dc2/ff2 0 2024-09-16T01:25:19.943 INFO:tasks.workunit.client.0.smithi063.stdout:4/612: dread d5/f2e [4194304,4194304] 0 2024-09-16T01:25:19.948 INFO:tasks.workunit.client.0.smithi063.stdout:1/663: dwrite d1/d5/d15/d18/d4b/fbd [0,4194304] 0 2024-09-16T01:25:19.949 INFO:tasks.workunit.client.0.smithi063.stdout:5/624: truncate d5/d7f/dc0/fd7 1002730 0 2024-09-16T01:25:19.953 INFO:tasks.workunit.client.0.smithi063.stdout:3/571: dwrite d2/d11/f1d [0,4194304] 0 2024-09-16T01:25:19.953 INFO:tasks.workunit.client.0.smithi063.stdout:7/500: rename d7/d18/f1a to d7/d18/d39/f9f 0 2024-09-16T01:25:19.955 INFO:tasks.workunit.client.0.smithi063.stdout:4/613: fdatasync d5/f3f 0 2024-09-16T01:25:19.958 INFO:tasks.workunit.client.0.smithi063.stdout:9/692: dwrite d7/d1f/fec [0,4194304] 0 2024-09-16T01:25:19.963 INFO:tasks.workunit.client.0.smithi063.stdout:1/664: rename d1/dd/d3b/dbe/dd4 to d1/d5/d82/d9b/d77/d7d/dda 0 2024-09-16T01:25:19.965 INFO:tasks.workunit.client.0.smithi063.stdout:4/614: creat d5/d3b/d5c/fbf x:0 0 0 2024-09-16T01:25:19.965 INFO:tasks.workunit.client.0.smithi063.stdout:7/501: chown d7/d56/d57/l6d 27635514 1 2024-09-16T01:25:19.966 INFO:tasks.workunit.client.0.smithi063.stdout:6/567: write d3/d30/d39/dac/db5/fad [748746,121909] 0 2024-09-16T01:25:19.970 INFO:tasks.workunit.client.0.smithi063.stdout:5/625: dread d5/d18/d29/d48/d98/d94/f60 [4194304,4194304] 0 2024-09-16T01:25:19.970 INFO:tasks.workunit.client.0.smithi063.stdout:2/707: dwrite d3/d7/d8/d19/d8c/d21/d28/d4e/fa0 [0,4194304] 0 2024-09-16T01:25:19.970 INFO:tasks.workunit.client.0.smithi063.stdout:1/665: creat d1/dd/d3b/db3/fdb x:0 0 0 2024-09-16T01:25:19.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/645: sync 2024-09-16T01:25:19.972 INFO:tasks.workunit.client.0.smithi063.stdout:9/693: symlink d7/d9/d20/de3/de7/db2/dca/lf4 0 2024-09-16T01:25:19.972 INFO:tasks.workunit.client.0.smithi063.stdout:2/708: stat d3/d7/d8/d19/d8c/d21/d28/d8a/c98 0 2024-09-16T01:25:19.973 INFO:tasks.workunit.client.0.smithi063.stdout:1/666: mkdir d1/dd/d3b/ddc 0 2024-09-16T01:25:19.973 INFO:tasks.workunit.client.0.smithi063.stdout:3/572: truncate d2/d11/d37/f74 5005189 0 2024-09-16T01:25:19.975 INFO:tasks.workunit.client.0.smithi063.stdout:4/615: mknod d5/d3b/d57/d66/db7/cc0 0 2024-09-16T01:25:20.098 INFO:tasks.workunit.client.0.smithi063.stdout:5/626: truncate d5/d12/fae 989165 0 2024-09-16T01:25:20.098 INFO:tasks.workunit.client.0.smithi063.stdout:1/667: symlink d1/d5/d82/d9b/d77/d8a/ldd 0 2024-09-16T01:25:20.099 INFO:tasks.workunit.client.0.smithi063.stdout:7/502: dwrite d7/d56/d57/d60/f63 [0,4194304] 0 2024-09-16T01:25:20.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/694: creat d7/d9/d20/de3/de7/db2/dc6/ddb/ff5 x:0 0 0 2024-09-16T01:25:20.100 INFO:tasks.workunit.client.0.smithi063.stdout:6/568: dread d3/d10/f29 [0,4194304] 0 2024-09-16T01:25:20.102 INFO:tasks.workunit.client.0.smithi063.stdout:7/503: chown d7/d56/l54 2784152 1 2024-09-16T01:25:20.103 INFO:tasks.workunit.client.0.smithi063.stdout:9/695: chown d7/d4a/cc5 513983113 1 2024-09-16T01:25:20.105 INFO:tasks.workunit.client.0.smithi063.stdout:1/668: write d1/d5/d15/d18/d4b/f5f [983538,271] 0 2024-09-16T01:25:20.105 INFO:tasks.workunit.client.0.smithi063.stdout:2/709: truncate d3/d7/d8/d1f/d37/f7a 2239290 0 2024-09-16T01:25:20.106 INFO:tasks.workunit.client.0.smithi063.stdout:4/616: creat d5/d3b/df/d1c/d29/d32/fc1 x:0 0 0 2024-09-16T01:25:20.106 INFO:tasks.workunit.client.0.smithi063.stdout:7/504: chown d7/d1c/d1f/d29/c7c 6107 1 2024-09-16T01:25:20.108 INFO:tasks.workunit.client.0.smithi063.stdout:9/696: write d7/d9/d20/de3/de7/fc2 [1561848,64721] 0 2024-09-16T01:25:20.109 INFO:tasks.workunit.client.0.smithi063.stdout:3/573: dwrite d2/d11/d37/d40/d5e/d3b/da1/fbd [0,4194304] 0 2024-09-16T01:25:20.109 INFO:tasks.workunit.client.0.smithi063.stdout:6/569: mkdir d3/d30/d39/d69/d95/dd1 0 2024-09-16T01:25:20.111 INFO:tasks.workunit.client.0.smithi063.stdout:2/710: rmdir d3/d7/d8/d19/d3c/d58 39 2024-09-16T01:25:20.113 INFO:tasks.workunit.client.0.smithi063.stdout:9/697: fsync d7/d9/d20/de3/de7/fc2 0 2024-09-16T01:25:20.114 INFO:tasks.workunit.client.0.smithi063.stdout:6/570: creat d3/d30/d39/fd2 x:0 0 0 2024-09-16T01:25:20.114 INFO:tasks.workunit.client.0.smithi063.stdout:7/505: mknod d7/d18/d39/d9d/ca0 0 2024-09-16T01:25:20.115 INFO:tasks.workunit.client.0.smithi063.stdout:5/627: dwrite d5/f38 [0,4194304] 0 2024-09-16T01:25:20.116 INFO:tasks.workunit.client.0.smithi063.stdout:2/711: mkdir d3/d7/d8/df1/df3 0 2024-09-16T01:25:20.117 INFO:tasks.workunit.client.0.smithi063.stdout:6/571: chown d3/d48/d28/d3e/d44/da4/ca6 21 1 2024-09-16T01:25:20.118 INFO:tasks.workunit.client.0.smithi063.stdout:4/617: creat d5/d3b/df/d1c/d29/d32/d9e/dbc/fc2 x:0 0 0 2024-09-16T01:25:20.120 INFO:tasks.workunit.client.0.smithi063.stdout:4/618: fdatasync d5/d3b/df/d1c/d29/f8e 0 2024-09-16T01:25:20.121 INFO:tasks.workunit.client.0.smithi063.stdout:1/669: rename d1/dd/c91 to d1/d5/d82/d9b/d77/d7d/dc2/cde 0 2024-09-16T01:25:20.125 INFO:tasks.workunit.client.0.smithi063.stdout:6/572: write d3/d48/f26 [5059913,24038] 0 2024-09-16T01:25:20.125 INFO:tasks.workunit.client.0.smithi063.stdout:2/712: creat d3/d7/d8/d19/d8c/d21/d28/d8a/db7/ff4 x:0 0 0 2024-09-16T01:25:20.125 INFO:tasks.workunit.client.0.smithi063.stdout:9/698: rmdir d7/d9/d20/de3/de7/d14/d63/d5f/dab/dd1 39 2024-09-16T01:25:20.125 INFO:tasks.workunit.client.0.smithi063.stdout:1/670: readlink d1/dd/d3b/db3/lce 0 2024-09-16T01:25:20.125 INFO:tasks.workunit.client.0.smithi063.stdout:7/506: write d7/d1c/d1f/f38 [58842,90007] 0 2024-09-16T01:25:20.125 INFO:tasks.workunit.client.0.smithi063.stdout:5/628: rename d5/d18/d29/d48/dad/lca to d5/d18/d29/d48/d66/db1/ld9 0 2024-09-16T01:25:20.126 INFO:tasks.workunit.client.0.smithi063.stdout:3/574: write d2/d11/d37/d40/d5e/d3b/f89 [87871,31220] 0 2024-09-16T01:25:20.126 INFO:tasks.workunit.client.0.smithi063.stdout:4/619: creat d5/d3b/df/d1c/d29/d20/d30/fc3 x:0 0 0 2024-09-16T01:25:20.127 INFO:tasks.workunit.client.0.smithi063.stdout:9/699: write d7/d1f/f78 [610599,102692] 0 2024-09-16T01:25:20.129 INFO:tasks.workunit.client.0.smithi063.stdout:1/671: mknod d1/d5/d82/d9b/cdf 0 2024-09-16T01:25:20.129 INFO:tasks.workunit.client.0.smithi063.stdout:2/713: rmdir d3/d7/d8/d19/d8c/d21/d28 39 2024-09-16T01:25:20.131 INFO:tasks.workunit.client.0.smithi063.stdout:2/714: chown d3/d7/c5b 48835 1 2024-09-16T01:25:20.132 INFO:tasks.workunit.client.0.smithi063.stdout:7/507: symlink d7/d1c/d1f/d29/d88/d98/la1 0 2024-09-16T01:25:20.133 INFO:tasks.workunit.client.0.smithi063.stdout:4/620: rmdir d5/d3b/df/d1c/d29/d20/d30 39 2024-09-16T01:25:20.135 INFO:tasks.workunit.client.0.smithi063.stdout:9/700: mknod d7/d4a/dba/cf6 0 2024-09-16T01:25:20.137 INFO:tasks.workunit.client.0.smithi063.stdout:7/508: chown d7/d1c/d1f/f2e 1 1 2024-09-16T01:25:20.140 INFO:tasks.workunit.client.0.smithi063.stdout:8/506: sync 2024-09-16T01:25:20.142 INFO:tasks.workunit.client.0.smithi063.stdout:9/701: chown d7/d9/d20/de3/de7/l15 17308 1 2024-09-16T01:25:20.142 INFO:tasks.workunit.client.0.smithi063.stdout:4/621: symlink d5/d3b/df/d1c/d29/d20/lc4 0 2024-09-16T01:25:20.142 INFO:tasks.workunit.client.0.smithi063.stdout:3/575: dread d2/d11/d18/f83 [0,4194304] 0 2024-09-16T01:25:20.144 INFO:tasks.workunit.client.0.smithi063.stdout:6/573: dwrite d3/d48/d28/d3e/d44/da4/f50 [0,4194304] 0 2024-09-16T01:25:20.146 INFO:tasks.workunit.client.0.smithi063.stdout:1/672: dread d1/d5/f13 [0,4194304] 0 2024-09-16T01:25:20.149 INFO:tasks.workunit.client.0.smithi063.stdout:7/509: write d7/d56/d57/f74 [3630854,70009] 0 2024-09-16T01:25:20.150 INFO:tasks.workunit.client.0.smithi063.stdout:4/622: mkdir d5/d3b/d57/d68/dc5 0 2024-09-16T01:25:20.151 INFO:tasks.workunit.client.0.smithi063.stdout:2/715: dwrite d3/d7/d8/d19/d8c/d21/d28/d8a/db7/fcf [0,4194304] 0 2024-09-16T01:25:20.153 INFO:tasks.workunit.client.0.smithi063.stdout:4/623: rmdir d5 39 2024-09-16T01:25:20.153 INFO:tasks.workunit.client.0.smithi063.stdout:5/629: dread d5/d12/d91/d72/f93 [0,4194304] 0 2024-09-16T01:25:20.155 INFO:tasks.workunit.client.0.smithi063.stdout:1/673: mkdir d1/d5/d15/de0 0 2024-09-16T01:25:20.155 INFO:tasks.workunit.client.0.smithi063.stdout:7/510: mkdir d7/d1c/d1f/d66/d70/da2 0 2024-09-16T01:25:20.155 INFO:tasks.workunit.client.0.smithi063.stdout:2/716: creat d3/d77/ff5 x:0 0 0 2024-09-16T01:25:20.156 INFO:tasks.workunit.client.0.smithi063.stdout:7/511: mknod d7/d56/ca3 0 2024-09-16T01:25:20.157 INFO:tasks.workunit.client.0.smithi063.stdout:4/624: chown d5/d3b/d5c/da7/lac 639381701 1 2024-09-16T01:25:20.157 INFO:tasks.workunit.client.0.smithi063.stdout:8/507: rename d5/d3a to d5/db/d12/d3d/d69/daa 0 2024-09-16T01:25:20.158 INFO:tasks.workunit.client.0.smithi063.stdout:1/674: mkdir d1/d5/d6f/dd2/de1 0 2024-09-16T01:25:20.159 INFO:tasks.workunit.client.0.smithi063.stdout:5/630: getdents d5/d18/d29/d48/dad/dc7 0 2024-09-16T01:25:20.159 INFO:tasks.workunit.client.0.smithi063.stdout:2/717: chown d3/d7/d8/d19/d8c/d21/d28/d8a/da1/f5e 18199 1 2024-09-16T01:25:20.159 INFO:tasks.workunit.client.0.smithi063.stdout:9/702: getdents d7/d1f 0 2024-09-16T01:25:20.160 INFO:tasks.workunit.client.0.smithi063.stdout:3/576: getdents d2/d5b/d90 0 2024-09-16T01:25:20.161 INFO:tasks.workunit.client.0.smithi063.stdout:8/508: rmdir d5/d86 39 2024-09-16T01:25:20.161 INFO:tasks.workunit.client.0.smithi063.stdout:0/646: sync 2024-09-16T01:25:20.163 INFO:tasks.workunit.client.0.smithi063.stdout:4/625: read d5/d3b/d57/d68/d90/faa [3630654,125017] 0 2024-09-16T01:25:20.163 INFO:tasks.workunit.client.0.smithi063.stdout:3/577: chown d2/d11/d37/db1/dc2 2169531 1 2024-09-16T01:25:20.164 INFO:tasks.workunit.client.0.smithi063.stdout:9/703: truncate d7/d4a/dba/fee 595468 0 2024-09-16T01:25:20.165 INFO:tasks.workunit.client.0.smithi063.stdout:2/718: creat d3/d7/d8/d1f/d37/ff6 x:0 0 0 2024-09-16T01:25:20.165 INFO:tasks.workunit.client.0.smithi063.stdout:0/647: creat d1/d30/d52/d5a/d44/ff3 x:0 0 0 2024-09-16T01:25:20.166 INFO:tasks.workunit.client.0.smithi063.stdout:8/509: symlink d5/d8c/d74/d87/lab 0 2024-09-16T01:25:20.168 INFO:tasks.workunit.client.0.smithi063.stdout:5/631: rename d5/d18/d29/d48/d66/fa0 to d5/d18/d29/d48/d66/fda 0 2024-09-16T01:25:20.168 INFO:tasks.workunit.client.0.smithi063.stdout:4/626: fsync d5/d3b/d5c/da7/fba 0 2024-09-16T01:25:20.169 INFO:tasks.workunit.client.0.smithi063.stdout:3/578: readlink d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/lc6 0 2024-09-16T01:25:20.171 INFO:tasks.workunit.client.0.smithi063.stdout:7/512: dwrite d7/d1c/d1f/f2b [0,4194304] 0 2024-09-16T01:25:20.172 INFO:tasks.workunit.client.0.smithi063.stdout:3/579: chown d2/d11/d37/db1/dc2 3878 1 2024-09-16T01:25:20.172 INFO:tasks.workunit.client.0.smithi063.stdout:8/510: symlink d5/db/d12/d3d/lac 0 2024-09-16T01:25:20.173 INFO:tasks.workunit.client.0.smithi063.stdout:2/719: write d3/d7/d8/d19/d8c/d21/d28/d8a/da1/db6/fe5 [630034,86340] 0 2024-09-16T01:25:20.173 INFO:tasks.workunit.client.0.smithi063.stdout:5/632: mkdir d5/d18/d29/d48/ddb 0 2024-09-16T01:25:20.174 INFO:tasks.workunit.client.0.smithi063.stdout:6/574: dread d3/d10/f2a [0,4194304] 0 2024-09-16T01:25:20.176 INFO:tasks.workunit.client.0.smithi063.stdout:7/513: truncate d7/d56/d57/f78 394027 0 2024-09-16T01:25:20.177 INFO:tasks.workunit.client.0.smithi063.stdout:9/704: write d7/d4a/f53 [5068905,120344] 0 2024-09-16T01:25:20.178 INFO:tasks.workunit.client.0.smithi063.stdout:0/648: write d1/d30/d52/d5a/fd9 [1577761,48510] 0 2024-09-16T01:25:20.179 INFO:tasks.workunit.client.0.smithi063.stdout:4/627: dread - d5/d3b/df/d1c/d29/d20/d30/fc3 zero size 2024-09-16T01:25:20.180 INFO:tasks.workunit.client.0.smithi063.stdout:8/511: write d5/f25 [1524054,125798] 0 2024-09-16T01:25:20.180 INFO:tasks.workunit.client.0.smithi063.stdout:6/575: chown d3/d30/d39/d69/d95/dd1 236 1 2024-09-16T01:25:20.181 INFO:tasks.workunit.client.0.smithi063.stdout:3/580: write d2/d11/d18/f2d [1290465,97241] 0 2024-09-16T01:25:20.181 INFO:tasks.workunit.client.0.smithi063.stdout:5/633: unlink d5/d18/d29/d52/l53 0 2024-09-16T01:25:20.183 INFO:tasks.workunit.client.0.smithi063.stdout:2/720: readlink d3/l5 0 2024-09-16T01:25:20.185 INFO:tasks.workunit.client.0.smithi063.stdout:7/514: readlink d7/d1c/d1f/d66/l99 0 2024-09-16T01:25:20.185 INFO:tasks.workunit.client.0.smithi063.stdout:6/576: write d3/f57 [2070416,44404] 0 2024-09-16T01:25:20.186 INFO:tasks.workunit.client.0.smithi063.stdout:8/512: mknod d5/d8c/d74/d87/cad 0 2024-09-16T01:25:20.187 INFO:tasks.workunit.client.0.smithi063.stdout:4/628: symlink d5/lc6 0 2024-09-16T01:25:20.188 INFO:tasks.workunit.client.0.smithi063.stdout:9/705: fsync d7/d9/d20/de3/de7/d14/d63/d5f/f62 0 2024-09-16T01:25:20.191 INFO:tasks.workunit.client.0.smithi063.stdout:8/513: write d5/db/d54/f61 [1866739,73958] 0 2024-09-16T01:25:20.192 INFO:tasks.workunit.client.0.smithi063.stdout:6/577: chown d3/d48/d7e/d91/c5d 4017 1 2024-09-16T01:25:20.193 INFO:tasks.workunit.client.0.smithi063.stdout:9/706: rmdir d7/d9/d20 39 2024-09-16T01:25:20.195 INFO:tasks.workunit.client.0.smithi063.stdout:3/581: rename d2/d11/d37/d40/d5e/d3b/d45/l7c to d2/d11/d69/d80/d8a/d8e/ld1 0 2024-09-16T01:25:20.197 INFO:tasks.workunit.client.0.smithi063.stdout:0/649: dwrite d1/df/fd3 [0,4194304] 0 2024-09-16T01:25:20.198 INFO:tasks.workunit.client.0.smithi063.stdout:5/634: dwrite d5/d18/fbb [0,4194304] 0 2024-09-16T01:25:20.198 INFO:tasks.workunit.client.0.smithi063.stdout:6/578: stat d3/d48/d28/d3e/d44/da4/ca6 0 2024-09-16T01:25:20.199 INFO:tasks.workunit.client.0.smithi063.stdout:8/514: fdatasync d5/db/d12/d1a/d1e/d68/f84 0 2024-09-16T01:25:20.202 INFO:tasks.workunit.client.0.smithi063.stdout:9/707: mkdir d7/d9/d20/de3/de7/d14/d38/df7 0 2024-09-16T01:25:20.202 INFO:tasks.workunit.client.0.smithi063.stdout:8/515: readlink d5/d8c/l71 0 2024-09-16T01:25:20.203 INFO:tasks.workunit.client.0.smithi063.stdout:4/629: truncate d5/d3b/d57/d68/f99 308415 0 2024-09-16T01:25:20.204 INFO:tasks.workunit.client.0.smithi063.stdout:3/582: mkdir d2/d11/d37/d40/d5e/d3b/d68/dd2 0 2024-09-16T01:25:20.205 INFO:tasks.workunit.client.0.smithi063.stdout:6/579: mknod d3/d48/d28/cd3 0 2024-09-16T01:25:20.206 INFO:tasks.workunit.client.0.smithi063.stdout:0/650: symlink d1/d30/d52/db3/lf4 0 2024-09-16T01:25:20.206 INFO:tasks.workunit.client.0.smithi063.stdout:2/721: dwrite d3/d7/d8/d19/d8c/d21/d28/d4e/f6d [0,4194304] 0 2024-09-16T01:25:20.206 INFO:tasks.workunit.client.0.smithi063.stdout:4/630: read - d5/d3b/d57/faf zero size 2024-09-16T01:25:20.208 INFO:tasks.workunit.client.0.smithi063.stdout:8/516: chown d5/db/d12/d3d/d69/f6d 1889 1 2024-09-16T01:25:20.209 INFO:tasks.workunit.client.0.smithi063.stdout:9/708: write d7/d9/d20/de3/de7/db2/dc6/ddb/ff5 [902849,81971] 0 2024-09-16T01:25:20.212 INFO:tasks.workunit.client.0.smithi063.stdout:5/635: write d5/d12/fa4 [1030402,106284] 0 2024-09-16T01:25:20.214 INFO:tasks.workunit.client.0.smithi063.stdout:3/583: chown d2/d11/d37/d40/d5e/d3b/d68/l72 103 1 2024-09-16T01:25:20.217 INFO:tasks.workunit.client.0.smithi063.stdout:2/722: creat d3/d7/d8/d1f/d34/d56/ff7 x:0 0 0 2024-09-16T01:25:20.218 INFO:tasks.workunit.client.0.smithi063.stdout:5/636: mknod d5/d7f/da3/cdc 0 2024-09-16T01:25:20.219 INFO:tasks.workunit.client.0.smithi063.stdout:3/584: unlink d2/fcc 0 2024-09-16T01:25:20.220 INFO:tasks.workunit.client.0.smithi063.stdout:9/709: rmdir d7/d9/d20/de3/de7/d14/d63/d5f/dab 39 2024-09-16T01:25:20.220 INFO:tasks.workunit.client.0.smithi063.stdout:0/651: link d1/d30/d52/d5a/d36/fb2 d1/d2e/d48/dc3/dca/ff5 0 2024-09-16T01:25:20.223 INFO:tasks.workunit.client.0.smithi063.stdout:4/631: dwrite d5/d3b/f1d [4194304,4194304] 0 2024-09-16T01:25:20.223 INFO:tasks.workunit.client.0.smithi063.stdout:5/637: mkdir d5/d18/d29/d48/dad/ddd 0 2024-09-16T01:25:20.224 INFO:tasks.workunit.client.0.smithi063.stdout:8/517: dread d5/db/d12/d3d/f9c [0,4194304] 0 2024-09-16T01:25:20.224 INFO:tasks.workunit.client.0.smithi063.stdout:2/723: write d3/d7/d8/d1f/d34/d45/d6e/fdb [761068,2527] 0 2024-09-16T01:25:20.225 INFO:tasks.workunit.client.0.smithi063.stdout:9/710: unlink d7/d9/l68 0 2024-09-16T01:25:20.226 INFO:tasks.workunit.client.0.smithi063.stdout:6/580: truncate d3/d48/d28/f2b 5247 0 2024-09-16T01:25:20.226 INFO:tasks.workunit.client.0.smithi063.stdout:5/638: chown d5/d7f/da3/dc3/fc8 0 1 2024-09-16T01:25:20.228 INFO:tasks.workunit.client.0.smithi063.stdout:2/724: mknod d3/d7/cf8 0 2024-09-16T01:25:20.229 INFO:tasks.workunit.client.0.smithi063.stdout:9/711: symlink d7/d4a/lf8 0 2024-09-16T01:25:20.230 INFO:tasks.workunit.client.0.smithi063.stdout:4/632: rmdir d5/d3b/df/d1c/d29/d32/d60/d61 39 2024-09-16T01:25:20.230 INFO:tasks.workunit.client.0.smithi063.stdout:0/652: write d1/d30/f71 [1038752,40413] 0 2024-09-16T01:25:20.233 INFO:tasks.workunit.client.0.smithi063.stdout:9/712: chown d7/d1f/fec 203 1 2024-09-16T01:25:20.234 INFO:tasks.workunit.client.0.smithi063.stdout:2/725: write d3/d7/d8/d19/d3c/d53/fb4 [3022840,56020] 0 2024-09-16T01:25:20.236 INFO:tasks.workunit.client.0.smithi063.stdout:6/581: getdents d3/d48/d28/d3e/d44/da4/d5a 0 2024-09-16T01:25:20.236 INFO:tasks.workunit.client.0.smithi063.stdout:0/653: chown d1/d2e/d48/dc3/cdb 210027264 1 2024-09-16T01:25:20.236 INFO:tasks.workunit.client.0.smithi063.stdout:8/518: link d5/db/d12/d3d/d69/daa/d40/l5b d5/db/d12/d1a/d60/d7a/lae 0 2024-09-16T01:25:20.238 INFO:tasks.workunit.client.0.smithi063.stdout:4/633: symlink d5/d3b/d57/d68/d90/lc7 0 2024-09-16T01:25:20.238 INFO:tasks.workunit.client.0.smithi063.stdout:5/639: link d5/d18/d29/d48/d66/ld2 d5/d18/d29/d48/d98/d94/lde 0 2024-09-16T01:25:20.241 INFO:tasks.workunit.client.0.smithi063.stdout:9/713: mknod d7/d9/d20/de3/de7/d14/d63/cf9 0 2024-09-16T01:25:20.243 INFO:tasks.workunit.client.0.smithi063.stdout:3/585: dread d2/d11/d18/f92 [0,4194304] 0 2024-09-16T01:25:20.243 INFO:tasks.workunit.client.0.smithi063.stdout:4/634: chown d5/d3b/df/d1c/d29/d32/l6b 300941821 1 2024-09-16T01:25:20.244 INFO:tasks.workunit.client.0.smithi063.stdout:8/519: write d5/db/d12/d1a/d60/d63/f81 [6647,44371] 0 2024-09-16T01:25:20.245 INFO:tasks.workunit.client.0.smithi063.stdout:2/726: rename d3/d77/fd9 to d3/d7/d8/d19/d8c/d21/d9c/dd4/ff9 0 2024-09-16T01:25:20.245 INFO:tasks.workunit.client.0.smithi063.stdout:6/582: creat d3/d48/d28/d3e/d44/da4/d5a/d6b/fd4 x:0 0 0 2024-09-16T01:25:20.247 INFO:tasks.workunit.client.0.smithi063.stdout:5/640: getdents d5/d18/d29/d48/dad/dc7 0 2024-09-16T01:25:20.248 INFO:tasks.workunit.client.0.smithi063.stdout:6/583: fdatasync f2 0 2024-09-16T01:25:20.248 INFO:tasks.workunit.client.0.smithi063.stdout:3/586: mknod d2/d11/d37/db1/dc2/cd3 0 2024-09-16T01:25:20.251 INFO:tasks.workunit.client.0.smithi063.stdout:4/635: write d5/d3b/df/d1c/d29/d32/f3c [114553,87678] 0 2024-09-16T01:25:20.253 INFO:tasks.workunit.client.0.smithi063.stdout:9/714: rename d7/d1f/fa0 to d7/d9/d20/de3/de7/db2/dc6/ffa 0 2024-09-16T01:25:20.253 INFO:tasks.workunit.client.0.smithi063.stdout:2/727: getdents d3 0 2024-09-16T01:25:20.254 INFO:tasks.workunit.client.0.smithi063.stdout:6/584: creat d3/d48/d28/d3e/d68/fd5 x:0 0 0 2024-09-16T01:25:20.254 INFO:tasks.workunit.client.0.smithi063.stdout:0/654: dread d1/df/d34/f5e [0,4194304] 0 2024-09-16T01:25:20.256 INFO:tasks.workunit.client.0.smithi063.stdout:5/641: dread d5/d12/d91/f8c [0,4194304] 0 2024-09-16T01:25:20.259 INFO:tasks.workunit.client.0.smithi063.stdout:0/655: write d1/d30/d52/d5a/fd9 [1556684,23319] 0 2024-09-16T01:25:20.260 INFO:tasks.workunit.client.0.smithi063.stdout:2/728: creat d3/d7/d8/d1f/d37/d4f/dce/ffa x:0 0 0 2024-09-16T01:25:20.266 INFO:tasks.workunit.client.0.smithi063.stdout:5/642: creat d5/d18/d29/d48/d66/db1/fdf x:0 0 0 2024-09-16T01:25:20.269 INFO:tasks.workunit.client.0.smithi063.stdout:2/729: rmdir d3/d7/d8/d1f/d37/d4f 39 2024-09-16T01:25:20.272 INFO:tasks.workunit.client.0.smithi063.stdout:4/636: dwrite d5/d3b/d57/d66/d9b/d7a/f89 [0,4194304] 0 2024-09-16T01:25:20.272 INFO:tasks.workunit.client.0.smithi063.stdout:8/520: dread d5/db/d12/d3d/d69/daa/f43 [4194304,4194304] 0 2024-09-16T01:25:20.277 INFO:tasks.workunit.client.0.smithi063.stdout:9/715: dwrite d7/d9/d20/de3/de7/d14/fc7 [0,4194304] 0 2024-09-16T01:25:20.277 INFO:tasks.workunit.client.0.smithi063.stdout:5/643: chown d5/d12/f23 1154972520 1 2024-09-16T01:25:20.278 INFO:tasks.workunit.client.0.smithi063.stdout:6/585: dwrite d3/d10/d49/fa8 [0,4194304] 0 2024-09-16T01:25:20.279 INFO:tasks.workunit.client.0.smithi063.stdout:3/587: dwrite f0 [0,4194304] 0 2024-09-16T01:25:20.280 INFO:tasks.workunit.client.0.smithi063.stdout:1/675: sync 2024-09-16T01:25:20.283 INFO:tasks.workunit.client.0.smithi063.stdout:1/676: write d1/d12/f8b [2050088,72194] 0 2024-09-16T01:25:20.283 INFO:tasks.workunit.client.0.smithi063.stdout:5/644: creat d5/d7f/dcb/fe0 x:0 0 0 2024-09-16T01:25:20.284 INFO:tasks.workunit.client.0.smithi063.stdout:1/677: fdatasync d1/dd/d3b/f58 0 2024-09-16T01:25:20.287 INFO:tasks.workunit.client.0.smithi063.stdout:4/637: symlink d5/d3b/d57/d68/lc8 0 2024-09-16T01:25:20.288 INFO:tasks.workunit.client.0.smithi063.stdout:9/716: fdatasync d7/d9/d20/de3/de7/d14/f29 0 2024-09-16T01:25:20.289 INFO:tasks.workunit.client.0.smithi063.stdout:8/521: symlink d5/db/d12/d1a/laf 0 2024-09-16T01:25:20.289 INFO:tasks.workunit.client.0.smithi063.stdout:3/588: write d2/d11/d18/f42 [1963719,6130] 0 2024-09-16T01:25:20.290 INFO:tasks.workunit.client.0.smithi063.stdout:6/586: mknod d3/d48/cd6 0 2024-09-16T01:25:20.292 INFO:tasks.workunit.client.0.smithi063.stdout:5/645: chown d5/d12/cbc 33 1 2024-09-16T01:25:20.294 INFO:tasks.workunit.client.0.smithi063.stdout:2/730: dwrite d3/d7/d8/d19/d8c/d21/d28/d8a/db7/fea [0,4194304] 0 2024-09-16T01:25:20.295 INFO:tasks.workunit.client.0.smithi063.stdout:6/587: creat d3/d41/d9b/fd7 x:0 0 0 2024-09-16T01:25:20.296 INFO:tasks.workunit.client.0.smithi063.stdout:8/522: rmdir d5/d8c/d74 39 2024-09-16T01:25:20.297 INFO:tasks.workunit.client.0.smithi063.stdout:1/678: creat d1/d5/d82/d9b/d77/d7d/dcb/fe2 x:0 0 0 2024-09-16T01:25:20.301 INFO:tasks.workunit.client.0.smithi063.stdout:8/523: fsync d5/d9/f6c 0 2024-09-16T01:25:20.302 INFO:tasks.workunit.client.0.smithi063.stdout:3/589: mknod d2/d11/d37/d40/d5e/d3b/cd4 0 2024-09-16T01:25:20.302 INFO:tasks.workunit.client.0.smithi063.stdout:6/588: write d3/d10/f29 [1383234,46226] 0 2024-09-16T01:25:20.303 INFO:tasks.workunit.client.0.smithi063.stdout:1/679: readlink d1/d5/d15/d18/l5e 0 2024-09-16T01:25:20.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/638: write d5/f3f [356684,38687] 0 2024-09-16T01:25:20.306 INFO:tasks.workunit.client.0.smithi063.stdout:2/731: truncate d3/d7/d8/d19/d8c/d21/d28/d8a/fbf 455157 0 2024-09-16T01:25:20.307 INFO:tasks.workunit.client.0.smithi063.stdout:1/680: read - d1/d5/d15/d18/d4b/fb1 zero size 2024-09-16T01:25:20.308 INFO:tasks.workunit.client.0.smithi063.stdout:0/656: dread d1/d2e/d48/dc3/dca/ff5 [0,4194304] 0 2024-09-16T01:25:20.309 INFO:tasks.workunit.client.0.smithi063.stdout:6/589: symlink d3/d30/d39/dac/db5/ld8 0 2024-09-16T01:25:20.310 INFO:tasks.workunit.client.0.smithi063.stdout:5/646: dwrite d5/d18/f24 [0,4194304] 0 2024-09-16T01:25:20.311 INFO:tasks.workunit.client.0.smithi063.stdout:4/639: read d5/d3b/df/d1c/d29/d20/d98/fbd [4690361,26658] 0 2024-09-16T01:25:20.313 INFO:tasks.workunit.client.0.smithi063.stdout:2/732: creat d3/d7/d8/d19/d8c/ffb x:0 0 0 2024-09-16T01:25:20.313 INFO:tasks.workunit.client.0.smithi063.stdout:6/590: chown d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d 658 1 2024-09-16T01:25:20.315 INFO:tasks.workunit.client.0.smithi063.stdout:9/717: dread d7/d9/f2a [0,4194304] 0 2024-09-16T01:25:20.316 INFO:tasks.workunit.client.0.smithi063.stdout:4/640: mkdir d5/d3b/d57/d66/db7/dc9 0 2024-09-16T01:25:20.317 INFO:tasks.workunit.client.0.smithi063.stdout:6/591: read d3/f65 [318407,61057] 0 2024-09-16T01:25:20.318 INFO:tasks.workunit.client.0.smithi063.stdout:9/718: chown d7/cc 45402490 1 2024-09-16T01:25:20.318 INFO:tasks.workunit.client.0.smithi063.stdout:1/681: truncate d1/d5/fac 2378255 0 2024-09-16T01:25:20.319 INFO:tasks.workunit.client.0.smithi063.stdout:4/641: rmdir d5/d3b 39 2024-09-16T01:25:20.320 INFO:tasks.workunit.client.0.smithi063.stdout:2/733: write d3/d7/d8/d19/d8c/d21/d28/d8a/db7/fea [3429084,77909] 0 2024-09-16T01:25:20.322 INFO:tasks.workunit.client.0.smithi063.stdout:1/682: read d1/d5/f1a [2246350,110920] 0 2024-09-16T01:25:20.329 INFO:tasks.workunit.client.0.smithi063.stdout:6/592: mknod d3/d48/d28/d3e/d44/d52/cd9 0 2024-09-16T01:25:20.329 INFO:tasks.workunit.client.0.smithi063.stdout:8/524: dread d5/f58 [0,4194304] 0 2024-09-16T01:25:20.329 INFO:tasks.workunit.client.0.smithi063.stdout:0/657: dwrite d1/d30/d52/fa3 [0,4194304] 0 2024-09-16T01:25:20.329 INFO:tasks.workunit.client.0.smithi063.stdout:2/734: mkdir d3/d7/d8/d1f/d37/dfc 0 2024-09-16T01:25:20.329 INFO:tasks.workunit.client.0.smithi063.stdout:9/719: symlink d7/d9/d20/de3/de7/d14/d38/df7/lfb 0 2024-09-16T01:25:20.329 INFO:tasks.workunit.client.0.smithi063.stdout:6/593: readlink d3/d48/d28/d3e/d68/lb1 0 2024-09-16T01:25:20.331 INFO:tasks.workunit.client.0.smithi063.stdout:1/683: dread d1/d5/f10 [4194304,4194304] 0 2024-09-16T01:25:20.332 INFO:tasks.workunit.client.0.smithi063.stdout:8/525: mkdir d5/db/d12/db0 0 2024-09-16T01:25:20.334 INFO:tasks.workunit.client.0.smithi063.stdout:1/684: chown d1/d12/d21/f92 2 1 2024-09-16T01:25:20.335 INFO:tasks.workunit.client.0.smithi063.stdout:6/594: creat d3/d48/fda x:0 0 0 2024-09-16T01:25:20.337 INFO:tasks.workunit.client.0.smithi063.stdout:8/526: creat d5/db/d12/d1a/d1e/fb1 x:0 0 0 2024-09-16T01:25:20.337 INFO:tasks.workunit.client.0.smithi063.stdout:0/658: link d1/df/fd3 d1/d30/d52/d9d/deb/ff6 0 2024-09-16T01:25:20.338 INFO:tasks.workunit.client.0.smithi063.stdout:1/685: creat d1/dd/d3b/db3/fe3 x:0 0 0 2024-09-16T01:25:20.338 INFO:tasks.workunit.client.0.smithi063.stdout:6/595: fdatasync d3/d30/f78 0 2024-09-16T01:25:20.341 INFO:tasks.workunit.client.0.smithi063.stdout:2/735: dwrite f2 [4194304,4194304] 0 2024-09-16T01:25:20.341 INFO:tasks.workunit.client.0.smithi063.stdout:4/642: dread d5/d3b/d57/fa6 [0,4194304] 0 2024-09-16T01:25:20.341 INFO:tasks.workunit.client.0.smithi063.stdout:6/596: write d3/f65 [4236056,62734] 0 2024-09-16T01:25:20.342 INFO:tasks.workunit.client.0.smithi063.stdout:0/659: write d1/d2e/d73/fd5 [29332,105521] 0 2024-09-16T01:25:20.344 INFO:tasks.workunit.client.0.smithi063.stdout:1/686: creat d1/d5/fe4 x:0 0 0 2024-09-16T01:25:20.348 INFO:tasks.workunit.client.0.smithi063.stdout:8/527: truncate d5/f8 1357555 0 2024-09-16T01:25:20.349 INFO:tasks.workunit.client.0.smithi063.stdout:2/736: creat d3/d7/d8/d1f/d34/dc2/ffd x:0 0 0 2024-09-16T01:25:20.349 INFO:tasks.workunit.client.0.smithi063.stdout:8/528: readlink d5/db/l37 0 2024-09-16T01:25:20.351 INFO:tasks.workunit.client.0.smithi063.stdout:4/643: symlink d5/d3b/df/d1c/d29/d32/d60/d61/lca 0 2024-09-16T01:25:20.352 INFO:tasks.workunit.client.0.smithi063.stdout:9/720: dread d7/d9/d20/de3/de7/d14/d63/d5f/f62 [0,4194304] 0 2024-09-16T01:25:20.352 INFO:tasks.workunit.client.0.smithi063.stdout:6/597: rename d3/d48/d28/d3e/d68/dc7 to d3/d30/d39/dac/ddb 0 2024-09-16T01:25:20.353 INFO:tasks.workunit.client.0.smithi063.stdout:6/598: readlink d3/l1c 0 2024-09-16T01:25:20.353 INFO:tasks.workunit.client.0.smithi063.stdout:1/687: write d1/d5/d82/d9b/d77/d7d/dc2/dad/f65 [695619,105966] 0 2024-09-16T01:25:20.354 INFO:tasks.workunit.client.0.smithi063.stdout:0/660: dread d1/df/fd3 [0,4194304] 0 2024-09-16T01:25:20.355 INFO:tasks.workunit.client.0.smithi063.stdout:2/737: mkdir d3/d7/d8/d19/d8c/d21/d28/d4e/dfe 0 2024-09-16T01:25:20.357 INFO:tasks.workunit.client.0.smithi063.stdout:4/644: mknod d5/d3b/d57/d66/d9b/ccb 0 2024-09-16T01:25:20.359 INFO:tasks.workunit.client.0.smithi063.stdout:1/688: creat d1/fe5 x:0 0 0 2024-09-16T01:25:20.361 INFO:tasks.workunit.client.0.smithi063.stdout:2/738: mkdir d3/d7/d8/d19/d3c/d58/dff 0 2024-09-16T01:25:20.362 INFO:tasks.workunit.client.0.smithi063.stdout:8/529: dwrite d5/db/d12/f64 [4194304,4194304] 0 2024-09-16T01:25:20.365 INFO:tasks.workunit.client.0.smithi063.stdout:0/661: getdents d1/d30/d52/d5a/d36 0 2024-09-16T01:25:20.365 INFO:tasks.workunit.client.0.smithi063.stdout:4/645: mkdir d5/d3b/df/d1c/d29/d20/d98/dcc 0 2024-09-16T01:25:20.367 INFO:tasks.workunit.client.0.smithi063.stdout:9/721: dwrite d7/d4a/d4d/d96/fd2 [0,4194304] 0 2024-09-16T01:25:20.367 INFO:tasks.workunit.client.0.smithi063.stdout:2/739: chown d3/d7/d8/d19/d3c 0 1 2024-09-16T01:25:20.370 INFO:tasks.workunit.client.0.smithi063.stdout:4/646: mknod d5/d3b/df/d1c/d29/d20/d98/ccd 0 2024-09-16T01:25:20.371 INFO:tasks.workunit.client.0.smithi063.stdout:2/740: chown d3/d7/d8/d1f/d37/d4f/dce 2130 1 2024-09-16T01:25:20.371 INFO:tasks.workunit.client.0.smithi063.stdout:6/599: dwrite d3/d48/d28/d3e/d44/da4/d5a/d6b/f82 [0,4194304] 0 2024-09-16T01:25:20.373 INFO:tasks.workunit.client.0.smithi063.stdout:0/662: rename d1/d2e/d48/l5d to d1/d30/d52/d9d/dcf/lf7 0 2024-09-16T01:25:20.373 INFO:tasks.workunit.client.0.smithi063.stdout:8/530: unlink d5/db/d12/d1a/d1e/l82 0 2024-09-16T01:25:20.412 INFO:tasks.workunit.client.0.smithi063.stdout:7/515: sync 2024-09-16T01:25:20.429 INFO:tasks.workunit.client.0.smithi063.stdout:9/722: mknod d7/d9/d20/de3/de7/cfc 0 2024-09-16T01:25:20.429 INFO:tasks.workunit.client.0.smithi063.stdout:4/647: mkdir d5/d3b/d57/dce 0 2024-09-16T01:25:20.429 INFO:tasks.workunit.client.0.smithi063.stdout:2/741: unlink c1 0 2024-09-16T01:25:20.429 INFO:tasks.workunit.client.0.smithi063.stdout:0/663: rename d1/d1c/l42 to d1/df/d34/lf8 0 2024-09-16T01:25:20.430 INFO:tasks.workunit.client.0.smithi063.stdout:6/600: creat d3/d30/d39/d69/d95/dd1/fdc x:0 0 0 2024-09-16T01:25:20.432 INFO:tasks.workunit.client.0.smithi063.stdout:4/648: creat d5/d3b/d5c/fcf x:0 0 0 2024-09-16T01:25:20.432 INFO:tasks.workunit.client.0.smithi063.stdout:0/664: write d1/d30/d52/d5a/d36/d41/fed [806245,66435] 0 2024-09-16T01:25:20.433 INFO:tasks.workunit.client.0.smithi063.stdout:9/723: chown d7/d9/d20/de3/de7/d14/d23 5162 1 2024-09-16T01:25:20.434 INFO:tasks.workunit.client.0.smithi063.stdout:9/724: write d7/d9/d20/de3/de7/f42 [1624357,41673] 0 2024-09-16T01:25:20.435 INFO:tasks.workunit.client.0.smithi063.stdout:0/665: truncate d1/df/d34/f79 483657 0 2024-09-16T01:25:20.436 INFO:tasks.workunit.client.0.smithi063.stdout:0/666: write d1/df/f9c [279441,63255] 0 2024-09-16T01:25:20.436 INFO:tasks.workunit.client.0.smithi063.stdout:8/531: link d5/db/d12/d1a/d1e/f32 d5/db/d12/db0/fb2 0 2024-09-16T01:25:20.438 INFO:tasks.workunit.client.0.smithi063.stdout:0/667: write d1/df/f40 [2200422,110157] 0 2024-09-16T01:25:20.441 INFO:tasks.workunit.client.0.smithi063.stdout:4/649: mknod d5/d3b/cd0 0 2024-09-16T01:25:20.442 INFO:tasks.workunit.client.0.smithi063.stdout:9/725: mkdir d7/d4a/dba/dfd 0 2024-09-16T01:25:20.443 INFO:tasks.workunit.client.0.smithi063.stdout:0/668: creat d1/d30/d52/d5a/d44/ff9 x:0 0 0 2024-09-16T01:25:20.443 INFO:tasks.workunit.client.0.smithi063.stdout:2/742: dwrite d3/d7/f16 [4194304,4194304] 0 2024-09-16T01:25:20.444 INFO:tasks.workunit.client.0.smithi063.stdout:7/516: write d7/d18/d40/f89 [1239158,100733] 0 2024-09-16T01:25:20.444 INFO:tasks.workunit.client.0.smithi063.stdout:4/650: creat d5/d3b/d57/d66/d9b/fd1 x:0 0 0 2024-09-16T01:25:20.447 INFO:tasks.workunit.client.0.smithi063.stdout:8/532: dread d5/db/d12/f64 [4194304,4194304] 0 2024-09-16T01:25:20.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/651: symlink d5/d3b/d57/d66/d9b/ld2 0 2024-09-16T01:25:20.452 INFO:tasks.workunit.client.0.smithi063.stdout:0/669: write d1/d30/d52/d9d/deb/ff6 [234511,41064] 0 2024-09-16T01:25:20.452 INFO:tasks.workunit.client.0.smithi063.stdout:7/517: dread d7/d56/d57/d73/f75 [0,4194304] 0 2024-09-16T01:25:20.454 INFO:tasks.workunit.client.0.smithi063.stdout:6/601: dwrite d3/d48/d28/d3e/d44/da4/fb7 [0,4194304] 0 2024-09-16T01:25:20.454 INFO:tasks.workunit.client.0.smithi063.stdout:9/726: creat d7/d9/ffe x:0 0 0 2024-09-16T01:25:20.454 INFO:tasks.workunit.client.0.smithi063.stdout:2/743: fsync d3/d7/f16 0 2024-09-16T01:25:20.455 INFO:tasks.workunit.client.0.smithi063.stdout:0/670: readlink d1/d1c/lc6 0 2024-09-16T01:25:20.458 INFO:tasks.workunit.client.0.smithi063.stdout:6/602: readlink d3/d48/d28/d3e/d44/d52/l71 0 2024-09-16T01:25:20.459 INFO:tasks.workunit.client.0.smithi063.stdout:7/518: creat d7/d1c/d1f/d29/d88/fa4 x:0 0 0 2024-09-16T01:25:20.460 INFO:tasks.workunit.client.0.smithi063.stdout:2/744: symlink d3/d77/l100 0 2024-09-16T01:25:20.461 INFO:tasks.workunit.client.0.smithi063.stdout:0/671: symlink d1/d30/d52/d9d/dcf/lfa 0 2024-09-16T01:25:20.461 INFO:tasks.workunit.client.0.smithi063.stdout:9/727: fdatasync d7/d9/d20/de3/de7/d14/d63/d5f/fb4 0 2024-09-16T01:25:20.462 INFO:tasks.workunit.client.0.smithi063.stdout:7/519: dread - d7/d56/d6b/f87 zero size 2024-09-16T01:25:20.462 INFO:tasks.workunit.client.0.smithi063.stdout:6/603: chown d3/d48/d7e/d91/f8a 954 1 2024-09-16T01:25:20.462 INFO:tasks.workunit.client.0.smithi063.stdout:2/745: chown d3/lb9 4830 1 2024-09-16T01:25:20.462 INFO:tasks.workunit.client.0.smithi063.stdout:8/533: dread d5/db/f2a [0,4194304] 0 2024-09-16T01:25:20.465 INFO:tasks.workunit.client.0.smithi063.stdout:6/604: read d3/f65 [637950,116735] 0 2024-09-16T01:25:20.466 INFO:tasks.workunit.client.0.smithi063.stdout:9/728: chown d7/d9/d20/de3/de7/d14/d34/f84 3 1 2024-09-16T01:25:20.466 INFO:tasks.workunit.client.0.smithi063.stdout:8/534: dread - d5/db/d12/d3d/d69/daa/f9b zero size 2024-09-16T01:25:20.468 INFO:tasks.workunit.client.0.smithi063.stdout:6/605: symlink d3/d41/d9b/ldd 0 2024-09-16T01:25:20.468 INFO:tasks.workunit.client.0.smithi063.stdout:0/672: rename d1/d2e/d50/ca8 to d1/d30/d95/cfb 0 2024-09-16T01:25:20.469 INFO:tasks.workunit.client.0.smithi063.stdout:8/535: rmdir d5/db/d12/db0 39 2024-09-16T01:25:20.470 INFO:tasks.workunit.client.0.smithi063.stdout:7/520: truncate d7/f77 3535153 0 2024-09-16T01:25:20.471 INFO:tasks.workunit.client.0.smithi063.stdout:8/536: chown d5/db/d12/d3d/c49 0 1 2024-09-16T01:25:20.471 INFO:tasks.workunit.client.0.smithi063.stdout:0/673: rmdir d1/df/d34 39 2024-09-16T01:25:20.471 INFO:tasks.workunit.client.0.smithi063.stdout:9/729: creat d7/d9/d20/de3/de7/db2/dc6/ddb/fff x:0 0 0 2024-09-16T01:25:20.473 INFO:tasks.workunit.client.0.smithi063.stdout:6/606: fsync d3/d30/f40 0 2024-09-16T01:25:20.473 INFO:tasks.workunit.client.0.smithi063.stdout:6/607: fdatasync d3/f13 0 2024-09-16T01:25:20.474 INFO:tasks.workunit.client.0.smithi063.stdout:7/521: truncate d7/d18/d40/f83 483558 0 2024-09-16T01:25:20.474 INFO:tasks.workunit.client.0.smithi063.stdout:0/674: fdatasync d1/df/d2c/f39 0 2024-09-16T01:25:20.474 INFO:tasks.workunit.client.0.smithi063.stdout:4/652: dread d5/d3b/df/d1c/d29/d32/d60/d61/f86 [0,4194304] 0 2024-09-16T01:25:20.475 INFO:tasks.workunit.client.0.smithi063.stdout:8/537: write d5/db/d12/d1a/f5f [233628,43865] 0 2024-09-16T01:25:20.477 INFO:tasks.workunit.client.0.smithi063.stdout:9/730: rmdir d7/d1f 39 2024-09-16T01:25:20.478 INFO:tasks.workunit.client.0.smithi063.stdout:4/653: write d5/d3b/d57/f79 [682155,101952] 0 2024-09-16T01:25:20.481 INFO:tasks.workunit.client.0.smithi063.stdout:8/538: creat d5/db/d12/d3d/d69/daa/d40/fb3 x:0 0 0 2024-09-16T01:25:20.483 INFO:tasks.workunit.client.0.smithi063.stdout:2/746: dread d3/d7/d8/d1f/d37/f74 [0,4194304] 0 2024-09-16T01:25:20.483 INFO:tasks.workunit.client.0.smithi063.stdout:0/675: dread d1/d30/d52/fa3 [0,4194304] 0 2024-09-16T01:25:20.484 INFO:tasks.workunit.client.0.smithi063.stdout:4/654: mknod d5/d3b/df/d1c/d29/d32/d60/cd3 0 2024-09-16T01:25:20.485 INFO:tasks.workunit.client.0.smithi063.stdout:9/731: read d7/d9/d20/de3/de7/d14/d34/fe4 [4561251,34354] 0 2024-09-16T01:25:20.486 INFO:tasks.workunit.client.0.smithi063.stdout:8/539: mknod d5/d9/d2f/cb4 0 2024-09-16T01:25:20.486 INFO:tasks.workunit.client.0.smithi063.stdout:9/732: readlink d7/d4a/l4c 0 2024-09-16T01:25:20.488 INFO:tasks.workunit.client.0.smithi063.stdout:6/608: dwrite d3/d48/fcc [0,4194304] 0 2024-09-16T01:25:20.489 INFO:tasks.workunit.client.0.smithi063.stdout:0/676: chown d1/df/d17/l3a 15144 1 2024-09-16T01:25:20.489 INFO:tasks.workunit.client.0.smithi063.stdout:7/522: truncate d7/ff 1871767 0 2024-09-16T01:25:20.490 INFO:tasks.workunit.client.0.smithi063.stdout:8/540: mknod d5/db/cb5 0 2024-09-16T01:25:20.491 INFO:tasks.workunit.client.0.smithi063.stdout:9/733: fdatasync d7/d1f/f44 0 2024-09-16T01:25:20.493 INFO:tasks.workunit.client.0.smithi063.stdout:8/541: chown d5/db/d12/d1a 26 1 2024-09-16T01:25:20.495 INFO:tasks.workunit.client.0.smithi063.stdout:0/677: creat d1/d30/d52/d5a/d36/ffc x:0 0 0 2024-09-16T01:25:20.497 INFO:tasks.workunit.client.0.smithi063.stdout:2/747: dread d3/d7/d8/d19/d8c/d21/d28/d8a/db7/fcf [0,4194304] 0 2024-09-16T01:25:20.499 INFO:tasks.workunit.client.0.smithi063.stdout:6/609: rmdir d3/d48/d28/d3e/d44/da4/d5a/d6b 39 2024-09-16T01:25:20.500 INFO:tasks.workunit.client.0.smithi063.stdout:0/678: dread d1/d30/d52/fa3 [0,4194304] 0 2024-09-16T01:25:20.501 INFO:tasks.workunit.client.0.smithi063.stdout:4/655: rename d5/d3b/df/d1c/d29/d32/d9e to d5/d3b/df/d1c/d29/dd4 0 2024-09-16T01:25:20.502 INFO:tasks.workunit.client.0.smithi063.stdout:9/734: creat d7/d9/d20/de3/de7/d14/d38/df7/f100 x:0 0 0 2024-09-16T01:25:20.503 INFO:tasks.workunit.client.0.smithi063.stdout:6/610: write d3/d48/d28/d3e/d68/db4/fc0 [223502,70116] 0 2024-09-16T01:25:20.503 INFO:tasks.workunit.client.0.smithi063.stdout:0/679: chown d1/df/d2c/d43/fa0 3 1 2024-09-16T01:25:20.506 INFO:tasks.workunit.client.0.smithi063.stdout:6/611: write d3/d48/d7e/d91/f8e [757217,126001] 0 2024-09-16T01:25:20.507 INFO:tasks.workunit.client.0.smithi063.stdout:6/612: fsync d3/d10/d49/f9e 0 2024-09-16T01:25:20.507 INFO:tasks.workunit.client.0.smithi063.stdout:4/656: fdatasync d5/d3b/df/d1c/d29/d32/d60/d61/f52 0 2024-09-16T01:25:20.508 INFO:tasks.workunit.client.0.smithi063.stdout:2/748: dread f0 [0,4194304] 0 2024-09-16T01:25:20.545 INFO:tasks.workunit.client.0.smithi063.stdout:0/680: unlink d1/df/db1/fbe 0 2024-09-16T01:25:20.546 INFO:tasks.workunit.client.0.smithi063.stdout:8/542: truncate d5/d8c/d74/f96 213661 0 2024-09-16T01:25:20.546 INFO:tasks.workunit.client.0.smithi063.stdout:7/523: dread d7/d1c/d1f/d66/f82 [0,4194304] 0 2024-09-16T01:25:20.546 INFO:tasks.workunit.client.0.smithi063.stdout:6/613: dread - d3/d48/d28/d3e/f85 zero size 2024-09-16T01:25:20.547 INFO:tasks.workunit.client.0.smithi063.stdout:8/543: dread - d5/db/d12/fa7 zero size 2024-09-16T01:25:20.547 INFO:tasks.workunit.client.0.smithi063.stdout:4/657: unlink d5/d3b/d57/d68/fb0 0 2024-09-16T01:25:20.548 INFO:tasks.workunit.client.0.smithi063.stdout:6/614: readlink d3/d48/d28/d3e/d68/l6c 0 2024-09-16T01:25:20.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/749: write d3/d7/d8/d19/d3c/d58/f93 [1221549,1835] 0 2024-09-16T01:25:20.552 INFO:tasks.workunit.client.0.smithi063.stdout:8/544: fdatasync d5/db/d12/d3d/d69/daa/f90 0 2024-09-16T01:25:20.554 INFO:tasks.workunit.client.0.smithi063.stdout:4/658: truncate d5/f8c 3686016 0 2024-09-16T01:25:20.557 INFO:tasks.workunit.client.0.smithi063.stdout:0/681: dwrite d1/df/d2c/f55 [4194304,4194304] 0 2024-09-16T01:25:20.558 INFO:tasks.workunit.client.0.smithi063.stdout:8/545: fdatasync d5/db/d12/f64 0 2024-09-16T01:25:20.558 INFO:tasks.workunit.client.0.smithi063.stdout:2/750: creat d3/d7/d8/d1f/d37/d4f/da7/f101 x:0 0 0 2024-09-16T01:25:20.560 INFO:tasks.workunit.client.0.smithi063.stdout:0/682: stat d1/l3 0 2024-09-16T01:25:20.560 INFO:tasks.workunit.client.0.smithi063.stdout:8/546: mknod d5/db/d12/d3d/d69/cb6 0 2024-09-16T01:25:20.560 INFO:tasks.workunit.client.0.smithi063.stdout:2/751: mknod d3/d7/d8/d19/d8c/c102 0 2024-09-16T01:25:20.561 INFO:tasks.workunit.client.0.smithi063.stdout:4/659: dread d5/d3b/df/d1c/d29/d32/f27 [0,4194304] 0 2024-09-16T01:25:20.562 INFO:tasks.workunit.client.0.smithi063.stdout:6/615: rename d3/d41/l47 to d3/d48/d28/d3e/d44/da4/d5a/d6b/lde 0 2024-09-16T01:25:20.562 INFO:tasks.workunit.client.0.smithi063.stdout:0/683: unlink d1/d30/d52/d9d/deb/c84 0 2024-09-16T01:25:20.564 INFO:tasks.workunit.client.0.smithi063.stdout:6/616: chown d3/d10/f23 135 1 2024-09-16T01:25:20.564 INFO:tasks.workunit.client.0.smithi063.stdout:0/684: chown d1/d2e/f96 406116585 1 2024-09-16T01:25:20.565 INFO:tasks.workunit.client.0.smithi063.stdout:2/752: getdents d3/d7/d8/d1f/d37/d4f/dce 0 2024-09-16T01:25:20.565 INFO:tasks.workunit.client.0.smithi063.stdout:4/660: fsync d5/d3b/df/d1c/d29/d32/f5b 0 2024-09-16T01:25:20.569 INFO:tasks.workunit.client.0.smithi063.stdout:8/547: dwrite d5/d9/f16 [0,4194304] 0 2024-09-16T01:25:20.569 INFO:tasks.workunit.client.0.smithi063.stdout:2/753: fdatasync d3/d7/d8/d19/d3c/d58/f5d 0 2024-09-16T01:25:20.572 INFO:tasks.workunit.client.0.smithi063.stdout:4/661: chown d5/d3b/d57/d66/d9b/d7a/f83 117854105 1 2024-09-16T01:25:20.572 INFO:tasks.workunit.client.0.smithi063.stdout:7/524: dread d7/d18/d40/d6c/f6e [0,4194304] 0 2024-09-16T01:25:20.573 INFO:tasks.workunit.client.0.smithi063.stdout:8/548: mkdir d5/d8c/d74/db7 0 2024-09-16T01:25:20.573 INFO:tasks.workunit.client.0.smithi063.stdout:0/685: write d1/d2e/f96 [573566,103894] 0 2024-09-16T01:25:20.575 INFO:tasks.workunit.client.0.smithi063.stdout:4/662: write d5/d3b/df/d1c/d29/d32/f3c [1204132,84355] 0 2024-09-16T01:25:20.575 INFO:tasks.workunit.client.0.smithi063.stdout:7/525: creat d7/d56/d57/d60/fa5 x:0 0 0 2024-09-16T01:25:20.578 INFO:tasks.workunit.client.0.smithi063.stdout:6/617: dwrite d3/d48/d28/d3e/d44/da4/d5a/d6b/f82 [0,4194304] 0 2024-09-16T01:25:20.581 INFO:tasks.workunit.client.0.smithi063.stdout:4/663: mknod d5/d3b/d57/d66/db7/cd5 0 2024-09-16T01:25:20.583 INFO:tasks.workunit.client.0.smithi063.stdout:7/526: getdents d7/d56/d6b 0 2024-09-16T01:25:20.586 INFO:tasks.workunit.client.0.smithi063.stdout:0/686: dwrite d1/d2e/d73/f74 [0,4194304] 0 2024-09-16T01:25:20.586 INFO:tasks.workunit.client.0.smithi063.stdout:2/754: dwrite d3/d7/d8/d1f/fac [0,4194304] 0 2024-09-16T01:25:20.586 INFO:tasks.workunit.client.0.smithi063.stdout:4/664: read d5/d3b/df/d1c/d29/f5a [3362355,109738] 0 2024-09-16T01:25:20.588 INFO:tasks.workunit.client.0.smithi063.stdout:0/687: chown d1/df/f54 19331735 1 2024-09-16T01:25:20.590 INFO:tasks.workunit.client.0.smithi063.stdout:6/618: dread d3/d10/f2a [0,4194304] 0 2024-09-16T01:25:20.591 INFO:tasks.workunit.client.0.smithi063.stdout:4/665: stat d5/d3b/df/d1c/d29/d20/l50 0 2024-09-16T01:25:20.592 INFO:tasks.workunit.client.0.smithi063.stdout:0/688: symlink d1/df/d2c/dde/lfd 0 2024-09-16T01:25:20.592 INFO:tasks.workunit.client.0.smithi063.stdout:2/755: write d3/d7/d8/d19/d3c/d53/d7f/d80/fdd [715229,61944] 0 2024-09-16T01:25:20.593 INFO:tasks.workunit.client.0.smithi063.stdout:7/527: link d7/d1c/d1f/d29/f52 d7/d56/fa6 0 2024-09-16T01:25:20.593 INFO:tasks.workunit.client.0.smithi063.stdout:0/689: fsync d1/f7 0 2024-09-16T01:25:20.597 INFO:tasks.workunit.client.0.smithi063.stdout:2/756: chown d3/d77 7 1 2024-09-16T01:25:20.597 INFO:tasks.workunit.client.0.smithi063.stdout:6/619: write d3/d48/d28/d3e/d44/da4/f3a [1760107,41015] 0 2024-09-16T01:25:20.598 INFO:tasks.workunit.client.0.smithi063.stdout:2/757: stat d3/d7/d8/d1f/d37/d4f/le4 0 2024-09-16T01:25:20.599 INFO:tasks.workunit.client.0.smithi063.stdout:0/690: mknod d1/d2e/d73/cfe 0 2024-09-16T01:25:20.599 INFO:tasks.workunit.client.0.smithi063.stdout:4/666: rename d5/d3b/df/f95 to d5/d3b/df/d1c/d29/dd4/dbc/fd6 0 2024-09-16T01:25:20.601 INFO:tasks.workunit.client.0.smithi063.stdout:2/758: truncate d3/d7/d8/d1f/d37/ff6 357962 0 2024-09-16T01:25:20.601 INFO:tasks.workunit.client.0.smithi063.stdout:0/691: mkdir d1/d30/dff 0 2024-09-16T01:25:20.601 INFO:tasks.workunit.client.0.smithi063.stdout:6/620: symlink d3/d48/d28/d3e/d44/d8c/ldf 0 2024-09-16T01:25:20.603 INFO:tasks.workunit.client.0.smithi063.stdout:7/528: getdents d7/d1c/d1f 0 2024-09-16T01:25:20.603 INFO:tasks.workunit.client.0.smithi063.stdout:0/692: creat d1/d2e/f100 x:0 0 0 2024-09-16T01:25:20.604 INFO:tasks.workunit.client.0.smithi063.stdout:1/689: sync 2024-09-16T01:25:20.604 INFO:tasks.workunit.client.0.smithi063.stdout:5/647: sync 2024-09-16T01:25:20.604 INFO:tasks.workunit.client.0.smithi063.stdout:3/590: sync 2024-09-16T01:25:20.605 INFO:tasks.workunit.client.0.smithi063.stdout:6/621: creat d3/d30/d39/d69/d95/db0/fe0 x:0 0 0 2024-09-16T01:25:20.606 INFO:tasks.workunit.client.0.smithi063.stdout:5/648: fsync d5/d18/d29/d52/fac 0 2024-09-16T01:25:20.606 INFO:tasks.workunit.client.0.smithi063.stdout:1/690: fsync d1/d5/d15/f29 0 2024-09-16T01:25:20.608 INFO:tasks.workunit.client.0.smithi063.stdout:6/622: fsync d3/d10/f1d 0 2024-09-16T01:25:20.609 INFO:tasks.workunit.client.0.smithi063.stdout:0/693: rename d1/df/d17/c15 to d1/d30/d52/d9d/c101 0 2024-09-16T01:25:20.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:20 smithi063 ceph-mon[31070]: pgmap v395: 97 pgs: 97 active+clean; 1.0 GiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 142 MiB/s wr, 217 op/s 2024-09-16T01:25:20.609 INFO:tasks.workunit.client.0.smithi063.stdout:5/649: dread - d5/d18/d29/d48/f80 zero size 2024-09-16T01:25:20.610 INFO:tasks.workunit.client.0.smithi063.stdout:3/591: readlink d2/d11/d37/d40/d5e/d3b/d68/d6b/l78 0 2024-09-16T01:25:20.612 INFO:tasks.workunit.client.0.smithi063.stdout:2/759: truncate d3/d7/d8/d1f/d34/dc2/ff2 1975424 0 2024-09-16T01:25:20.613 INFO:tasks.workunit.client.0.smithi063.stdout:0/694: mknod d1/df/d2c/d43/d90/c102 0 2024-09-16T01:25:20.614 INFO:tasks.workunit.client.0.smithi063.stdout:6/623: mkdir d3/d48/d28/d3e/d68/de1 0 2024-09-16T01:25:20.616 INFO:tasks.workunit.client.0.smithi063.stdout:5/650: write d5/d18/d29/d48/d66/fda [680134,38121] 0 2024-09-16T01:25:20.617 INFO:tasks.workunit.client.0.smithi063.stdout:2/760: mknod d3/d7/d8/d19/c103 0 2024-09-16T01:25:20.619 INFO:tasks.workunit.client.0.smithi063.stdout:6/624: write d3/d48/d7e/f93 [1411836,20190] 0 2024-09-16T01:25:20.619 INFO:tasks.workunit.client.0.smithi063.stdout:3/592: link d2/d11/d18/l44 d2/d11/d37/dce/ld5 0 2024-09-16T01:25:20.622 INFO:tasks.workunit.client.0.smithi063.stdout:4/667: symlink d5/d3b/df/d1c/d29/ld7 0 2024-09-16T01:25:20.622 INFO:tasks.workunit.client.0.smithi063.stdout:5/651: chown d5/lab 6879131 1 2024-09-16T01:25:20.622 INFO:tasks.workunit.client.0.smithi063.stdout:2/761: chown d3/d7/d8/d19/d8c/c97 167539 1 2024-09-16T01:25:20.625 INFO:tasks.workunit.client.0.smithi063.stdout:0/695: getdents d1/d30/d52/d5a/d36/d41 0 2024-09-16T01:25:20.625 INFO:tasks.workunit.client.0.smithi063.stdout:7/529: dwrite d7/d56/d57/f74 [0,4194304] 0 2024-09-16T01:25:20.626 INFO:tasks.workunit.client.0.smithi063.stdout:3/593: unlink d2/d11/d37/d40/d5e/l51 0 2024-09-16T01:25:20.626 INFO:tasks.workunit.client.0.smithi063.stdout:1/691: dread d1/d5/d82/d9b/fa3 [0,4194304] 0 2024-09-16T01:25:20.627 INFO:tasks.workunit.client.0.smithi063.stdout:2/762: dread - d3/d7/d8/d19/d8c/d21/d9c/dd4/ff9 zero size 2024-09-16T01:25:20.629 INFO:tasks.workunit.client.0.smithi063.stdout:5/652: mkdir d5/d18/d29/d48/de1 0 2024-09-16T01:25:20.630 INFO:tasks.workunit.client.0.smithi063.stdout:7/530: write d7/d1c/d1f/d66/f7f [2795448,97276] 0 2024-09-16T01:25:20.631 INFO:tasks.workunit.client.0.smithi063.stdout:4/668: write d5/d3b/df/d1c/d29/f5a [3617964,22115] 0 2024-09-16T01:25:20.632 INFO:tasks.workunit.client.0.smithi063.stdout:0/696: mkdir d1/df/d2c/d103 0 2024-09-16T01:25:20.632 INFO:tasks.workunit.client.0.smithi063.stdout:6/625: creat d3/d48/d28/d3e/d44/da4/d5a/fe2 x:0 0 0 2024-09-16T01:25:20.634 INFO:tasks.workunit.client.0.smithi063.stdout:2/763: write d3/d7/d8/d1f/d34/dc2/ffd [489800,76606] 0 2024-09-16T01:25:20.634 INFO:tasks.workunit.client.0.smithi063.stdout:3/594: mknod d2/d11/d37/d40/d5e/d3b/d94/d30/cd6 0 2024-09-16T01:25:20.634 INFO:tasks.workunit.client.0.smithi063.stdout:0/697: write d1/d30/f71 [1209845,52674] 0 2024-09-16T01:25:20.636 INFO:tasks.workunit.client.0.smithi063.stdout:7/531: mknod d7/d1c/d1f/d66/ca7 0 2024-09-16T01:25:20.637 INFO:tasks.workunit.client.0.smithi063.stdout:0/698: fdatasync d1/d2e/d73/fd5 0 2024-09-16T01:25:20.638 INFO:tasks.workunit.client.0.smithi063.stdout:3/595: write d2/d11/d37/d40/d5e/d3b/da1/faf [349599,109758] 0 2024-09-16T01:25:20.639 INFO:tasks.workunit.client.0.smithi063.stdout:5/653: rmdir d5/d18/d29/d48/de1 0 2024-09-16T01:25:20.641 INFO:tasks.workunit.client.0.smithi063.stdout:7/532: creat d7/d1c/d1f/d29/d72/fa8 x:0 0 0 2024-09-16T01:25:20.641 INFO:tasks.workunit.client.0.smithi063.stdout:2/764: creat d3/d7/d8/d1f/d34/f104 x:0 0 0 2024-09-16T01:25:20.643 INFO:tasks.workunit.client.0.smithi063.stdout:6/626: getdents d3/d48/d28/d3e/d44/da4/d5a/d81 0 2024-09-16T01:25:20.644 INFO:tasks.workunit.client.0.smithi063.stdout:4/669: truncate d5/f2e 450740 0 2024-09-16T01:25:20.645 INFO:tasks.workunit.client.0.smithi063.stdout:1/692: dread d1/d5/d15/d18/fca [0,4194304] 0 2024-09-16T01:25:20.645 INFO:tasks.workunit.client.0.smithi063.stdout:5/654: rename d5/d18/d29/d48/dad/ddd to d5/d18/d29/d48/de2 0 2024-09-16T01:25:20.649 INFO:tasks.workunit.client.0.smithi063.stdout:1/693: mkdir d1/dd/d3b/de6 0 2024-09-16T01:25:20.649 INFO:tasks.workunit.client.0.smithi063.stdout:4/670: creat d5/d3b/d5c/da7/fd8 x:0 0 0 2024-09-16T01:25:20.651 INFO:tasks.workunit.client.0.smithi063.stdout:6/627: rmdir d3/d30/d39/d69/d95/db0 39 2024-09-16T01:25:20.652 INFO:tasks.workunit.client.0.smithi063.stdout:6/628: chown d3/d48/d28/d3e/d44/da4/ca6 1939597 1 2024-09-16T01:25:20.655 INFO:tasks.workunit.client.0.smithi063.stdout:3/596: link d2/d11/d18/c1e d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6/cd7 0 2024-09-16T01:25:20.656 INFO:tasks.workunit.client.0.smithi063.stdout:4/671: creat d5/d3b/df/d1c/d29/d20/d98/dcc/fd9 x:0 0 0 2024-09-16T01:25:20.657 INFO:tasks.workunit.client.0.smithi063.stdout:7/533: dread d7/d1c/d1f/d29/f4e [0,4194304] 0 2024-09-16T01:25:20.657 INFO:tasks.workunit.client.0.smithi063.stdout:6/629: mknod d3/d30/d39/d69/d95/dd1/ce3 0 2024-09-16T01:25:20.658 INFO:tasks.workunit.client.0.smithi063.stdout:7/534: read - d7/f48 zero size 2024-09-16T01:25:20.660 INFO:tasks.workunit.client.0.smithi063.stdout:6/630: fsync d3/f16 0 2024-09-16T01:25:20.662 INFO:tasks.workunit.client.0.smithi063.stdout:1/694: dwrite d1/d12/fa7 [0,4194304] 0 2024-09-16T01:25:20.663 INFO:tasks.workunit.client.0.smithi063.stdout:2/765: rename d3/d7/d8/d1f to d3/d7/d8/d19/d8c/d21/d28/d4e/d105 0 2024-09-16T01:25:20.663 INFO:tasks.workunit.client.0.smithi063.stdout:6/631: write d3/d48/d28/d3e/d44/da4/d5a/fe2 [115359,16838] 0 2024-09-16T01:25:20.666 INFO:tasks.workunit.client.0.smithi063.stdout:1/695: write d1/d5/d15/d18/d4b/f5f [4161402,21739] 0 2024-09-16T01:25:20.666 INFO:tasks.workunit.client.0.smithi063.stdout:3/597: link d2/d11/d37/d40/d5e/d3b/d94/cbc d2/d11/d37/d40/d5e/d3b/d45/cd8 0 2024-09-16T01:25:20.667 INFO:tasks.workunit.client.0.smithi063.stdout:5/655: rename d5/d18/d29/d48/dad/dc7 to d5/d7f/da3/de3 0 2024-09-16T01:25:20.667 INFO:tasks.workunit.client.0.smithi063.stdout:3/598: fdatasync d2/f22 0 2024-09-16T01:25:20.668 INFO:tasks.workunit.client.0.smithi063.stdout:6/632: mknod d3/d48/d28/ce4 0 2024-09-16T01:25:20.670 INFO:tasks.workunit.client.0.smithi063.stdout:4/672: rename d5/d3b/df/d1c/d29/d32/f27 to d5/d3b/d57/dce/fda 0 2024-09-16T01:25:20.671 INFO:tasks.workunit.client.0.smithi063.stdout:5/656: mkdir d5/d18/d29/d48/de2/de4 0 2024-09-16T01:25:20.672 INFO:tasks.workunit.client.0.smithi063.stdout:3/599: creat d2/d11/d69/d80/d8a/d8e/fd9 x:0 0 0 2024-09-16T01:25:20.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:20 smithi192 ceph-mon[34775]: pgmap v395: 97 pgs: 97 active+clean; 1.0 GiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 142 MiB/s wr, 217 op/s 2024-09-16T01:25:20.674 INFO:tasks.workunit.client.0.smithi063.stdout:4/673: dread - d5/d3b/d5c/fcf zero size 2024-09-16T01:25:20.676 INFO:tasks.workunit.client.0.smithi063.stdout:5/657: dread - d5/d18/d29/d52/fac zero size 2024-09-16T01:25:20.680 INFO:tasks.workunit.client.0.smithi063.stdout:4/674: fdatasync d5/d3b/f16 0 2024-09-16T01:25:20.680 INFO:tasks.workunit.client.0.smithi063.stdout:3/600: mknod d2/d11/d37/d40/d5e/d3b/d68/cda 0 2024-09-16T01:25:20.681 INFO:tasks.workunit.client.0.smithi063.stdout:1/696: dwrite d1/d5/d15/fd1 [0,4194304] 0 2024-09-16T01:25:20.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:20 smithi162 ceph-mon[34539]: pgmap v395: 97 pgs: 97 active+clean; 1.0 GiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 28 MiB/s rd, 142 MiB/s wr, 217 op/s 2024-09-16T01:25:20.684 INFO:tasks.workunit.client.0.smithi063.stdout:7/535: dwrite d7/f12 [0,4194304] 0 2024-09-16T01:25:20.685 INFO:tasks.workunit.client.0.smithi063.stdout:6/633: dwrite d3/d41/d9b/fd7 [0,4194304] 0 2024-09-16T01:25:20.687 INFO:tasks.workunit.client.0.smithi063.stdout:3/601: read d2/d11/d18/f5d [482596,50520] 0 2024-09-16T01:25:20.689 INFO:tasks.workunit.client.0.smithi063.stdout:1/697: truncate d1/dd/d3b/db3/fe3 727456 0 2024-09-16T01:25:20.689 INFO:tasks.workunit.client.0.smithi063.stdout:7/536: write d7/d1c/d1f/d66/f7f [5176367,116134] 0 2024-09-16T01:25:20.690 INFO:tasks.workunit.client.0.smithi063.stdout:5/658: link d5/d18/d29/d48/d98/f5f d5/d18/d29/d48/de2/de4/fe5 0 2024-09-16T01:25:20.690 INFO:tasks.workunit.client.0.smithi063.stdout:4/675: mkdir d5/d3b/df/d1c/d29/d32/d60/ddb 0 2024-09-16T01:25:20.692 INFO:tasks.workunit.client.0.smithi063.stdout:1/698: stat d1/dd/c60 0 2024-09-16T01:25:20.693 INFO:tasks.workunit.client.0.smithi063.stdout:3/602: write d2/d11/d37/d40/d5e/f55 [74625,98116] 0 2024-09-16T01:25:20.694 INFO:tasks.workunit.client.0.smithi063.stdout:5/659: write d5/f38 [1368339,9570] 0 2024-09-16T01:25:20.697 INFO:tasks.workunit.client.0.smithi063.stdout:1/699: mknod d1/dd/d3b/de6/ce7 0 2024-09-16T01:25:20.697 INFO:tasks.workunit.client.0.smithi063.stdout:5/660: mknod d5/d7f/dc0/ce6 0 2024-09-16T01:25:20.698 INFO:tasks.workunit.client.0.smithi063.stdout:1/700: fsync d1/d5/d15/d18/f1e 0 2024-09-16T01:25:20.699 INFO:tasks.workunit.client.0.smithi063.stdout:7/537: unlink d7/d1c/d1f/d29/d88/f8a 0 2024-09-16T01:25:20.699 INFO:tasks.workunit.client.0.smithi063.stdout:5/661: creat d5/d18/d29/d48/d7b/d85/fe7 x:0 0 0 2024-09-16T01:25:20.703 INFO:tasks.workunit.client.0.smithi063.stdout:4/676: write d5/d3b/d57/d66/f6e [1127037,128893] 0 2024-09-16T01:25:20.704 INFO:tasks.workunit.client.0.smithi063.stdout:6/634: symlink d3/d48/d28/d3e/d44/da4/d5a/d6b/le5 0 2024-09-16T01:25:20.704 INFO:tasks.workunit.client.0.smithi063.stdout:3/603: creat d2/d11/d37/dab/fdb x:0 0 0 2024-09-16T01:25:20.707 INFO:tasks.workunit.client.0.smithi063.stdout:4/677: creat d5/d3b/df/d1c/fdc x:0 0 0 2024-09-16T01:25:20.709 INFO:tasks.workunit.client.0.smithi063.stdout:5/662: unlink d5/d12/l4e 0 2024-09-16T01:25:20.709 INFO:tasks.workunit.client.0.smithi063.stdout:3/604: fsync d2/d11/d37/d40/d5e/d3b/d94/d30/f3c 0 2024-09-16T01:25:20.711 INFO:tasks.workunit.client.0.smithi063.stdout:6/635: getdents d3/d48/d28/d3e/d44/d8c 0 2024-09-16T01:25:20.712 INFO:tasks.workunit.client.0.smithi063.stdout:3/605: dread d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/f9b [0,4194304] 0 2024-09-16T01:25:20.713 INFO:tasks.workunit.client.0.smithi063.stdout:4/678: creat d5/d3b/d57/d66/d9b/d7a/fdd x:0 0 0 2024-09-16T01:25:20.714 INFO:tasks.workunit.client.0.smithi063.stdout:4/679: stat d5/d3b/df/d1c/d29 0 2024-09-16T01:25:20.714 INFO:tasks.workunit.client.0.smithi063.stdout:7/538: dread d7/d56/fa6 [0,4194304] 0 2024-09-16T01:25:20.715 INFO:tasks.workunit.client.0.smithi063.stdout:6/636: mknod d3/d48/d28/d3e/d44/da4/d5a/d6b/ce6 0 2024-09-16T01:25:20.715 INFO:tasks.workunit.client.0.smithi063.stdout:5/663: creat d5/d12/fe8 x:0 0 0 2024-09-16T01:25:20.715 INFO:tasks.workunit.client.0.smithi063.stdout:7/539: fdatasync d7/d56/d57/d60/f61 0 2024-09-16T01:25:20.716 INFO:tasks.workunit.client.0.smithi063.stdout:3/606: mkdir d2/d11/d37/d40/d5e/ddc 0 2024-09-16T01:25:20.717 INFO:tasks.workunit.client.0.smithi063.stdout:6/637: symlink d3/d30/d39/d69/d95/dd1/le7 0 2024-09-16T01:25:20.719 INFO:tasks.workunit.client.0.smithi063.stdout:3/607: creat d2/d11/d69/d80/d8a/fdd x:0 0 0 2024-09-16T01:25:20.719 INFO:tasks.workunit.client.0.smithi063.stdout:5/664: rename d5/d18/d29/d48/fa2 to d5/d18/d29/d48/d7b/d85/fe9 0 2024-09-16T01:25:20.719 INFO:tasks.workunit.client.0.smithi063.stdout:6/638: truncate d3/d48/d28/d3e/f85 993224 0 2024-09-16T01:25:20.725 INFO:tasks.workunit.client.0.smithi063.stdout:6/639: getdents d3/d48/d28/d3e 0 2024-09-16T01:25:20.726 INFO:tasks.workunit.client.0.smithi063.stdout:3/608: dwrite d2/d11/d18/f6f [0,4194304] 0 2024-09-16T01:25:20.726 INFO:tasks.workunit.client.0.smithi063.stdout:5/665: dwrite d5/d18/d29/d48/d7b/f65 [0,4194304] 0 2024-09-16T01:25:20.726 INFO:tasks.workunit.client.0.smithi063.stdout:7/540: truncate d7/d1c/d1f/d66/f7f 1574734 0 2024-09-16T01:25:20.728 INFO:tasks.workunit.client.0.smithi063.stdout:6/640: write d3/d30/d39/dac/db5/fad [390660,86361] 0 2024-09-16T01:25:20.729 INFO:tasks.workunit.client.0.smithi063.stdout:7/541: chown d7/d1c/d1f/d29/d88/d96/c9a 349544864 1 2024-09-16T01:25:20.730 INFO:tasks.workunit.client.0.smithi063.stdout:3/609: rmdir d2/d11 39 2024-09-16T01:25:20.730 INFO:tasks.workunit.client.0.smithi063.stdout:5/666: mknod d5/d18/d29/d48/d66/db1/cea 0 2024-09-16T01:25:20.732 INFO:tasks.workunit.client.0.smithi063.stdout:6/641: chown d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/lc1 286 1 2024-09-16T01:25:20.732 INFO:tasks.workunit.client.0.smithi063.stdout:5/667: truncate d5/d18/d29/d48/f71 964608 0 2024-09-16T01:25:20.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/642: chown d3/d10/d49/fa8 212 1 2024-09-16T01:25:20.733 INFO:tasks.workunit.client.0.smithi063.stdout:3/610: mknod d2/d11/d18/cde 0 2024-09-16T01:25:20.740 INFO:tasks.workunit.client.0.smithi063.stdout:3/611: rename d2/d11/d37/d40/d5e/d3b/da1/faf to d2/d11/d37/d40/d5e/d3b/d68/fdf 0 2024-09-16T01:25:20.741 INFO:tasks.workunit.client.0.smithi063.stdout:7/542: dread f5 [0,4194304] 0 2024-09-16T01:25:20.743 INFO:tasks.workunit.client.0.smithi063.stdout:5/668: dwrite d5/d12/f8b [0,4194304] 0 2024-09-16T01:25:20.750 INFO:tasks.workunit.client.0.smithi063.stdout:5/669: truncate d5/d90/f99 208842 0 2024-09-16T01:25:20.751 INFO:tasks.workunit.client.0.smithi063.stdout:5/670: stat d5/d18/d29/d52/f5c 0 2024-09-16T01:25:20.752 INFO:tasks.workunit.client.0.smithi063.stdout:6/643: dwrite d3/d30/d39/d69/fb9 [4194304,4194304] 0 2024-09-16T01:25:20.752 INFO:tasks.workunit.client.0.smithi063.stdout:3/612: link d2/d11/d37/c4b d2/d11/d37/d40/d5e/d3b/da1/ce0 0 2024-09-16T01:25:20.752 INFO:tasks.workunit.client.0.smithi063.stdout:9/735: sync 2024-09-16T01:25:20.753 INFO:tasks.workunit.client.0.smithi063.stdout:7/543: getdents d7 0 2024-09-16T01:25:20.753 INFO:tasks.workunit.client.0.smithi063.stdout:5/671: readlink d5/d18/d29/d48/d7b/d85/lb8 0 2024-09-16T01:25:20.755 INFO:tasks.workunit.client.0.smithi063.stdout:7/544: chown d7/d1c/d1f/d66/ca7 0 1 2024-09-16T01:25:20.756 INFO:tasks.workunit.client.0.smithi063.stdout:9/736: write d7/d9/d20/de3/de7/d14/d34/f6b [7323495,54890] 0 2024-09-16T01:25:20.758 INFO:tasks.workunit.client.0.smithi063.stdout:5/672: creat d5/d12/d91/d72/feb x:0 0 0 2024-09-16T01:25:20.758 INFO:tasks.workunit.client.0.smithi063.stdout:6/644: creat d3/d41/d9b/fe8 x:0 0 0 2024-09-16T01:25:20.762 INFO:tasks.workunit.client.0.smithi063.stdout:9/737: rename d7/d9/ldc to d7/d1f/df1/l101 0 2024-09-16T01:25:20.764 INFO:tasks.workunit.client.0.smithi063.stdout:7/545: write d7/d18/d39/f9f [7136651,64694] 0 2024-09-16T01:25:20.766 INFO:tasks.workunit.client.0.smithi063.stdout:9/738: chown d7/d9/d20/de3/de7/d14/d23/l2d 850073 1 2024-09-16T01:25:20.766 INFO:tasks.workunit.client.0.smithi063.stdout:6/645: creat d3/d48/d28/d3e/fe9 x:0 0 0 2024-09-16T01:25:20.766 INFO:tasks.workunit.client.0.smithi063.stdout:3/613: link d2/d11/d69/lad d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/le1 0 2024-09-16T01:25:20.768 INFO:tasks.workunit.client.0.smithi063.stdout:5/673: dwrite d5/d18/d29/d48/d66/fda [0,4194304] 0 2024-09-16T01:25:20.769 INFO:tasks.workunit.client.0.smithi063.stdout:6/646: write d3/d48/d7e/d91/f87 [215936,63098] 0 2024-09-16T01:25:20.770 INFO:tasks.workunit.client.0.smithi063.stdout:9/739: mkdir d7/d9/d20/de3/de7/db2/dca/d102 0 2024-09-16T01:25:20.771 INFO:tasks.workunit.client.0.smithi063.stdout:5/674: dread - d5/d7f/dcb/fe0 zero size 2024-09-16T01:25:20.772 INFO:tasks.workunit.client.0.smithi063.stdout:3/614: read d2/d11/d69/d80/d8a/fa8 [182886,108601] 0 2024-09-16T01:25:20.772 INFO:tasks.workunit.client.0.smithi063.stdout:6/647: write d3/d10/f23 [5958994,46941] 0 2024-09-16T01:25:20.775 INFO:tasks.workunit.client.0.smithi063.stdout:7/546: dwrite d7/d56/f31 [0,4194304] 0 2024-09-16T01:25:20.775 INFO:tasks.workunit.client.0.smithi063.stdout:5/675: creat d5/d7f/da3/de3/fec x:0 0 0 2024-09-16T01:25:20.776 INFO:tasks.workunit.client.0.smithi063.stdout:9/740: creat d7/d9/d20/de3/de7/d14/d38/df7/f103 x:0 0 0 2024-09-16T01:25:20.777 INFO:tasks.workunit.client.0.smithi063.stdout:6/648: write d3/d48/d28/d3e/d44/da4/d5a/d6b/fd4 [670849,56004] 0 2024-09-16T01:25:20.779 INFO:tasks.workunit.client.0.smithi063.stdout:7/547: creat d7/d18/d40/fa9 x:0 0 0 2024-09-16T01:25:20.779 INFO:tasks.workunit.client.0.smithi063.stdout:5/676: write d5/d18/d29/d52/f8f [759413,80339] 0 2024-09-16T01:25:20.782 INFO:tasks.workunit.client.0.smithi063.stdout:9/741: creat d7/d9/d20/de3/de7/db2/dc6/ddb/f104 x:0 0 0 2024-09-16T01:25:20.783 INFO:tasks.workunit.client.0.smithi063.stdout:7/548: readlink d7/d18/d39/d65/l8d 0 2024-09-16T01:25:20.785 INFO:tasks.workunit.client.0.smithi063.stdout:7/549: readlink d7/d18/d39/d65/l79 0 2024-09-16T01:25:20.785 INFO:tasks.workunit.client.0.smithi063.stdout:5/677: write d5/d12/fcf [3794976,96953] 0 2024-09-16T01:25:20.786 INFO:tasks.workunit.client.0.smithi063.stdout:6/649: dwrite d3/d48/d7e/f93 [0,4194304] 0 2024-09-16T01:25:20.789 INFO:tasks.workunit.client.0.smithi063.stdout:9/742: read d7/d9/d20/de3/de7/f33 [4011594,5117] 0 2024-09-16T01:25:20.789 INFO:tasks.workunit.client.0.smithi063.stdout:5/678: stat d5/d18/d29/f79 0 2024-09-16T01:25:20.789 INFO:tasks.workunit.client.0.smithi063.stdout:3/615: truncate d2/d11/d37/d40/d5e/d3b/d94/d30/f57 2657766 0 2024-09-16T01:25:20.790 INFO:tasks.workunit.client.0.smithi063.stdout:7/550: unlink d7/d18/d40/c50 0 2024-09-16T01:25:20.791 INFO:tasks.workunit.client.0.smithi063.stdout:6/650: creat d3/d30/d39/dac/db5/dcf/fea x:0 0 0 2024-09-16T01:25:20.791 INFO:tasks.workunit.client.0.smithi063.stdout:7/551: fsync d7/d18/d39/f9f 0 2024-09-16T01:25:20.792 INFO:tasks.workunit.client.0.smithi063.stdout:7/552: readlink d7/ld 0 2024-09-16T01:25:20.792 INFO:tasks.workunit.client.0.smithi063.stdout:5/679: mknod d5/d12/ced 0 2024-09-16T01:25:20.793 INFO:tasks.workunit.client.0.smithi063.stdout:9/743: symlink d7/d4a/d4d/d96/l105 0 2024-09-16T01:25:20.793 INFO:tasks.workunit.client.0.smithi063.stdout:3/616: mkdir d2/d11/d37/d40/d5e/d3b/d68/dd2/de2 0 2024-09-16T01:25:20.794 INFO:tasks.workunit.client.0.smithi063.stdout:5/680: write d5/d18/d29/d48/d98/d94/f86 [1178964,81182] 0 2024-09-16T01:25:20.795 INFO:tasks.workunit.client.0.smithi063.stdout:7/553: creat d7/d1c/d1f/d29/d88/faa x:0 0 0 2024-09-16T01:25:20.795 INFO:tasks.workunit.client.0.smithi063.stdout:6/651: write d3/d48/d28/d3e/d68/db4/fce [349191,22783] 0 2024-09-16T01:25:20.796 INFO:tasks.workunit.client.0.smithi063.stdout:9/744: creat d7/d1f/df1/f106 x:0 0 0 2024-09-16T01:25:20.799 INFO:tasks.workunit.client.0.smithi063.stdout:9/745: write d7/d4a/d4d/f80 [193912,33160] 0 2024-09-16T01:25:20.799 INFO:tasks.workunit.client.0.smithi063.stdout:7/554: creat d7/d18/d40/fab x:0 0 0 2024-09-16T01:25:20.801 INFO:tasks.workunit.client.0.smithi063.stdout:5/681: creat d5/d12/d91/fee x:0 0 0 2024-09-16T01:25:20.803 INFO:tasks.workunit.client.0.smithi063.stdout:5/682: dread - d5/d12/d91/d72/feb zero size 2024-09-16T01:25:20.803 INFO:tasks.workunit.client.0.smithi063.stdout:3/617: dwrite d2/d11/d37/f88 [4194304,4194304] 0 2024-09-16T01:25:20.804 INFO:tasks.workunit.client.0.smithi063.stdout:6/652: creat d3/d48/d28/d3e/d44/da4/d5a/d6b/feb x:0 0 0 2024-09-16T01:25:20.805 INFO:tasks.workunit.client.0.smithi063.stdout:3/618: fdatasync d2/f54 0 2024-09-16T01:25:20.805 INFO:tasks.workunit.client.0.smithi063.stdout:6/653: fdatasync d3/d48/d7e/d91/f87 0 2024-09-16T01:25:20.808 INFO:tasks.workunit.client.0.smithi063.stdout:3/619: stat d2/d11/d37/f74 0 2024-09-16T01:25:20.810 INFO:tasks.workunit.client.0.smithi063.stdout:6/654: dread d3/d48/d28/d3e/d44/da4/d5a/d6b/f90 [0,4194304] 0 2024-09-16T01:25:20.811 INFO:tasks.workunit.client.0.smithi063.stdout:7/555: getdents d7/d56 0 2024-09-16T01:25:20.812 INFO:tasks.workunit.client.0.smithi063.stdout:5/683: truncate d5/d12/f23 241191 0 2024-09-16T01:25:20.813 INFO:tasks.workunit.client.0.smithi063.stdout:3/620: fsync d2/d11/d37/d40/d5e/d3b/d94/d30/f73 0 2024-09-16T01:25:20.814 INFO:tasks.workunit.client.0.smithi063.stdout:6/655: readlink d3/d48/l67 0 2024-09-16T01:25:20.816 INFO:tasks.workunit.client.0.smithi063.stdout:5/684: dread - d5/d12/fba zero size 2024-09-16T01:25:20.817 INFO:tasks.workunit.client.0.smithi063.stdout:3/621: unlink d2/d11/d37/d40/d5e/d3b/d94/c38 0 2024-09-16T01:25:20.819 INFO:tasks.workunit.client.0.smithi063.stdout:6/656: rmdir d3/d10 39 2024-09-16T01:25:20.820 INFO:tasks.workunit.client.0.smithi063.stdout:3/622: readlink d2/d11/d37/d40/d5e/d3b/d68/d6b/l78 0 2024-09-16T01:25:20.820 INFO:tasks.workunit.client.0.smithi063.stdout:7/556: getdents d7/d18/d39/d9d 0 2024-09-16T01:25:20.821 INFO:tasks.workunit.client.0.smithi063.stdout:6/657: fsync d3/d48/d28/f77 0 2024-09-16T01:25:20.823 INFO:tasks.workunit.client.0.smithi063.stdout:9/746: dwrite d7/d9/d20/de3/de7/db2/f92 [0,4194304] 0 2024-09-16T01:25:20.825 INFO:tasks.workunit.client.0.smithi063.stdout:3/623: mknod d2/d11/d37/d40/d5e/d3b/ce3 0 2024-09-16T01:25:20.828 INFO:tasks.workunit.client.0.smithi063.stdout:6/658: creat d3/d30/d39/d69/d95/db0/fec x:0 0 0 2024-09-16T01:25:20.832 INFO:tasks.workunit.client.0.smithi063.stdout:7/557: dwrite d7/d1c/d1f/d29/f3d [0,4194304] 0 2024-09-16T01:25:20.832 INFO:tasks.workunit.client.0.smithi063.stdout:3/624: mknod d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/ce4 0 2024-09-16T01:25:20.833 INFO:tasks.workunit.client.0.smithi063.stdout:6/659: read - d3/d30/d39/dac/db5/dcf/fea zero size 2024-09-16T01:25:20.834 INFO:tasks.workunit.client.0.smithi063.stdout:9/747: dwrite d7/d9/d20/de3/de7/d14/f31 [4194304,4194304] 0 2024-09-16T01:25:20.836 INFO:tasks.workunit.client.0.smithi063.stdout:3/625: fdatasync d2/d11/d37/d40/d5e/d3b/d94/d30/f99 0 2024-09-16T01:25:20.840 INFO:tasks.workunit.client.0.smithi063.stdout:7/558: creat d7/d1c/d1f/fac x:0 0 0 2024-09-16T01:25:20.842 INFO:tasks.workunit.client.0.smithi063.stdout:5/685: dread d5/d18/f39 [0,4194304] 0 2024-09-16T01:25:20.845 INFO:tasks.workunit.client.0.smithi063.stdout:9/748: truncate d7/d9/d20/de3/de7/fb8 696540 0 2024-09-16T01:25:20.845 INFO:tasks.workunit.client.0.smithi063.stdout:7/559: mkdir d7/d18/d40/dad 0 2024-09-16T01:25:20.845 INFO:tasks.workunit.client.0.smithi063.stdout:6/660: dwrite d3/d48/d28/f33 [4194304,4194304] 0 2024-09-16T01:25:20.851 INFO:tasks.workunit.client.0.smithi063.stdout:9/749: rmdir d7/d9/d20/de3/de7/d14/d38 39 2024-09-16T01:25:20.851 INFO:tasks.workunit.client.0.smithi063.stdout:7/560: write d7/d1c/d1f/f4d [1593077,119958] 0 2024-09-16T01:25:20.851 INFO:tasks.workunit.client.0.smithi063.stdout:5/686: creat d5/fef x:0 0 0 2024-09-16T01:25:20.853 INFO:tasks.workunit.client.0.smithi063.stdout:3/626: dwrite d2/d11/d37/d40/d5e/d3b/da1/fbd [0,4194304] 0 2024-09-16T01:25:20.855 INFO:tasks.workunit.client.0.smithi063.stdout:7/561: readlink d7/d1c/d1f/l43 0 2024-09-16T01:25:20.856 INFO:tasks.workunit.client.0.smithi063.stdout:7/562: dread - d7/f48 zero size 2024-09-16T01:25:20.856 INFO:tasks.workunit.client.0.smithi063.stdout:9/750: creat d7/d1f/df1/f107 x:0 0 0 2024-09-16T01:25:20.857 INFO:tasks.workunit.client.0.smithi063.stdout:6/661: fsync d3/d48/d28/d3e/d44/da4/d5a/d6b/f82 0 2024-09-16T01:25:20.859 INFO:tasks.workunit.client.0.smithi063.stdout:3/627: mkdir d2/d11/d37/d40/d5e/d3b/d68/d6d/de5 0 2024-09-16T01:25:20.859 INFO:tasks.workunit.client.0.smithi063.stdout:5/687: symlink d5/d12/d91/lf0 0 2024-09-16T01:25:20.860 INFO:tasks.workunit.client.0.smithi063.stdout:7/563: symlink d7/lae 0 2024-09-16T01:25:20.862 INFO:tasks.workunit.client.0.smithi063.stdout:9/751: symlink d7/d4a/dba/dfd/l108 0 2024-09-16T01:25:20.863 INFO:tasks.workunit.client.0.smithi063.stdout:7/564: fdatasync d7/d1c/d1f/f4d 0 2024-09-16T01:25:20.863 INFO:tasks.workunit.client.0.smithi063.stdout:5/688: rename d5/d7f/da3/dc3 to d5/d7f/df1 0 2024-09-16T01:25:20.865 INFO:tasks.workunit.client.0.smithi063.stdout:3/628: creat d2/d11/d37/d40/d5e/d3b/d45/d9f/fe6 x:0 0 0 2024-09-16T01:25:20.865 INFO:tasks.workunit.client.0.smithi063.stdout:9/752: mkdir d7/d9/d20/de3/de7/d14/d23/d109 0 2024-09-16T01:25:20.867 INFO:tasks.workunit.client.0.smithi063.stdout:3/629: mknod d2/ce7 0 2024-09-16T01:25:20.869 INFO:tasks.workunit.client.0.smithi063.stdout:3/630: write d2/f9c [925698,15653] 0 2024-09-16T01:25:20.871 INFO:tasks.workunit.client.0.smithi063.stdout:5/689: link d5/f15 d5/d18/d29/d48/d7b/d85/ff2 0 2024-09-16T01:25:20.872 INFO:tasks.workunit.client.0.smithi063.stdout:3/631: stat d2/d11/d37/d40/d5e/d3b/d94/d30/f99 0 2024-09-16T01:25:20.873 INFO:tasks.workunit.client.0.smithi063.stdout:7/565: dwrite d7/d1c/d1f/d29/f3f [0,4194304] 0 2024-09-16T01:25:20.874 INFO:tasks.workunit.client.0.smithi063.stdout:5/690: creat d5/d7f/dc0/ff3 x:0 0 0 2024-09-16T01:25:20.874 INFO:tasks.workunit.client.0.smithi063.stdout:3/632: write d2/d11/d37/d40/d5e/fb2 [9154812,102772] 0 2024-09-16T01:25:20.875 INFO:tasks.workunit.client.0.smithi063.stdout:9/753: truncate d7/d9/d20/de3/de7/f77 534550 0 2024-09-16T01:25:20.876 INFO:tasks.workunit.client.0.smithi063.stdout:7/566: mkdir d7/d1c/d1f/d29/daf 0 2024-09-16T01:25:20.877 INFO:tasks.workunit.client.0.smithi063.stdout:9/754: chown d7/d4a/d4d/f80 0 1 2024-09-16T01:25:20.877 INFO:tasks.workunit.client.0.smithi063.stdout:5/691: symlink d5/d18/d29/d48/d7b/dc2/lf4 0 2024-09-16T01:25:20.879 INFO:tasks.workunit.client.0.smithi063.stdout:3/633: getdents d2/d11/d69 0 2024-09-16T01:25:20.880 INFO:tasks.workunit.client.0.smithi063.stdout:5/692: mknod d5/d18/d29/d48/ddb/cf5 0 2024-09-16T01:25:20.881 INFO:tasks.workunit.client.0.smithi063.stdout:9/755: mkdir d7/d9/d20/de3/de7/db2/dc6/d10a 0 2024-09-16T01:25:20.885 INFO:tasks.workunit.client.0.smithi063.stdout:9/756: dread - d7/d4a/d4d/d96/da2/fe6 zero size 2024-09-16T01:25:20.885 INFO:tasks.workunit.client.0.smithi063.stdout:3/634: getdents d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e 0 2024-09-16T01:25:20.885 INFO:tasks.workunit.client.0.smithi063.stdout:5/693: rename d5/d18/d29/d48/d7b/dc2/lf4 to d5/d18/d29/d48/d7b/lf6 0 2024-09-16T01:25:20.887 INFO:tasks.workunit.client.0.smithi063.stdout:7/567: dwrite d7/d18/d40/f89 [0,4194304] 0 2024-09-16T01:25:20.888 INFO:tasks.workunit.client.0.smithi063.stdout:5/694: rmdir d5/d7f/dcb 39 2024-09-16T01:25:20.890 INFO:tasks.workunit.client.0.smithi063.stdout:9/757: mknod d7/d9/d20/de3/de7/db2/dca/c10b 0 2024-09-16T01:25:20.890 INFO:tasks.workunit.client.0.smithi063.stdout:5/695: symlink d5/d12/d91/d72/dc9/lf7 0 2024-09-16T01:25:20.891 INFO:tasks.workunit.client.0.smithi063.stdout:5/696: stat d5/d7f/df1 0 2024-09-16T01:25:20.893 INFO:tasks.workunit.client.0.smithi063.stdout:7/568: truncate d7/d56/f64 2006105 0 2024-09-16T01:25:20.895 INFO:tasks.workunit.client.0.smithi063.stdout:7/569: write d7/d18/d40/fa9 [424932,57339] 0 2024-09-16T01:25:20.897 INFO:tasks.workunit.client.0.smithi063.stdout:5/697: getdents d5/d18/d29/d48/d98 0 2024-09-16T01:25:20.899 INFO:tasks.workunit.client.0.smithi063.stdout:5/698: symlink d5/d18/d29/d48/de2/de4/lf8 0 2024-09-16T01:25:20.899 INFO:tasks.workunit.client.0.smithi063.stdout:9/758: truncate d7/d9/d20/de3/de7/d14/f31 6159162 0 2024-09-16T01:25:20.900 INFO:tasks.workunit.client.0.smithi063.stdout:7/570: write d7/d56/f64 [2532048,47175] 0 2024-09-16T01:25:20.900 INFO:tasks.workunit.client.0.smithi063.stdout:3/635: dread d2/d11/d37/d40/d5e/d3b/d94/d30/f3c [0,4194304] 0 2024-09-16T01:25:20.903 INFO:tasks.workunit.client.0.smithi063.stdout:5/699: mkdir d5/d18/d29/d48/d7b/d85/df9 0 2024-09-16T01:25:20.904 INFO:tasks.workunit.client.0.smithi063.stdout:9/759: chown d7/d9/d20/de3/de7/d14/d63/d5f/dab/leb 140105473 1 2024-09-16T01:25:20.904 INFO:tasks.workunit.client.0.smithi063.stdout:9/760: fsync d7/d4a/fbf 0 2024-09-16T01:25:20.905 INFO:tasks.workunit.client.0.smithi063.stdout:5/700: rmdir d5/d18/d29/d48/d66/db1 39 2024-09-16T01:25:20.906 INFO:tasks.workunit.client.0.smithi063.stdout:3/636: write d2/d11/d37/d40/d5e/d3b/d94/f2f [4587696,88937] 0 2024-09-16T01:25:20.907 INFO:tasks.workunit.client.0.smithi063.stdout:9/761: symlink d7/d1f/df1/l10c 0 2024-09-16T01:25:20.908 INFO:tasks.workunit.client.0.smithi063.stdout:7/571: rename d7/d1c/c4c to d7/d1c/d1f/cb0 0 2024-09-16T01:25:20.909 INFO:tasks.workunit.client.0.smithi063.stdout:3/637: dread d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/fae [0,4194304] 0 2024-09-16T01:25:20.910 INFO:tasks.workunit.client.0.smithi063.stdout:9/762: write d7/d9/d20/de3/de7/db2/dc6/ffa [1279434,51678] 0 2024-09-16T01:25:20.911 INFO:tasks.workunit.client.0.smithi063.stdout:7/572: symlink d7/d1c/lb1 0 2024-09-16T01:25:20.911 INFO:tasks.workunit.client.0.smithi063.stdout:3/638: fsync d2/d11/d37/d40/d5e/d97/fc9 0 2024-09-16T01:25:20.913 INFO:tasks.workunit.client.0.smithi063.stdout:9/763: truncate d7/d9/d20/de3/de7/d14/f75 2402747 0 2024-09-16T01:25:20.916 INFO:tasks.workunit.client.0.smithi063.stdout:9/764: write d7/d9/d20/fd0 [225279,123377] 0 2024-09-16T01:25:20.919 INFO:tasks.workunit.client.0.smithi063.stdout:5/701: truncate d5/d12/f13 1890310 0 2024-09-16T01:25:20.921 INFO:tasks.workunit.client.0.smithi063.stdout:9/765: fsync d7/d9/d20/de3/de7/d14/fb6 0 2024-09-16T01:25:20.921 INFO:tasks.workunit.client.0.smithi063.stdout:7/573: dwrite d7/d56/d57/d60/fa5 [0,4194304] 0 2024-09-16T01:25:20.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/574: chown d7 2031 1 2024-09-16T01:25:20.923 INFO:tasks.workunit.client.0.smithi063.stdout:3/639: dwrite d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/f7e [0,4194304] 0 2024-09-16T01:25:20.929 INFO:tasks.workunit.client.0.smithi063.stdout:9/766: rmdir d7/d9/d20/de3/de7/db2/dc6/d10a 0 2024-09-16T01:25:20.929 INFO:tasks.workunit.client.0.smithi063.stdout:5/702: link d5/d18/d29/d48/d7b/f95 d5/d7f/ffa 0 2024-09-16T01:25:20.929 INFO:tasks.workunit.client.0.smithi063.stdout:3/640: creat d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/fe8 x:0 0 0 2024-09-16T01:25:20.930 INFO:tasks.workunit.client.0.smithi063.stdout:3/641: chown d2/d11/d18/fd 509277153 1 2024-09-16T01:25:20.935 INFO:tasks.workunit.client.0.smithi063.stdout:3/642: creat d2/d11/d69/d80/fe9 x:0 0 0 2024-09-16T01:25:20.937 INFO:tasks.workunit.client.0.smithi063.stdout:3/643: write d2/d11/d37/d40/d5e/f55 [517513,14195] 0 2024-09-16T01:25:20.940 INFO:tasks.workunit.client.0.smithi063.stdout:3/644: rename d2/d11/d37 to d2/d11/d37/d40/d5e/d3b/d94/d30/dea 22 2024-09-16T01:25:20.940 INFO:tasks.workunit.client.0.smithi063.stdout:9/767: truncate d7/d9/d20/de3/de7/db2/dca/fe8 2569190 0 2024-09-16T01:25:20.944 INFO:tasks.workunit.client.0.smithi063.stdout:3/645: chown d2/d11/c1b 57 1 2024-09-16T01:25:20.944 INFO:tasks.workunit.client.0.smithi063.stdout:9/768: fdatasync d7/d9/d20/de3/de7/d14/f16 0 2024-09-16T01:25:20.945 INFO:tasks.workunit.client.0.smithi063.stdout:7/575: dread d7/d18/d40/f58 [0,4194304] 0 2024-09-16T01:25:20.946 INFO:tasks.workunit.client.0.smithi063.stdout:3/646: truncate d2/d11/d37/d40/d5e/d3b/d68/fdf 1031960 0 2024-09-16T01:25:20.954 INFO:tasks.workunit.client.0.smithi063.stdout:9/769: unlink d7/d9/d20/de3/de7/d14/d23/c3d 0 2024-09-16T01:25:20.955 INFO:tasks.workunit.client.0.smithi063.stdout:7/576: read d7/d1c/d1f/d29/f3d [1264880,48561] 0 2024-09-16T01:25:20.955 INFO:tasks.workunit.client.0.smithi063.stdout:8/549: sync 2024-09-16T01:25:20.956 INFO:tasks.workunit.client.0.smithi063.stdout:9/770: write d7/d1f/fec [2895461,122675] 0 2024-09-16T01:25:20.957 INFO:tasks.workunit.client.0.smithi063.stdout:5/703: dread d5/d18/fbb [0,4194304] 0 2024-09-16T01:25:20.959 INFO:tasks.workunit.client.0.smithi063.stdout:5/704: creat d5/d7f/da3/de3/ffb x:0 0 0 2024-09-16T01:25:20.961 INFO:tasks.workunit.client.0.smithi063.stdout:7/577: dwrite d7/d56/f31 [0,4194304] 0 2024-09-16T01:25:20.962 INFO:tasks.workunit.client.0.smithi063.stdout:8/550: mkdir d5/db/d12/d1a/d1e/d93/db8 0 2024-09-16T01:25:20.967 INFO:tasks.workunit.client.0.smithi063.stdout:9/771: creat d7/d9/d20/de3/de7/d14/d38/f10d x:0 0 0 2024-09-16T01:25:20.969 INFO:tasks.workunit.client.0.smithi063.stdout:3/647: link d2/d11/d18/f2d d2/d11/d37/feb 0 2024-09-16T01:25:20.971 INFO:tasks.workunit.client.0.smithi063.stdout:7/578: rename d7/d18/c1e to d7/d56/d6b/cb2 0 2024-09-16T01:25:20.973 INFO:tasks.workunit.client.0.smithi063.stdout:7/579: fsync d7/ff 0 2024-09-16T01:25:20.973 INFO:tasks.workunit.client.0.smithi063.stdout:3/648: dread d2/d11/d37/d40/d5e/d3b/d94/d30/f3c [0,4194304] 0 2024-09-16T01:25:20.974 INFO:tasks.workunit.client.0.smithi063.stdout:5/705: rename d5/d12/d91/d72/dc9 to d5/d18/d29/d48/d66/db1/dfc 0 2024-09-16T01:25:20.975 INFO:tasks.workunit.client.0.smithi063.stdout:8/551: link d5/db/d12/d3d/c49 d5/d9/cb9 0 2024-09-16T01:25:20.977 INFO:tasks.workunit.client.0.smithi063.stdout:8/552: write d5/db/d12/d3d/d69/daa/d40/d4a/f8b [260220,126808] 0 2024-09-16T01:25:20.977 INFO:tasks.workunit.client.0.smithi063.stdout:7/580: creat d7/d56/d6b/d86/fb3 x:0 0 0 2024-09-16T01:25:20.977 INFO:tasks.workunit.client.0.smithi063.stdout:5/706: creat d5/d7f/ffd x:0 0 0 2024-09-16T01:25:20.979 INFO:tasks.workunit.client.0.smithi063.stdout:5/707: fdatasync d5/fef 0 2024-09-16T01:25:20.980 INFO:tasks.workunit.client.0.smithi063.stdout:3/649: unlink d2/d11/d37/d40/d5e/d3b/d94/d30/f57 0 2024-09-16T01:25:20.981 INFO:tasks.workunit.client.0.smithi063.stdout:3/650: chown d2/d11/d37/dab/fdb 49074 1 2024-09-16T01:25:20.982 INFO:tasks.workunit.client.0.smithi063.stdout:8/553: creat d5/db/d12/d3d/fba x:0 0 0 2024-09-16T01:25:20.982 INFO:tasks.workunit.client.0.smithi063.stdout:3/651: truncate d2/d11/f1d 4588971 0 2024-09-16T01:25:20.983 INFO:tasks.workunit.client.0.smithi063.stdout:8/554: chown d5/d9/c2e 25 1 2024-09-16T01:25:20.983 INFO:tasks.workunit.client.0.smithi063.stdout:3/652: read d2/f10 [2529666,77346] 0 2024-09-16T01:25:20.984 INFO:tasks.workunit.client.0.smithi063.stdout:7/581: mkdir d7/d56/d57/d73/d91/db4 0 2024-09-16T01:25:20.985 INFO:tasks.workunit.client.0.smithi063.stdout:8/555: symlink d5/db/d12/d3d/lbb 0 2024-09-16T01:25:20.986 INFO:tasks.workunit.client.0.smithi063.stdout:7/582: mkdir d7/d1c/d1f/d29/db5 0 2024-09-16T01:25:20.987 INFO:tasks.workunit.client.0.smithi063.stdout:8/556: write d5/d9/f7b [585527,13144] 0 2024-09-16T01:25:20.992 INFO:tasks.workunit.client.0.smithi063.stdout:3/653: dwrite d2/d11/d69/d80/fe9 [0,4194304] 0 2024-09-16T01:25:20.996 INFO:tasks.workunit.client.0.smithi063.stdout:5/708: dread d5/d18/f78 [0,4194304] 0 2024-09-16T01:25:20.998 INFO:tasks.workunit.client.0.smithi063.stdout:3/654: dread - d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6/fcd zero size 2024-09-16T01:25:20.999 INFO:tasks.workunit.client.0.smithi063.stdout:7/583: dwrite d7/d1c/d1f/f2b [0,4194304] 0 2024-09-16T01:25:21.000 INFO:tasks.workunit.client.0.smithi063.stdout:8/557: dwrite d5/d86/f89 [4194304,4194304] 0 2024-09-16T01:25:21.002 INFO:tasks.workunit.client.0.smithi063.stdout:5/709: fsync d5/f17 0 2024-09-16T01:25:21.003 INFO:tasks.workunit.client.0.smithi063.stdout:8/558: truncate d5/db/d12/d1a/d60/f91 40507 0 2024-09-16T01:25:21.004 INFO:tasks.workunit.client.0.smithi063.stdout:7/584: mknod d7/d56/cb6 0 2024-09-16T01:25:21.007 INFO:tasks.workunit.client.0.smithi063.stdout:3/655: write d2/d11/d37/f74 [124022,74467] 0 2024-09-16T01:25:21.009 INFO:tasks.workunit.client.0.smithi063.stdout:8/559: unlink d5/d8c/d74/d87/l9d 0 2024-09-16T01:25:21.010 INFO:tasks.workunit.client.0.smithi063.stdout:7/585: creat d7/d1c/d1f/d29/fb7 x:0 0 0 2024-09-16T01:25:21.013 INFO:tasks.workunit.client.0.smithi063.stdout:7/586: dread - d7/d1c/d1f/d66/d70/f94 zero size 2024-09-16T01:25:21.014 INFO:tasks.workunit.client.0.smithi063.stdout:8/560: unlink d5/db/d12/d1a/l27 0 2024-09-16T01:25:21.014 INFO:tasks.workunit.client.0.smithi063.stdout:5/710: dwrite d5/d12/fa4 [0,4194304] 0 2024-09-16T01:25:21.015 INFO:tasks.workunit.client.0.smithi063.stdout:3/656: getdents d2/d5b 0 2024-09-16T01:25:21.016 INFO:tasks.workunit.client.0.smithi063.stdout:7/587: stat d7/d56/d6b/cb2 0 2024-09-16T01:25:21.016 INFO:tasks.workunit.client.0.smithi063.stdout:8/561: unlink d5/f3b 0 2024-09-16T01:25:21.017 INFO:tasks.workunit.client.0.smithi063.stdout:8/562: fsync d5/f94 0 2024-09-16T01:25:21.017 INFO:tasks.workunit.client.0.smithi063.stdout:5/711: mknod d5/d18/d29/d48/de2/cfe 0 2024-09-16T01:25:21.019 INFO:tasks.workunit.client.0.smithi063.stdout:3/657: creat d2/d11/d37/d40/d5e/d3b/d68/d6d/de5/fec x:0 0 0 2024-09-16T01:25:21.019 INFO:tasks.workunit.client.0.smithi063.stdout:7/588: creat d7/d56/d57/d73/d91/db4/fb8 x:0 0 0 2024-09-16T01:25:21.021 INFO:tasks.workunit.client.0.smithi063.stdout:8/563: creat d5/db/d12/d3d/fbc x:0 0 0 2024-09-16T01:25:21.025 INFO:tasks.workunit.client.0.smithi063.stdout:3/658: truncate d2/d11/d37/d40/d5e/d3b/d94/d30/f3c 842061 0 2024-09-16T01:25:21.025 INFO:tasks.workunit.client.0.smithi063.stdout:5/712: write d5/d12/f49 [1573277,120143] 0 2024-09-16T01:25:21.026 INFO:tasks.workunit.client.0.smithi063.stdout:7/589: dwrite d7/d1c/d1f/d66/f8b [0,4194304] 0 2024-09-16T01:25:21.028 INFO:tasks.workunit.client.0.smithi063.stdout:8/564: rename d5/db/d54 to d5/d8c/dbd 0 2024-09-16T01:25:21.028 INFO:tasks.workunit.client.0.smithi063.stdout:7/590: chown d7/d1c/d1f/d29/f3f 116632311 1 2024-09-16T01:25:21.030 INFO:tasks.workunit.client.0.smithi063.stdout:7/591: fdatasync d7/d1c/d1f/d29/f3f 0 2024-09-16T01:25:21.034 INFO:tasks.workunit.client.0.smithi063.stdout:3/659: getdents d2/d11 0 2024-09-16T01:25:21.035 INFO:tasks.workunit.client.0.smithi063.stdout:7/592: mkdir d7/d56/d57/d60/db9 0 2024-09-16T01:25:21.038 INFO:tasks.workunit.client.0.smithi063.stdout:3/660: truncate d2/fbf 1241039 0 2024-09-16T01:25:21.041 INFO:tasks.workunit.client.0.smithi063.stdout:8/565: dwrite d5/db/d12/d1a/d1e/fa9 [0,4194304] 0 2024-09-16T01:25:21.041 INFO:tasks.workunit.client.0.smithi063.stdout:5/713: dwrite d5/d18/d29/d48/d7b/f95 [0,4194304] 0 2024-09-16T01:25:21.044 INFO:tasks.workunit.client.0.smithi063.stdout:5/714: fsync d5/d18/d29/f79 0 2024-09-16T01:25:21.046 INFO:tasks.workunit.client.0.smithi063.stdout:8/566: write d5/db/d12/d3d/d69/daa/f90 [1373798,114637] 0 2024-09-16T01:25:21.050 INFO:tasks.workunit.client.0.smithi063.stdout:5/715: dread - d5/fa1 zero size 2024-09-16T01:25:21.052 INFO:tasks.workunit.client.0.smithi063.stdout:8/567: fdatasync d5/db/d12/d1a/d60/d63/f56 0 2024-09-16T01:25:21.052 INFO:tasks.workunit.client.0.smithi063.stdout:7/593: dwrite d7/d56/d57/d60/f63 [0,4194304] 0 2024-09-16T01:25:21.053 INFO:tasks.workunit.client.0.smithi063.stdout:8/568: fdatasync d5/d9/f7b 0 2024-09-16T01:25:21.054 INFO:tasks.workunit.client.0.smithi063.stdout:5/716: chown d5/d7f/df1/ld1 0 1 2024-09-16T01:25:21.054 INFO:tasks.workunit.client.0.smithi063.stdout:3/661: dwrite d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/f8f [8388608,4194304] 0 2024-09-16T01:25:21.060 INFO:tasks.workunit.client.0.smithi063.stdout:8/569: symlink d5/d9/lbe 0 2024-09-16T01:25:21.060 INFO:tasks.workunit.client.0.smithi063.stdout:5/717: truncate d5/d12/f49 2344635 0 2024-09-16T01:25:21.061 INFO:tasks.workunit.client.0.smithi063.stdout:3/662: rmdir d2/d11/d37/d40/d5e 39 2024-09-16T01:25:21.062 INFO:tasks.workunit.client.0.smithi063.stdout:7/594: creat d7/d1c/d1f/fba x:0 0 0 2024-09-16T01:25:21.062 INFO:tasks.workunit.client.0.smithi063.stdout:8/570: dread - d5/db/d12/d3d/d69/daa/f9b zero size 2024-09-16T01:25:21.064 INFO:tasks.workunit.client.0.smithi063.stdout:3/663: creat d2/d11/d37/db6/fed x:0 0 0 2024-09-16T01:25:21.068 INFO:tasks.workunit.client.0.smithi063.stdout:5/718: dread d5/d18/f6e [0,4194304] 0 2024-09-16T01:25:21.068 INFO:tasks.workunit.client.0.smithi063.stdout:8/571: symlink d5/lbf 0 2024-09-16T01:25:21.071 INFO:tasks.workunit.client.0.smithi063.stdout:3/664: creat d2/d11/d37/d40/d5e/d3b/fee x:0 0 0 2024-09-16T01:25:21.072 INFO:tasks.workunit.client.0.smithi063.stdout:7/595: dwrite d7/d1c/d1f/f2e [0,4194304] 0 2024-09-16T01:25:21.075 INFO:tasks.workunit.client.0.smithi063.stdout:3/665: mknod d2/d11/d37/cef 0 2024-09-16T01:25:21.080 INFO:tasks.workunit.client.0.smithi063.stdout:3/666: mkdir d2/d11/d69/d80/df0 0 2024-09-16T01:25:21.081 INFO:tasks.workunit.client.0.smithi063.stdout:8/572: dwrite d5/db/d12/d3d/fbc [0,4194304] 0 2024-09-16T01:25:21.081 INFO:tasks.workunit.client.0.smithi063.stdout:5/719: dwrite d5/d18/d29/d48/d98/d94/f86 [0,4194304] 0 2024-09-16T01:25:21.084 INFO:tasks.workunit.client.0.smithi063.stdout:7/596: dread d7/d56/d57/d60/fa5 [0,4194304] 0 2024-09-16T01:25:21.085 INFO:tasks.workunit.client.0.smithi063.stdout:8/573: mknod d5/db/d12/d3d/d69/cc0 0 2024-09-16T01:25:21.086 INFO:tasks.workunit.client.0.smithi063.stdout:5/720: symlink d5/d18/d29/d48/d7b/dc2/lff 0 2024-09-16T01:25:21.087 INFO:tasks.workunit.client.0.smithi063.stdout:3/667: creat d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/ff1 x:0 0 0 2024-09-16T01:25:21.089 INFO:tasks.workunit.client.0.smithi063.stdout:8/574: truncate d5/d9/d2f/f85 5084769 0 2024-09-16T01:25:21.090 INFO:tasks.workunit.client.0.smithi063.stdout:7/597: symlink d7/d1c/d1f/d66/lbb 0 2024-09-16T01:25:21.090 INFO:tasks.workunit.client.0.smithi063.stdout:2/766: sync 2024-09-16T01:25:21.090 INFO:tasks.workunit.client.0.smithi063.stdout:0/699: sync 2024-09-16T01:25:21.090 INFO:tasks.workunit.client.0.smithi063.stdout:3/668: fsync d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6/fcd 0 2024-09-16T01:25:21.092 INFO:tasks.workunit.client.0.smithi063.stdout:3/669: chown d2/d11/d37/fb0 41457 1 2024-09-16T01:25:21.093 INFO:tasks.workunit.client.0.smithi063.stdout:7/598: creat d7/d56/fbc x:0 0 0 2024-09-16T01:25:21.094 INFO:tasks.workunit.client.0.smithi063.stdout:2/767: symlink d3/d7/d8/d19/d8c/d21/d28/d8a/dda/l106 0 2024-09-16T01:25:21.096 INFO:tasks.workunit.client.0.smithi063.stdout:3/670: mknod d2/dc1/cf2 0 2024-09-16T01:25:21.097 INFO:tasks.workunit.client.0.smithi063.stdout:7/599: creat d7/d18/d40/d6c/fbd x:0 0 0 2024-09-16T01:25:21.097 INFO:tasks.workunit.client.0.smithi063.stdout:5/721: link d5/d18/d29/d48/d66/c8d d5/d18/d29/d48/de2/de4/c100 0 2024-09-16T01:25:21.098 INFO:tasks.workunit.client.0.smithi063.stdout:0/700: getdents d1/d2e/d48/dcb 0 2024-09-16T01:25:21.099 INFO:tasks.workunit.client.0.smithi063.stdout:3/671: creat d2/d11/d18/ff3 x:0 0 0 2024-09-16T01:25:21.103 INFO:tasks.workunit.client.0.smithi063.stdout:0/701: chown d1/d30/d52/d5a/d36/f5b 0 1 2024-09-16T01:25:21.105 INFO:tasks.workunit.client.0.smithi063.stdout:2/768: dwrite d3/d7/d8/d19/d3c/d58/fbb [0,4194304] 0 2024-09-16T01:25:21.106 INFO:tasks.workunit.client.0.smithi063.stdout:0/702: write d1/d1c/fad [2900845,129099] 0 2024-09-16T01:25:21.108 INFO:tasks.workunit.client.0.smithi063.stdout:7/600: dwrite d7/d18/d40/d6c/fbd [0,4194304] 0 2024-09-16T01:25:21.116 INFO:tasks.workunit.client.0.smithi063.stdout:3/672: dwrite d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/f7e [0,4194304] 0 2024-09-16T01:25:21.117 INFO:tasks.workunit.client.0.smithi063.stdout:2/769: creat d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d34/d45/f107 x:0 0 0 2024-09-16T01:25:21.117 INFO:tasks.workunit.client.0.smithi063.stdout:5/722: dread d5/f67 [0,4194304] 0 2024-09-16T01:25:21.117 INFO:tasks.workunit.client.0.smithi063.stdout:0/703: mkdir d1/d30/d52/d5a/d104 0 2024-09-16T01:25:21.118 INFO:tasks.workunit.client.0.smithi063.stdout:3/673: chown d2/d11/d69/cbb 3950499 1 2024-09-16T01:25:21.120 INFO:tasks.workunit.client.0.smithi063.stdout:2/770: write d3/d7/d8/d19/f44 [2906069,107471] 0 2024-09-16T01:25:21.121 INFO:tasks.workunit.client.0.smithi063.stdout:0/704: mkdir d1/d2e/d105 0 2024-09-16T01:25:21.122 INFO:tasks.workunit.client.0.smithi063.stdout:3/674: read d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/fb3 [662651,19621] 0 2024-09-16T01:25:21.123 INFO:tasks.workunit.client.0.smithi063.stdout:3/675: stat d2/fa0 0 2024-09-16T01:25:21.124 INFO:tasks.workunit.client.0.smithi063.stdout:0/705: rmdir d1/d2e/d48/dc3 39 2024-09-16T01:25:21.128 INFO:tasks.workunit.client.0.smithi063.stdout:7/601: dwrite d7/f14 [0,4194304] 0 2024-09-16T01:25:21.128 INFO:tasks.workunit.client.0.smithi063.stdout:2/771: creat d3/d7/d8/d19/d8c/d21/d28/d8a/da1/db6/f108 x:0 0 0 2024-09-16T01:25:21.129 INFO:tasks.workunit.client.0.smithi063.stdout:0/706: mknod d1/d30/d95/db5/c106 0 2024-09-16T01:25:21.130 INFO:tasks.workunit.client.0.smithi063.stdout:5/723: write d5/d18/d29/d48/d98/f84 [4110546,16402] 0 2024-09-16T01:25:21.134 INFO:tasks.workunit.client.0.smithi063.stdout:0/707: dread - d1/d30/d52/d5a/d36/ffc zero size 2024-09-16T01:25:21.137 INFO:tasks.workunit.client.0.smithi063.stdout:5/724: creat d5/d7f/dc0/f101 x:0 0 0 2024-09-16T01:25:21.138 INFO:tasks.workunit.client.0.smithi063.stdout:2/772: mkdir d3/d7/d8/d19/d8c/d21/d28/d4e/dfe/d109 0 2024-09-16T01:25:21.139 INFO:tasks.workunit.client.0.smithi063.stdout:3/676: dwrite d2/d11/d37/d40/d5e/f31 [0,4194304] 0 2024-09-16T01:25:21.141 INFO:tasks.workunit.client.0.smithi063.stdout:7/602: rename d7/d1c/d1f/f5d to d7/d1c/d1f/d29/d88/d98/fbe 0 2024-09-16T01:25:21.143 INFO:tasks.workunit.client.0.smithi063.stdout:2/773: creat d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d34/dc2/dde/f10a x:0 0 0 2024-09-16T01:25:21.144 INFO:tasks.workunit.client.0.smithi063.stdout:7/603: unlink d7/ff 0 2024-09-16T01:25:21.144 INFO:tasks.workunit.client.0.smithi063.stdout:5/725: link d5/d12/d91/d72/fb9 d5/d18/d29/d48/d7b/d85/f102 0 2024-09-16T01:25:21.144 INFO:tasks.workunit.client.0.smithi063.stdout:0/708: link d1/df/d17/l6c d1/d2e/dc1/l107 0 2024-09-16T01:25:21.145 INFO:tasks.workunit.client.0.smithi063.stdout:2/774: write d3/d7/d8/d19/d3c/d53/f83 [403656,27253] 0 2024-09-16T01:25:21.148 INFO:tasks.workunit.client.0.smithi063.stdout:3/677: write d2/d11/d18/f83 [545652,1823] 0 2024-09-16T01:25:21.148 INFO:tasks.workunit.client.0.smithi063.stdout:3/678: read - d2/d11/d69/d80/d8a/fdd zero size 2024-09-16T01:25:21.151 INFO:tasks.workunit.client.0.smithi063.stdout:0/709: link d1/fb4 d1/d2e/d48/f108 0 2024-09-16T01:25:21.151 INFO:tasks.workunit.client.0.smithi063.stdout:3/679: mknod d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/cf4 0 2024-09-16T01:25:21.154 INFO:tasks.workunit.client.0.smithi063.stdout:0/710: mknod d1/d30/d52/db3/c109 0 2024-09-16T01:25:21.155 INFO:tasks.workunit.client.0.smithi063.stdout:3/680: getdents d2/d11/d37/d40/d5e/d3b/d45/d9f 0 2024-09-16T01:25:21.157 INFO:tasks.workunit.client.0.smithi063.stdout:0/711: mknod d1/df/d2c/db6/c10a 0 2024-09-16T01:25:21.159 INFO:tasks.workunit.client.0.smithi063.stdout:3/681: creat d2/d11/d37/d40/d5e/d3b/d68/dd2/ff5 x:0 0 0 2024-09-16T01:25:21.160 INFO:tasks.workunit.client.0.smithi063.stdout:2/775: truncate d3/d7/d8/d19/d8c/d21/d28/d8a/da1/db6/fe5 148752 0 2024-09-16T01:25:21.161 INFO:tasks.workunit.client.0.smithi063.stdout:7/604: rename d7/d18 to d7/d1c/d1f/d29/dbf 0 2024-09-16T01:25:21.163 INFO:tasks.workunit.client.0.smithi063.stdout:3/682: creat d2/d11/d69/d80/d8a/ff6 x:0 0 0 2024-09-16T01:25:21.163 INFO:tasks.workunit.client.0.smithi063.stdout:5/726: dwrite d5/d18/d29/d48/f54 [0,4194304] 0 2024-09-16T01:25:21.165 INFO:tasks.workunit.client.0.smithi063.stdout:7/605: fdatasync d7/f9 0 2024-09-16T01:25:21.169 INFO:tasks.workunit.client.0.smithi063.stdout:0/712: dwrite d1/df/fd3 [4194304,4194304] 0 2024-09-16T01:25:21.169 INFO:tasks.workunit.client.0.smithi063.stdout:2/776: symlink d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d37/d4f/l10b 0 2024-09-16T01:25:21.170 INFO:tasks.workunit.client.0.smithi063.stdout:7/606: write d7/d1c/d1f/d29/dbf/d39/d65/f9b [748530,41704] 0 2024-09-16T01:25:21.171 INFO:tasks.workunit.client.0.smithi063.stdout:5/727: mknod d5/d12/c103 0 2024-09-16T01:25:21.172 INFO:tasks.workunit.client.0.smithi063.stdout:3/683: rename d2/d11/d18/f5d to d2/d11/d37/d40/d5e/d3b/d45/d9f/ff7 0 2024-09-16T01:25:21.172 INFO:tasks.workunit.client.0.smithi063.stdout:2/777: mknod d3/d7/c10c 0 2024-09-16T01:25:21.173 INFO:tasks.workunit.client.0.smithi063.stdout:7/607: mknod d7/d56/d57/d60/db9/cc0 0 2024-09-16T01:25:21.176 INFO:tasks.workunit.client.0.smithi063.stdout:7/608: mkdir d7/d1c/d1f/d29/dbf/d40/d6c/dc1 0 2024-09-16T01:25:21.177 INFO:tasks.workunit.client.0.smithi063.stdout:3/684: rmdir d2/d11/d37/d40/d5e/d3b/d45/d9f 39 2024-09-16T01:25:21.179 INFO:tasks.workunit.client.0.smithi063.stdout:5/728: unlink d5/d12/f21 0 2024-09-16T01:25:21.180 INFO:tasks.workunit.client.0.smithi063.stdout:3/685: chown d2/d11/d18/c1e 22130 1 2024-09-16T01:25:21.180 INFO:tasks.workunit.client.0.smithi063.stdout:2/778: dwrite d3/d7/d8/d19/d3c/d58/fbb [4194304,4194304] 0 2024-09-16T01:25:21.180 INFO:tasks.workunit.client.0.smithi063.stdout:0/713: truncate d1/df/db1/fdf 462994 0 2024-09-16T01:25:21.181 INFO:tasks.workunit.client.0.smithi063.stdout:2/779: chown d3/l5c 1 1 2024-09-16T01:25:21.182 INFO:tasks.workunit.client.0.smithi063.stdout:5/729: mkdir d5/d18/d29/d104 0 2024-09-16T01:25:21.182 INFO:tasks.workunit.client.0.smithi063.stdout:3/686: chown d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/ce4 849478 1 2024-09-16T01:25:21.183 INFO:tasks.workunit.client.0.smithi063.stdout:7/609: link d7/d1c/d1f/d66/f82 d7/d1c/fc2 0 2024-09-16T01:25:21.183 INFO:tasks.workunit.client.0.smithi063.stdout:0/714: write d1/d30/d52/d5a/d36/d41/fed [896232,79334] 0 2024-09-16T01:25:21.184 INFO:tasks.workunit.client.0.smithi063.stdout:0/715: readlink d1/df/d17/l3a 0 2024-09-16T01:25:21.185 INFO:tasks.workunit.client.0.smithi063.stdout:3/687: fdatasync d2/d11/d18/f6f 0 2024-09-16T01:25:21.186 INFO:tasks.workunit.client.0.smithi063.stdout:5/730: chown d5/f17 253124071 1 2024-09-16T01:25:21.186 INFO:tasks.workunit.client.0.smithi063.stdout:0/716: stat d1/d30/f71 0 2024-09-16T01:25:21.188 INFO:tasks.workunit.client.0.smithi063.stdout:0/717: read d1/d2e/d73/fd5 [40404,73084] 0 2024-09-16T01:25:21.188 INFO:tasks.workunit.client.0.smithi063.stdout:5/731: write d5/d18/d29/d52/fd0 [179172,41532] 0 2024-09-16T01:25:21.191 INFO:tasks.workunit.client.0.smithi063.stdout:0/718: rmdir d1/d2e/d105 0 2024-09-16T01:25:21.192 INFO:tasks.workunit.client.0.smithi063.stdout:7/610: rename d7/d1c/d1f/d29/f3d to d7/d1c/d1f/d29/dbf/d40/d6c/fc3 0 2024-09-16T01:25:21.192 INFO:tasks.workunit.client.0.smithi063.stdout:0/719: read d1/d1c/f78 [265476,100638] 0 2024-09-16T01:25:21.196 INFO:tasks.workunit.client.0.smithi063.stdout:0/720: fsync d1/df/d34/f45 0 2024-09-16T01:25:21.196 INFO:tasks.workunit.client.0.smithi063.stdout:7/611: symlink d7/d56/d57/d73/d91/db4/lc4 0 2024-09-16T01:25:21.198 INFO:tasks.workunit.client.0.smithi063.stdout:2/780: rename d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d34/d72/c82 to d3/d7/d8/d19/d8c/d21/d28/d4e/d105/c10d 0 2024-09-16T01:25:21.201 INFO:tasks.workunit.client.0.smithi063.stdout:2/781: symlink d3/d7/d8/d19/d8c/d21/d28/d4e/l10e 0 2024-09-16T01:25:21.204 INFO:tasks.workunit.client.0.smithi063.stdout:3/688: write d2/fbf [868193,111222] 0 2024-09-16T01:25:21.205 INFO:tasks.workunit.client.0.smithi063.stdout:2/782: mknod d3/d7/d8/d19/d3c/d53/d7f/d80/c10f 0 2024-09-16T01:25:21.207 INFO:tasks.workunit.client.0.smithi063.stdout:0/721: truncate d1/df/fd3 4081636 0 2024-09-16T01:25:21.207 INFO:tasks.workunit.client.0.smithi063.stdout:5/732: dread d5/d12/f43 [0,4194304] 0 2024-09-16T01:25:21.208 INFO:tasks.workunit.client.0.smithi063.stdout:0/722: readlink d1/df/d2c/l75 0 2024-09-16T01:25:21.209 INFO:tasks.workunit.client.0.smithi063.stdout:2/783: write d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d34/d56/ff7 [227196,61266] 0 2024-09-16T01:25:21.210 INFO:tasks.workunit.client.0.smithi063.stdout:3/689: creat d2/d11/d37/d40/d5e/d3b/d68/d6d/de5/ff8 x:0 0 0 2024-09-16T01:25:21.210 INFO:tasks.workunit.client.0.smithi063.stdout:7/612: write d7/f77 [3031276,21893] 0 2024-09-16T01:25:21.211 INFO:tasks.workunit.client.0.smithi063.stdout:5/733: getdents d5/d18/d29/d104 0 2024-09-16T01:25:21.211 INFO:tasks.workunit.client.0.smithi063.stdout:5/734: fdatasync d5/fef 0 2024-09-16T01:25:21.213 INFO:tasks.workunit.client.0.smithi063.stdout:7/613: truncate d7/d56/d57/f5c 4323848 0 2024-09-16T01:25:21.213 INFO:tasks.workunit.client.0.smithi063.stdout:3/690: creat d2/d11/d37/d40/d5e/d3b/d68/d6d/ff9 x:0 0 0 2024-09-16T01:25:21.213 INFO:tasks.workunit.client.0.smithi063.stdout:2/784: creat d3/d7/d8/d19/d8c/d21/d28/d8a/db7/f110 x:0 0 0 2024-09-16T01:25:21.215 INFO:tasks.workunit.client.0.smithi063.stdout:5/735: getdents d5/d90 0 2024-09-16T01:25:21.216 INFO:tasks.workunit.client.0.smithi063.stdout:7/614: symlink d7/d1c/d1f/d29/d72/d9e/lc5 0 2024-09-16T01:25:21.217 INFO:tasks.workunit.client.0.smithi063.stdout:2/785: creat d3/d7/d8/d19/d8c/d21/d28/f111 x:0 0 0 2024-09-16T01:25:21.218 INFO:tasks.workunit.client.0.smithi063.stdout:5/736: write d5/d18/d29/d48/d98/f84 [4718190,93402] 0 2024-09-16T01:25:21.221 INFO:tasks.workunit.client.0.smithi063.stdout:2/786: rmdir d3/d7/d8/d19 39 2024-09-16T01:25:21.221 INFO:tasks.workunit.client.0.smithi063.stdout:7/615: chown d7/d1c/d1f/d29/dbf/l35 604885 1 2024-09-16T01:25:21.221 INFO:tasks.workunit.client.0.smithi063.stdout:5/737: mkdir d5/d18/d29/d48/de2/de4/d105 0 2024-09-16T01:25:21.222 INFO:tasks.workunit.client.0.smithi063.stdout:3/691: dwrite d2/d11/d37/d40/d5e/f55 [0,4194304] 0 2024-09-16T01:25:21.223 INFO:tasks.workunit.client.0.smithi063.stdout:7/616: write d7/f9 [6925739,110104] 0 2024-09-16T01:25:21.225 INFO:tasks.workunit.client.0.smithi063.stdout:5/738: creat d5/d12/d91/d72/f106 x:0 0 0 2024-09-16T01:25:21.226 INFO:tasks.workunit.client.0.smithi063.stdout:2/787: readlink d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d37/d4f/da7/lad 0 2024-09-16T01:25:21.228 INFO:tasks.workunit.client.0.smithi063.stdout:7/617: truncate d7/d1c/d1f/d66/d70/f94 299324 0 2024-09-16T01:25:21.231 INFO:tasks.workunit.client.0.smithi063.stdout:5/739: rename d5/d18/d29/d48/d7b/f65 to d5/d18/d29/d48/d98/f107 0 2024-09-16T01:25:21.233 INFO:tasks.workunit.client.0.smithi063.stdout:5/740: rmdir d5/d18 39 2024-09-16T01:25:21.239 INFO:tasks.workunit.client.0.smithi063.stdout:5/741: link d5/d18/d29/d48/d98/d94/f92 d5/d7f/df1/f108 0 2024-09-16T01:25:21.242 INFO:tasks.workunit.client.0.smithi063.stdout:2/788: truncate d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d37/d4f/f63 1403206 0 2024-09-16T01:25:21.243 INFO:tasks.workunit.client.0.smithi063.stdout:2/789: readlink d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d34/d45/le6 0 2024-09-16T01:25:21.246 INFO:tasks.workunit.client.0.smithi063.stdout:2/790: symlink d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d37/d4f/dce/l112 0 2024-09-16T01:25:21.247 INFO:tasks.workunit.client.0.smithi063.stdout:5/742: dread d5/d18/d29/d48/d98/d94/f92 [0,4194304] 0 2024-09-16T01:25:21.248 INFO:tasks.workunit.client.0.smithi063.stdout:2/791: symlink d3/d7/d8/d19/d8c/d21/d28/d8a/da1/db6/l113 0 2024-09-16T01:25:21.249 INFO:tasks.workunit.client.0.smithi063.stdout:2/792: readlink d3/d7/d8/d19/d3c/l42 0 2024-09-16T01:25:21.249 INFO:tasks.workunit.client.0.smithi063.stdout:5/743: creat d5/d18/d29/d104/f109 x:0 0 0 2024-09-16T01:25:21.251 INFO:tasks.workunit.client.0.smithi063.stdout:5/744: creat d5/d18/d29/d48/dad/f10a x:0 0 0 2024-09-16T01:25:21.252 INFO:tasks.workunit.client.0.smithi063.stdout:5/745: dread - d5/d18/d29/d48/d7b/d85/f102 zero size 2024-09-16T01:25:21.253 INFO:tasks.workunit.client.0.smithi063.stdout:5/746: write d5/d18/d29/f97 [3690758,72854] 0 2024-09-16T01:25:21.255 INFO:tasks.workunit.client.0.smithi063.stdout:5/747: creat d5/d90/f10b x:0 0 0 2024-09-16T01:25:21.255 INFO:tasks.workunit.client.0.smithi063.stdout:5/748: stat d5/d12/d91/d72/fb3 0 2024-09-16T01:25:21.258 INFO:tasks.workunit.client.0.smithi063.stdout:5/749: creat d5/d7f/f10c x:0 0 0 2024-09-16T01:25:21.258 INFO:tasks.workunit.client.0.smithi063.stdout:5/750: stat d5/d18/f24 0 2024-09-16T01:25:21.259 INFO:tasks.workunit.client.0.smithi063.stdout:2/793: write d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d34/d56/f96 [643751,118453] 0 2024-09-16T01:25:21.260 INFO:tasks.workunit.client.0.smithi063.stdout:5/751: chown d5/c33 178999 1 2024-09-16T01:25:21.261 INFO:tasks.workunit.client.0.smithi063.stdout:2/794: dread - d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d34/f104 zero size 2024-09-16T01:25:21.262 INFO:tasks.workunit.client.0.smithi063.stdout:5/752: unlink d5/d7f/da3/cdc 0 2024-09-16T01:25:21.266 INFO:tasks.workunit.client.0.smithi063.stdout:5/753: rename d5/d18/d29/d48/d7b/d85/cc6 to d5/d18/d29/d48/c10d 0 2024-09-16T01:25:21.267 INFO:tasks.workunit.client.0.smithi063.stdout:2/795: dwrite d3/d7/d8/d19/d8c/d21/f99 [0,4194304] 0 2024-09-16T01:25:21.268 INFO:tasks.workunit.client.0.smithi063.stdout:5/754: chown d5/d18/d29/f97 458201552 1 2024-09-16T01:25:21.269 INFO:tasks.workunit.client.0.smithi063.stdout:2/796: dread - d3/d7/d8/d19/d8c/d21/d9c/dd4/ff9 zero size 2024-09-16T01:25:21.270 INFO:tasks.workunit.client.0.smithi063.stdout:5/755: unlink d5/d18/d29/d48/d98/d94/c7c 0 2024-09-16T01:25:21.271 INFO:tasks.workunit.client.0.smithi063.stdout:2/797: creat d3/d7/d8/d19/f114 x:0 0 0 2024-09-16T01:25:21.273 INFO:tasks.workunit.client.0.smithi063.stdout:2/798: write d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d34/d56/f96 [1678005,1203] 0 2024-09-16T01:25:21.274 INFO:tasks.workunit.client.0.smithi063.stdout:5/756: link d5/d18/d29/d48/d7b/d85/fe7 d5/d12/d91/f10e 0 2024-09-16T01:25:21.275 INFO:tasks.workunit.client.0.smithi063.stdout:2/799: symlink d3/d7/d8/d19/d8c/d21/d28/d4e/d105/d37/l115 0 2024-09-16T01:25:21.281 INFO:tasks.workunit.client.0.smithi063.stdout:5/757: dwrite d5/d90/f10b [0,4194304] 0 2024-09-16T01:25:21.284 INFO:tasks.workunit.client.0.smithi063.stdout:5/758: mknod d5/d7f/dc0/c10f 0 2024-09-16T01:25:21.284 INFO:tasks.workunit.client.0.smithi063.stdout:2/800: dwrite d3/d7/d8/d19/d8c/d21/d28/d4e/fa0 [0,4194304] 0 2024-09-16T01:25:21.287 INFO:tasks.workunit.client.0.smithi063.stdout:5/759: symlink d5/d7f/l110 0 2024-09-16T01:25:21.290 INFO:tasks.workunit.client.0.smithi063.stdout:2/801: dread d3/d7/d8/d19/d3c/d53/d7f/d80/fdd [0,4194304] 0 2024-09-16T01:25:21.293 INFO:tasks.workunit.client.0.smithi063.stdout:1/701: sync 2024-09-16T01:25:21.296 INFO:tasks.workunit.client.0.smithi063.stdout:5/760: dwrite d5/d18/d29/d48/dad/f10a [0,4194304] 0 2024-09-16T01:25:21.296 INFO:tasks.workunit.client.0.smithi063.stdout:1/702: truncate d1/f3 4843577 0 2024-09-16T01:25:21.298 INFO:tasks.workunit.client.0.smithi063.stdout:5/761: chown d5/d18/d29/d48/d66/c8d 1524 1 2024-09-16T01:25:21.300 INFO:tasks.workunit.client.0.smithi063.stdout:2/802: rename d3/d7/d8/d19/d8c/d21/d28 to d3/d7/d8/d19/d8c/d21/d9c/d116 0 2024-09-16T01:25:21.300 INFO:tasks.workunit.client.0.smithi063.stdout:1/703: mkdir d1/d5/d82/de8 0 2024-09-16T01:25:21.301 INFO:tasks.workunit.client.0.smithi063.stdout:5/762: unlink d5/d18/d29/d52/l55 0 2024-09-16T01:25:21.302 INFO:tasks.workunit.client.0.smithi063.stdout:2/803: mknod d3/d7/d8/d19/d3c/d53/d7f/c117 0 2024-09-16T01:25:21.304 INFO:tasks.workunit.client.0.smithi063.stdout:1/704: getdents d1/d5/d82/d9b/d77/d86/dc6 0 2024-09-16T01:25:21.305 INFO:tasks.workunit.client.0.smithi063.stdout:2/804: truncate d3/d7/d8/d19/d8c/d21/d9c/d116/d8a/ff0 825590 0 2024-09-16T01:25:21.306 INFO:tasks.workunit.client.0.smithi063.stdout:5/763: link d5/d12/f13 d5/d18/d29/d48/d98/d94/f111 0 2024-09-16T01:25:21.309 INFO:tasks.workunit.client.0.smithi063.stdout:5/764: write d5/d18/f39 [3727468,50440] 0 2024-09-16T01:25:21.309 INFO:tasks.workunit.client.0.smithi063.stdout:2/805: mkdir d3/d7/d8/d19/d8c/dcc/d118 0 2024-09-16T01:25:21.312 INFO:tasks.workunit.client.0.smithi063.stdout:5/765: symlink d5/d7f/l112 0 2024-09-16T01:25:21.312 INFO:tasks.workunit.client.0.smithi063.stdout:1/705: dwrite d1/d5/f11 [0,4194304] 0 2024-09-16T01:25:21.313 INFO:tasks.workunit.client.0.smithi063.stdout:5/766: chown d5/d18/l27 4167661 1 2024-09-16T01:25:21.313 INFO:tasks.workunit.client.0.smithi063.stdout:2/806: write d3/d7/d8/d19/d8c/d21/d9c/d116/d4e/d105/d34/d45/d6e/fdb [1785569,97598] 0 2024-09-16T01:25:21.317 INFO:tasks.workunit.client.0.smithi063.stdout:1/706: write d1/d5/d82/d9b/d77/d7d/dc2/f35 [4540139,69845] 0 2024-09-16T01:25:21.317 INFO:tasks.workunit.client.0.smithi063.stdout:5/767: mknod d5/d18/d29/d48/d66/db1/dfc/c113 0 2024-09-16T01:25:21.318 INFO:tasks.workunit.client.0.smithi063.stdout:5/768: read d5/d18/d29/d48/d98/d94/f3d [914858,50832] 0 2024-09-16T01:25:21.319 INFO:tasks.workunit.client.0.smithi063.stdout:2/807: link d3/d7/d8/d19/d8c/c97 d3/d7/d8/d19/d8c/c119 0 2024-09-16T01:25:21.325 INFO:tasks.workunit.client.0.smithi063.stdout:5/769: link d5/d12/l2b d5/d18/d29/d48/d7b/d85/l114 0 2024-09-16T01:25:21.328 INFO:tasks.workunit.client.0.smithi063.stdout:5/770: mkdir d5/d18/d29/d48/d98/d115 0 2024-09-16T01:25:21.329 INFO:tasks.workunit.client.0.smithi063.stdout:1/707: dread d1/d5/d15/d18/f69 [0,4194304] 0 2024-09-16T01:25:21.330 INFO:tasks.workunit.client.0.smithi063.stdout:5/771: mkdir d5/d18/d29/d48/d98/d116 0 2024-09-16T01:25:21.333 INFO:tasks.workunit.client.0.smithi063.stdout:5/772: unlink d5/d12/d91/d72/fb9 0 2024-09-16T01:25:21.337 INFO:tasks.workunit.client.0.smithi063.stdout:1/708: dwrite d1/d5/d6f/dab/fbb [0,4194304] 0 2024-09-16T01:25:21.337 INFO:tasks.workunit.client.0.smithi063.stdout:5/773: write d5/d12/f8b [262347,95014] 0 2024-09-16T01:25:21.341 INFO:tasks.workunit.client.0.smithi063.stdout:2/808: dwrite d3/d7/d8/d19/d8c/d21/d9c/d116/d4e/d105/d34/d45/fc4 [0,4194304] 0 2024-09-16T01:25:21.341 INFO:tasks.workunit.client.0.smithi063.stdout:5/774: chown d5/d18/d29/d48/d98/d94/c46 14380 1 2024-09-16T01:25:21.344 INFO:tasks.workunit.client.0.smithi063.stdout:1/709: rename d1/d5/d15/c2a to d1/d5/d82/de8/ce9 0 2024-09-16T01:25:21.347 INFO:tasks.workunit.client.0.smithi063.stdout:2/809: creat d3/d7/d8/d19/d8c/d21/d9c/d116/d4e/d105/d37/d4f/f11a x:0 0 0 2024-09-16T01:25:21.348 INFO:tasks.workunit.client.0.smithi063.stdout:5/775: rename d5/d12/d91/d72/feb to d5/d7f/dcb/f117 0 2024-09-16T01:25:21.350 INFO:tasks.workunit.client.0.smithi063.stdout:2/810: creat d3/d7/f11b x:0 0 0 2024-09-16T01:25:21.351 INFO:tasks.workunit.client.0.smithi063.stdout:5/776: rename d5/d7f/dc0 to d5/d18/d29/d48/d98/d118 0 2024-09-16T01:25:21.352 INFO:tasks.workunit.client.0.smithi063.stdout:2/811: mknod d3/d7/d8/df1/c11c 0 2024-09-16T01:25:21.354 INFO:tasks.workunit.client.0.smithi063.stdout:5/777: write d5/f38 [2853739,82420] 0 2024-09-16T01:25:21.355 INFO:tasks.workunit.client.0.smithi063.stdout:2/812: unlink d3/d7/d8/d19/d8c/d21/d9c/d116/d4e/d105/d37/d4f/f94 0 2024-09-16T01:25:21.357 INFO:tasks.workunit.client.0.smithi063.stdout:2/813: readlink d3/d7/d8/d19/d8c/d21/d9c/d116/d4e/d105/d37/d4f/le3 0 2024-09-16T01:25:21.358 INFO:tasks.workunit.client.0.smithi063.stdout:1/710: dread d1/d5/f7 [0,4194304] 0 2024-09-16T01:25:21.359 INFO:tasks.workunit.client.0.smithi063.stdout:2/814: symlink d3/dbc/l11d 0 2024-09-16T01:25:21.360 INFO:tasks.workunit.client.0.smithi063.stdout:1/711: chown d1/d5/d15/d1b/f39 3 1 2024-09-16T01:25:21.361 INFO:tasks.workunit.client.0.smithi063.stdout:1/712: fdatasync d1/d12/d21/fcc 0 2024-09-16T01:25:21.362 INFO:tasks.workunit.client.0.smithi063.stdout:2/815: symlink d3/d7/d8/d19/d3c/d53/d7f/d80/l11e 0 2024-09-16T01:25:21.363 INFO:tasks.workunit.client.0.smithi063.stdout:1/713: unlink d1/d12/f41 0 2024-09-16T01:25:21.363 INFO:tasks.workunit.client.0.smithi063.stdout:5/778: dread d5/d18/d29/d52/f5c [0,4194304] 0 2024-09-16T01:25:21.365 INFO:tasks.workunit.client.0.smithi063.stdout:5/779: write d5/d12/f8b [3395311,76670] 0 2024-09-16T01:25:21.365 INFO:tasks.workunit.client.0.smithi063.stdout:2/816: write d3/d7/d8/d19/d8c/d21/d9c/d116/d4e/d105/fac [1430026,54599] 0 2024-09-16T01:25:21.366 INFO:tasks.workunit.client.0.smithi063.stdout:1/714: fdatasync d1/d5/d15/d18/fca 0 2024-09-16T01:25:21.368 INFO:tasks.workunit.client.0.smithi063.stdout:5/780: truncate d5/d12/f43 2058846 0 2024-09-16T01:25:21.371 INFO:tasks.workunit.client.0.smithi063.stdout:2/817: mknod d3/d7/d8/d19/d8c/d21/d9c/d116/d4e/d105/d34/d72/c11f 0 2024-09-16T01:25:21.371 INFO:tasks.workunit.client.0.smithi063.stdout:5/781: dread d5/d90/f99 [0,4194304] 0 2024-09-16T01:25:21.373 INFO:tasks.workunit.client.0.smithi063.stdout:1/715: dwrite d1/d5/d82/d9b/f4e [0,4194304] 0 2024-09-16T01:25:21.374 INFO:tasks.workunit.client.0.smithi063.stdout:5/782: unlink d5/f17 0 2024-09-16T01:25:21.378 INFO:tasks.workunit.client.0.smithi063.stdout:1/716: creat d1/d5/d15/d1b/fea x:0 0 0 2024-09-16T01:25:21.378 INFO:tasks.workunit.client.0.smithi063.stdout:2/818: mkdir d3/d7/d8/df1/df3/d120 0 2024-09-16T01:25:21.379 INFO:tasks.workunit.client.0.smithi063.stdout:2/819: readlink d3/d7/d8/d19/d8c/d21/ldf 0 2024-09-16T01:25:21.379 INFO:tasks.workunit.client.0.smithi063.stdout:5/783: symlink d5/d18/d29/d48/d66/l119 0 2024-09-16T01:25:21.380 INFO:tasks.workunit.client.0.smithi063.stdout:1/717: mknod d1/d5/d15/ceb 0 2024-09-16T01:25:21.381 INFO:tasks.workunit.client.0.smithi063.stdout:5/784: mkdir d5/d7f/da3/de3/d11a 0 2024-09-16T01:25:21.382 INFO:tasks.workunit.client.0.smithi063.stdout:1/718: mkdir d1/d5/d15/d18/db6/dec 0 2024-09-16T01:25:21.384 INFO:tasks.workunit.client.0.smithi063.stdout:2/820: mknod d3/d7/d8/d19/d3c/c121 0 2024-09-16T01:25:21.390 INFO:tasks.workunit.client.0.smithi063.stdout:5/785: dwrite f3 [4194304,4194304] 0 2024-09-16T01:25:21.392 INFO:tasks.workunit.client.0.smithi063.stdout:2/821: rename d3/d7/d8/d19/d8c/d21/d9c/d116 to d3/d7/d8/d19/d8c/d21/d9c/dd4/d122 0 2024-09-16T01:25:21.393 INFO:tasks.workunit.client.0.smithi063.stdout:2/822: chown d3/f4b 104 1 2024-09-16T01:25:21.394 INFO:tasks.workunit.client.0.smithi063.stdout:5/786: link d5/d18/d29/d48/d98/cb6 d5/d12/d91/d72/c11b 0 2024-09-16T01:25:21.399 INFO:tasks.workunit.client.0.smithi063.stdout:2/823: dwrite d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/da1/f47 [0,4194304] 0 2024-09-16T01:25:21.400 INFO:tasks.workunit.client.0.smithi063.stdout:5/787: symlink d5/d18/d29/d48/d7b/d85/df9/l11c 0 2024-09-16T01:25:21.403 INFO:tasks.workunit.client.0.smithi063.stdout:5/788: creat d5/d90/f11d x:0 0 0 2024-09-16T01:25:21.404 INFO:tasks.workunit.client.0.smithi063.stdout:5/789: readlink d5/d7f/df1/ld1 0 2024-09-16T01:25:21.406 INFO:tasks.workunit.client.0.smithi063.stdout:5/790: fsync d5/d18/d29/d48/d98/d118/ff3 0 2024-09-16T01:25:21.407 INFO:tasks.workunit.client.0.smithi063.stdout:2/824: dwrite d3/d7/d8/d19/fa5 [0,4194304] 0 2024-09-16T01:25:21.408 INFO:tasks.workunit.client.0.smithi063.stdout:5/791: chown d5/d12/f40 439 1 2024-09-16T01:25:21.410 INFO:tasks.workunit.client.0.smithi063.stdout:2/825: creat d3/d7/d8/df1/f123 x:0 0 0 2024-09-16T01:25:21.412 INFO:tasks.workunit.client.0.smithi063.stdout:5/792: creat d5/d18/d29/d48/d98/d116/f11e x:0 0 0 2024-09-16T01:25:21.413 INFO:tasks.workunit.client.0.smithi063.stdout:2/826: mkdir d3/d7/d8/d19/d3c/d53/d7f/d80/d124 0 2024-09-16T01:25:21.416 INFO:tasks.workunit.client.0.smithi063.stdout:5/793: truncate d5/d12/f49 2791094 0 2024-09-16T01:25:21.417 INFO:tasks.workunit.client.0.smithi063.stdout:5/794: dread - d5/d18/d29/d48/d7b/dc2/fc4 zero size 2024-09-16T01:25:21.418 INFO:tasks.workunit.client.0.smithi063.stdout:5/795: truncate d5/fa1 443215 0 2024-09-16T01:25:21.418 INFO:tasks.workunit.client.0.smithi063.stdout:5/796: read - d5/d7f/df1/fd8 zero size 2024-09-16T01:25:21.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/827: link d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/lba d3/d7/d8/d19/d3c/d58/dff/l125 0 2024-09-16T01:25:21.420 INFO:tasks.workunit.client.0.smithi063.stdout:2/828: fdatasync d3/f51 0 2024-09-16T01:25:21.420 INFO:tasks.workunit.client.0.smithi063.stdout:2/829: chown d3/d7/d8/d19 0 1 2024-09-16T01:25:21.421 INFO:tasks.workunit.client.0.smithi063.stdout:5/797: creat d5/d12/d91/d72/f11f x:0 0 0 2024-09-16T01:25:21.423 INFO:tasks.workunit.client.0.smithi063.stdout:2/830: unlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/l10e 0 2024-09-16T01:25:21.423 INFO:tasks.workunit.client.0.smithi063.stdout:4/680: sync 2024-09-16T01:25:21.423 INFO:tasks.workunit.client.0.smithi063.stdout:6/662: sync 2024-09-16T01:25:21.425 INFO:tasks.workunit.client.0.smithi063.stdout:6/663: readlink d3/d48/d28/d3e/d44/d8c/l9d 0 2024-09-16T01:25:21.425 INFO:tasks.workunit.client.0.smithi063.stdout:4/681: chown d5/d3b/df/d1c/d29/d20/l50 4311 1 2024-09-16T01:25:21.426 INFO:tasks.workunit.client.0.smithi063.stdout:6/664: write d3/d30/d39/dac/db5/dcf/fea [608238,5248] 0 2024-09-16T01:25:21.426 INFO:tasks.workunit.client.0.smithi063.stdout:4/682: mknod d5/d3b/d5c/cde 0 2024-09-16T01:25:21.427 INFO:tasks.workunit.client.0.smithi063.stdout:6/665: fsync d3/f13 0 2024-09-16T01:25:21.431 INFO:tasks.workunit.client.0.smithi063.stdout:2/831: rmdir d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/dfc 0 2024-09-16T01:25:21.432 INFO:tasks.workunit.client.0.smithi063.stdout:6/666: write d3/d48/d28/d3e/d44/da4/d5a/fe2 [170482,115852] 0 2024-09-16T01:25:21.435 INFO:tasks.workunit.client.0.smithi063.stdout:4/683: getdents d5/d3b/df/d1c 0 2024-09-16T01:25:21.435 INFO:tasks.workunit.client.0.smithi063.stdout:6/667: creat d3/d48/d28/d3e/d44/da4/d5a/d81/fed x:0 0 0 2024-09-16T01:25:21.437 INFO:tasks.workunit.client.0.smithi063.stdout:6/668: fdatasync d3/d30/d39/dac/db5/da7/fc3 0 2024-09-16T01:25:21.437 INFO:tasks.workunit.client.0.smithi063.stdout:5/798: dread d5/f15 [0,4194304] 0 2024-09-16T01:25:21.440 INFO:tasks.workunit.client.0.smithi063.stdout:2/832: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/da1/db6/fe5 [337856,75826] 0 2024-09-16T01:25:21.441 INFO:tasks.workunit.client.0.smithi063.stdout:5/799: fdatasync d5/d12/f13 0 2024-09-16T01:25:21.441 INFO:tasks.workunit.client.0.smithi063.stdout:4/684: dread d5/d3b/df/d1c/d29/d32/f3c [0,4194304] 0 2024-09-16T01:25:21.442 INFO:tasks.workunit.client.0.smithi063.stdout:6/669: rename d3/d30/d39/d69/d95/dd1 to d3/d30/d39/dac/db5/dcf/dee 0 2024-09-16T01:25:21.443 INFO:tasks.workunit.client.0.smithi063.stdout:2/833: chown d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/fd5 2 1 2024-09-16T01:25:21.443 INFO:tasks.workunit.client.0.smithi063.stdout:5/800: mkdir d5/d18/d29/d48/d66/db1/d120 0 2024-09-16T01:25:21.447 INFO:tasks.workunit.client.0.smithi063.stdout:4/685: dread d5/d3b/d57/d66/f6e [0,4194304] 0 2024-09-16T01:25:21.449 INFO:tasks.workunit.client.0.smithi063.stdout:5/801: write d5/d18/d29/d48/d7b/d85/fe7 [448172,36246] 0 2024-09-16T01:25:21.450 INFO:tasks.workunit.client.0.smithi063.stdout:2/834: dwrite d3/d7/d8/d19/f44 [4194304,4194304] 0 2024-09-16T01:25:21.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/686: mkdir d5/d3b/df/d1c/d29/d20/d98/ddf 0 2024-09-16T01:25:21.452 INFO:tasks.workunit.client.0.smithi063.stdout:5/802: creat d5/d18/d29/d48/dad/f121 x:0 0 0 2024-09-16T01:25:21.455 INFO:tasks.workunit.client.0.smithi063.stdout:6/670: truncate d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/f83 3729874 0 2024-09-16T01:25:21.457 INFO:tasks.workunit.client.0.smithi063.stdout:4/687: rename d5/d3b/d57/d66/d9b/c73 to d5/d3b/df/d1c/d29/dd4/dbc/ce0 0 2024-09-16T01:25:21.460 INFO:tasks.workunit.client.0.smithi063.stdout:5/803: rename d5/d7f/dcb/fe0 to d5/d18/d29/d48/de2/f122 0 2024-09-16T01:25:21.460 INFO:tasks.workunit.client.0.smithi063.stdout:6/671: unlink d3/c18 0 2024-09-16T01:25:21.461 INFO:tasks.workunit.client.0.smithi063.stdout:2/835: getdents d3/d7/d8/d19 0 2024-09-16T01:25:21.462 INFO:tasks.workunit.client.0.smithi063.stdout:4/688: symlink d5/d3b/df/d1c/d29/d32/le1 0 2024-09-16T01:25:21.465 INFO:tasks.workunit.client.0.smithi063.stdout:4/689: creat d5/d3b/d57/d66/fe2 x:0 0 0 2024-09-16T01:25:21.465 INFO:tasks.workunit.client.0.smithi063.stdout:2/836: mkdir d3/d7/d8/d19/d126 0 2024-09-16T01:25:21.466 INFO:tasks.workunit.client.0.smithi063.stdout:5/804: write d5/f51 [729647,70647] 0 2024-09-16T01:25:21.468 INFO:tasks.workunit.client.0.smithi063.stdout:2/837: read d3/d7/d8/d19/fa5 [572585,44225] 0 2024-09-16T01:25:21.468 INFO:tasks.workunit.client.0.smithi063.stdout:4/690: creat d5/d3b/d57/d66/d9b/d7a/fe3 x:0 0 0 2024-09-16T01:25:21.472 INFO:tasks.workunit.client.0.smithi063.stdout:4/691: getdents d5/d3b/df/d1c/d29/d32/d60/ddb 0 2024-09-16T01:25:21.474 INFO:tasks.workunit.client.0.smithi063.stdout:4/692: chown d5/d3b/d5c/da7/fd8 522251 1 2024-09-16T01:25:21.474 INFO:tasks.workunit.client.0.smithi063.stdout:6/672: dread d3/d48/d28/d3e/d44/d52/f9a [4194304,4194304] 0 2024-09-16T01:25:21.477 INFO:tasks.workunit.client.0.smithi063.stdout:2/838: rename d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/dc2/ffd to d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/f127 0 2024-09-16T01:25:21.477 INFO:tasks.workunit.client.0.smithi063.stdout:5/805: dwrite d5/d7f/df1/f108 [0,4194304] 0 2024-09-16T01:25:21.478 INFO:tasks.workunit.client.0.smithi063.stdout:6/673: mkdir d3/d48/def 0 2024-09-16T01:25:21.479 INFO:tasks.workunit.client.0.smithi063.stdout:4/693: truncate d5/d3b/df/d1c/d29/d32/fc1 463297 0 2024-09-16T01:25:21.479 INFO:tasks.workunit.client.0.smithi063.stdout:6/674: chown d3/d30/f78 98 1 2024-09-16T01:25:21.481 INFO:tasks.workunit.client.0.smithi063.stdout:2/839: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/fac [415742,116590] 0 2024-09-16T01:25:21.483 INFO:tasks.workunit.client.0.smithi063.stdout:5/806: getdents d5/d18/d29/d48/d7b/d85 0 2024-09-16T01:25:21.485 INFO:tasks.workunit.client.0.smithi063.stdout:5/807: write d5/d18/d29/d48/dad/f10a [3496025,15148] 0 2024-09-16T01:25:21.485 INFO:tasks.workunit.client.0.smithi063.stdout:6/675: creat d3/d48/d28/d3e/d44/da4/d5a/d6b/ff0 x:0 0 0 2024-09-16T01:25:21.486 INFO:tasks.workunit.client.0.smithi063.stdout:4/694: getdents d5/d3b/df/d1c/d29/d20 0 2024-09-16T01:25:21.486 INFO:tasks.workunit.client.0.smithi063.stdout:2/840: unlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/ff0 0 2024-09-16T01:25:21.489 INFO:tasks.workunit.client.0.smithi063.stdout:4/695: write d5/d3b/df/d1c/fdc [89733,112893] 0 2024-09-16T01:25:21.489 INFO:tasks.workunit.client.0.smithi063.stdout:5/808: chown d5/d12/fa4 42683 1 2024-09-16T01:25:21.489 INFO:tasks.workunit.client.0.smithi063.stdout:2/841: rmdir d3/d7/d8/df1/df3 39 2024-09-16T01:25:21.490 INFO:tasks.workunit.client.0.smithi063.stdout:6/676: symlink d3/d48/d28/d3e/d68/lf1 0 2024-09-16T01:25:21.491 INFO:tasks.workunit.client.0.smithi063.stdout:4/696: mknod d5/d3b/d57/d68/d90/ce4 0 2024-09-16T01:25:21.492 INFO:tasks.workunit.client.0.smithi063.stdout:2/842: chown d3/d7/d8/d19/d3c/d53/d7f/c117 2626367 1 2024-09-16T01:25:21.493 INFO:tasks.workunit.client.0.smithi063.stdout:5/809: symlink d5/d18/d29/d48/de2/de4/d105/l123 0 2024-09-16T01:25:21.493 INFO:tasks.workunit.client.0.smithi063.stdout:4/697: dread - d5/d3b/d57/d66/fe2 zero size 2024-09-16T01:25:21.493 INFO:tasks.workunit.client.0.smithi063.stdout:6/677: creat d3/d30/d39/dac/db5/dcf/dee/ff2 x:0 0 0 2024-09-16T01:25:21.495 INFO:tasks.workunit.client.0.smithi063.stdout:4/698: chown d5/d3b/d57/d66/d9b/d7a/f89 134 1 2024-09-16T01:25:21.496 INFO:tasks.workunit.client.0.smithi063.stdout:6/678: symlink d3/d48/d28/d3e/d44/lf3 0 2024-09-16T01:25:21.498 INFO:tasks.workunit.client.0.smithi063.stdout:2/843: dread d3/d77/f9e [0,4194304] 0 2024-09-16T01:25:21.498 INFO:tasks.workunit.client.0.smithi063.stdout:6/679: write d3/d48/d7e/d91/f8a [884442,26334] 0 2024-09-16T01:25:21.498 INFO:tasks.workunit.client.0.smithi063.stdout:4/699: mknod d5/d3b/df/d1c/d29/dd4/dbc/ce5 0 2024-09-16T01:25:21.503 INFO:tasks.workunit.client.0.smithi063.stdout:4/700: dwrite d5/d3b/d57/f7d [0,4194304] 0 2024-09-16T01:25:21.505 INFO:tasks.workunit.client.0.smithi063.stdout:6/680: dwrite d3/d48/d28/d3e/d44/d52/f9a [0,4194304] 0 2024-09-16T01:25:21.507 INFO:tasks.workunit.client.0.smithi063.stdout:4/701: unlink d5/d3b/df/d1c/c63 0 2024-09-16T01:25:21.514 INFO:tasks.workunit.client.0.smithi063.stdout:6/681: dwrite d3/d48/d28/f77 [0,4194304] 0 2024-09-16T01:25:21.518 INFO:tasks.workunit.client.0.smithi063.stdout:6/682: creat d3/d30/d39/dac/ddb/ff4 x:0 0 0 2024-09-16T01:25:21.518 INFO:tasks.workunit.client.0.smithi063.stdout:4/702: dwrite d5/d3b/df/d1c/d29/d32/d60/d61/fa4 [0,4194304] 0 2024-09-16T01:25:21.520 INFO:tasks.workunit.client.0.smithi063.stdout:6/683: chown d3/d48/d28 2548 1 2024-09-16T01:25:21.520 INFO:tasks.workunit.client.0.smithi063.stdout:4/703: stat d5/d3b/df/d1c/fdc 0 2024-09-16T01:25:21.523 INFO:tasks.workunit.client.0.smithi063.stdout:6/684: rmdir d3/d48/d28 39 2024-09-16T01:25:21.527 INFO:tasks.workunit.client.0.smithi063.stdout:6/685: readlink d3/d48/d28/d3e/d68/db4/lbd 0 2024-09-16T01:25:21.528 INFO:tasks.workunit.client.0.smithi063.stdout:4/704: dread d5/d3b/df/d1c/d29/f65 [0,4194304] 0 2024-09-16T01:25:21.529 INFO:tasks.workunit.client.0.smithi063.stdout:6/686: mknod d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/cf5 0 2024-09-16T01:25:21.532 INFO:tasks.workunit.client.0.smithi063.stdout:6/687: rename d3/c8 to d3/d48/d28/d3e/d44/da4/d5a/d81/cf6 0 2024-09-16T01:25:21.533 INFO:tasks.workunit.client.0.smithi063.stdout:6/688: fdatasync d3/d48/d28/d3e/d44/da4/d5a/f6d 0 2024-09-16T01:25:21.534 INFO:tasks.workunit.client.0.smithi063.stdout:4/705: write d5/d3b/d57/d66/d9b/d7a/fbb [2969787,47184] 0 2024-09-16T01:25:21.535 INFO:tasks.workunit.client.0.smithi063.stdout:4/706: chown d5/d3b/d57/d68/d90 1 1 2024-09-16T01:25:21.537 INFO:tasks.workunit.client.0.smithi063.stdout:6/689: link d3/d30/l3d d3/d48/d28/d3e/d44/da4/lf7 0 2024-09-16T01:25:21.542 INFO:tasks.workunit.client.0.smithi063.stdout:4/707: dwrite d5/d3b/df/d1c/d29/dd4/dbc/fd6 [4194304,4194304] 0 2024-09-16T01:25:21.544 INFO:tasks.workunit.client.0.smithi063.stdout:4/708: chown d5/d3b/df/d1c/d29/dd4/dbc/ce5 5 1 2024-09-16T01:25:21.545 INFO:tasks.workunit.client.0.smithi063.stdout:6/690: dwrite d3/d30/d39/d69/d95/db0/fec [0,4194304] 0 2024-09-16T01:25:21.551 INFO:tasks.workunit.client.0.smithi063.stdout:6/691: dread d3/d30/d39/dac/db5/dcf/fea [0,4194304] 0 2024-09-16T01:25:21.552 INFO:tasks.workunit.client.0.smithi063.stdout:4/709: dwrite d5/d3b/df/d1c/d29/d20/d30/fc3 [0,4194304] 0 2024-09-16T01:25:21.556 INFO:tasks.workunit.client.0.smithi063.stdout:6/692: write d3/d10/d49/fa8 [4497457,739] 0 2024-09-16T01:25:21.556 INFO:tasks.workunit.client.0.smithi063.stdout:6/693: fsync d3/d48/d28/f2e 0 2024-09-16T01:25:21.560 INFO:tasks.workunit.client.0.smithi063.stdout:6/694: dwrite d3/d10/f20 [0,4194304] 0 2024-09-16T01:25:21.569 INFO:tasks.workunit.client.0.smithi063.stdout:6/695: dwrite d3/d41/f7a [0,4194304] 0 2024-09-16T01:25:21.573 INFO:tasks.workunit.client.0.smithi063.stdout:6/696: creat d3/d48/ff8 x:0 0 0 2024-09-16T01:25:21.574 INFO:tasks.workunit.client.0.smithi063.stdout:4/710: dread d5/d3b/d57/d66/d9b/f8a [0,4194304] 0 2024-09-16T01:25:21.577 INFO:tasks.workunit.client.0.smithi063.stdout:6/697: rmdir d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d 39 2024-09-16T01:25:21.578 INFO:tasks.workunit.client.0.smithi063.stdout:4/711: symlink d5/d3b/d57/d68/dc5/le6 0 2024-09-16T01:25:21.578 INFO:tasks.workunit.client.0.smithi063.stdout:6/698: symlink d3/d30/d39/dac/db5/dcf/lf9 0 2024-09-16T01:25:21.579 INFO:tasks.workunit.client.0.smithi063.stdout:4/712: symlink d5/d3b/d57/d68/d90/le7 0 2024-09-16T01:25:21.580 INFO:tasks.workunit.client.0.smithi063.stdout:6/699: mknod d3/d48/d28/d3e/d44/da4/cfa 0 2024-09-16T01:25:21.581 INFO:tasks.workunit.client.0.smithi063.stdout:4/713: truncate d5/d3b/d57/d66/d9b/d7a/fdd 260742 0 2024-09-16T01:25:21.583 INFO:tasks.workunit.client.0.smithi063.stdout:6/700: truncate d3/d48/d28/d3e/d44/da4/d5a/f6d 814358 0 2024-09-16T01:25:21.585 INFO:tasks.workunit.client.0.smithi063.stdout:4/714: link d5/d3b/df/d1c/f31 d5/d3b/df/d1c/d29/d20/d98/fe8 0 2024-09-16T01:25:21.586 INFO:tasks.workunit.client.0.smithi063.stdout:6/701: mknod d3/d48/d28/d3e/d44/da4/d5a/cfb 0 2024-09-16T01:25:21.587 INFO:tasks.workunit.client.0.smithi063.stdout:4/715: chown d5/d3b/df/d1c/d29/d20/d98/fbd 107 1 2024-09-16T01:25:21.588 INFO:tasks.workunit.client.0.smithi063.stdout:4/716: stat d5/d3b/df/d1c/f53 0 2024-09-16T01:25:21.590 INFO:tasks.workunit.client.0.smithi063.stdout:4/717: creat d5/d3b/d57/dce/fe9 x:0 0 0 2024-09-16T01:25:21.590 INFO:tasks.workunit.client.0.smithi063.stdout:4/718: fdatasync d5/d3b/df/d1c/fdc 0 2024-09-16T01:25:21.591 INFO:tasks.workunit.client.0.smithi063.stdout:6/702: link d3/d48/d28/l38 d3/d30/d39/dac/db5/da7/lfc 0 2024-09-16T01:25:21.592 INFO:tasks.workunit.client.0.smithi063.stdout:4/719: fsync d5/d3b/df/d1c/d29/d20/d98/dcc/fd9 0 2024-09-16T01:25:21.592 INFO:tasks.workunit.client.0.smithi063.stdout:6/703: chown d3/d48/d28/d3e/d44/da4/c75 103428468 1 2024-09-16T01:25:21.594 INFO:tasks.workunit.client.0.smithi063.stdout:6/704: creat d3/d41/d89/ffd x:0 0 0 2024-09-16T01:25:21.596 INFO:tasks.workunit.client.0.smithi063.stdout:6/705: rmdir d3/d48/d28/d3e/d68 39 2024-09-16T01:25:21.596 INFO:tasks.workunit.client.0.smithi063.stdout:4/720: link d5/l10 d5/d3b/df/d1c/d29/lea 0 2024-09-16T01:25:21.596 INFO:tasks.workunit.client.0.smithi063.stdout:6/706: dread - d3/d48/f97 zero size 2024-09-16T01:25:21.598 INFO:tasks.workunit.client.0.smithi063.stdout:6/707: mknod d3/d48/d28/d3e/d44/cfe 0 2024-09-16T01:25:21.599 INFO:tasks.workunit.client.0.smithi063.stdout:9/772: sync 2024-09-16T01:25:21.601 INFO:tasks.workunit.client.0.smithi063.stdout:6/708: creat d3/d48/d28/d3e/fff x:0 0 0 2024-09-16T01:25:21.603 INFO:tasks.workunit.client.0.smithi063.stdout:9/773: dread d7/d4a/d4d/d96/da2/fe1 [0,4194304] 0 2024-09-16T01:25:21.605 INFO:tasks.workunit.client.0.smithi063.stdout:6/709: symlink d3/d48/d28/d3e/d44/da4/d5a/d6b/l100 0 2024-09-16T01:25:21.606 INFO:tasks.workunit.client.0.smithi063.stdout:6/710: dread - d3/d48/fda zero size 2024-09-16T01:25:21.611 INFO:tasks.workunit.client.0.smithi063.stdout:6/711: dwrite d3/d30/d39/d69/d95/db0/fec [0,4194304] 0 2024-09-16T01:25:21.614 INFO:tasks.workunit.client.0.smithi063.stdout:6/712: write d3/d30/d39/dac/db5/dcf/dee/fdc [497399,17104] 0 2024-09-16T01:25:21.615 INFO:tasks.workunit.client.0.smithi063.stdout:4/721: dwrite d5/d3b/d57/d68/f99 [0,4194304] 0 2024-09-16T01:25:21.615 INFO:tasks.workunit.client.0.smithi063.stdout:6/713: fsync d3/d48/d28/f77 0 2024-09-16T01:25:21.618 INFO:tasks.workunit.client.0.smithi063.stdout:4/722: creat d5/d3b/d57/d66/d9b/d7a/feb x:0 0 0 2024-09-16T01:25:21.621 INFO:tasks.workunit.client.0.smithi063.stdout:6/714: unlink d3/d48/d28/l38 0 2024-09-16T01:25:21.622 INFO:tasks.workunit.client.0.smithi063.stdout:4/723: symlink d5/d3b/df/d1c/d29/d20/d98/dcc/lec 0 2024-09-16T01:25:21.622 INFO:tasks.workunit.client.0.smithi063.stdout:6/715: symlink d3/d30/d39/dac/db5/dcf/l101 0 2024-09-16T01:25:21.623 INFO:tasks.workunit.client.0.smithi063.stdout:4/724: write d5/d3b/d57/d66/d9b/d7a/fbb [491633,84957] 0 2024-09-16T01:25:21.624 INFO:tasks.workunit.client.0.smithi063.stdout:6/716: readlink d3/d30/d39/dac/db5/dcf/dee/le7 0 2024-09-16T01:25:21.625 INFO:tasks.workunit.client.0.smithi063.stdout:4/725: mknod d5/d3b/df/d1c/d29/d20/d98/ced 0 2024-09-16T01:25:21.625 INFO:tasks.workunit.client.0.smithi063.stdout:6/717: write d3/d30/f78 [351845,67243] 0 2024-09-16T01:25:21.626 INFO:tasks.workunit.client.0.smithi063.stdout:6/718: dread - d3/d48/ff8 zero size 2024-09-16T01:25:21.628 INFO:tasks.workunit.client.0.smithi063.stdout:4/726: symlink d5/d3b/d57/d66/db7/dc9/lee 0 2024-09-16T01:25:21.630 INFO:tasks.workunit.client.0.smithi063.stdout:4/727: mkdir d5/d3b/d57/d66/d9b/d7a/def 0 2024-09-16T01:25:21.632 INFO:tasks.workunit.client.0.smithi063.stdout:4/728: truncate d5/d3b/df/d1c/d29/d32/f5e 4506826 0 2024-09-16T01:25:21.632 INFO:tasks.workunit.client.0.smithi063.stdout:6/719: rename d3/d48/d7e to d3/d30/d8d/d102 0 2024-09-16T01:25:21.633 INFO:tasks.workunit.client.0.smithi063.stdout:6/720: readlink d3/d48/d28/d3e/d44/d8c/l9d 0 2024-09-16T01:25:21.633 INFO:tasks.workunit.client.0.smithi063.stdout:4/729: write d5/d3b/d57/d66/f7c [970949,104740] 0 2024-09-16T01:25:21.636 INFO:tasks.workunit.client.0.smithi063.stdout:4/730: symlink d5/d3b/df/d1c/d29/dd4/lf0 0 2024-09-16T01:25:21.636 INFO:tasks.workunit.client.0.smithi063.stdout:6/721: rmdir d3/d48/d28/d3e/d44/da4/d5a 39 2024-09-16T01:25:21.636 INFO:tasks.workunit.client.0.smithi063.stdout:6/722: chown d3/d10/f2a 174 1 2024-09-16T01:25:21.637 INFO:tasks.workunit.client.0.smithi063.stdout:4/731: mkdir d5/d3b/df/d1c/d29/d20/d98/df1 0 2024-09-16T01:25:21.638 INFO:tasks.workunit.client.0.smithi063.stdout:6/723: write d3/d48/d28/d3e/d44/da4/d5a/d6b/ff0 [299124,72780] 0 2024-09-16T01:25:21.639 INFO:tasks.workunit.client.0.smithi063.stdout:4/732: mknod d5/d3b/d57/d66/cf2 0 2024-09-16T01:25:21.640 INFO:tasks.workunit.client.0.smithi063.stdout:4/733: chown d5/d3b/d57/d68/dc5 1425 1 2024-09-16T01:25:21.641 INFO:tasks.workunit.client.0.smithi063.stdout:4/734: chown d5/d3b/df/d1c/d29/f65 1 1 2024-09-16T01:25:21.643 INFO:tasks.workunit.client.0.smithi063.stdout:4/735: read d5/f8c [1559894,58417] 0 2024-09-16T01:25:21.649 INFO:tasks.workunit.client.0.smithi063.stdout:6/724: fsync d3/d10/d49/f5c 0 2024-09-16T01:25:21.651 INFO:tasks.workunit.client.0.smithi063.stdout:6/725: rmdir d3/d30/d39/d69/d95 39 2024-09-16T01:25:21.653 INFO:tasks.workunit.client.0.smithi063.stdout:6/726: read d3/d48/d28/d3e/d44/da4/fb7 [756434,102995] 0 2024-09-16T01:25:21.660 INFO:tasks.workunit.client.0.smithi063.stdout:6/727: dwrite d3/d48/d28/d3e/d68/db4/fc0 [0,4194304] 0 2024-09-16T01:25:21.661 INFO:tasks.workunit.client.0.smithi063.stdout:6/728: fsync d3/d10/d49/f5c 0 2024-09-16T01:25:21.661 INFO:tasks.workunit.client.0.smithi063.stdout:6/729: chown d3/d48/d28/f33 173 1 2024-09-16T01:25:21.667 INFO:tasks.workunit.client.0.smithi063.stdout:6/730: link d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/lc1 d3/d10/l103 0 2024-09-16T01:25:21.669 INFO:tasks.workunit.client.0.smithi063.stdout:6/731: symlink d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/l104 0 2024-09-16T01:25:21.672 INFO:tasks.workunit.client.0.smithi063.stdout:6/732: rmdir d3/d30/d39/d69/d95 39 2024-09-16T01:25:21.673 INFO:tasks.workunit.client.0.smithi063.stdout:6/733: chown d3/d48/d28/d3e/d44/da4/d5a/d6b/feb 36902523 1 2024-09-16T01:25:21.680 INFO:tasks.workunit.client.0.smithi063.stdout:6/734: truncate d3/d48/f24 1300782 0 2024-09-16T01:25:21.681 INFO:tasks.workunit.client.0.smithi063.stdout:6/735: mkdir d3/d41/d105 0 2024-09-16T01:25:21.683 INFO:tasks.workunit.client.0.smithi063.stdout:6/736: creat d3/d41/d105/f106 x:0 0 0 2024-09-16T01:25:21.689 INFO:tasks.workunit.client.0.smithi063.stdout:6/737: write d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/f83 [4412392,130487] 0 2024-09-16T01:25:21.692 INFO:tasks.workunit.client.0.smithi063.stdout:6/738: rename d3/d30/d39/dac/db5/dcf/dee/le7 to d3/d10/l107 0 2024-09-16T01:25:21.694 INFO:tasks.workunit.client.0.smithi063.stdout:6/739: creat d3/d48/d28/d3e/d68/de1/f108 x:0 0 0 2024-09-16T01:25:21.695 INFO:tasks.workunit.client.0.smithi063.stdout:6/740: symlink d3/d30/d39/dac/l109 0 2024-09-16T01:25:21.696 INFO:tasks.workunit.client.0.smithi063.stdout:6/741: dread - d3/d41/fbc zero size 2024-09-16T01:25:21.701 INFO:tasks.workunit.client.0.smithi063.stdout:6/742: dwrite d3/d48/d28/d3e/d44/da4/d5a/fe2 [0,4194304] 0 2024-09-16T01:25:21.703 INFO:tasks.workunit.client.0.smithi063.stdout:6/743: fsync d3/d30/f40 0 2024-09-16T01:25:21.709 INFO:tasks.workunit.client.0.smithi063.stdout:6/744: dwrite d3/d30/d8d/f8f [0,4194304] 0 2024-09-16T01:25:21.710 INFO:tasks.workunit.client.0.smithi063.stdout:6/745: stat d3/d48/d28/d3e/d68/de1/f108 0 2024-09-16T01:25:21.712 INFO:tasks.workunit.client.0.smithi063.stdout:6/746: creat d3/d10/d49/f10a x:0 0 0 2024-09-16T01:25:21.714 INFO:tasks.workunit.client.0.smithi063.stdout:6/747: readlink d3/d10/l103 0 2024-09-16T01:25:21.719 INFO:tasks.workunit.client.0.smithi063.stdout:6/748: creat d3/d48/d28/d3e/d44/da4/f10b x:0 0 0 2024-09-16T01:25:21.719 INFO:tasks.workunit.client.0.smithi063.stdout:0/723: sync 2024-09-16T01:25:21.719 INFO:tasks.workunit.client.0.smithi063.stdout:8/575: sync 2024-09-16T01:25:21.720 INFO:tasks.workunit.client.0.smithi063.stdout:8/576: chown d5/db/d12/d1a/d1e/d68/l72 196667596 1 2024-09-16T01:25:21.722 INFO:tasks.workunit.client.0.smithi063.stdout:8/577: chown d5/d9/cb9 15345628 1 2024-09-16T01:25:21.723 INFO:tasks.workunit.client.0.smithi063.stdout:6/749: unlink d3/d30/d39/d69/d95/db0/fe0 0 2024-09-16T01:25:21.723 INFO:tasks.workunit.client.0.smithi063.stdout:8/578: write d5/db/d12/d1a/d1e/d93/f9a [10900,62487] 0 2024-09-16T01:25:21.723 INFO:tasks.workunit.client.0.smithi063.stdout:0/724: getdents d1/d30/d95 0 2024-09-16T01:25:21.724 INFO:tasks.workunit.client.0.smithi063.stdout:0/725: dread - d1/df/ff1 zero size 2024-09-16T01:25:21.726 INFO:tasks.workunit.client.0.smithi063.stdout:8/579: read d5/d9/f88 [1072022,106629] 0 2024-09-16T01:25:21.726 INFO:tasks.workunit.client.0.smithi063.stdout:6/750: fsync d3/d48/d28/d3e/d44/da4/d5a/d6b/f82 0 2024-09-16T01:25:21.726 INFO:tasks.workunit.client.0.smithi063.stdout:0/726: dread - d1/d30/d52/d5a/d44/ff3 zero size 2024-09-16T01:25:21.728 INFO:tasks.workunit.client.0.smithi063.stdout:0/727: write d1/d30/d95/fc5 [342298,37313] 0 2024-09-16T01:25:21.728 INFO:tasks.workunit.client.0.smithi063.stdout:8/580: rmdir d5/db/d12/d1a/d1e/d93 39 2024-09-16T01:25:21.730 INFO:tasks.workunit.client.0.smithi063.stdout:6/751: rename d3/d30/d39/d69/d95/db0/cc2 to d3/d48/d28/d3e/d68/db4/c10c 0 2024-09-16T01:25:21.732 INFO:tasks.workunit.client.0.smithi063.stdout:8/581: creat d5/fc1 x:0 0 0 2024-09-16T01:25:21.732 INFO:tasks.workunit.client.0.smithi063.stdout:0/728: link d1/d30/d52/d5a/l23 d1/df/d2c/db6/l10b 0 2024-09-16T01:25:21.733 INFO:tasks.workunit.client.0.smithi063.stdout:6/752: rmdir d3/d48/d28/d3e/d44/da4/d5a/d81 39 2024-09-16T01:25:21.734 INFO:tasks.workunit.client.0.smithi063.stdout:0/729: unlink d1/d2e/d48/le6 0 2024-09-16T01:25:21.735 INFO:tasks.workunit.client.0.smithi063.stdout:6/753: write d3/d48/d28/d3e/d44/da4/d5a/f6d [624025,25226] 0 2024-09-16T01:25:21.736 INFO:tasks.workunit.client.0.smithi063.stdout:6/754: truncate d3/d30/d8d/fd0 348847 0 2024-09-16T01:25:21.737 INFO:tasks.workunit.client.0.smithi063.stdout:0/730: unlink d1/df/d2c/d43/f77 0 2024-09-16T01:25:21.737 INFO:tasks.workunit.client.0.smithi063.stdout:6/755: dread - d3/d48/d28/d3e/d68/fd5 zero size 2024-09-16T01:25:21.737 INFO:tasks.workunit.client.0.smithi063.stdout:8/582: truncate d5/db/d12/f57 628243 0 2024-09-16T01:25:21.738 INFO:tasks.workunit.client.0.smithi063.stdout:0/731: truncate d1/d1c/f78 1649755 0 2024-09-16T01:25:21.739 INFO:tasks.workunit.client.0.smithi063.stdout:0/732: truncate d1/df/f40 5021543 0 2024-09-16T01:25:21.740 INFO:tasks.workunit.client.0.smithi063.stdout:8/583: mknod d5/db/d12/d3d/d69/daa/d40/d4a/cc2 0 2024-09-16T01:25:21.742 INFO:tasks.workunit.client.0.smithi063.stdout:6/756: write d3/d48/d28/f2b [959732,123708] 0 2024-09-16T01:25:21.743 INFO:tasks.workunit.client.0.smithi063.stdout:6/757: readlink d3/d48/d28/d3e/d68/db4/lbd 0 2024-09-16T01:25:21.744 INFO:tasks.workunit.client.0.smithi063.stdout:6/758: fdatasync d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/faa 0 2024-09-16T01:25:21.746 INFO:tasks.workunit.client.0.smithi063.stdout:6/759: fsync d3/d48/d28/d3e/d44/da4/d5a/d6b/feb 0 2024-09-16T01:25:21.746 INFO:tasks.workunit.client.0.smithi063.stdout:8/584: link d5/db/d12/d1a/d60/d7a/f9f d5/db/d12/d1a/fc3 0 2024-09-16T01:25:21.753 INFO:tasks.workunit.client.0.smithi063.stdout:6/760: link d3/d48/d28/d3e/d44/da4/d5a/l5e d3/d30/d39/d69/d95/l10d 0 2024-09-16T01:25:21.753 INFO:tasks.workunit.client.0.smithi063.stdout:0/733: dread d1/d1c/f80 [0,4194304] 0 2024-09-16T01:25:21.756 INFO:tasks.workunit.client.0.smithi063.stdout:8/585: dread d5/d9/f88 [0,4194304] 0 2024-09-16T01:25:21.756 INFO:tasks.workunit.client.0.smithi063.stdout:0/734: link d1/l25 d1/df/d2c/dde/l10c 0 2024-09-16T01:25:21.758 INFO:tasks.workunit.client.0.smithi063.stdout:0/735: rmdir d1/d30/d52/d5a/d76 39 2024-09-16T01:25:21.758 INFO:tasks.workunit.client.0.smithi063.stdout:8/586: fdatasync d5/d9/d2f/f85 0 2024-09-16T01:25:21.759 INFO:tasks.workunit.client.0.smithi063.stdout:0/736: chown d1/f31 3355 1 2024-09-16T01:25:21.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/761: getdents d3/d48/d28/d3e/d44/da4/d5a/d81 0 2024-09-16T01:25:21.760 INFO:tasks.workunit.client.0.smithi063.stdout:8/587: dread - d5/db/d12/d3d/d69/daa/d40/fb3 zero size 2024-09-16T01:25:21.761 INFO:tasks.workunit.client.0.smithi063.stdout:8/588: dread - d5/db/d12/d1a/fa0 zero size 2024-09-16T01:25:21.761 INFO:tasks.workunit.client.0.smithi063.stdout:0/737: write d1/d30/d52/d5a/d36/fdc [710741,69144] 0 2024-09-16T01:25:21.762 INFO:tasks.workunit.client.0.smithi063.stdout:6/762: symlink d3/d30/d8d/l10e 0 2024-09-16T01:25:21.763 INFO:tasks.workunit.client.0.smithi063.stdout:8/589: mknod d5/d9/d98/cc4 0 2024-09-16T01:25:21.765 INFO:tasks.workunit.client.0.smithi063.stdout:0/738: truncate d1/df/db1/fdf 849105 0 2024-09-16T01:25:21.766 INFO:tasks.workunit.client.0.smithi063.stdout:8/590: dread d5/db/d12/d1a/d1e/d93/f9a [0,4194304] 0 2024-09-16T01:25:21.769 INFO:tasks.workunit.client.0.smithi063.stdout:6/763: write d3/d10/f34 [1433321,51790] 0 2024-09-16T01:25:21.772 INFO:tasks.workunit.client.0.smithi063.stdout:8/591: dwrite d5/d9/d98/fa4 [0,4194304] 0 2024-09-16T01:25:21.774 INFO:tasks.workunit.client.0.smithi063.stdout:0/739: truncate d1/d30/d52/db3/fd8 196906 0 2024-09-16T01:25:21.775 INFO:tasks.workunit.client.0.smithi063.stdout:8/592: truncate d5/db/d12/f38 1338128 0 2024-09-16T01:25:21.777 INFO:tasks.workunit.client.0.smithi063.stdout:1/719: sync 2024-09-16T01:25:21.777 INFO:tasks.workunit.client.0.smithi063.stdout:2/844: sync 2024-09-16T01:25:21.777 INFO:tasks.workunit.client.0.smithi063.stdout:3/692: sync 2024-09-16T01:25:21.777 INFO:tasks.workunit.client.0.smithi063.stdout:9/774: sync 2024-09-16T01:25:21.777 INFO:tasks.workunit.client.0.smithi063.stdout:5/810: sync 2024-09-16T01:25:21.777 INFO:tasks.workunit.client.0.smithi063.stdout:7/618: sync 2024-09-16T01:25:21.779 INFO:tasks.workunit.client.0.smithi063.stdout:8/593: write d5/d86/f95 [59446,15324] 0 2024-09-16T01:25:21.783 INFO:tasks.workunit.client.0.smithi063.stdout:1/720: unlink d1/d12/d21/c43 0 2024-09-16T01:25:21.784 INFO:tasks.workunit.client.0.smithi063.stdout:3/693: symlink d2/d11/d37/db1/dc2/lfa 0 2024-09-16T01:25:21.784 INFO:tasks.workunit.client.0.smithi063.stdout:6/764: dwrite d3/d48/d28/d3e/d44/da4/d5a/d81/fed [0,4194304] 0 2024-09-16T01:25:21.784 INFO:tasks.workunit.client.0.smithi063.stdout:5/811: chown d5/d18/d29/d48/ca6 5510 1 2024-09-16T01:25:21.785 INFO:tasks.workunit.client.0.smithi063.stdout:8/594: symlink d5/d86/lc5 0 2024-09-16T01:25:21.786 INFO:tasks.workunit.client.0.smithi063.stdout:2/845: rmdir d3/d7/d8/d19/d3c/d53/d7f 39 2024-09-16T01:25:21.788 INFO:tasks.workunit.client.0.smithi063.stdout:8/595: chown d5/f58 75671614 1 2024-09-16T01:25:21.789 INFO:tasks.workunit.client.0.smithi063.stdout:3/694: dread - d2/d11/d37/dab/fdb zero size 2024-09-16T01:25:21.789 INFO:tasks.workunit.client.0.smithi063.stdout:7/619: creat d7/d1c/d1f/d29/dbf/fc6 x:0 0 0 2024-09-16T01:25:21.790 INFO:tasks.workunit.client.0.smithi063.stdout:1/721: mkdir d1/d5/ded 0 2024-09-16T01:25:21.791 INFO:tasks.workunit.client.0.smithi063.stdout:6/765: mkdir d3/d30/d39/d69/d95/d10f 0 2024-09-16T01:25:21.791 INFO:tasks.workunit.client.0.smithi063.stdout:8/596: stat d5/d9/f6c 0 2024-09-16T01:25:21.795 INFO:tasks.workunit.client.0.smithi063.stdout:6/766: chown d3/d30/d39/d69/fb9 100574550 1 2024-09-16T01:25:21.797 INFO:tasks.workunit.client.0.smithi063.stdout:3/695: getdents d2/d11/d69/d85 0 2024-09-16T01:25:21.797 INFO:tasks.workunit.client.0.smithi063.stdout:2/846: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d56/f96 [2709159,20783] 0 2024-09-16T01:25:21.797 INFO:tasks.workunit.client.0.smithi063.stdout:7/620: symlink d7/d1c/d1f/d29/dbf/d39/d65/lc7 0 2024-09-16T01:25:21.798 INFO:tasks.workunit.client.0.smithi063.stdout:0/740: dread d1/df/d17/f6d [0,4194304] 0 2024-09-16T01:25:21.800 INFO:tasks.workunit.client.0.smithi063.stdout:9/775: dread f4 [0,4194304] 0 2024-09-16T01:25:21.801 INFO:tasks.workunit.client.0.smithi063.stdout:8/597: write d5/db/d12/d3d/d69/daa/f43 [7686835,107574] 0 2024-09-16T01:25:21.804 INFO:tasks.workunit.client.0.smithi063.stdout:7/621: creat d7/d1c/d1f/d29/fc8 x:0 0 0 2024-09-16T01:25:21.805 INFO:tasks.workunit.client.0.smithi063.stdout:3/696: chown d2/d11/d37/d40/d5e/d3b/f76 341 1 2024-09-16T01:25:21.808 INFO:tasks.workunit.client.0.smithi063.stdout:9/776: unlink d7/d9/d20/de3/de7/f33 0 2024-09-16T01:25:21.810 INFO:tasks.workunit.client.0.smithi063.stdout:1/722: dwrite d1/d5/d15/f62 [4194304,4194304] 0 2024-09-16T01:25:21.811 INFO:tasks.workunit.client.0.smithi063.stdout:3/697: mknod d2/d11/d69/cfb 0 2024-09-16T01:25:21.812 INFO:tasks.workunit.client.0.smithi063.stdout:2/847: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/da1/db6/f108 [627968,16975] 0 2024-09-16T01:25:21.812 INFO:tasks.workunit.client.0.smithi063.stdout:5/812: dread d5/d18/d29/d48/d98/f84 [0,4194304] 0 2024-09-16T01:25:21.813 INFO:tasks.workunit.client.0.smithi063.stdout:7/622: mkdir d7/d1c/d1f/d29/d72/dc9 0 2024-09-16T01:25:21.815 INFO:tasks.workunit.client.0.smithi063.stdout:6/767: dwrite d3/d48/ff8 [0,4194304] 0 2024-09-16T01:25:21.815 INFO:tasks.workunit.client.0.smithi063.stdout:0/741: link d1/d30/d52/d5a/fd9 d1/d30/d52/d5a/d36/d41/f10d 0 2024-09-16T01:25:21.818 INFO:tasks.workunit.client.0.smithi063.stdout:8/598: dread d5/db/d12/d1a/d1e/d68/f84 [0,4194304] 0 2024-09-16T01:25:21.819 INFO:tasks.workunit.client.0.smithi063.stdout:7/623: chown d7/d1c/d1f/d29/dbf/d39/d65/l79 1333 1 2024-09-16T01:25:21.820 INFO:tasks.workunit.client.0.smithi063.stdout:9/777: mknod d7/d9/d20/de3/de7/d14/d38/df7/c10e 0 2024-09-16T01:25:21.820 INFO:tasks.workunit.client.0.smithi063.stdout:3/698: symlink d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/lfc 0 2024-09-16T01:25:21.821 INFO:tasks.workunit.client.0.smithi063.stdout:6/768: creat d3/d48/def/f110 x:0 0 0 2024-09-16T01:25:21.821 INFO:tasks.workunit.client.0.smithi063.stdout:5/813: rmdir d5/d18/d29/d48/de2/de4/d105 39 2024-09-16T01:25:21.823 INFO:tasks.workunit.client.0.smithi063.stdout:8/599: creat d5/db/d12/d3d/fc6 x:0 0 0 2024-09-16T01:25:21.823 INFO:tasks.workunit.client.0.smithi063.stdout:7/624: unlink d7/d1c/d1f/d29/f3f 0 2024-09-16T01:25:21.824 INFO:tasks.workunit.client.0.smithi063.stdout:5/814: stat d5/d7f/df1/fc8 0 2024-09-16T01:25:21.824 INFO:tasks.workunit.client.0.smithi063.stdout:9/778: chown d7/d9/ffe 13 1 2024-09-16T01:25:21.825 INFO:tasks.workunit.client.0.smithi063.stdout:2/848: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/da7/faf [43200,84177] 0 2024-09-16T01:25:21.825 INFO:tasks.workunit.client.0.smithi063.stdout:6/769: fsync d3/d10/f2a 0 2024-09-16T01:25:21.826 INFO:tasks.workunit.client.0.smithi063.stdout:1/723: dread d1/d5/d82/d9b/f4e [0,4194304] 0 2024-09-16T01:25:21.826 INFO:tasks.workunit.client.0.smithi063.stdout:3/699: symlink d2/d11/d69/d85/lfd 0 2024-09-16T01:25:21.826 INFO:tasks.workunit.client.0.smithi063.stdout:0/742: rename d1/d30/c94 to d1/df/d2c/d43/c10e 0 2024-09-16T01:25:21.829 INFO:tasks.workunit.client.0.smithi063.stdout:6/770: dread - d3/d48/def/f110 zero size 2024-09-16T01:25:21.830 INFO:tasks.workunit.client.0.smithi063.stdout:8/600: creat d5/d8c/d74/db7/fc7 x:0 0 0 2024-09-16T01:25:21.831 INFO:tasks.workunit.client.0.smithi063.stdout:7/625: mkdir d7/d1c/d1f/d29/d88/d96/dca 0 2024-09-16T01:25:21.832 INFO:tasks.workunit.client.0.smithi063.stdout:5/815: creat d5/d18/d29/d48/d98/d115/f124 x:0 0 0 2024-09-16T01:25:21.833 INFO:tasks.workunit.client.0.smithi063.stdout:1/724: symlink d1/d5/d82/d9b/d77/d7d/da5/lee 0 2024-09-16T01:25:21.833 INFO:tasks.workunit.client.0.smithi063.stdout:0/743: creat d1/d30/f10f x:0 0 0 2024-09-16T01:25:21.833 INFO:tasks.workunit.client.0.smithi063.stdout:3/700: mkdir d2/d11/d69/dfe 0 2024-09-16T01:25:21.834 INFO:tasks.workunit.client.0.smithi063.stdout:2/849: mkdir d3/d128 0 2024-09-16T01:25:21.834 INFO:tasks.workunit.client.0.smithi063.stdout:8/601: fdatasync d5/db/d12/d3d/d69/daa/f43 0 2024-09-16T01:25:21.836 INFO:tasks.workunit.client.0.smithi063.stdout:6/771: creat d3/d41/d105/f111 x:0 0 0 2024-09-16T01:25:21.838 INFO:tasks.workunit.client.0.smithi063.stdout:7/626: chown d7/d1c/d1f/d66/d70/f94 0 1 2024-09-16T01:25:21.838 INFO:tasks.workunit.client.0.smithi063.stdout:9/779: link d7/d4a/d4d/d96/l105 d7/d4a/d9d/l10f 0 2024-09-16T01:25:21.838 INFO:tasks.workunit.client.0.smithi063.stdout:0/744: mknod d1/d30/d52/d5a/c110 0 2024-09-16T01:25:21.841 INFO:tasks.workunit.client.0.smithi063.stdout:8/602: symlink d5/db/d12/d1a/d1e/d68/lc8 0 2024-09-16T01:25:21.843 INFO:tasks.workunit.client.0.smithi063.stdout:6/772: rmdir d3/d48/d28/d3e/d44/da4 39 2024-09-16T01:25:21.846 INFO:tasks.workunit.client.0.smithi063.stdout:7/627: truncate d7/d1c/d1f/d29/dbf/d40/fa9 1474143 0 2024-09-16T01:25:21.847 INFO:tasks.workunit.client.0.smithi063.stdout:1/725: dread d1/d5/f13 [4194304,4194304] 0 2024-09-16T01:25:21.847 INFO:tasks.workunit.client.0.smithi063.stdout:9/780: mknod d7/d9/d20/de3/de7/d14/d63/d5f/c110 0 2024-09-16T01:25:21.848 INFO:tasks.workunit.client.0.smithi063.stdout:2/850: chown d3/d7/d8/d19/d3c/d53/d7f/d80/d124 400364 1 2024-09-16T01:25:21.850 INFO:tasks.workunit.client.0.smithi063.stdout:7/628: chown d7/l11 29891 1 2024-09-16T01:25:21.851 INFO:tasks.workunit.client.0.smithi063.stdout:0/745: link d1/d30/d52/d5a/f3d d1/d30/d52/db3/f111 0 2024-09-16T01:25:21.852 INFO:tasks.workunit.client.0.smithi063.stdout:8/603: rename d5/db/d12/d1a/d60/d63 to d5/db/d12/d1a/d1e/d68/dc9 0 2024-09-16T01:25:21.854 INFO:tasks.workunit.client.0.smithi063.stdout:1/726: rmdir d1/d5/ded 0 2024-09-16T01:25:21.854 INFO:tasks.workunit.client.0.smithi063.stdout:3/701: dread d2/d11/d37/d40/d5e/d3b/d94/f2f [0,4194304] 0 2024-09-16T01:25:21.854 INFO:tasks.workunit.client.0.smithi063.stdout:9/781: symlink d7/d9/d20/de3/de7/d14/d38/l111 0 2024-09-16T01:25:21.854 INFO:tasks.workunit.client.0.smithi063.stdout:5/816: dread d5/d12/f4c [4194304,4194304] 0 2024-09-16T01:25:21.857 INFO:tasks.workunit.client.0.smithi063.stdout:1/727: readlink d1/d12/d21/l2f 0 2024-09-16T01:25:21.858 INFO:tasks.workunit.client.0.smithi063.stdout:8/604: fdatasync d5/f58 0 2024-09-16T01:25:21.859 INFO:tasks.workunit.client.0.smithi063.stdout:4/736: sync 2024-09-16T01:25:21.860 INFO:tasks.workunit.client.0.smithi063.stdout:0/746: creat d1/d30/f112 x:0 0 0 2024-09-16T01:25:21.862 INFO:tasks.workunit.client.0.smithi063.stdout:9/782: dread d7/d1f/f83 [0,4194304] 0 2024-09-16T01:25:21.866 INFO:tasks.workunit.client.0.smithi063.stdout:0/747: dread - d1/d30/d52/d5a/d44/ff9 zero size 2024-09-16T01:25:21.866 INFO:tasks.workunit.client.0.smithi063.stdout:7/629: dwrite d7/f14 [0,4194304] 0 2024-09-16T01:25:21.867 INFO:tasks.workunit.client.0.smithi063.stdout:1/728: creat d1/d5/d15/d1b/fef x:0 0 0 2024-09-16T01:25:21.870 INFO:tasks.workunit.client.0.smithi063.stdout:2/851: dwrite d3/d77/f89 [0,4194304] 0 2024-09-16T01:25:21.871 INFO:tasks.workunit.client.0.smithi063.stdout:5/817: link d5/d18/d29/d48/d98/d115/f124 d5/d18/d29/d48/d66/db1/dfc/f125 0 2024-09-16T01:25:21.872 INFO:tasks.workunit.client.0.smithi063.stdout:3/702: dwrite d2/d5b/f7a [4194304,4194304] 0 2024-09-16T01:25:21.873 INFO:tasks.workunit.client.0.smithi063.stdout:0/748: unlink d1/d30/d95/l97 0 2024-09-16T01:25:21.873 INFO:tasks.workunit.client.0.smithi063.stdout:6/773: rename d3/cb8 to d3/d48/d28/d3e/d44/da4/d5a/c112 0 2024-09-16T01:25:21.874 INFO:tasks.workunit.client.0.smithi063.stdout:4/737: unlink d5/d3b/df/d1c/l9c 0 2024-09-16T01:25:21.875 INFO:tasks.workunit.client.0.smithi063.stdout:7/630: fsync d7/d56/d57/d60/fa5 0 2024-09-16T01:25:21.876 INFO:tasks.workunit.client.0.smithi063.stdout:4/738: dread - d5/fb8 zero size 2024-09-16T01:25:21.876 INFO:tasks.workunit.client.0.smithi063.stdout:3/703: chown d2/d11/d69/d80/d8a/d8e/fd9 1793 1 2024-09-16T01:25:21.877 INFO:tasks.workunit.client.0.smithi063.stdout:8/605: rename d5/d86/f89 to d5/db/d12/d3d/d69/daa/d40/d4a/fca 0 2024-09-16T01:25:21.881 INFO:tasks.workunit.client.0.smithi063.stdout:8/606: dread - d5/db/d12/d3d/d69/daa/f97 zero size 2024-09-16T01:25:21.881 INFO:tasks.workunit.client.0.smithi063.stdout:6/774: mkdir d3/d48/d28/d113 0 2024-09-16T01:25:21.881 INFO:tasks.workunit.client.0.smithi063.stdout:1/729: link d1/d5/c83 d1/d5/d15/cf0 0 2024-09-16T01:25:21.883 INFO:tasks.workunit.client.0.smithi063.stdout:3/704: unlink d2/d11/d18/f42 0 2024-09-16T01:25:21.883 INFO:tasks.workunit.client.0.smithi063.stdout:5/818: write d5/d18/d29/d48/f80 [993873,34902] 0 2024-09-16T01:25:21.886 INFO:tasks.workunit.client.0.smithi063.stdout:3/705: fsync d2/d11/d37/db6/fed 0 2024-09-16T01:25:21.887 INFO:tasks.workunit.client.0.smithi063.stdout:7/631: creat d7/d1c/d1f/d29/d88/d98/fcb x:0 0 0 2024-09-16T01:25:21.887 INFO:tasks.workunit.client.0.smithi063.stdout:5/819: truncate d5/fa1 1072255 0 2024-09-16T01:25:21.888 INFO:tasks.workunit.client.0.smithi063.stdout:2/852: dread f2 [4194304,4194304] 0 2024-09-16T01:25:21.888 INFO:tasks.workunit.client.0.smithi063.stdout:8/607: rmdir d5/d8c/d74/d87 39 2024-09-16T01:25:21.888 INFO:tasks.workunit.client.0.smithi063.stdout:3/706: readlink d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/l8c 0 2024-09-16T01:25:21.890 INFO:tasks.workunit.client.0.smithi063.stdout:5/820: mknod d5/d18/d29/d48/d98/d94/c126 0 2024-09-16T01:25:21.892 INFO:tasks.workunit.client.0.smithi063.stdout:9/783: getdents d7/d9/d20/de3/de7/db2 0 2024-09-16T01:25:21.893 INFO:tasks.workunit.client.0.smithi063.stdout:2/853: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/f127 [962205,17131] 0 2024-09-16T01:25:21.894 INFO:tasks.workunit.client.0.smithi063.stdout:6/775: rmdir d3/d30/d39/d69/d95/db0 39 2024-09-16T01:25:21.895 INFO:tasks.workunit.client.0.smithi063.stdout:5/821: mknod d5/d18/d29/d48/d66/db1/d120/c127 0 2024-09-16T01:25:21.897 INFO:tasks.workunit.client.0.smithi063.stdout:7/632: symlink d7/d1c/d1f/d29/d88/d98/lcc 0 2024-09-16T01:25:21.897 INFO:tasks.workunit.client.0.smithi063.stdout:1/730: dwrite d1/d5/d15/d18/f42 [0,4194304] 0 2024-09-16T01:25:21.900 INFO:tasks.workunit.client.0.smithi063.stdout:8/608: creat d5/db/d12/db0/fcb x:0 0 0 2024-09-16T01:25:21.903 INFO:tasks.workunit.client.0.smithi063.stdout:6/776: mkdir d3/d30/d8d/d102/d91/d114 0 2024-09-16T01:25:21.903 INFO:tasks.workunit.client.0.smithi063.stdout:5/822: rename d5/d18/d29/d48/d98 to d5/d18/d29/d48/d98/d94/d128 22 2024-09-16T01:25:21.904 INFO:tasks.workunit.client.0.smithi063.stdout:1/731: fsync d1/d5/d82/d9b/fa3 0 2024-09-16T01:25:21.906 INFO:tasks.workunit.client.0.smithi063.stdout:2/854: creat d3/d7/d8/d19/f129 x:0 0 0 2024-09-16T01:25:21.906 INFO:tasks.workunit.client.0.smithi063.stdout:4/739: dwrite d5/d3b/df/d1c/d29/d32/d60/d61/f52 [0,4194304] 0 2024-09-16T01:25:21.908 INFO:tasks.workunit.client.0.smithi063.stdout:7/633: unlink d7/d56/d6b/f87 0 2024-09-16T01:25:21.909 INFO:tasks.workunit.client.0.smithi063.stdout:6/777: chown d3/d48/d28/d3e/d44/f6a 6857153 1 2024-09-16T01:25:21.910 INFO:tasks.workunit.client.0.smithi063.stdout:1/732: stat d1/d5/d15/d18/db6/fc1 0 2024-09-16T01:25:21.916 INFO:tasks.workunit.client.0.smithi063.stdout:1/733: chown d1/d5/d6f/f95 3 1 2024-09-16T01:25:21.917 INFO:tasks.workunit.client.0.smithi063.stdout:3/707: dwrite d2/d11/d37/d40/d5e/d3b/d45/d9f/fe6 [0,4194304] 0 2024-09-16T01:25:21.918 INFO:tasks.workunit.client.0.smithi063.stdout:2/855: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/f127 [273983,116747] 0 2024-09-16T01:25:21.918 INFO:tasks.workunit.client.0.smithi063.stdout:8/609: rename d5/db/d12/d3d/d69/daa/d40/d4a/l7d to d5/db/d12/d1a/d1e/d93/db8/lcc 0 2024-09-16T01:25:21.920 INFO:tasks.workunit.client.0.smithi063.stdout:5/823: link d5/d18/d29/d48/d7b/d85/lb8 d5/d18/d29/d48/d66/l129 0 2024-09-16T01:25:21.923 INFO:tasks.workunit.client.0.smithi063.stdout:1/734: rmdir d1/d5/d82 39 2024-09-16T01:25:21.925 INFO:tasks.workunit.client.0.smithi063.stdout:8/610: write d5/db/d12/d3d/fbc [2981733,80850] 0 2024-09-16T01:25:21.926 INFO:tasks.workunit.client.0.smithi063.stdout:9/784: dread d7/d9/d20/de3/de7/db2/f92 [0,4194304] 0 2024-09-16T01:25:21.929 INFO:tasks.workunit.client.0.smithi063.stdout:7/634: dwrite d7/d56/d57/d60/fa5 [0,4194304] 0 2024-09-16T01:25:21.931 INFO:tasks.workunit.client.0.smithi063.stdout:4/740: dwrite d5/d3b/df/d1c/d29/d32/d60/d61/f52 [0,4194304] 0 2024-09-16T01:25:21.931 INFO:tasks.workunit.client.0.smithi063.stdout:6/778: dwrite d3/d41/d105/f111 [0,4194304] 0 2024-09-16T01:25:21.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/824: dread d5/d12/fae [0,4194304] 0 2024-09-16T01:25:21.934 INFO:tasks.workunit.client.0.smithi063.stdout:2/856: chown d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d45/d6e 1 1 2024-09-16T01:25:21.937 INFO:tasks.workunit.client.0.smithi063.stdout:1/735: rename d1/d5/d6f/dab to d1/d5/d82/d9b/df1 0 2024-09-16T01:25:21.938 INFO:tasks.workunit.client.0.smithi063.stdout:6/779: creat d3/d41/f115 x:0 0 0 2024-09-16T01:25:21.940 INFO:tasks.workunit.client.0.smithi063.stdout:1/736: fdatasync d1/d12/f8b 0 2024-09-16T01:25:21.940 INFO:tasks.workunit.client.0.smithi063.stdout:9/785: mknod d7/d9/d20/de3/de7/d14/d63/c112 0 2024-09-16T01:25:21.943 INFO:tasks.workunit.client.0.smithi063.stdout:4/741: write d5/d3b/d57/fa6 [2427275,4445] 0 2024-09-16T01:25:21.947 INFO:tasks.workunit.client.0.smithi063.stdout:7/635: rename d7/d1c/d1f/d29/c7c to d7/d1c/d1f/d29/d72/dc9/ccd 0 2024-09-16T01:25:21.948 INFO:tasks.workunit.client.0.smithi063.stdout:3/708: dwrite d2/d11/d37/d40/d5e/d3b/d68/fdf [0,4194304] 0 2024-09-16T01:25:21.948 INFO:tasks.workunit.client.0.smithi063.stdout:5/825: getdents d5/d90 0 2024-09-16T01:25:21.950 INFO:tasks.workunit.client.0.smithi063.stdout:1/737: read - d1/d5/d82/d9b/d77/d7d/dcb/fe2 zero size 2024-09-16T01:25:21.954 INFO:tasks.workunit.client.0.smithi063.stdout:4/742: unlink d5/d3b/d57/d68/c84 0 2024-09-16T01:25:21.961 INFO:tasks.workunit.client.0.smithi063.stdout:1/738: chown d1/d5/d15/d18/db6 15 1 2024-09-16T01:25:21.963 INFO:tasks.workunit.client.0.smithi063.stdout:8/611: dwrite d5/db/d12/d1a/d1e/f32 [0,4194304] 0 2024-09-16T01:25:21.964 INFO:tasks.workunit.client.0.smithi063.stdout:1/739: readlink d1/lc0 0 2024-09-16T01:25:21.969 INFO:tasks.workunit.client.0.smithi063.stdout:3/709: creat d2/d11/d37/d40/d5e/d3b/d68/fff x:0 0 0 2024-09-16T01:25:21.973 INFO:tasks.workunit.client.0.smithi063.stdout:6/780: dwrite d3/d30/d39/dac/ddb/ff4 [0,4194304] 0 2024-09-16T01:25:21.973 INFO:tasks.workunit.client.0.smithi063.stdout:2/857: dwrite d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/dce/fed [0,4194304] 0 2024-09-16T01:25:21.976 INFO:tasks.workunit.client.0.smithi063.stdout:4/743: chown d5/d3b/df/d1c/d29/lea 183526770 1 2024-09-16T01:25:21.977 INFO:tasks.workunit.client.0.smithi063.stdout:7/636: dwrite d7/f9 [0,4194304] 0 2024-09-16T01:25:21.979 INFO:tasks.workunit.client.0.smithi063.stdout:9/786: dwrite d7/d9/d20/de3/de7/d14/f31 [4194304,4194304] 0 2024-09-16T01:25:21.980 INFO:tasks.workunit.client.0.smithi063.stdout:1/740: creat d1/d5/d15/d18/db6/ff2 x:0 0 0 2024-09-16T01:25:21.981 INFO:tasks.workunit.client.0.smithi063.stdout:8/612: creat d5/db/d12/d3d/d69/daa/d40/fcd x:0 0 0 2024-09-16T01:25:21.982 INFO:tasks.workunit.client.0.smithi063.stdout:7/637: readlink d7/d1c/d1f/d29/dbf/d39/d65/l8d 0 2024-09-16T01:25:21.983 INFO:tasks.workunit.client.0.smithi063.stdout:3/710: write d2/d11/d37/d40/d5e/f36 [904883,29619] 0 2024-09-16T01:25:21.986 INFO:tasks.workunit.client.0.smithi063.stdout:1/741: symlink d1/d5/d6f/d8f/lf3 0 2024-09-16T01:25:21.986 INFO:tasks.workunit.client.0.smithi063.stdout:4/744: mknod d5/d3b/df/cf3 0 2024-09-16T01:25:21.986 INFO:tasks.workunit.client.0.smithi063.stdout:7/638: readlink d7/d1c/d1f/d29/d88/l93 0 2024-09-16T01:25:21.987 INFO:tasks.workunit.client.0.smithi063.stdout:9/787: symlink d7/d4a/dba/l113 0 2024-09-16T01:25:21.987 INFO:tasks.workunit.client.0.smithi063.stdout:5/826: link d5/d18/d29/d48/d66/l119 d5/d18/d29/d48/d66/db1/l12a 0 2024-09-16T01:25:21.988 INFO:tasks.workunit.client.0.smithi063.stdout:1/742: fdatasync d1/d5/d82/fbc 0 2024-09-16T01:25:21.991 INFO:tasks.workunit.client.0.smithi063.stdout:6/781: rename d3/d30/d39/d69/d95/db0/fec to d3/d30/d8d/d102/d91/f116 0 2024-09-16T01:25:21.992 INFO:tasks.workunit.client.0.smithi063.stdout:3/711: chown d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/l8c 38 1 2024-09-16T01:25:21.995 INFO:tasks.workunit.client.0.smithi063.stdout:4/745: write d5/d3b/d57/d66/d9b/fd1 [451208,52120] 0 2024-09-16T01:25:21.996 INFO:tasks.workunit.client.0.smithi063.stdout:1/743: write d1/d5/d15/f19 [7665449,120944] 0 2024-09-16T01:25:21.999 INFO:tasks.workunit.client.0.smithi063.stdout:8/613: dwrite d5/d8c/dbd/f61 [0,4194304] 0 2024-09-16T01:25:22.000 INFO:tasks.workunit.client.0.smithi063.stdout:3/712: creat d2/d11/f100 x:0 0 0 2024-09-16T01:25:22.007 INFO:tasks.workunit.client.0.smithi063.stdout:8/614: write d5/db/d12/d1a/f2c [4383948,34878] 0 2024-09-16T01:25:22.008 INFO:tasks.workunit.client.0.smithi063.stdout:1/744: dread d1/d5/fb5 [0,4194304] 0 2024-09-16T01:25:22.009 INFO:tasks.workunit.client.0.smithi063.stdout:6/782: rename d3/d48/d28/f2b to d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/f117 0 2024-09-16T01:25:22.010 INFO:tasks.workunit.client.0.smithi063.stdout:9/788: dwrite d7/d9/ffe [0,4194304] 0 2024-09-16T01:25:22.012 INFO:tasks.workunit.client.0.smithi063.stdout:5/827: dwrite d5/d18/d29/d48/d7b/dc2/fc4 [0,4194304] 0 2024-09-16T01:25:22.013 INFO:tasks.workunit.client.0.smithi063.stdout:3/713: write d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/ff1 [35608,39249] 0 2024-09-16T01:25:22.013 INFO:tasks.workunit.client.0.smithi063.stdout:8/615: fdatasync d5/db/d12/d3d/d69/daa/f97 0 2024-09-16T01:25:22.015 INFO:tasks.workunit.client.0.smithi063.stdout:3/714: chown d2/d5b/db4/cba 391397 1 2024-09-16T01:25:22.015 INFO:tasks.workunit.client.0.smithi063.stdout:6/783: chown d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/cf5 0 1 2024-09-16T01:25:22.016 INFO:tasks.workunit.client.0.smithi063.stdout:4/746: mkdir d5/d3b/df/d1c/d29/d32/d60/df4 0 2024-09-16T01:25:22.016 INFO:tasks.workunit.client.0.smithi063.stdout:1/745: creat d1/d12/ff4 x:0 0 0 2024-09-16T01:25:22.019 INFO:tasks.workunit.client.0.smithi063.stdout:5/828: truncate d5/d12/f76 731128 0 2024-09-16T01:25:22.019 INFO:tasks.workunit.client.0.smithi063.stdout:6/784: chown d3/d48/d28/d3e/d44/da4/d5a/d6b/f90 20 1 2024-09-16T01:25:22.022 INFO:tasks.workunit.client.0.smithi063.stdout:1/746: write d1/d5/d82/d9b/d77/d86/fc9 [457702,25026] 0 2024-09-16T01:25:22.022 INFO:tasks.workunit.client.0.smithi063.stdout:4/747: creat d5/d3b/d57/d66/d9b/ff5 x:0 0 0 2024-09-16T01:25:22.024 INFO:tasks.workunit.client.0.smithi063.stdout:5/829: mkdir d5/d7f/da3/de3/d12b 0 2024-09-16T01:25:22.024 INFO:tasks.workunit.client.0.smithi063.stdout:4/748: read - d5/fb8 zero size 2024-09-16T01:25:22.024 INFO:tasks.workunit.client.0.smithi063.stdout:3/715: dread d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/fb3 [0,4194304] 0 2024-09-16T01:25:22.026 INFO:tasks.workunit.client.0.smithi063.stdout:9/789: dwrite d7/d9/d20/de3/de7/d14/d38/f10d [0,4194304] 0 2024-09-16T01:25:22.027 INFO:tasks.workunit.client.0.smithi063.stdout:5/830: fdatasync d5/d18/d29/d48/f9b 0 2024-09-16T01:25:22.027 INFO:tasks.workunit.client.0.smithi063.stdout:6/785: truncate d3/d30/f40 1213605 0 2024-09-16T01:25:22.030 INFO:tasks.workunit.client.0.smithi063.stdout:6/786: dread - d3/d48/d28/d3e/d44/f6a zero size 2024-09-16T01:25:22.030 INFO:tasks.workunit.client.0.smithi063.stdout:5/831: stat d5/d12/f49 0 2024-09-16T01:25:22.031 INFO:tasks.workunit.client.0.smithi063.stdout:1/747: rename d1/d5/c83 to d1/d5/d15/d18/cf5 0 2024-09-16T01:25:22.031 INFO:tasks.workunit.client.0.smithi063.stdout:3/716: chown d2/d11/d37/d40/d5e/d3b/d94/cbc 32440275 1 2024-09-16T01:25:22.032 INFO:tasks.workunit.client.0.smithi063.stdout:4/749: creat d5/d3b/df/d1c/d29/d20/d98/ddf/ff6 x:0 0 0 2024-09-16T01:25:22.032 INFO:tasks.workunit.client.0.smithi063.stdout:1/748: fsync d1/d5/d15/d18/f1e 0 2024-09-16T01:25:22.034 INFO:tasks.workunit.client.0.smithi063.stdout:5/832: creat d5/d18/d29/d48/ddb/f12c x:0 0 0 2024-09-16T01:25:22.035 INFO:tasks.workunit.client.0.smithi063.stdout:4/750: stat d5/l62 0 2024-09-16T01:25:22.035 INFO:tasks.workunit.client.0.smithi063.stdout:1/749: chown d1/d5/d15/d18/f6a 4790823 1 2024-09-16T01:25:22.036 INFO:tasks.workunit.client.0.smithi063.stdout:3/717: creat d2/d11/d37/d40/d5e/d3b/d45/d9f/f101 x:0 0 0 2024-09-16T01:25:22.037 INFO:tasks.workunit.client.0.smithi063.stdout:4/751: fdatasync d5/d3b/d57/d66/f7c 0 2024-09-16T01:25:22.041 INFO:tasks.workunit.client.0.smithi063.stdout:1/750: mkdir d1/d5/d82/d9b/d77/d7d/dda/df6 0 2024-09-16T01:25:22.042 INFO:tasks.workunit.client.0.smithi063.stdout:6/787: dwrite d3/d48/d28/d3e/d44/da4/d5a/d81/fed [0,4194304] 0 2024-09-16T01:25:22.042 INFO:tasks.workunit.client.0.smithi063.stdout:4/752: write d5/d3b/d57/faf [529107,121270] 0 2024-09-16T01:25:22.047 INFO:tasks.workunit.client.0.smithi063.stdout:1/751: fdatasync d1/d5/d15/d1b/f39 0 2024-09-16T01:25:22.048 INFO:tasks.workunit.client.0.smithi063.stdout:5/833: dwrite d5/d7f/f10c [0,4194304] 0 2024-09-16T01:25:22.048 INFO:tasks.workunit.client.0.smithi063.stdout:6/788: truncate d3/d10/f2a 9322230 0 2024-09-16T01:25:22.048 INFO:tasks.workunit.client.0.smithi063.stdout:9/790: dwrite d7/d9/d20/de3/de7/f52 [0,4194304] 0 2024-09-16T01:25:22.049 INFO:tasks.workunit.client.0.smithi063.stdout:4/753: symlink d5/d3b/df/d1c/d29/d20/lf7 0 2024-09-16T01:25:22.050 INFO:tasks.workunit.client.0.smithi063.stdout:1/752: fsync d1/d5/d82/d9b/d77/d86/fc9 0 2024-09-16T01:25:22.051 INFO:tasks.workunit.client.0.smithi063.stdout:9/791: symlink d7/d9/d20/de3/l114 0 2024-09-16T01:25:22.053 INFO:tasks.workunit.client.0.smithi063.stdout:1/753: fdatasync d1/d5/d82/d9b/df1/fbb 0 2024-09-16T01:25:22.056 INFO:tasks.workunit.client.0.smithi063.stdout:4/754: mkdir d5/d3b/d5c/da7/df8 0 2024-09-16T01:25:22.058 INFO:tasks.workunit.client.0.smithi063.stdout:9/792: unlink d7/d9/d20/de3/de7/d14/f16 0 2024-09-16T01:25:22.059 INFO:tasks.workunit.client.0.smithi063.stdout:5/834: rename d5/d18/d29/d52/fac to d5/d18/d29/f12d 0 2024-09-16T01:25:22.059 INFO:tasks.workunit.client.0.smithi063.stdout:4/755: stat d5/d3b/df/d1c/d29/d20/d98 0 2024-09-16T01:25:22.060 INFO:tasks.workunit.client.0.smithi063.stdout:1/754: mknod d1/d5/d82/d9b/d77/d7d/dda/df6/cf7 0 2024-09-16T01:25:22.062 INFO:tasks.workunit.client.0.smithi063.stdout:5/835: fsync d5/d12/fae 0 2024-09-16T01:25:22.062 INFO:tasks.workunit.client.0.smithi063.stdout:4/756: chown d5/d3b/d57/d66/d9b/d7a/def 428 1 2024-09-16T01:25:22.063 INFO:tasks.workunit.client.0.smithi063.stdout:6/789: dwrite d3/d48/d28/d3e/d44/da4/f50 [0,4194304] 0 2024-09-16T01:25:22.063 INFO:tasks.workunit.client.0.smithi063.stdout:9/793: write d7/d9/d20/de3/de7/db2/f92 [4191314,112523] 0 2024-09-16T01:25:22.068 INFO:tasks.workunit.client.0.smithi063.stdout:5/836: rename d5/d18/d29/d48/de2 to d5/d18/d29/d52/d12e 0 2024-09-16T01:25:22.068 INFO:tasks.workunit.client.0.smithi063.stdout:9/794: creat d7/d9/d20/de3/de7/db2/f115 x:0 0 0 2024-09-16T01:25:22.069 INFO:tasks.workunit.client.0.smithi063.stdout:6/790: readlink d3/d30/d39/dac/db5/da7/lfc 0 2024-09-16T01:25:22.070 INFO:tasks.workunit.client.0.smithi063.stdout:5/837: symlink d5/d18/d29/d48/d7b/l12f 0 2024-09-16T01:25:22.074 INFO:tasks.workunit.client.0.smithi063.stdout:5/838: unlink d5/d12/fe8 0 2024-09-16T01:25:22.076 INFO:tasks.workunit.client.0.smithi063.stdout:9/795: dwrite d7/d9/d20/de3/de7/d14/f91 [4194304,4194304] 0 2024-09-16T01:25:22.078 INFO:tasks.workunit.client.0.smithi063.stdout:4/757: dread d5/d3b/df/d1c/d29/dd4/dbc/fd6 [0,4194304] 0 2024-09-16T01:25:22.079 INFO:tasks.workunit.client.0.smithi063.stdout:4/758: fdatasync d5/d3b/f2d 0 2024-09-16T01:25:22.080 INFO:tasks.workunit.client.0.smithi063.stdout:4/759: chown d5/d3b/d57/dce/fe9 187 1 2024-09-16T01:25:22.083 INFO:tasks.workunit.client.0.smithi063.stdout:5/839: dwrite d5/d12/d91/f8c [0,4194304] 0 2024-09-16T01:25:22.085 INFO:tasks.workunit.client.0.smithi063.stdout:5/840: creat d5/d90/f130 x:0 0 0 2024-09-16T01:25:22.086 INFO:tasks.workunit.client.0.smithi063.stdout:4/760: mkdir d5/d3b/df/d1c/d29/d20/d30/df9 0 2024-09-16T01:25:22.087 INFO:tasks.workunit.client.0.smithi063.stdout:5/841: write d5/d18/d29/d48/d98/d94/f86 [29576,13518] 0 2024-09-16T01:25:22.088 INFO:tasks.workunit.client.0.smithi063.stdout:4/761: write d5/d3b/d57/fa6 [887025,110292] 0 2024-09-16T01:25:22.091 INFO:tasks.workunit.client.0.smithi063.stdout:5/842: symlink d5/d18/d29/d48/d98/d115/l131 0 2024-09-16T01:25:22.094 INFO:tasks.workunit.client.0.smithi063.stdout:4/762: write d5/d3b/df/d1c/d29/d20/fa5 [203360,19949] 0 2024-09-16T01:25:22.098 INFO:tasks.workunit.client.0.smithi063.stdout:4/763: rename d5/d3b/d57/f67 to d5/d3b/df/d1c/d29/d20/ffa 0 2024-09-16T01:25:22.098 INFO:tasks.workunit.client.0.smithi063.stdout:5/843: dwrite d5/d12/f4c [0,4194304] 0 2024-09-16T01:25:22.099 INFO:tasks.workunit.client.0.smithi063.stdout:5/844: fsync d5/d18/f24 0 2024-09-16T01:25:22.101 INFO:tasks.workunit.client.0.smithi063.stdout:5/845: chown d5/d12/d91/d72/c11b 26 1 2024-09-16T01:25:22.103 INFO:tasks.workunit.client.0.smithi063.stdout:5/846: mknod d5/d18/d29/d48/d7b/c132 0 2024-09-16T01:25:22.105 INFO:tasks.workunit.client.0.smithi063.stdout:4/764: dread d5/d3b/df/d1c/f6d [0,4194304] 0 2024-09-16T01:25:22.108 INFO:tasks.workunit.client.0.smithi063.stdout:4/765: mknod d5/d3b/d57/d66/db7/cfb 0 2024-09-16T01:25:22.108 INFO:tasks.workunit.client.0.smithi063.stdout:4/766: fsync d5/d3b/df/d1c/d29/dd4/dbc/fc2 0 2024-09-16T01:25:22.113 INFO:tasks.workunit.client.0.smithi063.stdout:5/847: dwrite d5/d12/f76 [0,4194304] 0 2024-09-16T01:25:22.113 INFO:tasks.workunit.client.0.smithi063.stdout:5/848: chown d5/d12 158744804 1 2024-09-16T01:25:22.114 INFO:tasks.workunit.client.0.smithi063.stdout:4/767: rename d5/d3b/df/d1c/d29/d32/d60/d61/lca to d5/d3b/d57/d66/db7/dc9/lfc 0 2024-09-16T01:25:22.115 INFO:tasks.workunit.client.0.smithi063.stdout:4/768: fsync d5/d3b/d5c/fcf 0 2024-09-16T01:25:22.119 INFO:tasks.workunit.client.0.smithi063.stdout:4/769: creat d5/d3b/d57/ffd x:0 0 0 2024-09-16T01:25:22.119 INFO:tasks.workunit.client.0.smithi063.stdout:5/849: dread d5/d7f/da3/fbe [0,4194304] 0 2024-09-16T01:25:22.121 INFO:tasks.workunit.client.0.smithi063.stdout:5/850: rmdir d5/d18/d29/d48/d7b/d85/df9 39 2024-09-16T01:25:22.122 INFO:tasks.workunit.client.0.smithi063.stdout:5/851: write d5/d18/d29/d52/fcd [190384,97637] 0 2024-09-16T01:25:22.125 INFO:tasks.workunit.client.0.smithi063.stdout:5/852: symlink d5/d18/d29/d48/dad/l133 0 2024-09-16T01:25:22.126 INFO:tasks.workunit.client.0.smithi063.stdout:5/853: readlink d5/d18/d29/d48/d66/db1/ld9 0 2024-09-16T01:25:22.128 INFO:tasks.workunit.client.0.smithi063.stdout:5/854: creat d5/d18/d29/d52/f134 x:0 0 0 2024-09-16T01:25:22.128 INFO:tasks.workunit.client.0.smithi063.stdout:5/855: stat d5/d18/d29/d48/d98/f5f 0 2024-09-16T01:25:22.130 INFO:tasks.workunit.client.0.smithi063.stdout:5/856: getdents d5/d7f/da3/de3/d11a 0 2024-09-16T01:25:22.132 INFO:tasks.workunit.client.0.smithi063.stdout:5/857: truncate d5/d18/d29/d48/d98/d94/f111 82646 0 2024-09-16T01:25:22.134 INFO:tasks.workunit.client.0.smithi063.stdout:5/858: creat d5/d18/d29/d48/d98/d118/f135 x:0 0 0 2024-09-16T01:25:22.135 INFO:tasks.workunit.client.0.smithi063.stdout:5/859: creat d5/d7f/da3/de3/f136 x:0 0 0 2024-09-16T01:25:22.138 INFO:tasks.workunit.client.0.smithi063.stdout:5/860: getdents d5/d90 0 2024-09-16T01:25:22.139 INFO:tasks.workunit.client.0.smithi063.stdout:5/861: write d5/d18/d29/d48/f54 [668324,64031] 0 2024-09-16T01:25:22.178 INFO:tasks.workunit.client.0.smithi063.stdout:0/749: sync 2024-09-16T01:25:22.188 INFO:tasks.workunit.client.0.smithi063.stdout:0/750: dwrite d1/d30/d52/d5a/d36/fe9 [0,4194304] 0 2024-09-16T01:25:22.190 INFO:tasks.workunit.client.0.smithi063.stdout:0/751: chown d1/d2e/d48/dc3/cdb 7689386 1 2024-09-16T01:25:22.196 INFO:tasks.workunit.client.0.smithi063.stdout:0/752: write d1/d2e/d48/faf [25869,8195] 0 2024-09-16T01:25:22.201 INFO:tasks.workunit.client.0.smithi063.stdout:0/753: dwrite d1/df/d34/f79 [0,4194304] 0 2024-09-16T01:25:22.213 INFO:tasks.workunit.client.0.smithi063.stdout:0/754: fdatasync d1/df/d34/f79 0 2024-09-16T01:25:22.215 INFO:tasks.workunit.client.0.smithi063.stdout:0/755: rename d1/d2e/d48/dc3/cdb to d1/d2e/d48/dc3/c113 0 2024-09-16T01:25:22.217 INFO:tasks.workunit.client.0.smithi063.stdout:0/756: chown d1/df/d17/l6c 34381980 1 2024-09-16T01:25:22.220 INFO:tasks.workunit.client.0.smithi063.stdout:0/757: link d1/d30/d52/d9d/deb/f82 d1/df/d2c/dde/f114 0 2024-09-16T01:25:22.220 INFO:tasks.workunit.client.0.smithi063.stdout:0/758: truncate d1/d30/f10f 341356 0 2024-09-16T01:25:22.229 INFO:tasks.workunit.client.0.smithi063.stdout:0/759: dread d1/df/d17/f22 [0,4194304] 0 2024-09-16T01:25:22.234 INFO:tasks.workunit.client.0.smithi063.stdout:0/760: dwrite d1/d30/d52/d5a/d36/fdc [0,4194304] 0 2024-09-16T01:25:22.237 INFO:tasks.workunit.client.0.smithi063.stdout:0/761: mknod d1/df/d2c/d43/c115 0 2024-09-16T01:25:22.238 INFO:tasks.workunit.client.0.smithi063.stdout:0/762: truncate d1/df/d34/f79 4546085 0 2024-09-16T01:25:22.241 INFO:tasks.workunit.client.0.smithi063.stdout:0/763: symlink d1/d30/d52/d5a/d36/l116 0 2024-09-16T01:25:22.241 INFO:tasks.workunit.client.0.smithi063.stdout:0/764: dread - d1/d30/d52/d5a/d36/ffc zero size 2024-09-16T01:25:22.251 INFO:tasks.workunit.client.0.smithi063.stdout:0/765: dwrite d1/d30/d52/d5a/d36/d41/f10d [0,4194304] 0 2024-09-16T01:25:22.253 INFO:tasks.workunit.client.0.smithi063.stdout:2/858: sync 2024-09-16T01:25:22.264 INFO:tasks.workunit.client.0.smithi063.stdout:0/766: dread d1/d2e/d48/dc3/dca/ff5 [0,4194304] 0 2024-09-16T01:25:22.266 INFO:tasks.workunit.client.0.smithi063.stdout:2/859: dread d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/db7/fea [0,4194304] 0 2024-09-16T01:25:22.268 INFO:tasks.workunit.client.0.smithi063.stdout:0/767: link d1/d30/d52/d5a/d44/ff3 d1/df/d2c/f117 0 2024-09-16T01:25:22.269 INFO:tasks.workunit.client.0.smithi063.stdout:0/768: chown d1/d30/d52/db3/ca2 227 1 2024-09-16T01:25:22.269 INFO:tasks.workunit.client.0.smithi063.stdout:2/860: creat d3/d7/d8/d19/d8c/dcc/d118/f12a x:0 0 0 2024-09-16T01:25:22.270 INFO:tasks.workunit.client.0.smithi063.stdout:2/861: dread - d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/fd5 zero size 2024-09-16T01:25:22.274 INFO:tasks.workunit.client.0.smithi063.stdout:0/769: truncate d1/df/d34/f5e 3724225 0 2024-09-16T01:25:22.276 INFO:tasks.workunit.client.0.smithi063.stdout:2/862: dwrite d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/f11a [0,4194304] 0 2024-09-16T01:25:22.280 INFO:tasks.workunit.client.0.smithi063.stdout:2/863: symlink d3/d7/l12b 0 2024-09-16T01:25:22.331 INFO:tasks.workunit.client.0.smithi063.stdout:2/864: chown d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34 19585738 1 2024-09-16T01:25:22.332 INFO:tasks.workunit.client.0.smithi063.stdout:0/770: dwrite d1/d30/d52/d5a/d36/d41/f6a [0,4194304] 0 2024-09-16T01:25:22.335 INFO:tasks.workunit.client.0.smithi063.stdout:2/865: truncate d3/d7/d8/d19/d8c/d21/d9c/dd4/fe0 1253 0 2024-09-16T01:25:22.340 INFO:tasks.workunit.client.0.smithi063.stdout:0/771: dwrite d1/d1c/f78 [0,4194304] 0 2024-09-16T01:25:22.341 INFO:tasks.workunit.client.0.smithi063.stdout:0/772: dread - d1/df/d17/f81 zero size 2024-09-16T01:25:22.343 INFO:tasks.workunit.client.0.smithi063.stdout:2/866: rename d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/da1/db6/f108 to d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/f12c 0 2024-09-16T01:25:22.346 INFO:tasks.workunit.client.0.smithi063.stdout:0/773: creat d1/d30/d52/f118 x:0 0 0 2024-09-16T01:25:22.348 INFO:tasks.workunit.client.0.smithi063.stdout:0/774: mkdir d1/df/d2c/dde/d119 0 2024-09-16T01:25:22.350 INFO:tasks.workunit.client.0.smithi063.stdout:0/775: symlink d1/d2e/d73/l11a 0 2024-09-16T01:25:22.351 INFO:tasks.workunit.client.0.smithi063.stdout:2/867: dwrite d3/d7/d8/d19/d3c/d58/f5d [0,4194304] 0 2024-09-16T01:25:22.353 INFO:tasks.workunit.client.0.smithi063.stdout:2/868: chown d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/f127 4 1 2024-09-16T01:25:22.357 INFO:tasks.workunit.client.0.smithi063.stdout:2/869: creat d3/d7/d8/d19/d3c/d53/f12d x:0 0 0 2024-09-16T01:25:22.359 INFO:tasks.workunit.client.0.smithi063.stdout:2/870: rmdir d3/d7/d8/df1 39 2024-09-16T01:25:22.361 INFO:tasks.workunit.client.0.smithi063.stdout:2/871: truncate d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/fbf 528854 0 2024-09-16T01:25:22.364 INFO:tasks.workunit.client.0.smithi063.stdout:2/872: mkdir d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d12e 0 2024-09-16T01:25:22.366 INFO:tasks.workunit.client.0.smithi063.stdout:2/873: unlink d3/d7/d8/d19/d8c/l41 0 2024-09-16T01:25:22.368 INFO:tasks.workunit.client.0.smithi063.stdout:2/874: mkdir d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/dfe/d12f 0 2024-09-16T01:25:22.371 INFO:tasks.workunit.client.0.smithi063.stdout:2/875: getdents d3/d7/d8/d19/d3c/d53/d7f/d80/d124 0 2024-09-16T01:25:22.372 INFO:tasks.workunit.client.0.smithi063.stdout:2/876: chown d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/db7/fcf 15039123 1 2024-09-16T01:25:22.372 INFO:tasks.workunit.client.0.smithi063.stdout:2/877: dread - d3/d7/d8/d19/d3c/d53/f12d zero size 2024-09-16T01:25:22.372 INFO:tasks.workunit.client.0.smithi063.stdout:2/878: chown d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/da1/f5a 4052 1 2024-09-16T01:25:22.376 INFO:tasks.workunit.client.0.smithi063.stdout:2/879: creat d3/d7/d8/d19/d3c/d53/f130 x:0 0 0 2024-09-16T01:25:22.379 INFO:tasks.workunit.client.0.smithi063.stdout:2/880: rename d3/d7/cf8 to d3/d7/d8/df1/df3/c131 0 2024-09-16T01:25:22.393 INFO:tasks.workunit.client.0.smithi063.stdout:7/639: sync 2024-09-16T01:25:22.398 INFO:tasks.workunit.client.0.smithi063.stdout:7/640: rename d7/f9c to d7/d1c/d1f/d29/d72/dc9/fce 0 2024-09-16T01:25:22.410 INFO:tasks.workunit.client.0.smithi063.stdout:7/641: chown d7/d1c/d1f/d29/d88 2 1 2024-09-16T01:25:22.416 INFO:tasks.workunit.client.0.smithi063.stdout:7/642: truncate d7/d56/fa6 836803 0 2024-09-16T01:25:22.416 INFO:tasks.workunit.client.0.smithi063.stdout:7/643: stat d7/d56/d57/f74 0 2024-09-16T01:25:22.454 INFO:tasks.workunit.client.0.smithi063.stdout:7/644: write d7/d1c/d1f/d66/f7f [1612384,112825] 0 2024-09-16T01:25:22.456 INFO:tasks.workunit.client.0.smithi063.stdout:7/645: creat d7/d56/d57/d73/fcf x:0 0 0 2024-09-16T01:25:22.457 INFO:tasks.workunit.client.0.smithi063.stdout:7/646: fdatasync d7/d1c/d1f/d29/dbf/d39/f9f 0 2024-09-16T01:25:22.459 INFO:tasks.workunit.client.0.smithi063.stdout:7/647: creat d7/d56/d6b/fd0 x:0 0 0 2024-09-16T01:25:22.459 INFO:tasks.workunit.client.0.smithi063.stdout:7/648: fdatasync d7/d1c/d1f/d29/dbf/d40/fa9 0 2024-09-16T01:25:22.511 INFO:tasks.workunit.client.0.smithi063.stdout:3/718: sync 2024-09-16T01:25:22.511 INFO:tasks.workunit.client.0.smithi063.stdout:8/616: sync 2024-09-16T01:25:22.511 INFO:tasks.workunit.client.0.smithi063.stdout:7/649: dwrite d7/d56/f31 [0,4194304] 0 2024-09-16T01:25:22.516 INFO:tasks.workunit.client.0.smithi063.stdout:8/617: link d5/db/d12/db0/fcb d5/db/d12/d3d/fce 0 2024-09-16T01:25:22.517 INFO:tasks.workunit.client.0.smithi063.stdout:7/650: dread d7/d56/d6b/d86/f69 [0,4194304] 0 2024-09-16T01:25:22.518 INFO:tasks.workunit.client.0.smithi063.stdout:7/651: stat d7/d56/d6b/fd0 0 2024-09-16T01:25:22.520 INFO:tasks.workunit.client.0.smithi063.stdout:7/652: creat d7/d56/d57/d73/d91/fd1 x:0 0 0 2024-09-16T01:25:22.520 INFO:tasks.workunit.client.0.smithi063.stdout:3/719: dread d2/d11/d37/feb [0,4194304] 0 2024-09-16T01:25:22.521 INFO:tasks.workunit.client.0.smithi063.stdout:7/653: read - d7/d56/d6b/d86/fb3 zero size 2024-09-16T01:25:22.522 INFO:tasks.workunit.client.0.smithi063.stdout:3/720: write d2/d11/d37/d40/d5e/fb2 [4306456,12122] 0 2024-09-16T01:25:22.524 INFO:tasks.workunit.client.0.smithi063.stdout:3/721: write d2/d11/d37/d40/d5e/fb2 [6847646,32302] 0 2024-09-16T01:25:22.525 INFO:tasks.workunit.client.0.smithi063.stdout:8/618: dread d5/d9/f6c [0,4194304] 0 2024-09-16T01:25:22.526 INFO:tasks.workunit.client.0.smithi063.stdout:7/654: fdatasync d7/d1c/d1f/d29/d88/d98/fbe 0 2024-09-16T01:25:22.526 INFO:tasks.workunit.client.0.smithi063.stdout:8/619: fdatasync d5/f58 0 2024-09-16T01:25:22.527 INFO:tasks.workunit.client.0.smithi063.stdout:8/620: fdatasync d5/db/d12/f2d 0 2024-09-16T01:25:22.529 INFO:tasks.workunit.client.0.smithi063.stdout:7/655: mkdir d7/d1c/dd2 0 2024-09-16T01:25:22.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/722: truncate d2/d11/d37/d40/d5e/d3b/d94/d30/f3c 1848441 0 2024-09-16T01:25:22.533 INFO:tasks.workunit.client.0.smithi063.stdout:8/621: symlink d5/db/d12/lcf 0 2024-09-16T01:25:22.533 INFO:tasks.workunit.client.0.smithi063.stdout:7/656: creat d7/d1c/dd2/fd3 x:0 0 0 2024-09-16T01:25:22.534 INFO:tasks.workunit.client.0.smithi063.stdout:3/723: read d2/d11/d37/d40/d5e/d3b/d94/d30/f99 [676601,111994] 0 2024-09-16T01:25:22.536 INFO:tasks.workunit.client.0.smithi063.stdout:7/657: symlink d7/d1c/d1f/d29/dbf/d39/ld4 0 2024-09-16T01:25:22.537 INFO:tasks.workunit.client.0.smithi063.stdout:7/658: dread - d7/d56/d6b/d86/f85 zero size 2024-09-16T01:25:22.539 INFO:tasks.workunit.client.0.smithi063.stdout:7/659: symlink d7/d56/d57/d60/db9/ld5 0 2024-09-16T01:25:22.541 INFO:tasks.workunit.client.0.smithi063.stdout:7/660: dread - d7/d1c/d1f/d29/d72/dc9/fce zero size 2024-09-16T01:25:22.543 INFO:tasks.workunit.client.0.smithi063.stdout:3/724: dread d2/d11/d37/d40/f53 [0,4194304] 0 2024-09-16T01:25:22.545 INFO:tasks.workunit.client.0.smithi063.stdout:8/622: truncate d5/db/d12/d3d/f9c 2313322 0 2024-09-16T01:25:22.546 INFO:tasks.workunit.client.0.smithi063.stdout:7/661: unlink d7/d1c/d1f/d66/d70/f94 0 2024-09-16T01:25:22.549 INFO:tasks.workunit.client.0.smithi063.stdout:3/725: symlink d2/d11/d37/d40/d5e/d3b/d68/d6d/l102 0 2024-09-16T01:25:22.556 INFO:tasks.workunit.client.0.smithi063.stdout:7/662: mkdir d7/dd6 0 2024-09-16T01:25:22.556 INFO:tasks.workunit.client.0.smithi063.stdout:3/726: creat d2/d11/d37/d40/d5e/d3b/d68/d6d/f103 x:0 0 0 2024-09-16T01:25:22.556 INFO:tasks.workunit.client.0.smithi063.stdout:7/663: readlink d7/d56/d6b/d86/l62 0 2024-09-16T01:25:22.556 INFO:tasks.workunit.client.0.smithi063.stdout:3/727: stat d2/d11/d37/d40/d5e/d3b/d68/l72 0 2024-09-16T01:25:22.556 INFO:tasks.workunit.client.0.smithi063.stdout:7/664: chown d7/d56/d57/d73/d91/fd1 1 1 2024-09-16T01:25:22.556 INFO:tasks.workunit.client.0.smithi063.stdout:7/665: fdatasync f5 0 2024-09-16T01:25:22.559 INFO:tasks.workunit.client.0.smithi063.stdout:7/666: creat d7/d1c/d1f/d29/d88/fd7 x:0 0 0 2024-09-16T01:25:22.560 INFO:tasks.workunit.client.0.smithi063.stdout:3/728: truncate d2/d11/d37/d40/d5e/f20 416836 0 2024-09-16T01:25:22.561 INFO:tasks.workunit.client.0.smithi063.stdout:7/667: write d7/d1c/d1f/d29/dbf/d40/f83 [542718,28478] 0 2024-09-16T01:25:22.562 INFO:tasks.workunit.client.0.smithi063.stdout:7/668: mkdir d7/d56/d57/d60/db9/dd8 0 2024-09-16T01:25:22.563 INFO:tasks.workunit.client.0.smithi063.stdout:3/729: dread d2/f54 [0,4194304] 0 2024-09-16T01:25:22.563 INFO:tasks.workunit.client.0.smithi063.stdout:7/669: stat d7/d1c/d1f/d29/l97 0 2024-09-16T01:25:22.565 INFO:tasks.workunit.client.0.smithi063.stdout:7/670: creat d7/d1c/d1f/d29/dbf/d39/fd9 x:0 0 0 2024-09-16T01:25:22.567 INFO:tasks.workunit.client.0.smithi063.stdout:3/730: link d2/d11/d69/fca d2/dc1/f104 0 2024-09-16T01:25:22.569 INFO:tasks.workunit.client.0.smithi063.stdout:7/671: dread d7/d1c/d1f/d29/d88/d98/fbe [0,4194304] 0 2024-09-16T01:25:22.570 INFO:tasks.workunit.client.0.smithi063.stdout:7/672: write d7/d56/d57/d60/f61 [306513,96104] 0 2024-09-16T01:25:22.570 INFO:tasks.workunit.client.0.smithi063.stdout:3/731: link d2/d11/d69/d80/fe9 d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/f105 0 2024-09-16T01:25:22.573 INFO:tasks.workunit.client.0.smithi063.stdout:7/673: write d7/d1c/d1f/f28 [4821486,2041] 0 2024-09-16T01:25:22.575 INFO:tasks.workunit.client.0.smithi063.stdout:7/674: chown d7/d1c/d1f/d29/dbf/d39/c6a 494035308 1 2024-09-16T01:25:22.576 INFO:tasks.workunit.client.0.smithi063.stdout:3/732: dwrite f0 [0,4194304] 0 2024-09-16T01:25:22.581 INFO:tasks.workunit.client.0.smithi063.stdout:3/733: creat d2/f106 x:0 0 0 2024-09-16T01:25:22.582 INFO:tasks.workunit.client.0.smithi063.stdout:7/675: dwrite d7/d1c/d1f/d29/f4e [0,4194304] 0 2024-09-16T01:25:22.583 INFO:tasks.workunit.client.0.smithi063.stdout:3/734: chown d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e 273 1 2024-09-16T01:25:22.584 INFO:tasks.workunit.client.0.smithi063.stdout:3/735: dread - d2/d11/d69/d80/d8a/fdd zero size 2024-09-16T01:25:22.586 INFO:tasks.workunit.client.0.smithi063.stdout:3/736: chown d2/d11/d37/d40 781 1 2024-09-16T01:25:22.589 INFO:tasks.workunit.client.0.smithi063.stdout:3/737: write d2/d11/d37/d40/d5e/d3b/d68/d6d/ff9 [815214,5674] 0 2024-09-16T01:25:22.593 INFO:tasks.workunit.client.0.smithi063.stdout:7/676: dwrite d7/d1c/d1f/d29/dbf/f45 [4194304,4194304] 0 2024-09-16T01:25:22.593 INFO:tasks.workunit.client.0.smithi063.stdout:3/738: creat d2/d11/d37/d40/d5e/d3b/d68/d6d/f107 x:0 0 0 2024-09-16T01:25:22.595 INFO:tasks.workunit.client.0.smithi063.stdout:3/739: fdatasync d2/d11/d37/d40/d5e/d3b/f89 0 2024-09-16T01:25:22.595 INFO:tasks.workunit.client.0.smithi063.stdout:7/677: dread d7/d56/d57/f78 [0,4194304] 0 2024-09-16T01:25:22.597 INFO:tasks.workunit.client.0.smithi063.stdout:7/678: write d7/d1c/d1f/fba [911156,48490] 0 2024-09-16T01:25:22.597 INFO:tasks.workunit.client.0.smithi063.stdout:7/679: readlink d7/d56/l4a 0 2024-09-16T01:25:22.598 INFO:tasks.workunit.client.0.smithi063.stdout:3/740: creat d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/f108 x:0 0 0 2024-09-16T01:25:22.599 INFO:tasks.workunit.client.0.smithi063.stdout:7/680: write d7/d1c/d1f/f2b [4147724,60986] 0 2024-09-16T01:25:22.602 INFO:tasks.workunit.client.0.smithi063.stdout:3/741: symlink d2/d11/d37/d40/d5e/d3b/d68/d6b/l109 0 2024-09-16T01:25:22.602 INFO:tasks.workunit.client.0.smithi063.stdout:7/681: creat d7/d1c/d1f/d29/dbf/d39/d9d/fda x:0 0 0 2024-09-16T01:25:22.606 INFO:tasks.workunit.client.0.smithi063.stdout:3/742: truncate d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/fe8 949366 0 2024-09-16T01:25:22.606 INFO:tasks.workunit.client.0.smithi063.stdout:3/743: fdatasync d2/d11/d37/d40/d5e/d3b/d68/d6d/f103 0 2024-09-16T01:25:22.607 INFO:tasks.workunit.client.0.smithi063.stdout:3/744: truncate d2/d5b/d90/fc7 486399 0 2024-09-16T01:25:22.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:22 smithi063 ceph-mon[31070]: pgmap v396: 97 pgs: 97 active+clean; 1.4 GiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s rd, 195 MiB/s wr, 335 op/s 2024-09-16T01:25:22.612 INFO:tasks.workunit.client.0.smithi063.stdout:3/745: dwrite f0 [0,4194304] 0 2024-09-16T01:25:22.613 INFO:tasks.workunit.client.0.smithi063.stdout:3/746: dread d2/f54 [0,4194304] 0 2024-09-16T01:25:22.616 INFO:tasks.workunit.client.0.smithi063.stdout:7/682: dwrite d7/d1c/d1f/d29/d88/d98/fbe [0,4194304] 0 2024-09-16T01:25:22.616 INFO:tasks.workunit.client.0.smithi063.stdout:3/747: unlink d2/f106 0 2024-09-16T01:25:22.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/683: chown d7/d1c/d1f/d29/d88/fd7 314852 1 2024-09-16T01:25:22.618 INFO:tasks.workunit.client.0.smithi063.stdout:3/748: readlink d2/d11/d37/d40/d5e/l7b 0 2024-09-16T01:25:22.620 INFO:tasks.workunit.client.0.smithi063.stdout:3/749: write d2/d11/d69/d80/d8a/ff6 [228572,23566] 0 2024-09-16T01:25:22.620 INFO:tasks.workunit.client.0.smithi063.stdout:7/684: rmdir d7/d1c/d1f/d29/dbf/d40/d6c 39 2024-09-16T01:25:22.623 INFO:tasks.workunit.client.0.smithi063.stdout:7/685: rmdir d7/d1c/d1f/d29/dbf/d40/d6c 39 2024-09-16T01:25:22.623 INFO:tasks.workunit.client.0.smithi063.stdout:3/750: dread d2/d11/d37/d40/d5e/d3b/d94/f2f [0,4194304] 0 2024-09-16T01:25:22.624 INFO:tasks.workunit.client.0.smithi063.stdout:7/686: chown d7/d1c/d1f/f32 2772 1 2024-09-16T01:25:22.626 INFO:tasks.workunit.client.0.smithi063.stdout:3/751: write d2/d11/d37/d40/d5e/d3b/d68/d6d/de5/ff8 [390882,25769] 0 2024-09-16T01:25:22.628 INFO:tasks.workunit.client.0.smithi063.stdout:3/752: readlink d2/d11/d37/d40/d5e/d3b/d94/d30/l48 0 2024-09-16T01:25:22.629 INFO:tasks.workunit.client.0.smithi063.stdout:7/687: link d7/f14 d7/d56/d57/d73/fdb 0 2024-09-16T01:25:22.631 INFO:tasks.workunit.client.0.smithi063.stdout:3/753: write d2/d11/d18/fd [1339888,81666] 0 2024-09-16T01:25:22.631 INFO:tasks.workunit.client.0.smithi063.stdout:7/688: truncate d7/d56/d57/d73/fdb 4922643 0 2024-09-16T01:25:22.633 INFO:tasks.workunit.client.0.smithi063.stdout:3/754: write d2/d11/d37/d40/d5e/d3b/d45/d9f/f101 [795157,108868] 0 2024-09-16T01:25:22.633 INFO:tasks.workunit.client.0.smithi063.stdout:7/689: creat d7/d1c/d1f/d29/d88/d96/fdc x:0 0 0 2024-09-16T01:25:22.636 INFO:tasks.workunit.client.0.smithi063.stdout:3/755: unlink d2/d11/d69/d80/d8a/d8e/fd9 0 2024-09-16T01:25:22.638 INFO:tasks.workunit.client.0.smithi063.stdout:3/756: symlink d2/d11/d37/d40/d5e/d3b/d68/d6d/l10a 0 2024-09-16T01:25:22.639 INFO:tasks.workunit.client.0.smithi063.stdout:3/757: stat d2/d11/d37/d40/d5e/d3b/d94/d30/cd6 0 2024-09-16T01:25:22.640 INFO:tasks.workunit.client.0.smithi063.stdout:3/758: write d2/d11/d69/d80/d8a/fdd [724022,119719] 0 2024-09-16T01:25:22.643 INFO:tasks.workunit.client.0.smithi063.stdout:7/690: truncate d7/d1c/d1f/f2b 3761688 0 2024-09-16T01:25:22.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/759: write d2/dc1/f104 [831230,11587] 0 2024-09-16T01:25:22.644 INFO:tasks.workunit.client.0.smithi063.stdout:7/691: dread - d7/d1c/d1f/d29/d88/d98/fcb zero size 2024-09-16T01:25:22.646 INFO:tasks.workunit.client.0.smithi063.stdout:7/692: rename d7/d56/d57/d60 to d7/d56/d57/d60/ddd 22 2024-09-16T01:25:22.646 INFO:tasks.workunit.client.0.smithi063.stdout:7/693: chown d7/d1c/d1f/fac 205909 1 2024-09-16T01:25:22.648 INFO:tasks.workunit.client.0.smithi063.stdout:3/760: rmdir d2/d11/d37/d40/d5e/d3b/d68/d6d 39 2024-09-16T01:25:22.649 INFO:tasks.workunit.client.0.smithi063.stdout:3/761: readlink d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/le1 0 2024-09-16T01:25:22.650 INFO:tasks.workunit.client.0.smithi063.stdout:7/694: dread d7/d1c/d1f/d29/d88/d98/fbe [0,4194304] 0 2024-09-16T01:25:22.651 INFO:tasks.workunit.client.0.smithi063.stdout:3/762: mkdir d2/d11/d37/dab/d10b 0 2024-09-16T01:25:22.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/695: symlink d7/d1c/d1f/d29/d88/d96/dca/lde 0 2024-09-16T01:25:22.654 INFO:tasks.workunit.client.0.smithi063.stdout:3/763: truncate d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6/fcd 391764 0 2024-09-16T01:25:22.657 INFO:tasks.workunit.client.0.smithi063.stdout:3/764: getdents d2/d11/d37/d40/d5e 0 2024-09-16T01:25:22.660 INFO:tasks.workunit.client.0.smithi063.stdout:3/765: creat d2/d11/d37/d40/d5e/d3b/d68/d6d/f10c x:0 0 0 2024-09-16T01:25:22.660 INFO:tasks.workunit.client.0.smithi063.stdout:6/791: sync 2024-09-16T01:25:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:9/796: sync 2024-09-16T01:25:22.661 INFO:tasks.workunit.client.0.smithi063.stdout:1/755: sync 2024-09-16T01:25:22.662 INFO:tasks.workunit.client.0.smithi063.stdout:3/766: dread d2/d11/d69/d80/d8a/fc5 [0,4194304] 0 2024-09-16T01:25:22.662 INFO:tasks.workunit.client.0.smithi063.stdout:7/696: dread d7/d56/d57/d73/f7e [0,4194304] 0 2024-09-16T01:25:22.664 INFO:tasks.workunit.client.0.smithi063.stdout:6/792: creat d3/d48/d28/f118 x:0 0 0 2024-09-16T01:25:22.665 INFO:tasks.workunit.client.0.smithi063.stdout:3/767: chown d2/d11/d37/d40/d5e/d3b/d45/d9f 0 1 2024-09-16T01:25:22.666 INFO:tasks.workunit.client.0.smithi063.stdout:6/793: read - d3/d10/d49/f10a zero size 2024-09-16T01:25:22.668 INFO:tasks.workunit.client.0.smithi063.stdout:9/797: rmdir d7/d9/d20/de3/de7/d14/d63/d5f/dab/dd1 39 2024-09-16T01:25:22.669 INFO:tasks.workunit.client.0.smithi063.stdout:7/697: rename d7/d1c/d1f/d29/dbf/d39/d65/lc7 to d7/d56/d57/d73/d91/ldf 0 2024-09-16T01:25:22.670 INFO:tasks.workunit.client.0.smithi063.stdout:1/756: dwrite d1/d12/ff4 [0,4194304] 0 2024-09-16T01:25:22.671 INFO:tasks.workunit.client.0.smithi063.stdout:6/794: creat d3/d30/d39/dac/db5/f119 x:0 0 0 2024-09-16T01:25:22.671 INFO:tasks.workunit.client.0.smithi063.stdout:9/798: mkdir d7/d116 0 2024-09-16T01:25:22.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:22 smithi192 ceph-mon[34775]: pgmap v396: 97 pgs: 97 active+clean; 1.4 GiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s rd, 195 MiB/s wr, 335 op/s 2024-09-16T01:25:22.674 INFO:tasks.workunit.client.0.smithi063.stdout:7/698: mkdir d7/d56/d57/d60/db9/de0 0 2024-09-16T01:25:22.674 INFO:tasks.workunit.client.0.smithi063.stdout:9/799: write d7/d4a/dba/fee [175190,88508] 0 2024-09-16T01:25:22.675 INFO:tasks.workunit.client.0.smithi063.stdout:1/757: symlink d1/d5/d15/d1b/lf8 0 2024-09-16T01:25:22.678 INFO:tasks.workunit.client.0.smithi063.stdout:3/768: dwrite d2/d11/d18/f2d [0,4194304] 0 2024-09-16T01:25:22.680 INFO:tasks.workunit.client.0.smithi063.stdout:3/769: write d2/fa0 [1034461,82012] 0 2024-09-16T01:25:22.681 INFO:tasks.workunit.client.0.smithi063.stdout:7/699: creat d7/d56/d57/d73/fe1 x:0 0 0 2024-09-16T01:25:22.682 INFO:tasks.workunit.client.0.smithi063.stdout:6/795: dread d3/d10/f60 [0,4194304] 0 2024-09-16T01:25:22.683 INFO:tasks.workunit.client.0.smithi063.stdout:1/758: getdents d1/d5/d82/d9b/d77/d7d/dcb 0 2024-09-16T01:25:22.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:22 smithi162 ceph-mon[34539]: pgmap v396: 97 pgs: 97 active+clean; 1.4 GiB data, 901 MiB used, 1.0 TiB / 1.0 TiB avail; 48 MiB/s rd, 195 MiB/s wr, 335 op/s 2024-09-16T01:25:22.685 INFO:tasks.workunit.client.0.smithi063.stdout:7/700: mkdir d7/d1c/d1f/d29/dbf/d39/d9d/de2 0 2024-09-16T01:25:22.686 INFO:tasks.workunit.client.0.smithi063.stdout:1/759: mkdir d1/d5/d82/d9b/d77/d7d/dcb/df9 0 2024-09-16T01:25:22.686 INFO:tasks.workunit.client.0.smithi063.stdout:9/800: symlink d7/d9/d20/de3/de7/d14/d23/d109/l117 0 2024-09-16T01:25:22.687 INFO:tasks.workunit.client.0.smithi063.stdout:6/796: unlink d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/f117 0 2024-09-16T01:25:22.689 INFO:tasks.workunit.client.0.smithi063.stdout:9/801: mknod d7/d9/d20/de3/de7/db2/dca/d102/c118 0 2024-09-16T01:25:22.690 INFO:tasks.workunit.client.0.smithi063.stdout:7/701: rename d7/d1c/d1f/f2b to d7/d56/d6b/fe3 0 2024-09-16T01:25:22.691 INFO:tasks.workunit.client.0.smithi063.stdout:6/797: mkdir d3/d10/d11a 0 2024-09-16T01:25:22.692 INFO:tasks.workunit.client.0.smithi063.stdout:9/802: symlink d7/d1f/l119 0 2024-09-16T01:25:22.694 INFO:tasks.workunit.client.0.smithi063.stdout:6/798: chown d3/d48/d28/d3e/d44/c6e 14713106 1 2024-09-16T01:25:22.695 INFO:tasks.workunit.client.0.smithi063.stdout:1/760: dwrite d1/d5/d15/f62 [4194304,4194304] 0 2024-09-16T01:25:22.695 INFO:tasks.workunit.client.0.smithi063.stdout:7/702: creat d7/d56/d57/d60/db9/de0/fe4 x:0 0 0 2024-09-16T01:25:22.697 INFO:tasks.workunit.client.0.smithi063.stdout:7/703: dread - d7/d1c/d1f/d29/fc8 zero size 2024-09-16T01:25:22.698 INFO:tasks.workunit.client.0.smithi063.stdout:9/803: symlink d7/d9/d20/de3/de7/d14/d63/d5f/dab/dd1/l11a 0 2024-09-16T01:25:22.698 INFO:tasks.workunit.client.0.smithi063.stdout:7/704: chown d7/d1c 45 1 2024-09-16T01:25:22.700 INFO:tasks.workunit.client.0.smithi063.stdout:1/761: mknod d1/d5/d82/d9b/d77/d7d/cfa 0 2024-09-16T01:25:22.700 INFO:tasks.workunit.client.0.smithi063.stdout:6/799: link d3/d41/d9b/fe8 d3/d10/f11b 0 2024-09-16T01:25:22.701 INFO:tasks.workunit.client.0.smithi063.stdout:9/804: symlink d7/d9/d20/de3/de7/d14/d23/d109/l11b 0 2024-09-16T01:25:22.702 INFO:tasks.workunit.client.0.smithi063.stdout:6/800: mkdir d3/d48/d28/d3e/d44/d52/d11c 0 2024-09-16T01:25:22.704 INFO:tasks.workunit.client.0.smithi063.stdout:1/762: creat d1/d5/d82/d9b/d77/d7d/dc2/dad/ffb x:0 0 0 2024-09-16T01:25:22.704 INFO:tasks.workunit.client.0.smithi063.stdout:9/805: rename d7/d4a/d4d/d96/ccb to d7/d9/d20/c11c 0 2024-09-16T01:25:22.706 INFO:tasks.workunit.client.0.smithi063.stdout:9/806: mkdir d7/d4a/d9d/d11d 0 2024-09-16T01:25:22.706 INFO:tasks.workunit.client.0.smithi063.stdout:1/763: symlink d1/d5/d82/d9b/d77/d7d/dcb/lfc 0 2024-09-16T01:25:22.709 INFO:tasks.workunit.client.0.smithi063.stdout:1/764: unlink d1/d5/d82/d9b/d77/d86/dc6/fcf 0 2024-09-16T01:25:22.709 INFO:tasks.workunit.client.0.smithi063.stdout:9/807: write d7/d9/d20/de3/de7/d14/fd6 [4082626,19896] 0 2024-09-16T01:25:22.710 INFO:tasks.workunit.client.0.smithi063.stdout:9/808: stat d7/c1a 0 2024-09-16T01:25:22.714 INFO:tasks.workunit.client.0.smithi063.stdout:9/809: rename d7/d9/d20/de3/de7/db2/dca/fed to d7/d4a/d9d/f11e 0 2024-09-16T01:25:22.715 INFO:tasks.workunit.client.0.smithi063.stdout:1/765: dwrite d1/d5/d15/d18/f42 [0,4194304] 0 2024-09-16T01:25:22.718 INFO:tasks.workunit.client.0.smithi063.stdout:9/810: mknod d7/d4a/dba/dfd/c11f 0 2024-09-16T01:25:22.718 INFO:tasks.workunit.client.0.smithi063.stdout:1/766: symlink d1/d5/d6f/dd2/de1/lfd 0 2024-09-16T01:25:22.720 INFO:tasks.workunit.client.0.smithi063.stdout:1/767: dread - d1/d5/d15/fb2 zero size 2024-09-16T01:25:22.720 INFO:tasks.workunit.client.0.smithi063.stdout:7/705: dwrite d7/f14 [0,4194304] 0 2024-09-16T01:25:22.723 INFO:tasks.workunit.client.0.smithi063.stdout:1/768: symlink d1/d5/d82/d9b/d77/d86/lfe 0 2024-09-16T01:25:22.727 INFO:tasks.workunit.client.0.smithi063.stdout:1/769: dread d1/dd/d3b/db3/fe3 [0,4194304] 0 2024-09-16T01:25:22.728 INFO:tasks.workunit.client.0.smithi063.stdout:7/706: write d7/fe [4256386,125057] 0 2024-09-16T01:25:22.730 INFO:tasks.workunit.client.0.smithi063.stdout:1/770: rename d1/lc0 to d1/d5/d82/d9b/d77/d7d/dcb/lff 0 2024-09-16T01:25:22.732 INFO:tasks.workunit.client.0.smithi063.stdout:7/707: symlink d7/d1c/d1f/d29/db5/le5 0 2024-09-16T01:25:22.733 INFO:tasks.workunit.client.0.smithi063.stdout:7/708: chown d7/d1c/d1f/d29/dbf/d39/d9d/fda 75 1 2024-09-16T01:25:22.737 INFO:tasks.workunit.client.0.smithi063.stdout:7/709: dread d7/d1c/d1f/d29/dbf/d40/f58 [0,4194304] 0 2024-09-16T01:25:22.739 INFO:tasks.workunit.client.0.smithi063.stdout:7/710: mknod d7/d1c/d1f/d29/d88/d96/ce6 0 2024-09-16T01:25:22.742 INFO:tasks.workunit.client.0.smithi063.stdout:1/771: dwrite d1/d5/f10 [0,4194304] 0 2024-09-16T01:25:22.745 INFO:tasks.workunit.client.0.smithi063.stdout:1/772: readlink d1/d5/d82/d9b/d77/d7d/dcb/lfc 0 2024-09-16T01:25:22.746 INFO:tasks.workunit.client.0.smithi063.stdout:1/773: fsync d1/d5/d82/faa 0 2024-09-16T01:25:22.746 INFO:tasks.workunit.client.0.smithi063.stdout:7/711: dwrite d7/d1c/d1f/d29/dbf/d40/fa9 [0,4194304] 0 2024-09-16T01:25:22.752 INFO:tasks.workunit.client.0.smithi063.stdout:1/774: getdents d1/d5/d6f/dd2 0 2024-09-16T01:25:22.759 INFO:tasks.workunit.client.0.smithi063.stdout:7/712: dwrite d7/d1c/d1f/d29/dbf/d39/fd9 [0,4194304] 0 2024-09-16T01:25:22.762 INFO:tasks.workunit.client.0.smithi063.stdout:7/713: mknod d7/d56/d57/d60/ce7 0 2024-09-16T01:25:22.763 INFO:tasks.workunit.client.0.smithi063.stdout:1/775: dwrite d1/d5/d15/f19 [0,4194304] 0 2024-09-16T01:25:22.764 INFO:tasks.workunit.client.0.smithi063.stdout:7/714: dread - d7/d1c/d1f/d29/d72/fa8 zero size 2024-09-16T01:25:22.767 INFO:tasks.workunit.client.0.smithi063.stdout:7/715: dread - d7/f48 zero size 2024-09-16T01:25:22.767 INFO:tasks.workunit.client.0.smithi063.stdout:1/776: getdents d1/dd 0 2024-09-16T01:25:22.769 INFO:tasks.workunit.client.0.smithi063.stdout:1/777: mkdir d1/d5/d6f/dd2/de1/d100 0 2024-09-16T01:25:22.770 INFO:tasks.workunit.client.0.smithi063.stdout:1/778: truncate d1/fe5 493831 0 2024-09-16T01:25:22.774 INFO:tasks.workunit.client.0.smithi063.stdout:7/716: rename d7/d1c/d1f/f38 to d7/d1c/d1f/d29/dbf/d40/d6c/fe8 0 2024-09-16T01:25:22.774 INFO:tasks.workunit.client.0.smithi063.stdout:1/779: link d1/dd/d3b/f58 d1/d5/d15/d18/f101 0 2024-09-16T01:25:22.775 INFO:tasks.workunit.client.0.smithi063.stdout:7/717: readlink d7/ld 0 2024-09-16T01:25:22.777 INFO:tasks.workunit.client.0.smithi063.stdout:7/718: write d7/d1c/d1f/d29/dbf/f45 [5772509,43286] 0 2024-09-16T01:25:22.777 INFO:tasks.workunit.client.0.smithi063.stdout:1/780: creat d1/d5/d82/d9b/f102 x:0 0 0 2024-09-16T01:25:22.778 INFO:tasks.workunit.client.0.smithi063.stdout:7/719: write d7/d1c/d1f/f32 [1723247,85399] 0 2024-09-16T01:25:22.780 INFO:tasks.workunit.client.0.smithi063.stdout:7/720: write d7/d1c/d1f/d29/dbf/d40/d6c/fc3 [5740048,30388] 0 2024-09-16T01:25:22.784 INFO:tasks.workunit.client.0.smithi063.stdout:7/721: write d7/d56/d57/d73/d91/fd1 [595528,114193] 0 2024-09-16T01:25:22.785 INFO:tasks.workunit.client.0.smithi063.stdout:7/722: mkdir d7/d56/d57/d60/de9 0 2024-09-16T01:25:22.788 INFO:tasks.workunit.client.0.smithi063.stdout:7/723: dwrite d7/d1c/d1f/d29/dbf/d40/fa9 [4194304,4194304] 0 2024-09-16T01:25:22.791 INFO:tasks.workunit.client.0.smithi063.stdout:7/724: creat d7/d1c/d1f/d29/d72/d9e/fea x:0 0 0 2024-09-16T01:25:22.794 INFO:tasks.workunit.client.0.smithi063.stdout:7/725: mkdir d7/d56/d57/d60/db9/de0/deb 0 2024-09-16T01:25:22.795 INFO:tasks.workunit.client.0.smithi063.stdout:4/770: sync 2024-09-16T01:25:22.795 INFO:tasks.workunit.client.0.smithi063.stdout:5/862: sync 2024-09-16T01:25:22.795 INFO:tasks.workunit.client.0.smithi063.stdout:0/776: sync 2024-09-16T01:25:22.795 INFO:tasks.workunit.client.0.smithi063.stdout:7/726: mknod d7/d1c/d1f/d29/d88/d98/cec 0 2024-09-16T01:25:22.797 INFO:tasks.workunit.client.0.smithi063.stdout:5/863: truncate d5/d12/d91/d72/f106 695053 0 2024-09-16T01:25:22.797 INFO:tasks.workunit.client.0.smithi063.stdout:4/771: mknod d5/d3b/d57/dce/cfe 0 2024-09-16T01:25:22.797 INFO:tasks.workunit.client.0.smithi063.stdout:0/777: mknod d1/df/d2c/c11b 0 2024-09-16T01:25:22.798 INFO:tasks.workunit.client.0.smithi063.stdout:7/727: mkdir d7/d1c/d1f/d66/ded 0 2024-09-16T01:25:22.798 INFO:tasks.workunit.client.0.smithi063.stdout:0/778: chown d1/d30/d95/db5 590953 1 2024-09-16T01:25:22.799 INFO:tasks.workunit.client.0.smithi063.stdout:4/772: write d5/d3b/d5c/fbf [999715,26617] 0 2024-09-16T01:25:22.803 INFO:tasks.workunit.client.0.smithi063.stdout:5/864: chown d5/d18/d29/d52/d12e/de4/d105 2 1 2024-09-16T01:25:22.805 INFO:tasks.workunit.client.0.smithi063.stdout:4/773: truncate d5/d3b/df/d1c/d29/f5a 5674213 0 2024-09-16T01:25:22.807 INFO:tasks.workunit.client.0.smithi063.stdout:4/774: creat d5/d3b/d57/d66/db7/fff x:0 0 0 2024-09-16T01:25:22.810 INFO:tasks.workunit.client.0.smithi063.stdout:4/775: fsync d5/d3b/df/d1c/d29/dd4/dbc/fd6 0 2024-09-16T01:25:22.810 INFO:tasks.workunit.client.0.smithi063.stdout:5/865: getdents d5/d18/d29/d48/d98 0 2024-09-16T01:25:22.811 INFO:tasks.workunit.client.0.smithi063.stdout:5/866: fsync d5/d12/d91/f10e 0 2024-09-16T01:25:22.812 INFO:tasks.workunit.client.0.smithi063.stdout:7/728: dread d7/d56/f64 [0,4194304] 0 2024-09-16T01:25:22.813 INFO:tasks.workunit.client.0.smithi063.stdout:4/776: creat d5/d3b/d57/d68/d90/f100 x:0 0 0 2024-09-16T01:25:22.814 INFO:tasks.workunit.client.0.smithi063.stdout:0/779: write d1/d30/d52/d5a/f3d [726734,108444] 0 2024-09-16T01:25:22.815 INFO:tasks.workunit.client.0.smithi063.stdout:4/777: unlink d5/d3b/d57/l6c 0 2024-09-16T01:25:22.818 INFO:tasks.workunit.client.0.smithi063.stdout:0/780: creat d1/d30/d52/d5a/d44/f11c x:0 0 0 2024-09-16T01:25:22.818 INFO:tasks.workunit.client.0.smithi063.stdout:4/778: creat d5/d3b/d57/f101 x:0 0 0 2024-09-16T01:25:22.821 INFO:tasks.workunit.client.0.smithi063.stdout:0/781: write d1/df/d17/f81 [700961,96762] 0 2024-09-16T01:25:22.823 INFO:tasks.workunit.client.0.smithi063.stdout:4/779: dwrite d5/d3b/f16 [8388608,4194304] 0 2024-09-16T01:25:22.824 INFO:tasks.workunit.client.0.smithi063.stdout:0/782: symlink d1/d30/d52/d9d/deb/l11d 0 2024-09-16T01:25:22.826 INFO:tasks.workunit.client.0.smithi063.stdout:5/867: dread d5/d18/d29/d48/d98/d94/f60 [4194304,4194304] 0 2024-09-16T01:25:22.826 INFO:tasks.workunit.client.0.smithi063.stdout:0/783: creat d1/d30/d52/db3/f11e x:0 0 0 2024-09-16T01:25:22.827 INFO:tasks.workunit.client.0.smithi063.stdout:4/780: truncate d5/d3b/df/d1c/f36 4117794 0 2024-09-16T01:25:22.828 INFO:tasks.workunit.client.0.smithi063.stdout:0/784: chown d1/d2e/d48/dc3/c113 467670 1 2024-09-16T01:25:22.829 INFO:tasks.workunit.client.0.smithi063.stdout:5/868: creat d5/d7f/da3/de3/d12b/f137 x:0 0 0 2024-09-16T01:25:22.830 INFO:tasks.workunit.client.0.smithi063.stdout:5/869: dread - d5/d18/d29/d48/d66/f83 zero size 2024-09-16T01:25:22.832 INFO:tasks.workunit.client.0.smithi063.stdout:4/781: rename d5/d3b/df/d1c/d29/d32/d60/cd3 to d5/d3b/d57/d66/d9b/d7a/def/c102 0 2024-09-16T01:25:22.837 INFO:tasks.workunit.client.0.smithi063.stdout:0/785: dwrite d1/d30/d95/fc5 [0,4194304] 0 2024-09-16T01:25:22.840 INFO:tasks.workunit.client.0.smithi063.stdout:5/870: dwrite d5/d12/d91/d72/fb3 [0,4194304] 0 2024-09-16T01:25:22.842 INFO:tasks.workunit.client.0.smithi063.stdout:0/786: symlink d1/df/d2c/dde/l11f 0 2024-09-16T01:25:22.845 INFO:tasks.workunit.client.0.smithi063.stdout:0/787: chown d1/d30/d52/d5a/d44/dbc 1 1 2024-09-16T01:25:22.846 INFO:tasks.workunit.client.0.smithi063.stdout:4/782: dwrite d5/d3b/df/d1c/f53 [4194304,4194304] 0 2024-09-16T01:25:22.847 INFO:tasks.workunit.client.0.smithi063.stdout:5/871: creat d5/d18/d29/d48/d66/db1/d120/f138 x:0 0 0 2024-09-16T01:25:22.847 INFO:tasks.workunit.client.0.smithi063.stdout:0/788: chown d1/d30/d52/d5a/c26 4 1 2024-09-16T01:25:22.848 INFO:tasks.workunit.client.0.smithi063.stdout:0/789: readlink d1/d2e/d48/dc3/lda 0 2024-09-16T01:25:22.851 INFO:tasks.workunit.client.0.smithi063.stdout:0/790: read - d1/d30/d52/f9f zero size 2024-09-16T01:25:22.853 INFO:tasks.workunit.client.0.smithi063.stdout:0/791: readlink d1/df/d2c/l3b 0 2024-09-16T01:25:22.856 INFO:tasks.workunit.client.0.smithi063.stdout:5/872: dwrite d5/d12/f4c [4194304,4194304] 0 2024-09-16T01:25:22.856 INFO:tasks.workunit.client.0.smithi063.stdout:0/792: rmdir d1/df/d34/da6 39 2024-09-16T01:25:22.856 INFO:tasks.workunit.client.0.smithi063.stdout:4/783: dwrite d5/d3b/d57/d68/d90/f100 [0,4194304] 0 2024-09-16T01:25:22.859 INFO:tasks.workunit.client.0.smithi063.stdout:4/784: symlink d5/d3b/d57/l103 0 2024-09-16T01:25:22.862 INFO:tasks.workunit.client.0.smithi063.stdout:5/873: rename d5/d18/d29/d48/ddb/f12c to d5/d12/d91/d72/f139 0 2024-09-16T01:25:22.865 INFO:tasks.workunit.client.0.smithi063.stdout:0/793: link d1/d30/d52/d5a/d36/ffc d1/d30/d52/f120 0 2024-09-16T01:25:22.865 INFO:tasks.workunit.client.0.smithi063.stdout:4/785: rename d5/d3b/df/l1a to d5/d3b/d57/d66/l104 0 2024-09-16T01:25:22.869 INFO:tasks.workunit.client.0.smithi063.stdout:0/794: link d1/d30/d52/db3/f11e d1/df/d2c/dde/f121 0 2024-09-16T01:25:22.872 INFO:tasks.workunit.client.0.smithi063.stdout:5/874: rename d5/d90 to d5/d18/d29/d52/d12e/de4/d105/d13a 0 2024-09-16T01:25:22.879 INFO:tasks.workunit.client.0.smithi063.stdout:0/795: write d1/d2e/d48/f108 [1227982,27184] 0 2024-09-16T01:25:22.881 INFO:tasks.workunit.client.0.smithi063.stdout:5/875: truncate d5/d18/d29/d48/d7b/dc2/fc4 2704485 0 2024-09-16T01:25:22.882 INFO:tasks.workunit.client.0.smithi063.stdout:0/796: mknod d1/d30/d52/d5a/d36/d41/c122 0 2024-09-16T01:25:22.882 INFO:tasks.workunit.client.0.smithi063.stdout:0/797: dread - d1/d2e/d48/dc3/ff2 zero size 2024-09-16T01:25:22.883 INFO:tasks.workunit.client.0.smithi063.stdout:5/876: creat d5/d18/d29/d48/d66/db1/dfc/f13b x:0 0 0 2024-09-16T01:25:22.884 INFO:tasks.workunit.client.0.smithi063.stdout:0/798: symlink d1/d30/d95/l123 0 2024-09-16T01:25:22.885 INFO:tasks.workunit.client.0.smithi063.stdout:5/877: creat d5/d18/d29/d48/d66/db1/dfc/f13c x:0 0 0 2024-09-16T01:25:22.886 INFO:tasks.workunit.client.0.smithi063.stdout:0/799: fsync d1/d30/d52/d5a/d36/fb2 0 2024-09-16T01:25:22.889 INFO:tasks.workunit.client.0.smithi063.stdout:0/800: link d1/d2e/d48/f98 d1/d2e/d48/dcb/f124 0 2024-09-16T01:25:22.891 INFO:tasks.workunit.client.0.smithi063.stdout:5/878: dwrite d5/d18/d29/d48/d98/d118/f101 [0,4194304] 0 2024-09-16T01:25:22.892 INFO:tasks.workunit.client.0.smithi063.stdout:0/801: creat d1/df/d2c/d43/d90/f125 x:0 0 0 2024-09-16T01:25:22.892 INFO:tasks.workunit.client.0.smithi063.stdout:5/879: stat d5/d7f/df1/fd8 0 2024-09-16T01:25:22.894 INFO:tasks.workunit.client.0.smithi063.stdout:5/880: write d5/d12/d91/f8c [2809188,84794] 0 2024-09-16T01:25:22.896 INFO:tasks.workunit.client.0.smithi063.stdout:5/881: stat d5/d18/d29/d48/d98/d116 0 2024-09-16T01:25:22.901 INFO:tasks.workunit.client.0.smithi063.stdout:5/882: truncate d5/d12/f13 919697 0 2024-09-16T01:25:22.902 INFO:tasks.workunit.client.0.smithi063.stdout:5/883: symlink d5/d7f/da3/de3/l13d 0 2024-09-16T01:25:22.904 INFO:tasks.workunit.client.0.smithi063.stdout:0/802: dread d1/df/fa4 [0,4194304] 0 2024-09-16T01:25:22.905 INFO:tasks.workunit.client.0.smithi063.stdout:5/884: unlink d5/d18/d29/d48/d98/d94/f60 0 2024-09-16T01:25:22.906 INFO:tasks.workunit.client.0.smithi063.stdout:0/803: creat d1/d2e/f126 x:0 0 0 2024-09-16T01:25:22.907 INFO:tasks.workunit.client.0.smithi063.stdout:5/885: chown d5/d18/d29/d48/d7b/d85 1824 1 2024-09-16T01:25:22.907 INFO:tasks.workunit.client.0.smithi063.stdout:0/804: readlink d1/df/d34/lf8 0 2024-09-16T01:25:22.909 INFO:tasks.workunit.client.0.smithi063.stdout:5/886: unlink d5/d18/d29/d48/d66/db1/dfc/c113 0 2024-09-16T01:25:22.911 INFO:tasks.workunit.client.0.smithi063.stdout:0/805: truncate d1/df/fd3 1624080 0 2024-09-16T01:25:22.915 INFO:tasks.workunit.client.0.smithi063.stdout:5/887: dwrite d5/d18/d29/d48/d98/d118/ff3 [0,4194304] 0 2024-09-16T01:25:22.918 INFO:tasks.workunit.client.0.smithi063.stdout:5/888: creat d5/d18/d29/d48/d66/db1/f13e x:0 0 0 2024-09-16T01:25:22.918 INFO:tasks.workunit.client.0.smithi063.stdout:5/889: chown d5/d7f/l112 979458 1 2024-09-16T01:25:22.920 INFO:tasks.workunit.client.0.smithi063.stdout:5/890: chown d5/d18/d29/d48/d7b/d85/lb8 14093 1 2024-09-16T01:25:22.925 INFO:tasks.workunit.client.0.smithi063.stdout:5/891: rmdir d5/d18/d29/d52/d12e/de4/d105/d13a 39 2024-09-16T01:25:22.925 INFO:tasks.workunit.client.0.smithi063.stdout:0/806: dwrite d1/df/d2c/d43/fa0 [0,4194304] 0 2024-09-16T01:25:22.926 INFO:tasks.workunit.client.0.smithi063.stdout:5/892: chown d5/d18/d29/d48/d7b/dc2/lff 32 1 2024-09-16T01:25:22.927 INFO:tasks.workunit.client.0.smithi063.stdout:5/893: chown d5/d7f/da3/de3/d12b/f137 239 1 2024-09-16T01:25:22.928 INFO:tasks.workunit.client.0.smithi063.stdout:0/807: truncate d1/d30/faa 479794 0 2024-09-16T01:25:22.928 INFO:tasks.workunit.client.0.smithi063.stdout:2/881: sync 2024-09-16T01:25:22.929 INFO:tasks.workunit.client.0.smithi063.stdout:8/623: sync 2024-09-16T01:25:22.930 INFO:tasks.workunit.client.0.smithi063.stdout:5/894: dread - d5/d7f/da3/de3/d12b/f137 zero size 2024-09-16T01:25:22.930 INFO:tasks.workunit.client.0.smithi063.stdout:2/882: dread - d3/d7/d8/fc8 zero size 2024-09-16T01:25:22.930 INFO:tasks.workunit.client.0.smithi063.stdout:8/624: write d5/db/d12/d3d/fbc [2171942,114520] 0 2024-09-16T01:25:22.933 INFO:tasks.workunit.client.0.smithi063.stdout:2/883: symlink d3/d7/d8/df1/df3/d120/l132 0 2024-09-16T01:25:22.935 INFO:tasks.workunit.client.0.smithi063.stdout:8/625: fsync d5/db/d12/d3d/d69/daa/d40/d4a/fca 0 2024-09-16T01:25:22.935 INFO:tasks.workunit.client.0.smithi063.stdout:0/808: write d1/d30/d52/d5a/f1f [5036124,79051] 0 2024-09-16T01:25:22.939 INFO:tasks.workunit.client.0.smithi063.stdout:5/895: dwrite d5/d18/d29/d48/dad/f121 [0,4194304] 0 2024-09-16T01:25:22.939 INFO:tasks.workunit.client.0.smithi063.stdout:8/626: unlink d5/d9/f16 0 2024-09-16T01:25:22.941 INFO:tasks.workunit.client.0.smithi063.stdout:8/627: creat d5/d8c/dbd/fd0 x:0 0 0 2024-09-16T01:25:22.941 INFO:tasks.workunit.client.0.smithi063.stdout:0/809: link d1/df/f54 d1/d2e/d48/dc3/f127 0 2024-09-16T01:25:22.943 INFO:tasks.workunit.client.0.smithi063.stdout:5/896: rename d5/d18/d29/fbd to d5/d7f/df1/f13f 0 2024-09-16T01:25:22.944 INFO:tasks.workunit.client.0.smithi063.stdout:0/810: truncate d1/df/d2c/f117 787696 0 2024-09-16T01:25:22.945 INFO:tasks.workunit.client.0.smithi063.stdout:8/628: dread d5/f94 [0,4194304] 0 2024-09-16T01:25:22.945 INFO:tasks.workunit.client.0.smithi063.stdout:0/811: readlink d1/df/d2c/dde/lfd 0 2024-09-16T01:25:22.945 INFO:tasks.workunit.client.0.smithi063.stdout:5/897: rmdir d5/d18/d29/d48/d66/db1/dfc 39 2024-09-16T01:25:23.012 INFO:tasks.workunit.client.0.smithi063.stdout:2/884: truncate d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/f74 324950 0 2024-09-16T01:25:23.014 INFO:tasks.workunit.client.0.smithi063.stdout:8/629: creat d5/db/fd1 x:0 0 0 2024-09-16T01:25:23.015 INFO:tasks.workunit.client.0.smithi063.stdout:5/898: creat d5/d18/d29/d52/d12e/de4/d105/f140 x:0 0 0 2024-09-16T01:25:23.015 INFO:tasks.workunit.client.0.smithi063.stdout:8/630: dread - d5/db/d12/d3d/d69/daa/f9b zero size 2024-09-16T01:25:23.018 INFO:tasks.workunit.client.0.smithi063.stdout:5/899: creat d5/d7f/da3/de3/d11a/f141 x:0 0 0 2024-09-16T01:25:23.019 INFO:tasks.workunit.client.0.smithi063.stdout:8/631: getdents d5/d8c/d74/db7 0 2024-09-16T01:25:23.022 INFO:tasks.workunit.client.0.smithi063.stdout:0/812: dread d1/d2e/f4a [0,4194304] 0 2024-09-16T01:25:23.022 INFO:tasks.workunit.client.0.smithi063.stdout:5/900: dread d5/d12/f23 [0,4194304] 0 2024-09-16T01:25:23.026 INFO:tasks.workunit.client.0.smithi063.stdout:8/632: dwrite d5/db/d12/d3d/d69/daa/d40/d4a/fca [4194304,4194304] 0 2024-09-16T01:25:23.026 INFO:tasks.workunit.client.0.smithi063.stdout:5/901: chown d5/d18/d29/d48/d66/db1/l12a 372792 1 2024-09-16T01:25:23.027 INFO:tasks.workunit.client.0.smithi063.stdout:8/633: dread - d5/db/d12/d1a/fc3 zero size 2024-09-16T01:25:23.028 INFO:tasks.workunit.client.0.smithi063.stdout:8/634: chown d5/d8c 375261768 1 2024-09-16T01:25:23.030 INFO:tasks.workunit.client.0.smithi063.stdout:8/635: fsync d5/db/d12/fa7 0 2024-09-16T01:25:23.033 INFO:tasks.workunit.client.0.smithi063.stdout:8/636: symlink d5/db/d12/d1a/d1e/d93/ld2 0 2024-09-16T01:25:23.035 INFO:tasks.workunit.client.0.smithi063.stdout:5/902: dread d5/d12/f56 [0,4194304] 0 2024-09-16T01:25:23.038 INFO:tasks.workunit.client.0.smithi063.stdout:0/813: dwrite d1/d30/faa [0,4194304] 0 2024-09-16T01:25:23.045 INFO:tasks.workunit.client.0.smithi063.stdout:0/814: link d1/d30/d52/d5a/d44/ff3 d1/d2e/dc1/f128 0 2024-09-16T01:25:23.045 INFO:tasks.workunit.client.0.smithi063.stdout:5/903: dwrite d5/d18/d29/d48/d98/f9e [0,4194304] 0 2024-09-16T01:25:23.046 INFO:tasks.workunit.client.0.smithi063.stdout:8/637: dwrite d5/db/d12/d3d/f79 [0,4194304] 0 2024-09-16T01:25:23.048 INFO:tasks.workunit.client.0.smithi063.stdout:8/638: write d5/db/d12/d1a/d1e/d68/dc9/f56 [1361522,75318] 0 2024-09-16T01:25:23.051 INFO:tasks.workunit.client.0.smithi063.stdout:5/904: rmdir d5/d7f/da3/de3/d11a 39 2024-09-16T01:25:23.054 INFO:tasks.workunit.client.0.smithi063.stdout:8/639: creat d5/fd3 x:0 0 0 2024-09-16T01:25:23.055 INFO:tasks.workunit.client.0.smithi063.stdout:0/815: dwrite d1/df/ff1 [0,4194304] 0 2024-09-16T01:25:23.056 INFO:tasks.workunit.client.0.smithi063.stdout:8/640: chown d5/db/d12/d1a/c8d 263960 1 2024-09-16T01:25:23.059 INFO:tasks.workunit.client.0.smithi063.stdout:0/816: creat d1/d30/d52/d9d/deb/f129 x:0 0 0 2024-09-16T01:25:23.061 INFO:tasks.workunit.client.0.smithi063.stdout:8/641: truncate d5/db/d12/f64 6538529 0 2024-09-16T01:25:23.061 INFO:tasks.workunit.client.0.smithi063.stdout:5/905: rename d5/d18/d29/d48/d98/d115 to d5/d18/d29/d48/d7b/d85/df9/d142 0 2024-09-16T01:25:23.063 INFO:tasks.workunit.client.0.smithi063.stdout:3/770: sync 2024-09-16T01:25:23.064 INFO:tasks.workunit.client.0.smithi063.stdout:0/817: mkdir d1/df/d12a 0 2024-09-16T01:25:23.068 INFO:tasks.workunit.client.0.smithi063.stdout:8/642: link d5/d8c/d74/d87/lab d5/d8c/ld4 0 2024-09-16T01:25:23.069 INFO:tasks.workunit.client.0.smithi063.stdout:0/818: rename d1/d1c/f80 to d1/df/d2c/d43/d89/f12b 0 2024-09-16T01:25:23.073 INFO:tasks.workunit.client.0.smithi063.stdout:5/906: dwrite d5/d7f/dcb/f117 [0,4194304] 0 2024-09-16T01:25:23.074 INFO:tasks.workunit.client.0.smithi063.stdout:3/771: rename d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6/fcd to d2/d11/d69/d80/d8a/f10d 0 2024-09-16T01:25:23.077 INFO:tasks.workunit.client.0.smithi063.stdout:0/819: link d1/d30/d52/f120 d1/d30/d52/db3/f12c 0 2024-09-16T01:25:23.080 INFO:tasks.workunit.client.0.smithi063.stdout:8/643: dwrite d5/f83 [0,4194304] 0 2024-09-16T01:25:23.081 INFO:tasks.workunit.client.0.smithi063.stdout:0/820: mknod d1/d2e/d48/dcb/c12d 0 2024-09-16T01:25:23.082 INFO:tasks.workunit.client.0.smithi063.stdout:3/772: dread d2/dc1/f104 [0,4194304] 0 2024-09-16T01:25:23.082 INFO:tasks.workunit.client.0.smithi063.stdout:8/644: mkdir d5/d86/dd5 0 2024-09-16T01:25:23.083 INFO:tasks.workunit.client.0.smithi063.stdout:5/907: creat d5/d12/d91/f143 x:0 0 0 2024-09-16T01:25:23.087 INFO:tasks.workunit.client.0.smithi063.stdout:0/821: mknod d1/df/d2c/d103/c12e 0 2024-09-16T01:25:23.089 INFO:tasks.workunit.client.0.smithi063.stdout:0/822: dread - d1/d30/d52/d9d/deb/f129 zero size 2024-09-16T01:25:23.089 INFO:tasks.workunit.client.0.smithi063.stdout:3/773: dwrite d2/d11/d37/feb [0,4194304] 0 2024-09-16T01:25:23.090 INFO:tasks.workunit.client.0.smithi063.stdout:0/823: chown d1/df/d2c/dde/l11f 30 1 2024-09-16T01:25:23.091 INFO:tasks.workunit.client.0.smithi063.stdout:8/645: creat d5/d86/fd6 x:0 0 0 2024-09-16T01:25:23.096 INFO:tasks.workunit.client.0.smithi063.stdout:3/774: dwrite d2/d11/d37/d40/d5e/d3b/d68/d6d/f107 [0,4194304] 0 2024-09-16T01:25:23.096 INFO:tasks.workunit.client.0.smithi063.stdout:8/646: dread d5/d8c/d74/f96 [0,4194304] 0 2024-09-16T01:25:23.097 INFO:tasks.workunit.client.0.smithi063.stdout:3/775: chown d2/d11/d37/f74 12 1 2024-09-16T01:25:23.101 INFO:tasks.workunit.client.0.smithi063.stdout:0/824: link d1/d30/d52/d5a/d44/dbc/le3 d1/df/d12a/l12f 0 2024-09-16T01:25:23.102 INFO:tasks.workunit.client.0.smithi063.stdout:8/647: rename d5/db/d12/d1a/f5f to d5/d8c/d74/d87/fd7 0 2024-09-16T01:25:23.103 INFO:tasks.workunit.client.0.smithi063.stdout:0/825: write d1/d2e/d73/f74 [3415775,49794] 0 2024-09-16T01:25:23.108 INFO:tasks.workunit.client.0.smithi063.stdout:3/776: dwrite d2/d11/d37/feb [0,4194304] 0 2024-09-16T01:25:23.108 INFO:tasks.workunit.client.0.smithi063.stdout:0/826: symlink d1/d30/d52/d5a/d104/l130 0 2024-09-16T01:25:23.111 INFO:tasks.workunit.client.0.smithi063.stdout:8/648: write d5/db/d12/db0/fcb [253398,12663] 0 2024-09-16T01:25:23.112 INFO:tasks.workunit.client.0.smithi063.stdout:0/827: rename d1/d2e/d50/c85 to d1/df/d2c/dde/c131 0 2024-09-16T01:25:23.115 INFO:tasks.workunit.client.0.smithi063.stdout:3/777: unlink d2/d11/d37/d40/d5e/d3b/d94/l70 0 2024-09-16T01:25:23.115 INFO:tasks.workunit.client.0.smithi063.stdout:0/828: creat d1/df/d2c/d43/f132 x:0 0 0 2024-09-16T01:25:23.116 INFO:tasks.workunit.client.0.smithi063.stdout:3/778: readlink d2/d11/d69/d85/lfd 0 2024-09-16T01:25:23.118 INFO:tasks.workunit.client.0.smithi063.stdout:3/779: fdatasync d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/f84 0 2024-09-16T01:25:23.119 INFO:tasks.workunit.client.0.smithi063.stdout:0/829: mkdir d1/d30/d52/d5a/d36/d133 0 2024-09-16T01:25:23.120 INFO:tasks.workunit.client.0.smithi063.stdout:0/830: chown d1/d2e/d48/dc3/dca 2231 1 2024-09-16T01:25:23.131 INFO:tasks.workunit.client.0.smithi063.stdout:6/801: sync 2024-09-16T01:25:23.168 INFO:tasks.workunit.client.0.smithi063.stdout:5/908: getdents d5/d18/d29/d48 0 2024-09-16T01:25:23.168 INFO:tasks.workunit.client.0.smithi063.stdout:3/780: truncate d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/f84 229489 0 2024-09-16T01:25:23.172 INFO:tasks.workunit.client.0.smithi063.stdout:5/909: fdatasync d5/d18/d29/d48/d98/d116/f11e 0 2024-09-16T01:25:23.172 INFO:tasks.workunit.client.0.smithi063.stdout:6/802: mknod d3/d30/d8d/c11d 0 2024-09-16T01:25:23.172 INFO:tasks.workunit.client.0.smithi063.stdout:0/831: unlink d1/d2e/f100 0 2024-09-16T01:25:23.173 INFO:tasks.workunit.client.0.smithi063.stdout:6/803: symlink d3/d48/d28/l11e 0 2024-09-16T01:25:23.173 INFO:tasks.workunit.client.0.smithi063.stdout:6/804: readlink d3/l5f 0 2024-09-16T01:25:23.173 INFO:tasks.workunit.client.0.smithi063.stdout:3/781: rename d2/d11/d69/cfb to d2/d11/d37/d40/d5e/d3b/d45/d9f/c10e 0 2024-09-16T01:25:23.173 INFO:tasks.workunit.client.0.smithi063.stdout:0/832: symlink d1/df/d2c/dde/d119/l134 0 2024-09-16T01:25:23.173 INFO:tasks.workunit.client.0.smithi063.stdout:6/805: creat d3/d10/f11f x:0 0 0 2024-09-16T01:25:23.176 INFO:tasks.workunit.client.0.smithi063.stdout:0/833: mknod d1/d30/d95/c135 0 2024-09-16T01:25:23.177 INFO:tasks.workunit.client.0.smithi063.stdout:6/806: write d3/d48/f97 [436464,92080] 0 2024-09-16T01:25:23.177 INFO:tasks.workunit.client.0.smithi063.stdout:3/782: mknod d2/d11/d37/d40/d5e/ddc/c10f 0 2024-09-16T01:25:23.178 INFO:tasks.workunit.client.0.smithi063.stdout:5/910: dwrite d5/d18/d29/d48/d98/d118/f101 [4194304,4194304] 0 2024-09-16T01:25:23.179 INFO:tasks.workunit.client.0.smithi063.stdout:6/807: stat d3/d48/d28/d3e/d44/da4/d5a/cfb 0 2024-09-16T01:25:23.182 INFO:tasks.workunit.client.0.smithi063.stdout:5/911: symlink d5/l144 0 2024-09-16T01:25:23.184 INFO:tasks.workunit.client.0.smithi063.stdout:6/808: symlink d3/d30/d39/d69/d95/db0/l120 0 2024-09-16T01:25:23.186 INFO:tasks.workunit.client.0.smithi063.stdout:5/912: dread - d5/d12/fbf zero size 2024-09-16T01:25:23.187 INFO:tasks.workunit.client.0.smithi063.stdout:3/783: dwrite d2/d11/d37/feb [0,4194304] 0 2024-09-16T01:25:23.190 INFO:tasks.workunit.client.0.smithi063.stdout:0/834: dwrite d1/d2e/d48/f98 [0,4194304] 0 2024-09-16T01:25:23.192 INFO:tasks.workunit.client.0.smithi063.stdout:5/913: stat d5/d18/d29/d48/d66/db1/fdf 0 2024-09-16T01:25:23.193 INFO:tasks.workunit.client.0.smithi063.stdout:3/784: creat d2/d11/d37/d40/d5e/d3b/d68/d6b/f110 x:0 0 0 2024-09-16T01:25:23.194 INFO:tasks.workunit.client.0.smithi063.stdout:0/835: truncate d1/d30/d52/db3/f11e 450736 0 2024-09-16T01:25:23.196 INFO:tasks.workunit.client.0.smithi063.stdout:3/785: read d2/d11/f1d [4111975,110534] 0 2024-09-16T01:25:23.200 INFO:tasks.workunit.client.0.smithi063.stdout:5/914: getdents d5/d7f/da3/de3/d12b 0 2024-09-16T01:25:23.202 INFO:tasks.workunit.client.0.smithi063.stdout:0/836: link d1/df/d34/c53 d1/d30/d52/c136 0 2024-09-16T01:25:23.205 INFO:tasks.workunit.client.0.smithi063.stdout:0/837: mknod d1/d2e/d48/dc3/dca/c137 0 2024-09-16T01:25:23.209 INFO:tasks.workunit.client.0.smithi063.stdout:5/915: rename d5/d12/fd6 to d5/d18/d29/d52/d12e/de4/d105/d13a/f145 0 2024-09-16T01:25:23.210 INFO:tasks.workunit.client.0.smithi063.stdout:0/838: truncate d1/d2e/f4a 259901 0 2024-09-16T01:25:23.210 INFO:tasks.workunit.client.0.smithi063.stdout:3/786: dwrite d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/fae [0,4194304] 0 2024-09-16T01:25:23.211 INFO:tasks.workunit.client.0.smithi063.stdout:5/916: chown d5/d18/d29/d48/d98/f84 0 1 2024-09-16T01:25:23.212 INFO:tasks.workunit.client.0.smithi063.stdout:0/839: read d1/d30/f71 [236682,52037] 0 2024-09-16T01:25:23.214 INFO:tasks.workunit.client.0.smithi063.stdout:5/917: symlink d5/d18/d29/d48/d66/l146 0 2024-09-16T01:25:23.216 INFO:tasks.workunit.client.0.smithi063.stdout:3/787: getdents d2/d11/d37/d40/d5e 0 2024-09-16T01:25:23.217 INFO:tasks.workunit.client.0.smithi063.stdout:5/918: rmdir d5/d18 39 2024-09-16T01:25:23.218 INFO:tasks.workunit.client.0.smithi063.stdout:3/788: chown d2/d11/d69/lad 45826 1 2024-09-16T01:25:23.218 INFO:tasks.workunit.client.0.smithi063.stdout:0/840: dwrite d1/d30/d52/d5a/f9e [0,4194304] 0 2024-09-16T01:25:23.220 INFO:tasks.workunit.client.0.smithi063.stdout:5/919: write d5/d18/d29/d48/f71 [507647,125756] 0 2024-09-16T01:25:23.221 INFO:tasks.workunit.client.0.smithi063.stdout:5/920: chown d5/d18/d29/d48/d98/d94/f59 2 1 2024-09-16T01:25:23.222 INFO:tasks.workunit.client.0.smithi063.stdout:3/789: mknod d2/d11/d69/c111 0 2024-09-16T01:25:23.223 INFO:tasks.workunit.client.0.smithi063.stdout:3/790: readlink d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/lfc 0 2024-09-16T01:25:23.224 INFO:tasks.workunit.client.0.smithi063.stdout:0/841: rename d1/df/l18 to d1/df/d34/da6/l138 0 2024-09-16T01:25:23.225 INFO:tasks.workunit.client.0.smithi063.stdout:3/791: dread - d2/d11/d37/d40/d5e/d3b/d68/d6d/f103 zero size 2024-09-16T01:25:23.226 INFO:tasks.workunit.client.0.smithi063.stdout:0/842: chown d1/d2e/d48/ce2 153106791 1 2024-09-16T01:25:23.229 INFO:tasks.workunit.client.0.smithi063.stdout:5/921: rename d5/d12/fbf to d5/d18/d29/d48/d66/f147 0 2024-09-16T01:25:23.231 INFO:tasks.workunit.client.0.smithi063.stdout:3/792: link d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/f105 d2/d11/d37/d40/d5e/d3b/d68/dd2/f112 0 2024-09-16T01:25:23.231 INFO:tasks.workunit.client.0.smithi063.stdout:0/843: creat d1/df/d34/f139 x:0 0 0 2024-09-16T01:25:23.232 INFO:tasks.workunit.client.0.smithi063.stdout:0/844: chown d1/d2e/d73 1001 1 2024-09-16T01:25:23.234 INFO:tasks.workunit.client.0.smithi063.stdout:3/793: symlink d2/d11/d69/d80/l113 0 2024-09-16T01:25:23.237 INFO:tasks.workunit.client.0.smithi063.stdout:0/845: link d1/d30/d52/db3/lf4 d1/d30/l13a 0 2024-09-16T01:25:23.240 INFO:tasks.workunit.client.0.smithi063.stdout:0/846: mknod d1/df/d2c/d43/d90/c13b 0 2024-09-16T01:25:23.242 INFO:tasks.workunit.client.0.smithi063.stdout:3/794: dwrite d2/d11/d69/fca [0,4194304] 0 2024-09-16T01:25:23.244 INFO:tasks.workunit.client.0.smithi063.stdout:0/847: mknod d1/df/d2c/db6/dbb/c13c 0 2024-09-16T01:25:23.245 INFO:tasks.workunit.client.0.smithi063.stdout:5/922: truncate d5/d18/d29/d48/d98/f9e 2880764 0 2024-09-16T01:25:23.245 INFO:tasks.workunit.client.0.smithi063.stdout:3/795: creat d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/f114 x:0 0 0 2024-09-16T01:25:23.248 INFO:tasks.workunit.client.0.smithi063.stdout:0/848: dread d1/df/fa4 [0,4194304] 0 2024-09-16T01:25:23.248 INFO:tasks.workunit.client.0.smithi063.stdout:3/796: creat d2/d11/d37/d40/d5e/d3b/da1/f115 x:0 0 0 2024-09-16T01:25:23.249 INFO:tasks.workunit.client.0.smithi063.stdout:5/923: getdents d5/d18/d29/d48 0 2024-09-16T01:25:23.252 INFO:tasks.workunit.client.0.smithi063.stdout:3/797: creat d2/d11/d37/d40/d5e/d3b/da1/f116 x:0 0 0 2024-09-16T01:25:23.255 INFO:tasks.workunit.client.0.smithi063.stdout:0/849: write d1/df/d17/f22 [2976763,74783] 0 2024-09-16T01:25:23.259 INFO:tasks.workunit.client.0.smithi063.stdout:5/924: dwrite d5/d18/d29/d48/d66/f83 [0,4194304] 0 2024-09-16T01:25:23.260 INFO:tasks.workunit.client.0.smithi063.stdout:3/798: rename d2/d11/d18/c21 to d2/d11/d37/d40/d5e/d3b/d68/c117 0 2024-09-16T01:25:23.262 INFO:tasks.workunit.client.0.smithi063.stdout:5/925: mknod d5/d18/d29/d48/d7b/d85/c148 0 2024-09-16T01:25:23.264 INFO:tasks.workunit.client.0.smithi063.stdout:3/799: getdents d2/d11/d37/db6 0 2024-09-16T01:25:23.264 INFO:tasks.workunit.client.0.smithi063.stdout:0/850: rename d1/df/d2c/dde/f121 to d1/d30/d52/f13d 0 2024-09-16T01:25:23.267 INFO:tasks.workunit.client.0.smithi063.stdout:5/926: rename d5/d12/ca8 to d5/d7f/dcb/c149 0 2024-09-16T01:25:23.268 INFO:tasks.workunit.client.0.smithi063.stdout:3/800: dread d2/d5b/fa4 [0,4194304] 0 2024-09-16T01:25:23.271 INFO:tasks.workunit.client.0.smithi063.stdout:3/801: symlink d2/d11/d69/d85/l118 0 2024-09-16T01:25:23.274 INFO:tasks.workunit.client.0.smithi063.stdout:0/851: dwrite d1/fc [0,4194304] 0 2024-09-16T01:25:23.275 INFO:tasks.workunit.client.0.smithi063.stdout:3/802: mknod d2/d11/d37/d40/d5e/ddc/c119 0 2024-09-16T01:25:23.275 INFO:tasks.workunit.client.0.smithi063.stdout:0/852: chown d1/d30/d52/d9d/deb/f82 226692872 1 2024-09-16T01:25:23.282 INFO:tasks.workunit.client.0.smithi063.stdout:3/803: dwrite d2/d11/d69/d80/d8a/fa8 [0,4194304] 0 2024-09-16T01:25:23.284 INFO:tasks.workunit.client.0.smithi063.stdout:3/804: rmdir d2/d11/d69/d80/d8a/d8e 39 2024-09-16T01:25:23.287 INFO:tasks.workunit.client.0.smithi063.stdout:3/805: dread d2/d11/d37/d40/d5e/f65 [0,4194304] 0 2024-09-16T01:25:23.289 INFO:tasks.workunit.client.0.smithi063.stdout:3/806: truncate d2/f4e 24309 0 2024-09-16T01:25:23.290 INFO:tasks.workunit.client.0.smithi063.stdout:2/885: sync 2024-09-16T01:25:23.290 INFO:tasks.workunit.client.0.smithi063.stdout:7/729: sync 2024-09-16T01:25:23.290 INFO:tasks.workunit.client.0.smithi063.stdout:9/811: sync 2024-09-16T01:25:23.290 INFO:tasks.workunit.client.0.smithi063.stdout:4/786: sync 2024-09-16T01:25:23.290 INFO:tasks.workunit.client.0.smithi063.stdout:1/781: sync 2024-09-16T01:25:23.291 INFO:tasks.workunit.client.0.smithi063.stdout:4/787: readlink d5/l7b 0 2024-09-16T01:25:23.292 INFO:tasks.workunit.client.0.smithi063.stdout:4/788: chown d5/d3b/d5c/fbf 15612 1 2024-09-16T01:25:23.292 INFO:tasks.workunit.client.0.smithi063.stdout:9/812: symlink d7/d4a/d4d/l120 0 2024-09-16T01:25:23.293 INFO:tasks.workunit.client.0.smithi063.stdout:1/782: symlink d1/d5/d82/l103 0 2024-09-16T01:25:23.298 INFO:tasks.workunit.client.0.smithi063.stdout:4/789: rmdir d5/d3b/df/d1c/d29/d32 39 2024-09-16T01:25:23.298 INFO:tasks.workunit.client.0.smithi063.stdout:2/886: mknod d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/da1/db6/c133 0 2024-09-16T01:25:23.299 INFO:tasks.workunit.client.0.smithi063.stdout:1/783: write d1/d5/d82/d9b/f4e [4225503,103306] 0 2024-09-16T01:25:23.299 INFO:tasks.workunit.client.0.smithi063.stdout:3/807: truncate f0 1637021 0 2024-09-16T01:25:23.299 INFO:tasks.workunit.client.0.smithi063.stdout:7/730: truncate d7/d56/d57/f5c 3968491 0 2024-09-16T01:25:23.303 INFO:tasks.workunit.client.0.smithi063.stdout:7/731: fsync d7/d1c/d1f/d29/dbf/d40/d6c/fc3 0 2024-09-16T01:25:23.303 INFO:tasks.workunit.client.0.smithi063.stdout:1/784: symlink d1/d5/d82/d9b/d77/d8a/l104 0 2024-09-16T01:25:23.303 INFO:tasks.workunit.client.0.smithi063.stdout:2/887: truncate d3/d7/d8/d19/f114 197272 0 2024-09-16T01:25:23.307 INFO:tasks.workunit.client.0.smithi063.stdout:7/732: write d7/f9 [4595900,71032] 0 2024-09-16T01:25:23.307 INFO:tasks.workunit.client.0.smithi063.stdout:9/813: dwrite d7/d9/f74 [0,4194304] 0 2024-09-16T01:25:23.314 INFO:tasks.workunit.client.0.smithi063.stdout:3/808: link d2/d11/d37/d40/d5e/d3b/d94/d30/cd6 d2/d11/d37/d40/d5e/d3b/d45/c11a 0 2024-09-16T01:25:23.314 INFO:tasks.workunit.client.0.smithi063.stdout:4/790: dwrite d5/d3b/df/d1c/d29/f8e [0,4194304] 0 2024-09-16T01:25:23.387 INFO:tasks.workunit.client.0.smithi063.stdout:9/814: mkdir d7/d9/d20/de3/de7/db2/dca/d121 0 2024-09-16T01:25:23.389 INFO:tasks.workunit.client.0.smithi063.stdout:2/888: dwrite d3/f51 [0,4194304] 0 2024-09-16T01:25:23.391 INFO:tasks.workunit.client.0.smithi063.stdout:9/815: symlink d7/d4a/l122 0 2024-09-16T01:25:23.391 INFO:tasks.workunit.client.0.smithi063.stdout:1/785: truncate d1/d5/d15/d18/f42 3318426 0 2024-09-16T01:25:23.393 INFO:tasks.workunit.client.0.smithi063.stdout:3/809: unlink d2/d5b/d90/c98 0 2024-09-16T01:25:23.396 INFO:tasks.workunit.client.0.smithi063.stdout:9/816: chown d7/d9/d20/de3/de7/db2/dca/lf4 2 1 2024-09-16T01:25:23.398 INFO:tasks.workunit.client.0.smithi063.stdout:7/733: dwrite d7/d1c/d1f/d29/dbf/d40/d6c/f6e [4194304,4194304] 0 2024-09-16T01:25:23.403 INFO:tasks.workunit.client.0.smithi063.stdout:3/810: rename d2/d11/d69/fca to d2/d11/d37/d40/d5e/d3b/d68/d6b/f11b 0 2024-09-16T01:25:23.406 INFO:tasks.workunit.client.0.smithi063.stdout:9/817: creat d7/d4a/d4d/d96/f123 x:0 0 0 2024-09-16T01:25:23.406 INFO:tasks.workunit.client.0.smithi063.stdout:2/889: dwrite d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/dce/ffa [0,4194304] 0 2024-09-16T01:25:23.409 INFO:tasks.workunit.client.0.smithi063.stdout:9/818: chown d7/d9/d20/de3/de7/l30 1 1 2024-09-16T01:25:23.409 INFO:tasks.workunit.client.0.smithi063.stdout:7/734: dwrite d7/d56/d6b/fd0 [0,4194304] 0 2024-09-16T01:25:23.410 INFO:tasks.workunit.client.0.smithi063.stdout:3/811: fsync d2/d11/d37/d40/d5e/d3b/d68/d6b/f11b 0 2024-09-16T01:25:23.413 INFO:tasks.workunit.client.0.smithi063.stdout:2/890: write d3/d7/d8/d19/d3c/d58/f5d [956294,115779] 0 2024-09-16T01:25:23.414 INFO:tasks.workunit.client.0.smithi063.stdout:4/791: dread d5/d3b/f16 [4194304,4194304] 0 2024-09-16T01:25:23.417 INFO:tasks.workunit.client.0.smithi063.stdout:7/735: mknod d7/d1c/d1f/d29/d88/cee 0 2024-09-16T01:25:23.418 INFO:tasks.workunit.client.0.smithi063.stdout:3/812: mkdir d2/d11/d69/d80/d8a/d8e/d11c 0 2024-09-16T01:25:23.419 INFO:tasks.workunit.client.0.smithi063.stdout:3/813: chown d2/dc1 482 1 2024-09-16T01:25:23.420 INFO:tasks.workunit.client.0.smithi063.stdout:4/792: symlink d5/l105 0 2024-09-16T01:25:23.424 INFO:tasks.workunit.client.0.smithi063.stdout:2/891: dread f0 [0,4194304] 0 2024-09-16T01:25:23.425 INFO:tasks.workunit.client.0.smithi063.stdout:7/736: rename d7/d56/d6b/fe3 to d7/d1c/d1f/d29/d88/d98/fef 0 2024-09-16T01:25:23.425 INFO:tasks.workunit.client.0.smithi063.stdout:3/814: mknod d2/c11d 0 2024-09-16T01:25:23.429 INFO:tasks.workunit.client.0.smithi063.stdout:9/819: dwrite d7/d9/d20/de3/de7/d14/f75 [0,4194304] 0 2024-09-16T01:25:23.429 INFO:tasks.workunit.client.0.smithi063.stdout:8/649: sync 2024-09-16T01:25:23.431 INFO:tasks.workunit.client.0.smithi063.stdout:4/793: dwrite d5/d3b/df/d1c/d29/dd4/dbc/fd6 [0,4194304] 0 2024-09-16T01:25:23.431 INFO:tasks.workunit.client.0.smithi063.stdout:9/820: fdatasync d7/d4a/f53 0 2024-09-16T01:25:23.431 INFO:tasks.workunit.client.0.smithi063.stdout:2/892: creat d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d12e/f134 x:0 0 0 2024-09-16T01:25:23.432 INFO:tasks.workunit.client.0.smithi063.stdout:8/650: stat d5/db/d12/d1a/d1e/fa9 0 2024-09-16T01:25:23.437 INFO:tasks.workunit.client.0.smithi063.stdout:4/794: rename d5/d3b/d5c/da7 to d5/d3b/d5c/d106 0 2024-09-16T01:25:23.439 INFO:tasks.workunit.client.0.smithi063.stdout:9/821: fdatasync d7/d9/d20/de3/de7/f77 0 2024-09-16T01:25:23.440 INFO:tasks.workunit.client.0.smithi063.stdout:8/651: creat d5/db/d12/d1a/d1e/d68/dc9/fd8 x:0 0 0 2024-09-16T01:25:23.441 INFO:tasks.workunit.client.0.smithi063.stdout:3/815: dwrite d2/d11/d37/d40/d5e/d3b/f76 [0,4194304] 0 2024-09-16T01:25:23.445 INFO:tasks.workunit.client.0.smithi063.stdout:9/822: dread d7/d1f/fea [0,4194304] 0 2024-09-16T01:25:23.450 INFO:tasks.workunit.client.0.smithi063.stdout:7/737: dread d7/d56/d57/f5c [0,4194304] 0 2024-09-16T01:25:23.450 INFO:tasks.workunit.client.0.smithi063.stdout:9/823: write d7/d4a/d4d/d96/f123 [435853,42724] 0 2024-09-16T01:25:23.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/795: link d5/d3b/df/d1c/d29/d20/d98/ddf/ff6 d5/d3b/df/d1c/d29/d32/d60/f107 0 2024-09-16T01:25:23.455 INFO:tasks.workunit.client.0.smithi063.stdout:8/652: dwrite d5/f94 [0,4194304] 0 2024-09-16T01:25:23.460 INFO:tasks.workunit.client.0.smithi063.stdout:3/816: dwrite d2/d11/d37/d40/d5e/d3b/d94/f2f [0,4194304] 0 2024-09-16T01:25:23.461 INFO:tasks.workunit.client.0.smithi063.stdout:8/653: creat d5/d9/d98/fd9 x:0 0 0 2024-09-16T01:25:23.463 INFO:tasks.workunit.client.0.smithi063.stdout:2/893: dwrite d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/f3e [0,4194304] 0 2024-09-16T01:25:23.464 INFO:tasks.workunit.client.0.smithi063.stdout:7/738: rename d7/d1c/d1f/d29/dbf/d39/l3a to d7/d1c/d1f/d29/daf/lf0 0 2024-09-16T01:25:23.466 INFO:tasks.workunit.client.0.smithi063.stdout:9/824: creat d7/d9/d20/de3/de7/d14/f124 x:0 0 0 2024-09-16T01:25:23.470 INFO:tasks.workunit.client.0.smithi063.stdout:8/654: creat d5/db/d12/d3d/d69/daa/fda x:0 0 0 2024-09-16T01:25:23.471 INFO:tasks.workunit.client.0.smithi063.stdout:2/894: creat d3/d128/f135 x:0 0 0 2024-09-16T01:25:23.472 INFO:tasks.workunit.client.0.smithi063.stdout:4/796: dwrite d5/d3b/df/d1c/d29/d32/fc1 [0,4194304] 0 2024-09-16T01:25:23.475 INFO:tasks.workunit.client.0.smithi063.stdout:4/797: read d5/d3b/f2d [8214722,77837] 0 2024-09-16T01:25:23.477 INFO:tasks.workunit.client.0.smithi063.stdout:7/739: getdents d7/d1c/d1f/d29 0 2024-09-16T01:25:23.477 INFO:tasks.workunit.client.0.smithi063.stdout:2/895: creat d3/d7/d8/d19/d8c/d21/d9c/dd4/f136 x:0 0 0 2024-09-16T01:25:23.478 INFO:tasks.workunit.client.0.smithi063.stdout:2/896: read - d3/d7/d8/df1/f123 zero size 2024-09-16T01:25:23.479 INFO:tasks.workunit.client.0.smithi063.stdout:8/655: rename d5/d8c/dbd/f61 to d5/d8c/dbd/fdb 0 2024-09-16T01:25:23.483 INFO:tasks.workunit.client.0.smithi063.stdout:7/740: unlink d7/d1c/d1f/f2e 0 2024-09-16T01:25:23.484 INFO:tasks.workunit.client.0.smithi063.stdout:3/817: dread d2/d11/d18/fd [0,4194304] 0 2024-09-16T01:25:23.485 INFO:tasks.workunit.client.0.smithi063.stdout:7/741: write d7/d56/d57/d60/f61 [1429516,112101] 0 2024-09-16T01:25:23.486 INFO:tasks.workunit.client.0.smithi063.stdout:2/897: getdents d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d45 0 2024-09-16T01:25:23.486 INFO:tasks.workunit.client.0.smithi063.stdout:4/798: creat d5/d3b/df/d1c/d29/dd4/dbc/f108 x:0 0 0 2024-09-16T01:25:23.487 INFO:tasks.workunit.client.0.smithi063.stdout:7/742: fsync d7/d1c/d1f/d29/dbf/d39/d65/f9b 0 2024-09-16T01:25:23.489 INFO:tasks.workunit.client.0.smithi063.stdout:3/818: mknod d2/d5b/c11e 0 2024-09-16T01:25:23.490 INFO:tasks.workunit.client.0.smithi063.stdout:8/656: mknod d5/d8c/d74/cdc 0 2024-09-16T01:25:23.490 INFO:tasks.workunit.client.0.smithi063.stdout:2/898: rmdir d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d12e 39 2024-09-16T01:25:23.491 INFO:tasks.workunit.client.0.smithi063.stdout:3/819: stat d2/d11/d37/d40/d5e/l7b 0 2024-09-16T01:25:23.492 INFO:tasks.workunit.client.0.smithi063.stdout:9/825: link d7/d9/d20/de3/de7/d14/f75 d7/d9/d20/de3/de7/d14/d63/d5f/dab/f125 0 2024-09-16T01:25:23.495 INFO:tasks.workunit.client.0.smithi063.stdout:3/820: readlink d2/d11/d69/d85/l118 0 2024-09-16T01:25:23.495 INFO:tasks.workunit.client.0.smithi063.stdout:4/799: link d5/l33 d5/d3b/d57/d68/d90/l109 0 2024-09-16T01:25:23.497 INFO:tasks.workunit.client.0.smithi063.stdout:5/927: sync 2024-09-16T01:25:23.497 INFO:tasks.workunit.client.0.smithi063.stdout:6/809: sync 2024-09-16T01:25:23.497 INFO:tasks.workunit.client.0.smithi063.stdout:7/743: dwrite d7/d1c/d1f/fba [0,4194304] 0 2024-09-16T01:25:23.498 INFO:tasks.workunit.client.0.smithi063.stdout:9/826: read d7/d9/d20/de3/de7/d14/d63/d5f/dab/f125 [623514,105081] 0 2024-09-16T01:25:23.498 INFO:tasks.workunit.client.0.smithi063.stdout:2/899: rename d3/d7/c36 to d3/dbc/c137 0 2024-09-16T01:25:23.499 INFO:tasks.workunit.client.0.smithi063.stdout:4/800: fsync d5/d3b/d57/d66/d9b/d7a/fdd 0 2024-09-16T01:25:23.500 INFO:tasks.workunit.client.0.smithi063.stdout:5/928: fdatasync d5/d12/d91/f8c 0 2024-09-16T01:25:23.507 INFO:tasks.workunit.client.0.smithi063.stdout:8/657: dread d5/d9/f35 [0,4194304] 0 2024-09-16T01:25:23.509 INFO:tasks.workunit.client.0.smithi063.stdout:4/801: rmdir d5/d3b/df/d1c/d29/d20/d30 39 2024-09-16T01:25:23.512 INFO:tasks.workunit.client.0.smithi063.stdout:6/810: dwrite d3/d30/d39/d69/fb9 [4194304,4194304] 0 2024-09-16T01:25:23.514 INFO:tasks.workunit.client.0.smithi063.stdout:4/802: fsync d5/d3b/d57/dce/fe9 0 2024-09-16T01:25:23.516 INFO:tasks.workunit.client.0.smithi063.stdout:9/827: write d7/d9/d20/de3/de7/db2/faa [326776,111904] 0 2024-09-16T01:25:23.519 INFO:tasks.workunit.client.0.smithi063.stdout:7/744: truncate d7/d1c/d1f/d29/dbf/d39/f6f 1482089 0 2024-09-16T01:25:23.520 INFO:tasks.workunit.client.0.smithi063.stdout:6/811: chown d3/d30/d39/dac/db5/da7 122447 1 2024-09-16T01:25:23.521 INFO:tasks.workunit.client.0.smithi063.stdout:8/658: rename d5/db/d12/f2d to d5/db/d12/d3d/d69/daa/d40/d4a/fdd 0 2024-09-16T01:25:23.521 INFO:tasks.workunit.client.0.smithi063.stdout:2/900: dwrite d3/d7/d8/d19/f75 [0,4194304] 0 2024-09-16T01:25:23.522 INFO:tasks.workunit.client.0.smithi063.stdout:4/803: readlink d5/d3b/df/d1c/d29/lea 0 2024-09-16T01:25:23.526 INFO:tasks.workunit.client.0.smithi063.stdout:9/828: dread - d7/d9/d20/de3/ff3 zero size 2024-09-16T01:25:23.526 INFO:tasks.workunit.client.0.smithi063.stdout:5/929: dwrite d5/d18/d29/d48/d7b/dc2/fc4 [0,4194304] 0 2024-09-16T01:25:23.526 INFO:tasks.workunit.client.0.smithi063.stdout:6/812: unlink d3/d48/d28/l45 0 2024-09-16T01:25:23.529 INFO:tasks.workunit.client.0.smithi063.stdout:2/901: mknod d3/d7/d8/d19/d8c/c138 0 2024-09-16T01:25:23.530 INFO:tasks.workunit.client.0.smithi063.stdout:4/804: mknod d5/d3b/d5c/d106/df8/c10a 0 2024-09-16T01:25:23.531 INFO:tasks.workunit.client.0.smithi063.stdout:3/821: dwrite d2/d11/d37/d40/d5e/d3b/d68/dd2/f112 [0,4194304] 0 2024-09-16T01:25:23.535 INFO:tasks.workunit.client.0.smithi063.stdout:4/805: chown d5/d3b/df/d1c/l38 44729539 1 2024-09-16T01:25:23.536 INFO:tasks.workunit.client.0.smithi063.stdout:6/813: rmdir d3/d48/d28/d3e/d44/da4/d5a/d6b 39 2024-09-16T01:25:23.538 INFO:tasks.workunit.client.0.smithi063.stdout:3/822: symlink d2/d11/d37/dce/l11f 0 2024-09-16T01:25:23.540 INFO:tasks.workunit.client.0.smithi063.stdout:4/806: chown d5/d3b/d57/dce/cfe 12331129 1 2024-09-16T01:25:23.540 INFO:tasks.workunit.client.0.smithi063.stdout:7/745: dwrite d7/d1c/d1f/d29/d88/d96/fdc [0,4194304] 0 2024-09-16T01:25:23.542 INFO:tasks.workunit.client.0.smithi063.stdout:4/807: write d5/d3b/f1d [9454215,55823] 0 2024-09-16T01:25:23.542 INFO:tasks.workunit.client.0.smithi063.stdout:5/930: rename d5/d18/d29/d48/d98/d116 to d5/d18/d29/d48/d7b/d14a 0 2024-09-16T01:25:23.542 INFO:tasks.workunit.client.0.smithi063.stdout:3/823: chown d2/d11/d37/d40/d5e/d3b/da1/fbd 12 1 2024-09-16T01:25:23.543 INFO:tasks.workunit.client.0.smithi063.stdout:6/814: link d3/d48/f97 d3/d30/d39/f121 0 2024-09-16T01:25:23.545 INFO:tasks.workunit.client.0.smithi063.stdout:6/815: fdatasync d3/d48/fda 0 2024-09-16T01:25:23.545 INFO:tasks.workunit.client.0.smithi063.stdout:8/659: dread d5/db/d12/d1a/d1e/fa9 [0,4194304] 0 2024-09-16T01:25:23.546 INFO:tasks.workunit.client.0.smithi063.stdout:5/931: creat d5/d12/d91/d72/f14b x:0 0 0 2024-09-16T01:25:23.548 INFO:tasks.workunit.client.0.smithi063.stdout:3/824: mknod d2/dc1/c120 0 2024-09-16T01:25:23.550 INFO:tasks.workunit.client.0.smithi063.stdout:2/902: truncate d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/dc2/ff2 159010 0 2024-09-16T01:25:23.551 INFO:tasks.workunit.client.0.smithi063.stdout:7/746: mkdir d7/d56/d57/d60/db9/dd8/df1 0 2024-09-16T01:25:23.552 INFO:tasks.workunit.client.0.smithi063.stdout:8/660: rmdir d5/db/d12/d1a/d1e/d68 39 2024-09-16T01:25:23.553 INFO:tasks.workunit.client.0.smithi063.stdout:5/932: dread d5/f51 [0,4194304] 0 2024-09-16T01:25:23.555 INFO:tasks.workunit.client.0.smithi063.stdout:6/816: mkdir d3/d48/d28/d113/d122 0 2024-09-16T01:25:23.555 INFO:tasks.workunit.client.0.smithi063.stdout:9/829: dwrite d7/d9/d20/de3/de7/d14/f35 [0,4194304] 0 2024-09-16T01:25:23.556 INFO:tasks.workunit.client.0.smithi063.stdout:3/825: mkdir d2/d11/d37/d40/d5e/ddc/d121 0 2024-09-16T01:25:23.557 INFO:tasks.workunit.client.0.smithi063.stdout:8/661: dread - d5/db/d12/d3d/d69/daa/d40/fb3 zero size 2024-09-16T01:25:23.558 INFO:tasks.workunit.client.0.smithi063.stdout:4/808: rename d5/d3b/d5c/d106 to d5/d3b/df/d1c/d29/d32/d60/d10b 0 2024-09-16T01:25:23.559 INFO:tasks.workunit.client.0.smithi063.stdout:7/747: mknod d7/d1c/d1f/d29/dbf/d39/cf2 0 2024-09-16T01:25:23.560 INFO:tasks.workunit.client.0.smithi063.stdout:6/817: mknod d3/d41/d89/c123 0 2024-09-16T01:25:23.561 INFO:tasks.workunit.client.0.smithi063.stdout:9/830: read d7/d9/d20/de3/de7/db2/faa [177106,59976] 0 2024-09-16T01:25:23.563 INFO:tasks.workunit.client.0.smithi063.stdout:3/826: write d2/d11/d37/d40/d5e/d3b/d68/d6b/f110 [744092,83547] 0 2024-09-16T01:25:23.565 INFO:tasks.workunit.client.0.smithi063.stdout:8/662: write d5/db/d12/d1a/d1e/d68/dc9/f81 [928298,81931] 0 2024-09-16T01:25:23.566 INFO:tasks.workunit.client.0.smithi063.stdout:4/809: symlink d5/d3b/df/d1c/d29/d32/d60/d10b/df8/l10c 0 2024-09-16T01:25:23.567 INFO:tasks.workunit.client.0.smithi063.stdout:7/748: mknod d7/d1c/d1f/d66/d70/da2/cf3 0 2024-09-16T01:25:23.568 INFO:tasks.workunit.client.0.smithi063.stdout:5/933: write d5/d18/d29/d48/d7b/d85/df9/d142/f124 [38802,109007] 0 2024-09-16T01:25:23.569 INFO:tasks.workunit.client.0.smithi063.stdout:3/827: dread - d2/d11/d37/d40/d5e/d3b/d94/d30/f73 zero size 2024-09-16T01:25:23.570 INFO:tasks.workunit.client.0.smithi063.stdout:8/663: unlink d5/f25 0 2024-09-16T01:25:23.571 INFO:tasks.workunit.client.0.smithi063.stdout:2/903: dread d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d45/d6e/fdb [0,4194304] 0 2024-09-16T01:25:23.573 INFO:tasks.workunit.client.0.smithi063.stdout:9/831: fdatasync d7/d9/d20/de3/de7/d14/d38/f3a 0 2024-09-16T01:25:23.573 INFO:tasks.workunit.client.0.smithi063.stdout:3/828: chown d2/d11/f1d 48 1 2024-09-16T01:25:23.574 INFO:tasks.workunit.client.0.smithi063.stdout:8/664: chown d5/d9/d98/fa4 15323 1 2024-09-16T01:25:23.574 INFO:tasks.workunit.client.0.smithi063.stdout:7/749: creat d7/d56/ff4 x:0 0 0 2024-09-16T01:25:23.575 INFO:tasks.workunit.client.0.smithi063.stdout:5/934: write d5/d12/f23 [368176,54392] 0 2024-09-16T01:25:23.578 INFO:tasks.workunit.client.0.smithi063.stdout:4/810: dwrite d5/d3b/d57/f79 [0,4194304] 0 2024-09-16T01:25:23.578 INFO:tasks.workunit.client.0.smithi063.stdout:3/829: readlink d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/lfc 0 2024-09-16T01:25:23.578 INFO:tasks.workunit.client.0.smithi063.stdout:2/904: symlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/db7/l139 0 2024-09-16T01:25:23.579 INFO:tasks.workunit.client.0.smithi063.stdout:0/853: sync 2024-09-16T01:25:23.579 INFO:tasks.workunit.client.0.smithi063.stdout:1/786: sync 2024-09-16T01:25:23.580 INFO:tasks.workunit.client.0.smithi063.stdout:3/830: readlink d2/d11/d37/dce/l11f 0 2024-09-16T01:25:23.581 INFO:tasks.workunit.client.0.smithi063.stdout:6/818: getdents d3/d30/d39/d69/d95/db0 0 2024-09-16T01:25:23.581 INFO:tasks.workunit.client.0.smithi063.stdout:2/905: chown d3/d7/d8/d19/d3c/d58/cc1 231932194 1 2024-09-16T01:25:23.582 INFO:tasks.workunit.client.0.smithi063.stdout:0/854: chown d1/d30/d52/d5a/d44/f11c 424 1 2024-09-16T01:25:23.583 INFO:tasks.workunit.client.0.smithi063.stdout:5/935: write d5/d18/d29/d48/d7b/d85/ff2 [628915,15589] 0 2024-09-16T01:25:23.583 INFO:tasks.workunit.client.0.smithi063.stdout:2/906: chown d3/dbc 1310636 1 2024-09-16T01:25:23.583 INFO:tasks.workunit.client.0.smithi063.stdout:8/665: fdatasync d5/db/d12/f64 0 2024-09-16T01:25:23.584 INFO:tasks.workunit.client.0.smithi063.stdout:1/787: mkdir d1/d5/d15/d18/db6/d105 0 2024-09-16T01:25:23.585 INFO:tasks.workunit.client.0.smithi063.stdout:0/855: dread - d1/df/d17/f8a zero size 2024-09-16T01:25:23.588 INFO:tasks.workunit.client.0.smithi063.stdout:4/811: write d5/d3b/df/d1c/d29/d20/f44 [761271,69260] 0 2024-09-16T01:25:23.591 INFO:tasks.workunit.client.0.smithi063.stdout:6/819: rename d3/d48/d28/d3e/d68/de1 to d3/d10/d124 0 2024-09-16T01:25:23.592 INFO:tasks.workunit.client.0.smithi063.stdout:8/666: unlink d5/db/d12/d1a/c8d 0 2024-09-16T01:25:23.593 INFO:tasks.workunit.client.0.smithi063.stdout:0/856: getdents d1/d2e/d50 0 2024-09-16T01:25:23.594 INFO:tasks.workunit.client.0.smithi063.stdout:3/831: dread d2/d11/d37/d40/f53 [0,4194304] 0 2024-09-16T01:25:23.594 INFO:tasks.workunit.client.0.smithi063.stdout:9/832: truncate d7/d9/d20/de3/de7/db2/dca/fe8 1060142 0 2024-09-16T01:25:23.595 INFO:tasks.workunit.client.0.smithi063.stdout:1/788: link d1/d5/d82/d9b/d77/d7d/dcb/fe2 d1/d5/d15/de0/f106 0 2024-09-16T01:25:23.595 INFO:tasks.workunit.client.0.smithi063.stdout:4/812: mkdir d5/d3b/d57/dce/d10d 0 2024-09-16T01:25:23.602 INFO:tasks.workunit.client.0.smithi063.stdout:2/907: getdents d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e 0 2024-09-16T01:25:23.602 INFO:tasks.workunit.client.0.smithi063.stdout:6/820: mkdir d3/d10/d11a/d125 0 2024-09-16T01:25:23.602 INFO:tasks.workunit.client.0.smithi063.stdout:5/936: dwrite d5/d18/d29/d48/d98/f84 [0,4194304] 0 2024-09-16T01:25:23.602 INFO:tasks.workunit.client.0.smithi063.stdout:1/789: mknod d1/d12/d21/c107 0 2024-09-16T01:25:23.602 INFO:tasks.workunit.client.0.smithi063.stdout:0/857: unlink d1/df/d2c/d43/d90/l91 0 2024-09-16T01:25:23.603 INFO:tasks.workunit.client.0.smithi063.stdout:7/750: dwrite d7/d1c/fc2 [0,4194304] 0 2024-09-16T01:25:23.603 INFO:tasks.workunit.client.0.smithi063.stdout:3/832: creat d2/d11/d37/d40/d5e/d3b/d68/d6d/f122 x:0 0 0 2024-09-16T01:25:23.604 INFO:tasks.workunit.client.0.smithi063.stdout:6/821: chown d3/d30/d39/dac/db5/dcf/dee 66342966 1 2024-09-16T01:25:23.604 INFO:tasks.workunit.client.0.smithi063.stdout:2/908: symlink d3/d7/l13a 0 2024-09-16T01:25:23.606 INFO:tasks.workunit.client.0.smithi063.stdout:4/813: mkdir d5/d3b/d57/dce/d10d/d10e 0 2024-09-16T01:25:23.607 INFO:tasks.workunit.client.0.smithi063.stdout:0/858: mkdir d1/d30/dff/d13e 0 2024-09-16T01:25:23.607 INFO:tasks.workunit.client.0.smithi063.stdout:8/667: getdents d5/d8c/d74/d87 0 2024-09-16T01:25:23.609 INFO:tasks.workunit.client.0.smithi063.stdout:3/833: read d2/d11/d37/d40/f53 [1633160,36165] 0 2024-09-16T01:25:23.612 INFO:tasks.workunit.client.0.smithi063.stdout:8/668: dread - d5/d9/d98/fd9 zero size 2024-09-16T01:25:23.615 INFO:tasks.workunit.client.0.smithi063.stdout:0/859: symlink d1/df/d34/l13f 0 2024-09-16T01:25:23.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/751: mkdir d7/d1c/d1f/df5 0 2024-09-16T01:25:23.621 INFO:tasks.workunit.client.0.smithi063.stdout:1/790: dwrite d1/d5/d82/d9b/f4e [0,4194304] 0 2024-09-16T01:25:23.624 INFO:tasks.workunit.client.0.smithi063.stdout:5/937: dwrite d5/d12/f4c [4194304,4194304] 0 2024-09-16T01:25:23.626 INFO:tasks.workunit.client.0.smithi063.stdout:4/814: rename d5/d3b/df/d1c/d29/d20/ffa to d5/d3b/d57/dce/f10f 0 2024-09-16T01:25:23.627 INFO:tasks.workunit.client.0.smithi063.stdout:8/669: dread d5/db/d12/db0/fcb [0,4194304] 0 2024-09-16T01:25:23.627 INFO:tasks.workunit.client.0.smithi063.stdout:6/822: dwrite d3/d48/d28/f77 [0,4194304] 0 2024-09-16T01:25:23.629 INFO:tasks.workunit.client.0.smithi063.stdout:7/752: fsync d7/d56/fa6 0 2024-09-16T01:25:23.630 INFO:tasks.workunit.client.0.smithi063.stdout:2/909: symlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/dfe/d109/l13b 0 2024-09-16T01:25:23.631 INFO:tasks.workunit.client.0.smithi063.stdout:1/791: chown d1/d5/d15/d18/d4b/fbd 0 1 2024-09-16T01:25:23.631 INFO:tasks.workunit.client.0.smithi063.stdout:5/938: write d5/d12/d91/f143 [234513,112470] 0 2024-09-16T01:25:23.635 INFO:tasks.workunit.client.0.smithi063.stdout:7/753: write f5 [4637621,117442] 0 2024-09-16T01:25:23.635 INFO:tasks.workunit.client.0.smithi063.stdout:9/833: dwrite d7/d9/d20/de3/de7/d14/d23/fcf [0,4194304] 0 2024-09-16T01:25:23.640 INFO:tasks.workunit.client.0.smithi063.stdout:5/939: symlink d5/d18/d29/d52/l14c 0 2024-09-16T01:25:23.641 INFO:tasks.workunit.client.0.smithi063.stdout:9/834: write d7/d4a/dba/f48 [4626735,96633] 0 2024-09-16T01:25:23.642 INFO:tasks.workunit.client.0.smithi063.stdout:3/834: getdents d2/d11/d37/d40/d5e/d3b/d68/dd2 0 2024-09-16T01:25:23.644 INFO:tasks.workunit.client.0.smithi063.stdout:7/754: symlink d7/d56/d57/d60/db9/de0/lf6 0 2024-09-16T01:25:23.646 INFO:tasks.workunit.client.0.smithi063.stdout:3/835: chown d2/f22 226379260 1 2024-09-16T01:25:23.647 INFO:tasks.workunit.client.0.smithi063.stdout:0/860: creat d1/f140 x:0 0 0 2024-09-16T01:25:23.647 INFO:tasks.workunit.client.0.smithi063.stdout:1/792: rename d1/d5/d82/d9b/f78 to d1/d5/d82/d9b/d77/d7d/dcb/df9/f108 0 2024-09-16T01:25:23.648 INFO:tasks.workunit.client.0.smithi063.stdout:6/823: dwrite d3/d48/d28/d3e/d44/d52/f9a [4194304,4194304] 0 2024-09-16T01:25:23.650 INFO:tasks.workunit.client.0.smithi063.stdout:9/835: readlink d7/d4a/d4d/d96/l105 0 2024-09-16T01:25:23.651 INFO:tasks.workunit.client.0.smithi063.stdout:5/940: chown d5/d12/ced 4744709 1 2024-09-16T01:25:23.652 INFO:tasks.workunit.client.0.smithi063.stdout:4/815: getdents d5/d3b/df/d1c/d29/d20/d98/dcc 0 2024-09-16T01:25:23.655 INFO:tasks.workunit.client.0.smithi063.stdout:1/793: write d1/f57 [3835535,13289] 0 2024-09-16T01:25:23.656 INFO:tasks.workunit.client.0.smithi063.stdout:8/670: dread d5/db/d12/db0/fb2 [0,4194304] 0 2024-09-16T01:25:23.658 INFO:tasks.workunit.client.0.smithi063.stdout:3/836: symlink d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6/l123 0 2024-09-16T01:25:23.659 INFO:tasks.workunit.client.0.smithi063.stdout:0/861: chown d1/d30/d52/d5a/d36/d133 25824600 1 2024-09-16T01:25:23.659 INFO:tasks.workunit.client.0.smithi063.stdout:2/910: dwrite d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d12e/f134 [0,4194304] 0 2024-09-16T01:25:23.660 INFO:tasks.workunit.client.0.smithi063.stdout:5/941: symlink d5/d18/d29/d48/d98/l14d 0 2024-09-16T01:25:23.660 INFO:tasks.workunit.client.0.smithi063.stdout:3/837: stat d2/d11/d18/ff3 0 2024-09-16T01:25:23.661 INFO:tasks.workunit.client.0.smithi063.stdout:8/671: read d5/db/f2a [2252077,11467] 0 2024-09-16T01:25:23.661 INFO:tasks.workunit.client.0.smithi063.stdout:2/911: stat d3/d7/c1b 0 2024-09-16T01:25:23.662 INFO:tasks.workunit.client.0.smithi063.stdout:9/836: creat d7/d9/d20/de3/de7/d14/d23/d109/f126 x:0 0 0 2024-09-16T01:25:23.664 INFO:tasks.workunit.client.0.smithi063.stdout:4/816: creat d5/d3b/d57/dce/d10d/d10e/f110 x:0 0 0 2024-09-16T01:25:23.665 INFO:tasks.workunit.client.0.smithi063.stdout:1/794: mkdir d1/d5/d6f/dd2/de1/d100/d109 0 2024-09-16T01:25:23.668 INFO:tasks.workunit.client.0.smithi063.stdout:3/838: chown d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6/l123 215210 1 2024-09-16T01:25:23.668 INFO:tasks.workunit.client.0.smithi063.stdout:6/824: link d3/d30/d39/f121 d3/d48/d28/d3e/d44/da4/d5a/d81/f126 0 2024-09-16T01:25:23.668 INFO:tasks.workunit.client.0.smithi063.stdout:2/912: stat d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/dfe/d109/l13b 0 2024-09-16T01:25:23.668 INFO:tasks.workunit.client.0.smithi063.stdout:8/672: rmdir d5/db/d12/d1a/d1e/d68 39 2024-09-16T01:25:23.670 INFO:tasks.workunit.client.0.smithi063.stdout:5/942: mkdir d5/d12/d14e 0 2024-09-16T01:25:23.670 INFO:tasks.workunit.client.0.smithi063.stdout:1/795: chown d1/d5/d82/d9b/df1/lb8 1307550 1 2024-09-16T01:25:23.672 INFO:tasks.workunit.client.0.smithi063.stdout:6/825: dread - d3/d48/d28/d3e/d44/da4/f10b zero size 2024-09-16T01:25:23.673 INFO:tasks.workunit.client.0.smithi063.stdout:2/913: dread - d3/fcb zero size 2024-09-16T01:25:23.673 INFO:tasks.workunit.client.0.smithi063.stdout:4/817: fsync d5/d3b/df/d1c/d29/d20/f23 0 2024-09-16T01:25:23.673 INFO:tasks.workunit.client.0.smithi063.stdout:0/862: dread d1/fc [0,4194304] 0 2024-09-16T01:25:23.674 INFO:tasks.workunit.client.0.smithi063.stdout:3/839: dread - d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/f108 zero size 2024-09-16T01:25:23.675 INFO:tasks.workunit.client.0.smithi063.stdout:8/673: creat d5/db/d12/d3d/d69/daa/d40/d4a/fde x:0 0 0 2024-09-16T01:25:23.679 INFO:tasks.workunit.client.0.smithi063.stdout:9/837: truncate d7/fa9 1261175 0 2024-09-16T01:25:23.680 INFO:tasks.workunit.client.0.smithi063.stdout:2/914: stat d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d45/d6e/fdb 0 2024-09-16T01:25:23.681 INFO:tasks.workunit.client.0.smithi063.stdout:4/818: rmdir d5/d3b/df/d1c/d29/d32/d60/d10b/df8 39 2024-09-16T01:25:23.681 INFO:tasks.workunit.client.0.smithi063.stdout:8/674: write d5/db/d12/d1a/d60/f91 [87648,8501] 0 2024-09-16T01:25:23.683 INFO:tasks.workunit.client.0.smithi063.stdout:3/840: write d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/f114 [778457,112818] 0 2024-09-16T01:25:23.685 INFO:tasks.workunit.client.0.smithi063.stdout:6/826: write d3/d48/d28/d3e/d44/da4/d5a/fe2 [4291506,74905] 0 2024-09-16T01:25:23.686 INFO:tasks.workunit.client.0.smithi063.stdout:9/838: symlink d7/d1f/l127 0 2024-09-16T01:25:23.688 INFO:tasks.workunit.client.0.smithi063.stdout:2/915: chown d3/d7/d8/l13 60317330 1 2024-09-16T01:25:23.689 INFO:tasks.workunit.client.0.smithi063.stdout:1/796: dwrite d1/d5/d82/d9b/d77/d7d/dc2/f37 [0,4194304] 0 2024-09-16T01:25:23.689 INFO:tasks.workunit.client.0.smithi063.stdout:5/943: dwrite d5/d18/d29/d52/d12e/de4/d105/d13a/f10b [0,4194304] 0 2024-09-16T01:25:23.692 INFO:tasks.workunit.client.0.smithi063.stdout:4/819: read - d5/d3b/df/d1c/d29/d32/d60/d10b/fba zero size 2024-09-16T01:25:23.692 INFO:tasks.workunit.client.0.smithi063.stdout:3/841: fdatasync d2/d11/d37/d40/d5e/d3b/f89 0 2024-09-16T01:25:23.693 INFO:tasks.workunit.client.0.smithi063.stdout:9/839: mknod d7/d1f/c128 0 2024-09-16T01:25:23.761 INFO:tasks.workunit.client.0.smithi063.stdout:9/840: rmdir d7/d9/d20 39 2024-09-16T01:25:23.762 INFO:tasks.workunit.client.0.smithi063.stdout:4/820: write d5/d3b/d57/d66/fe2 [40961,119910] 0 2024-09-16T01:25:23.762 INFO:tasks.workunit.client.0.smithi063.stdout:3/842: readlink d2/d11/d37/d40/d5e/d3b/d68/l72 0 2024-09-16T01:25:23.762 INFO:tasks.workunit.client.0.smithi063.stdout:0/863: dwrite d1/d2e/d48/dc3/dca/fe8 [0,4194304] 0 2024-09-16T01:25:23.764 INFO:tasks.workunit.client.0.smithi063.stdout:1/797: getdents d1/dd/d3b/db3 0 2024-09-16T01:25:23.766 INFO:tasks.workunit.client.0.smithi063.stdout:5/944: getdents d5/d12/d91 0 2024-09-16T01:25:23.766 INFO:tasks.workunit.client.0.smithi063.stdout:8/675: dread d5/db/d12/db0/fb2 [0,4194304] 0 2024-09-16T01:25:23.767 INFO:tasks.workunit.client.0.smithi063.stdout:1/798: chown d1/d12/ff4 2671300 1 2024-09-16T01:25:23.768 INFO:tasks.workunit.client.0.smithi063.stdout:6/827: dread d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/f83 [4194304,4194304] 0 2024-09-16T01:25:23.769 INFO:tasks.workunit.client.0.smithi063.stdout:3/843: stat d2/d11/d37/d40/d5e/ddc 0 2024-09-16T01:25:23.769 INFO:tasks.workunit.client.0.smithi063.stdout:4/821: chown d5/d3b/df/d1c/d29/d32/d60/lad 163955628 1 2024-09-16T01:25:23.770 INFO:tasks.workunit.client.0.smithi063.stdout:1/799: fdatasync d1/d12/f8b 0 2024-09-16T01:25:23.774 INFO:tasks.workunit.client.0.smithi063.stdout:2/916: dwrite d3/d7/d8/d19/f44 [0,4194304] 0 2024-09-16T01:25:23.775 INFO:tasks.workunit.client.0.smithi063.stdout:6/828: mkdir d3/d127 0 2024-09-16T01:25:23.780 INFO:tasks.workunit.client.0.smithi063.stdout:3/844: mknod d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/c124 0 2024-09-16T01:25:23.783 INFO:tasks.workunit.client.0.smithi063.stdout:8/676: write d5/db/d12/d3d/f9c [2146466,68016] 0 2024-09-16T01:25:23.784 INFO:tasks.workunit.client.0.smithi063.stdout:3/845: chown d2/d11/d69/d85 499 1 2024-09-16T01:25:23.784 INFO:tasks.workunit.client.0.smithi063.stdout:9/841: rename d7/d1f to d7/d116/d129 0 2024-09-16T01:25:23.791 INFO:tasks.workunit.client.0.smithi063.stdout:8/677: unlink d5/d9/l8e 0 2024-09-16T01:25:23.792 INFO:tasks.workunit.client.0.smithi063.stdout:0/864: dread d1/d30/d52/d5a/d36/d41/f6a [0,4194304] 0 2024-09-16T01:25:23.792 INFO:tasks.workunit.client.0.smithi063.stdout:2/917: dread d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/f74 [0,4194304] 0 2024-09-16T01:25:23.793 INFO:tasks.workunit.client.0.smithi063.stdout:1/800: dread d1/d12/ff4 [0,4194304] 0 2024-09-16T01:25:23.794 INFO:tasks.workunit.client.0.smithi063.stdout:5/945: rename d5/d12/fcf to d5/d18/d29/d52/f14f 0 2024-09-16T01:25:23.794 INFO:tasks.workunit.client.0.smithi063.stdout:9/842: mknod d7/d9/d20/de3/de7/db2/c12a 0 2024-09-16T01:25:23.795 INFO:tasks.workunit.client.0.smithi063.stdout:4/822: dread d5/d3b/df/d1c/f36 [0,4194304] 0 2024-09-16T01:25:23.796 INFO:tasks.workunit.client.0.smithi063.stdout:1/801: write d1/f57 [4205163,63205] 0 2024-09-16T01:25:23.796 INFO:tasks.workunit.client.0.smithi063.stdout:2/918: unlink d3/d7/c1b 0 2024-09-16T01:25:23.798 INFO:tasks.workunit.client.0.smithi063.stdout:3/846: link d2/fbf d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/da6/f125 0 2024-09-16T01:25:23.798 INFO:tasks.workunit.client.0.smithi063.stdout:8/678: getdents d5/d8c/d74/d87 0 2024-09-16T01:25:23.821 INFO:tasks.workunit.client.0.smithi063.stdout:5/946: read d5/d18/d29/d48/d98/d94/f62 [1691265,97008] 0 2024-09-16T01:25:23.821 INFO:tasks.workunit.client.0.smithi063.stdout:6/829: dread d3/d10/f1d [0,4194304] 0 2024-09-16T01:25:23.822 INFO:tasks.workunit.client.0.smithi063.stdout:1/802: read d1/d5/d82/d9b/d77/d7d/dc2/f37 [3847815,96844] 0 2024-09-16T01:25:23.824 INFO:tasks.workunit.client.0.smithi063.stdout:8/679: rmdir d5/d8c/d74/db7 39 2024-09-16T01:25:23.824 INFO:tasks.workunit.client.0.smithi063.stdout:0/865: truncate d1/d30/d52/d5a/d36/d41/f4d 837890 0 2024-09-16T01:25:23.826 INFO:tasks.workunit.client.0.smithi063.stdout:2/919: unlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/c7b 0 2024-09-16T01:25:23.827 INFO:tasks.workunit.client.0.smithi063.stdout:6/830: creat d3/d48/d28/d113/f128 x:0 0 0 2024-09-16T01:25:23.829 INFO:tasks.workunit.client.0.smithi063.stdout:8/680: rmdir d5/db/d12/d3d/d69/daa 39 2024-09-16T01:25:23.829 INFO:tasks.workunit.client.0.smithi063.stdout:5/947: rename d5/d18/f2a to d5/d18/d29/d104/f150 0 2024-09-16T01:25:23.830 INFO:tasks.workunit.client.0.smithi063.stdout:0/866: mknod d1/d30/d52/d5a/d36/d41/c141 0 2024-09-16T01:25:23.832 INFO:tasks.workunit.client.0.smithi063.stdout:9/843: dwrite d7/d9/d20/de3/de7/db2/dca/fe8 [0,4194304] 0 2024-09-16T01:25:23.837 INFO:tasks.workunit.client.0.smithi063.stdout:6/831: read d3/d48/d28/d3e/d44/da4/d5a/fe2 [3875993,63077] 0 2024-09-16T01:25:23.838 INFO:tasks.workunit.client.0.smithi063.stdout:3/847: dread d2/d11/d37/d40/d5e/d3b/d94/d30/f3c [0,4194304] 0 2024-09-16T01:25:23.839 INFO:tasks.workunit.client.0.smithi063.stdout:9/844: fsync d7/d9/d20/de3/de7/d14/d38/f70 0 2024-09-16T01:25:23.840 INFO:tasks.workunit.client.0.smithi063.stdout:1/803: dwrite d1/d5/d15/d1b/fef [0,4194304] 0 2024-09-16T01:25:23.840 INFO:tasks.workunit.client.0.smithi063.stdout:6/832: dread - d3/d41/d89/ffd zero size 2024-09-16T01:25:23.841 INFO:tasks.workunit.client.0.smithi063.stdout:2/920: mknod d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d56/c13c 0 2024-09-16T01:25:23.846 INFO:tasks.workunit.client.0.smithi063.stdout:6/833: write d3/d41/f7a [3719957,48542] 0 2024-09-16T01:25:23.848 INFO:tasks.workunit.client.0.smithi063.stdout:0/867: rename d1/d30/d52/d5a/d36/f5b to d1/d30/d52/d5a/d76/f142 0 2024-09-16T01:25:23.850 INFO:tasks.workunit.client.0.smithi063.stdout:9/845: mknod d7/d9/d20/de3/de7/d14/d38/df7/c12b 0 2024-09-16T01:25:23.852 INFO:tasks.workunit.client.0.smithi063.stdout:8/681: dwrite d5/db/d12/d3d/d69/daa/f90 [0,4194304] 0 2024-09-16T01:25:23.853 INFO:tasks.workunit.client.0.smithi063.stdout:6/834: creat d3/d10/d11a/f129 x:0 0 0 2024-09-16T01:25:23.854 INFO:tasks.workunit.client.0.smithi063.stdout:0/868: chown d1/df 473398 1 2024-09-16T01:25:23.857 INFO:tasks.workunit.client.0.smithi063.stdout:5/948: rename d5/c6c to d5/d18/d29/d52/d12e/de4/d105/c151 0 2024-09-16T01:25:23.858 INFO:tasks.workunit.client.0.smithi063.stdout:1/804: dwrite d1/d5/d15/fd1 [0,4194304] 0 2024-09-16T01:25:23.858 INFO:tasks.workunit.client.0.smithi063.stdout:2/921: fsync d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d45/fd0 0 2024-09-16T01:25:23.859 INFO:tasks.workunit.client.0.smithi063.stdout:6/835: mknod d3/d10/d124/c12a 0 2024-09-16T01:25:23.859 INFO:tasks.workunit.client.0.smithi063.stdout:3/848: dwrite d2/f22 [0,4194304] 0 2024-09-16T01:25:23.863 INFO:tasks.workunit.client.0.smithi063.stdout:8/682: chown d5/db/d12/d1a/d60/d7a/f9f 750292 1 2024-09-16T01:25:23.864 INFO:tasks.workunit.client.0.smithi063.stdout:0/869: write d1/df/d2c/d43/fa0 [4312839,38652] 0 2024-09-16T01:25:23.871 INFO:tasks.workunit.client.0.smithi063.stdout:6/836: truncate d3/d41/f115 15632 0 2024-09-16T01:25:23.872 INFO:tasks.workunit.client.0.smithi063.stdout:8/683: mknod d5/db/d12/d1a/d60/da8/cdf 0 2024-09-16T01:25:23.874 INFO:tasks.workunit.client.0.smithi063.stdout:5/949: unlink d5/d18/d29/d48/d98/cb6 0 2024-09-16T01:25:23.876 INFO:tasks.workunit.client.0.smithi063.stdout:6/837: symlink d3/d48/d28/d113/l12b 0 2024-09-16T01:25:23.877 INFO:tasks.workunit.client.0.smithi063.stdout:1/805: link d1/d5/d15/ceb d1/d5/d82/d9b/d77/d7d/dda/c10a 0 2024-09-16T01:25:23.878 INFO:tasks.workunit.client.0.smithi063.stdout:8/684: fsync d5/db/d12/d1a/d1e/f32 0 2024-09-16T01:25:23.880 INFO:tasks.workunit.client.0.smithi063.stdout:2/922: dwrite d3/d7/f11b [0,4194304] 0 2024-09-16T01:25:23.880 INFO:tasks.workunit.client.0.smithi063.stdout:7/755: sync 2024-09-16T01:25:23.880 INFO:tasks.workunit.client.0.smithi063.stdout:3/849: rename d2/d11/d37/d40/d5e/d3b/d68/d6d/fc8 to d2/d11/d37/d40/d5e/d97/f126 0 2024-09-16T01:25:23.882 INFO:tasks.workunit.client.0.smithi063.stdout:9/846: dread d7/d4a/dba/d7f/fb7 [0,4194304] 0 2024-09-16T01:25:23.883 INFO:tasks.workunit.client.0.smithi063.stdout:8/685: stat d5/d86/dd5 0 2024-09-16T01:25:23.884 INFO:tasks.workunit.client.0.smithi063.stdout:0/870: dread d1/d30/d52/db3/fd8 [0,4194304] 0 2024-09-16T01:25:23.885 INFO:tasks.workunit.client.0.smithi063.stdout:3/850: fdatasync d2/d11/d69/d80/d8a/fa8 0 2024-09-16T01:25:23.886 INFO:tasks.workunit.client.0.smithi063.stdout:1/806: rmdir d1/dd/d3b 39 2024-09-16T01:25:23.889 INFO:tasks.workunit.client.0.smithi063.stdout:9/847: chown d7/d9/d20/de3/de7/d14/d23/d109/l11b 39642033 1 2024-09-16T01:25:23.891 INFO:tasks.workunit.client.0.smithi063.stdout:7/756: creat d7/d56/d57/d60/db9/dd8/df1/ff7 x:0 0 0 2024-09-16T01:25:23.895 INFO:tasks.workunit.client.0.smithi063.stdout:0/871: read d1/df/fd3 [364257,19493] 0 2024-09-16T01:25:23.897 INFO:tasks.workunit.client.0.smithi063.stdout:8/686: truncate d5/f83 813394 0 2024-09-16T01:25:23.904 INFO:tasks.workunit.client.0.smithi063.stdout:3/851: dwrite d2/f9c [0,4194304] 0 2024-09-16T01:25:23.905 INFO:tasks.workunit.client.0.smithi063.stdout:9/848: fdatasync d7/d9/d20/de3/de7/d14/fc7 0 2024-09-16T01:25:23.905 INFO:tasks.workunit.client.0.smithi063.stdout:2/923: dwrite d3/d7/f16 [4194304,4194304] 0 2024-09-16T01:25:23.907 INFO:tasks.workunit.client.0.smithi063.stdout:5/950: dwrite d5/d18/d29/d48/d98/d94/f62 [0,4194304] 0 2024-09-16T01:25:23.916 INFO:tasks.workunit.client.0.smithi063.stdout:6/838: dread d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/fc8 [0,4194304] 0 2024-09-16T01:25:23.916 INFO:tasks.workunit.client.0.smithi063.stdout:9/849: mkdir d7/d9/d20/de3/de7/db2/d12c 0 2024-09-16T01:25:23.917 INFO:tasks.workunit.client.0.smithi063.stdout:1/807: dwrite d1/d5/d15/d18/f101 [4194304,4194304] 0 2024-09-16T01:25:23.918 INFO:tasks.workunit.client.0.smithi063.stdout:8/687: creat d5/d8c/fe0 x:0 0 0 2024-09-16T01:25:23.922 INFO:tasks.workunit.client.0.smithi063.stdout:9/850: stat d7/d9/d20/de3/de7/d14/f35 0 2024-09-16T01:25:23.923 INFO:tasks.workunit.client.0.smithi063.stdout:7/757: dwrite d7/d56/d57/d60/db9/de0/fe4 [0,4194304] 0 2024-09-16T01:25:23.924 INFO:tasks.workunit.client.0.smithi063.stdout:3/852: dread d2/f9c [0,4194304] 0 2024-09-16T01:25:23.924 INFO:tasks.workunit.client.0.smithi063.stdout:2/924: dread d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/fbf [0,4194304] 0 2024-09-16T01:25:23.924 INFO:tasks.workunit.client.0.smithi063.stdout:8/688: read - d5/d8c/fe0 zero size 2024-09-16T01:25:23.926 INFO:tasks.workunit.client.0.smithi063.stdout:1/808: chown d1/d5/d15/d1b/lf8 717787 1 2024-09-16T01:25:23.928 INFO:tasks.workunit.client.0.smithi063.stdout:5/951: mknod d5/d18/d29/c152 0 2024-09-16T01:25:23.929 INFO:tasks.workunit.client.0.smithi063.stdout:0/872: getdents d1/d30/d52/d9d 0 2024-09-16T01:25:23.929 INFO:tasks.workunit.client.0.smithi063.stdout:7/758: fdatasync d7/d56/f55 0 2024-09-16T01:25:23.931 INFO:tasks.workunit.client.0.smithi063.stdout:6/839: symlink d3/d48/d28/d3e/d44/da4/l12c 0 2024-09-16T01:25:23.931 INFO:tasks.workunit.client.0.smithi063.stdout:8/689: unlink d5/db/d12/db0/fb2 0 2024-09-16T01:25:23.933 INFO:tasks.workunit.client.0.smithi063.stdout:1/809: mknod d1/d5/d15/d1b/c10b 0 2024-09-16T01:25:23.933 INFO:tasks.workunit.client.0.smithi063.stdout:3/853: rmdir d2/d11/d37/d40/d5e/d3b/d94/d30 39 2024-09-16T01:25:23.934 INFO:tasks.workunit.client.0.smithi063.stdout:5/952: dread d5/f51 [0,4194304] 0 2024-09-16T01:25:23.936 INFO:tasks.workunit.client.0.smithi063.stdout:0/873: read d1/fb [1301091,41262] 0 2024-09-16T01:25:23.937 INFO:tasks.workunit.client.0.smithi063.stdout:2/925: mkdir d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d13d 0 2024-09-16T01:25:23.937 INFO:tasks.workunit.client.0.smithi063.stdout:4/823: sync 2024-09-16T01:25:23.939 INFO:tasks.workunit.client.0.smithi063.stdout:1/810: symlink d1/d5/l10c 0 2024-09-16T01:25:23.942 INFO:tasks.workunit.client.0.smithi063.stdout:3/854: write d2/d11/d37/d40/d5e/f55 [4059862,2341] 0 2024-09-16T01:25:23.942 INFO:tasks.workunit.client.0.smithi063.stdout:5/953: rmdir d5/d18/d29 39 2024-09-16T01:25:23.943 INFO:tasks.workunit.client.0.smithi063.stdout:2/926: creat d3/dbc/f13e x:0 0 0 2024-09-16T01:25:23.944 INFO:tasks.workunit.client.0.smithi063.stdout:1/811: fdatasync d1/f3 0 2024-09-16T01:25:23.947 INFO:tasks.workunit.client.0.smithi063.stdout:4/824: creat d5/d3b/d57/d66/db7/dc9/f111 x:0 0 0 2024-09-16T01:25:23.947 INFO:tasks.workunit.client.0.smithi063.stdout:7/759: dwrite d7/d1c/d1f/d29/f4e [0,4194304] 0 2024-09-16T01:25:23.952 INFO:tasks.workunit.client.0.smithi063.stdout:9/851: dread d7/d9/d20/de3/de7/d14/d38/f10d [0,4194304] 0 2024-09-16T01:25:23.954 INFO:tasks.workunit.client.0.smithi063.stdout:6/840: dwrite d3/d48/d28/d3e/d44/da4/d5a/d6b/ff0 [0,4194304] 0 2024-09-16T01:25:23.957 INFO:tasks.workunit.client.0.smithi063.stdout:3/855: creat d2/d11/d18/f127 x:0 0 0 2024-09-16T01:25:23.960 INFO:tasks.workunit.client.0.smithi063.stdout:2/927: mknod d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/dfe/c13f 0 2024-09-16T01:25:23.961 INFO:tasks.workunit.client.0.smithi063.stdout:6/841: write d3/d30/f78 [292120,3154] 0 2024-09-16T01:25:23.961 INFO:tasks.workunit.client.0.smithi063.stdout:0/874: dwrite d1/df/d17/f6d [0,4194304] 0 2024-09-16T01:25:23.962 INFO:tasks.workunit.client.0.smithi063.stdout:1/812: truncate d1/d5/d15/d18/d4b/f6e 708511 0 2024-09-16T01:25:23.964 INFO:tasks.workunit.client.0.smithi063.stdout:9/852: rmdir d7/d4a/d4d/d96/da2 39 2024-09-16T01:25:23.966 INFO:tasks.workunit.client.0.smithi063.stdout:5/954: mkdir d5/d18/d29/d48/d7b/d14a/d153 0 2024-09-16T01:25:23.969 INFO:tasks.workunit.client.0.smithi063.stdout:6/842: creat d3/d30/d8d/d102/f12d x:0 0 0 2024-09-16T01:25:23.975 INFO:tasks.workunit.client.0.smithi063.stdout:4/825: dwrite d5/d3b/d57/dce/d10d/d10e/f110 [0,4194304] 0 2024-09-16T01:25:23.978 INFO:tasks.workunit.client.0.smithi063.stdout:3/856: truncate d2/d11/d37/d40/d5e/d3b/d45/d9f/fe6 4745396 0 2024-09-16T01:25:23.979 INFO:tasks.workunit.client.0.smithi063.stdout:7/760: dwrite d7/d1c/d1f/d29/dbf/d40/d6c/fe8 [0,4194304] 0 2024-09-16T01:25:23.980 INFO:tasks.workunit.client.0.smithi063.stdout:9/853: read d7/d9/d20/de3/de7/f5d [2274410,47848] 0 2024-09-16T01:25:23.982 INFO:tasks.workunit.client.0.smithi063.stdout:3/857: dread - d2/d11/d18/ff3 zero size 2024-09-16T01:25:23.982 INFO:tasks.workunit.client.0.smithi063.stdout:6/843: creat d3/d48/d28/d3e/d44/f12e x:0 0 0 2024-09-16T01:25:23.983 INFO:tasks.workunit.client.0.smithi063.stdout:4/826: unlink d5/d3b/df/d1c/d29/d20/d98/ced 0 2024-09-16T01:25:23.984 INFO:tasks.workunit.client.0.smithi063.stdout:2/928: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/f63 [295968,116352] 0 2024-09-16T01:25:23.985 INFO:tasks.workunit.client.0.smithi063.stdout:1/813: dread d1/f57 [0,4194304] 0 2024-09-16T01:25:23.985 INFO:tasks.workunit.client.0.smithi063.stdout:7/761: creat d7/d56/ff8 x:0 0 0 2024-09-16T01:25:23.985 INFO:tasks.workunit.client.0.smithi063.stdout:0/875: truncate d1/d30/d52/d5a/f3d 2183786 0 2024-09-16T01:25:23.987 INFO:tasks.workunit.client.0.smithi063.stdout:9/854: stat d7/d9/d20/de3/de7/d14/d63/d5f/c8d 0 2024-09-16T01:25:23.989 INFO:tasks.workunit.client.0.smithi063.stdout:2/929: fdatasync d3/d7/d8/d19/d3c/d53/f130 0 2024-09-16T01:25:23.989 INFO:tasks.workunit.client.0.smithi063.stdout:9/855: rmdir d7/d9 39 2024-09-16T01:25:23.991 INFO:tasks.workunit.client.0.smithi063.stdout:7/762: chown d7/d56/d57/d73/d91/db4/lc4 85423349 1 2024-09-16T01:25:23.991 INFO:tasks.workunit.client.0.smithi063.stdout:6/844: mknod d3/d30/d39/dac/db5/dcf/dee/c12f 0 2024-09-16T01:25:23.993 INFO:tasks.workunit.client.0.smithi063.stdout:5/955: truncate d5/d12/d91/d72/fb3 1277374 0 2024-09-16T01:25:23.995 INFO:tasks.workunit.client.0.smithi063.stdout:0/876: dread d1/df/d17/f81 [0,4194304] 0 2024-09-16T01:25:23.995 INFO:tasks.workunit.client.0.smithi063.stdout:6/845: creat d3/d10/d11a/f130 x:0 0 0 2024-09-16T01:25:23.995 INFO:tasks.workunit.client.0.smithi063.stdout:7/763: chown d7/d1c/d1f/d29/daf/lf0 0 1 2024-09-16T01:25:23.996 INFO:tasks.workunit.client.0.smithi063.stdout:4/827: creat d5/d3b/df/d1c/d29/d20/f112 x:0 0 0 2024-09-16T01:25:23.996 INFO:tasks.workunit.client.0.smithi063.stdout:3/858: rename d2/d11/d69/c111 to d2/d11/d37/d40/d5e/d3b/d94/c128 0 2024-09-16T01:25:23.997 INFO:tasks.workunit.client.0.smithi063.stdout:6/846: fsync d3/d41/fbc 0 2024-09-16T01:25:23.998 INFO:tasks.workunit.client.0.smithi063.stdout:5/956: fdatasync d5/d12/d91/d72/fb3 0 2024-09-16T01:25:23.999 INFO:tasks.workunit.client.0.smithi063.stdout:2/930: getdents d3/d7/d8/d19/d3c/d53/d7f/d80 0 2024-09-16T01:25:24.001 INFO:tasks.workunit.client.0.smithi063.stdout:3/859: fsync d2/d11/d37/dab/fdb 0 2024-09-16T01:25:24.002 INFO:tasks.workunit.client.0.smithi063.stdout:1/814: rename d1/d5/d15/d18/db6/dec to d1/dd/d3b/dbe/d10d 0 2024-09-16T01:25:24.004 INFO:tasks.workunit.client.0.smithi063.stdout:9/856: link d7/d4a/l122 d7/d9/d20/de3/de7/d14/d23/d109/l12d 0 2024-09-16T01:25:24.004 INFO:tasks.workunit.client.0.smithi063.stdout:6/847: mknod d3/d127/c131 0 2024-09-16T01:25:24.008 INFO:tasks.workunit.client.0.smithi063.stdout:0/877: fsync d1/d30/d52/d5a/d36/d41/f4d 0 2024-09-16T01:25:24.009 INFO:tasks.workunit.client.0.smithi063.stdout:2/931: read - d3/d7/d8/d19/d3c/d53/d7f/d80/fc5 zero size 2024-09-16T01:25:24.009 INFO:tasks.workunit.client.0.smithi063.stdout:3/860: write d2/d11/d37/d40/f53 [267441,103233] 0 2024-09-16T01:25:24.009 INFO:tasks.workunit.client.0.smithi063.stdout:1/815: mknod d1/d5/d82/c10e 0 2024-09-16T01:25:24.009 INFO:tasks.workunit.client.0.smithi063.stdout:6/848: readlink d3/d48/la9 0 2024-09-16T01:25:24.010 INFO:tasks.workunit.client.0.smithi063.stdout:4/828: dwrite d5/d3b/d57/d66/d9b/d7a/feb [0,4194304] 0 2024-09-16T01:25:24.011 INFO:tasks.workunit.client.0.smithi063.stdout:6/849: fdatasync d3/d48/d28/f33 0 2024-09-16T01:25:24.019 INFO:tasks.workunit.client.0.smithi063.stdout:9/857: creat d7/d4a/df2/f12e x:0 0 0 2024-09-16T01:25:24.021 INFO:tasks.workunit.client.0.smithi063.stdout:3/861: mkdir d2/d11/d37/db1/dc2/d129 0 2024-09-16T01:25:24.021 INFO:tasks.workunit.client.0.smithi063.stdout:6/850: dread - d3/d48/d28/d113/f128 zero size 2024-09-16T01:25:24.021 INFO:tasks.workunit.client.0.smithi063.stdout:4/829: write d5/d3b/d57/d68/d90/faa [64110,53279] 0 2024-09-16T01:25:24.024 INFO:tasks.workunit.client.0.smithi063.stdout:7/764: truncate d7/f5e 63253 0 2024-09-16T01:25:24.026 INFO:tasks.workunit.client.0.smithi063.stdout:5/957: getdents d5/d18/d29/d52/d12e/de4/d105/d13a 0 2024-09-16T01:25:24.029 INFO:tasks.workunit.client.0.smithi063.stdout:3/862: dread - d2/d11/d37/d40/d5e/d3b/da1/f116 zero size 2024-09-16T01:25:24.029 INFO:tasks.workunit.client.0.smithi063.stdout:1/816: dwrite d1/d5/d6f/f85 [4194304,4194304] 0 2024-09-16T01:25:24.030 INFO:tasks.workunit.client.0.smithi063.stdout:0/878: dwrite d1/d30/d52/d5a/d36/d41/f10d [0,4194304] 0 2024-09-16T01:25:24.030 INFO:tasks.workunit.client.0.smithi063.stdout:4/830: truncate d5/d3b/d57/ffd 894921 0 2024-09-16T01:25:24.031 INFO:tasks.workunit.client.0.smithi063.stdout:9/858: creat d7/d9/d20/de3/de7/d14/d34/f12f x:0 0 0 2024-09-16T01:25:24.032 INFO:tasks.workunit.client.0.smithi063.stdout:6/851: truncate d3/d48/d28/d3e/d44/f12e 897117 0 2024-09-16T01:25:24.032 INFO:tasks.workunit.client.0.smithi063.stdout:2/932: creat d3/d7/f140 x:0 0 0 2024-09-16T01:25:24.032 INFO:tasks.workunit.client.0.smithi063.stdout:7/765: write d7/d56/d57/d60/db9/de0/fe4 [1110592,15502] 0 2024-09-16T01:25:24.035 INFO:tasks.workunit.client.0.smithi063.stdout:4/831: mknod d5/d3b/d57/d68/dc5/c113 0 2024-09-16T01:25:24.036 INFO:tasks.workunit.client.0.smithi063.stdout:0/879: creat d1/df/d34/da6/f143 x:0 0 0 2024-09-16T01:25:24.037 INFO:tasks.workunit.client.0.smithi063.stdout:6/852: mknod d3/d10/c132 0 2024-09-16T01:25:24.037 INFO:tasks.workunit.client.0.smithi063.stdout:7/766: dread - d7/d1c/d1f/d29/d88/faa zero size 2024-09-16T01:25:24.037 INFO:tasks.workunit.client.0.smithi063.stdout:1/817: write d1/d5/d82/d9b/d77/d7d/fcd [112246,103854] 0 2024-09-16T01:25:24.039 INFO:tasks.workunit.client.0.smithi063.stdout:3/863: creat d2/d11/d37/d40/d5e/d3b/d68/dd2/f12a x:0 0 0 2024-09-16T01:25:24.041 INFO:tasks.workunit.client.0.smithi063.stdout:5/958: rename d5/d18/d29/d52/d12e/de4/d105/d13a/f130 to d5/d18/d29/d48/d7b/f154 0 2024-09-16T01:25:24.042 INFO:tasks.workunit.client.0.smithi063.stdout:1/818: mkdir d1/d5/d82/d10f 0 2024-09-16T01:25:24.043 INFO:tasks.workunit.client.0.smithi063.stdout:0/880: write d1/d30/d52/d5a/d36/fdc [3920810,119067] 0 2024-09-16T01:25:24.046 INFO:tasks.workunit.client.0.smithi063.stdout:9/859: truncate d7/d9/d20/de3/de7/db2/dc6/ffa 2299163 0 2024-09-16T01:25:24.046 INFO:tasks.workunit.client.0.smithi063.stdout:7/767: mkdir d7/d56/d57/d60/df9 0 2024-09-16T01:25:24.049 INFO:tasks.workunit.client.0.smithi063.stdout:5/959: fdatasync d5/d18/d29/d52/d12e/de4/fe5 0 2024-09-16T01:25:24.050 INFO:tasks.workunit.client.0.smithi063.stdout:1/819: dread - d1/d5/d82/d9b/d77/d7d/dc2/dad/ffb zero size 2024-09-16T01:25:24.052 INFO:tasks.workunit.client.0.smithi063.stdout:7/768: chown d7/d1c/d1f/d66/lbb 12 1 2024-09-16T01:25:24.052 INFO:tasks.workunit.client.0.smithi063.stdout:3/864: write d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/f8f [11785441,81293] 0 2024-09-16T01:25:24.056 INFO:tasks.workunit.client.0.smithi063.stdout:1/820: symlink d1/d5/d6f/l110 0 2024-09-16T01:25:24.057 INFO:tasks.workunit.client.0.smithi063.stdout:8/690: sync 2024-09-16T01:25:24.057 INFO:tasks.workunit.client.0.smithi063.stdout:0/881: fsync d1/d1c/f78 0 2024-09-16T01:25:24.060 INFO:tasks.workunit.client.0.smithi063.stdout:2/933: dwrite d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/da7/f101 [0,4194304] 0 2024-09-16T01:25:24.060 INFO:tasks.workunit.client.0.smithi063.stdout:4/832: getdents d5/d3b/df/d1c 0 2024-09-16T01:25:24.064 INFO:tasks.workunit.client.0.smithi063.stdout:7/769: creat d7/d1c/d1f/d29/d88/d96/dca/ffa x:0 0 0 2024-09-16T01:25:24.066 INFO:tasks.workunit.client.0.smithi063.stdout:3/865: fsync d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/fe8 0 2024-09-16T01:25:24.066 INFO:tasks.workunit.client.0.smithi063.stdout:0/882: rmdir d1/df/d17 39 2024-09-16T01:25:24.068 INFO:tasks.workunit.client.0.smithi063.stdout:6/853: dread d3/d30/d8d/d102/f93 [0,4194304] 0 2024-09-16T01:25:24.069 INFO:tasks.workunit.client.0.smithi063.stdout:4/833: creat d5/d3b/d5c/f114 x:0 0 0 2024-09-16T01:25:24.069 INFO:tasks.workunit.client.0.smithi063.stdout:5/960: dwrite d5/f15 [4194304,4194304] 0 2024-09-16T01:25:24.075 INFO:tasks.workunit.client.0.smithi063.stdout:8/691: creat d5/db/d12/d1a/d1e/d68/fe1 x:0 0 0 2024-09-16T01:25:24.076 INFO:tasks.workunit.client.0.smithi063.stdout:9/860: dwrite d7/d4a/dba/f45 [0,4194304] 0 2024-09-16T01:25:24.077 INFO:tasks.workunit.client.0.smithi063.stdout:6/854: readlink d3/d30/d39/d69/l80 0 2024-09-16T01:25:24.077 INFO:tasks.workunit.client.0.smithi063.stdout:7/770: read d7/d1c/d1f/d29/dbf/d40/f58 [3135254,4337] 0 2024-09-16T01:25:24.078 INFO:tasks.workunit.client.0.smithi063.stdout:5/961: mkdir d5/d18/d29/d48/d98/d155 0 2024-09-16T01:25:24.082 INFO:tasks.workunit.client.0.smithi063.stdout:4/834: chown d5/d3b/df/d1c/d29/dd4/dbc/fc2 387 1 2024-09-16T01:25:24.083 INFO:tasks.workunit.client.0.smithi063.stdout:3/866: getdents d2/d11/d37/dab/d10b 0 2024-09-16T01:25:24.083 INFO:tasks.workunit.client.0.smithi063.stdout:1/821: dwrite d1/d12/fa7 [4194304,4194304] 0 2024-09-16T01:25:24.084 INFO:tasks.workunit.client.0.smithi063.stdout:2/934: rename d3/d7/d8/d19/d3c/d53/ld1 to d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/db7/l141 0 2024-09-16T01:25:24.087 INFO:tasks.workunit.client.0.smithi063.stdout:8/692: creat d5/db/d12/d1a/fe2 x:0 0 0 2024-09-16T01:25:24.089 INFO:tasks.workunit.client.0.smithi063.stdout:0/883: creat d1/df/d17/f144 x:0 0 0 2024-09-16T01:25:24.091 INFO:tasks.workunit.client.0.smithi063.stdout:4/835: mkdir d5/d3b/d57/dce/d10d/d115 0 2024-09-16T01:25:24.091 INFO:tasks.workunit.client.0.smithi063.stdout:5/962: unlink d5/d18/d29/d48/d66/db1/dfc/f125 0 2024-09-16T01:25:24.092 INFO:tasks.workunit.client.0.smithi063.stdout:9/861: truncate d7/fa9 1097680 0 2024-09-16T01:25:24.094 INFO:tasks.workunit.client.0.smithi063.stdout:6/855: rename d3/d48/d28/d3e/d44/l7b to d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/l133 0 2024-09-16T01:25:24.097 INFO:tasks.workunit.client.0.smithi063.stdout:9/862: fsync d7/d4a/d9d/f11e 0 2024-09-16T01:25:24.099 INFO:tasks.workunit.client.0.smithi063.stdout:5/963: mkdir d5/d12/d156 0 2024-09-16T01:25:24.099 INFO:tasks.workunit.client.0.smithi063.stdout:6/856: write d3/d10/d49/f5c [2059676,18753] 0 2024-09-16T01:25:24.100 INFO:tasks.workunit.client.0.smithi063.stdout:3/867: link d2/d5b/db4/cba d2/d11/d37/c12b 0 2024-09-16T01:25:24.101 INFO:tasks.workunit.client.0.smithi063.stdout:1/822: link d1/d12/l55 d1/d5/d82/d9b/d77/d7d/da5/l111 0 2024-09-16T01:25:24.101 INFO:tasks.workunit.client.0.smithi063.stdout:0/884: dread d1/d1c/f2d [0,4194304] 0 2024-09-16T01:25:24.104 INFO:tasks.workunit.client.0.smithi063.stdout:1/823: readlink d1/d5/la8 0 2024-09-16T01:25:24.105 INFO:tasks.workunit.client.0.smithi063.stdout:8/693: truncate d5/f94 1138772 0 2024-09-16T01:25:24.106 INFO:tasks.workunit.client.0.smithi063.stdout:2/935: truncate d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/db7/ff4 103718 0 2024-09-16T01:25:24.106 INFO:tasks.workunit.client.0.smithi063.stdout:7/771: dread d7/d1c/d1f/d29/dbf/f22 [0,4194304] 0 2024-09-16T01:25:24.109 INFO:tasks.workunit.client.0.smithi063.stdout:5/964: chown d5/d18/d29/d48/d7b/d85/df9/d142/l131 6375543 1 2024-09-16T01:25:24.110 INFO:tasks.workunit.client.0.smithi063.stdout:4/836: dwrite d5/d3b/d57/d66/d9b/fd1 [0,4194304] 0 2024-09-16T01:25:24.111 INFO:tasks.workunit.client.0.smithi063.stdout:3/868: read d2/d11/d37/d40/d5e/f36 [843525,112549] 0 2024-09-16T01:25:24.111 INFO:tasks.workunit.client.0.smithi063.stdout:8/694: write d5/d9/d98/fd9 [126309,15787] 0 2024-09-16T01:25:24.114 INFO:tasks.workunit.client.0.smithi063.stdout:0/885: symlink d1/df/l145 0 2024-09-16T01:25:24.114 INFO:tasks.workunit.client.0.smithi063.stdout:2/936: stat d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/fbf 0 2024-09-16T01:25:24.115 INFO:tasks.workunit.client.0.smithi063.stdout:1/824: read d1/d5/d82/d9b/d77/d7d/dc2/f37 [1468985,25538] 0 2024-09-16T01:25:24.116 INFO:tasks.workunit.client.0.smithi063.stdout:4/837: creat d5/d3b/d57/dce/d10d/d10e/f116 x:0 0 0 2024-09-16T01:25:24.117 INFO:tasks.workunit.client.0.smithi063.stdout:9/863: rename d7/d9/d20/de3/de7/l19 to d7/d4a/d4d/d96/da2/l130 0 2024-09-16T01:25:24.121 INFO:tasks.workunit.client.0.smithi063.stdout:3/869: mkdir d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/d12c 0 2024-09-16T01:25:24.121 INFO:tasks.workunit.client.0.smithi063.stdout:8/695: creat d5/db/d12/d1a/d1e/d93/db8/fe3 x:0 0 0 2024-09-16T01:25:24.121 INFO:tasks.workunit.client.0.smithi063.stdout:6/857: link d3/d48/d28/d3e/d44/d8c/ldf d3/d48/l134 0 2024-09-16T01:25:24.121 INFO:tasks.workunit.client.0.smithi063.stdout:4/838: symlink d5/d3b/d57/dce/l117 0 2024-09-16T01:25:24.124 INFO:tasks.workunit.client.0.smithi063.stdout:8/696: chown d5/fc1 3574423 1 2024-09-16T01:25:24.127 INFO:tasks.workunit.client.0.smithi063.stdout:9/864: symlink d7/d9/d20/de3/de7/db2/d12c/l131 0 2024-09-16T01:25:24.129 INFO:tasks.workunit.client.0.smithi063.stdout:5/965: dread d5/d18/f6e [0,4194304] 0 2024-09-16T01:25:24.130 INFO:tasks.workunit.client.0.smithi063.stdout:0/886: write d1/d30/f71 [632638,49083] 0 2024-09-16T01:25:24.130 INFO:tasks.workunit.client.0.smithi063.stdout:7/772: dread d7/d1c/d1f/d29/dbf/d40/f58 [0,4194304] 0 2024-09-16T01:25:24.132 INFO:tasks.workunit.client.0.smithi063.stdout:6/858: symlink d3/d48/d28/d3e/d68/db4/l135 0 2024-09-16T01:25:24.134 INFO:tasks.workunit.client.0.smithi063.stdout:4/839: rmdir d5/d3b/d57/dce/d10d/d115 0 2024-09-16T01:25:24.134 INFO:tasks.workunit.client.0.smithi063.stdout:1/825: dwrite d1/d5/d15/d1b/fef [0,4194304] 0 2024-09-16T01:25:24.137 INFO:tasks.workunit.client.0.smithi063.stdout:6/859: dread - d3/d30/d39/fd2 zero size 2024-09-16T01:25:24.139 INFO:tasks.workunit.client.0.smithi063.stdout:8/697: getdents d5/d86 0 2024-09-16T01:25:24.140 INFO:tasks.workunit.client.0.smithi063.stdout:7/773: write d7/d56/f64 [2855691,34343] 0 2024-09-16T01:25:24.140 INFO:tasks.workunit.client.0.smithi063.stdout:5/966: write d5/d18/d29/d48/d66/db1/f13e [951181,27201] 0 2024-09-16T01:25:24.143 INFO:tasks.workunit.client.0.smithi063.stdout:6/860: chown d3/d48/d28/d113 119512659 1 2024-09-16T01:25:24.144 INFO:tasks.workunit.client.0.smithi063.stdout:2/937: dwrite d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/fc7 [0,4194304] 0 2024-09-16T01:25:24.146 INFO:tasks.workunit.client.0.smithi063.stdout:8/698: chown d5/db/d12/d1a/d60 168350695 1 2024-09-16T01:25:24.146 INFO:tasks.workunit.client.0.smithi063.stdout:1/826: creat d1/d5/d15/d18/d4b/f112 x:0 0 0 2024-09-16T01:25:24.147 INFO:tasks.workunit.client.0.smithi063.stdout:4/840: mknod d5/d3b/d57/dce/c118 0 2024-09-16T01:25:24.147 INFO:tasks.workunit.client.0.smithi063.stdout:3/870: dread d2/f22 [4194304,4194304] 0 2024-09-16T01:25:24.150 INFO:tasks.workunit.client.0.smithi063.stdout:2/938: fdatasync d3/d7/f2e 0 2024-09-16T01:25:24.151 INFO:tasks.workunit.client.0.smithi063.stdout:6/861: chown d3/d48/d28/d3e/d44/da4/d5a/d6b 316620 1 2024-09-16T01:25:24.152 INFO:tasks.workunit.client.0.smithi063.stdout:5/967: mkdir d5/d18/d29/d48/dad/d157 0 2024-09-16T01:25:24.157 INFO:tasks.workunit.client.0.smithi063.stdout:0/887: dread d1/d1c/f78 [0,4194304] 0 2024-09-16T01:25:24.163 INFO:tasks.workunit.client.0.smithi063.stdout:7/774: mkdir d7/d1c/d1f/d29/dbf/d39/d9d/de2/dfb 0 2024-09-16T01:25:24.165 INFO:tasks.workunit.client.0.smithi063.stdout:2/939: creat d3/d7/d8/d19/d8c/dcc/d118/f142 x:0 0 0 2024-09-16T01:25:24.168 INFO:tasks.workunit.client.0.smithi063.stdout:0/888: write d1/d1c/f2d [151234,57033] 0 2024-09-16T01:25:24.169 INFO:tasks.workunit.client.0.smithi063.stdout:4/841: dwrite d5/d3b/d57/faf [0,4194304] 0 2024-09-16T01:25:24.169 INFO:tasks.workunit.client.0.smithi063.stdout:9/865: write d7/d9/d20/de3/de7/d14/f75 [216041,55209] 0 2024-09-16T01:25:24.173 INFO:tasks.workunit.client.0.smithi063.stdout:3/871: write d2/d11/d37/fb0 [1022080,1761] 0 2024-09-16T01:25:24.174 INFO:tasks.workunit.client.0.smithi063.stdout:8/699: dwrite d5/db/d12/d1a/d60/f91 [0,4194304] 0 2024-09-16T01:25:24.175 INFO:tasks.workunit.client.0.smithi063.stdout:1/827: dread d1/dd/d3b/f44 [0,4194304] 0 2024-09-16T01:25:24.178 INFO:tasks.workunit.client.0.smithi063.stdout:5/968: rename d5/d12/d91/d72/l89 to d5/d18/d29/d48/ddb/l158 0 2024-09-16T01:25:24.179 INFO:tasks.workunit.client.0.smithi063.stdout:4/842: fsync d5/d3b/df/d1c/f53 0 2024-09-16T01:25:24.184 INFO:tasks.workunit.client.0.smithi063.stdout:5/969: fdatasync d5/f15 0 2024-09-16T01:25:24.184 INFO:tasks.workunit.client.0.smithi063.stdout:4/843: chown d5/f8c 4823029 1 2024-09-16T01:25:24.185 INFO:tasks.workunit.client.0.smithi063.stdout:9/866: write d7/d9/d20/de3/de7/d14/f29 [1541302,103772] 0 2024-09-16T01:25:24.188 INFO:tasks.workunit.client.0.smithi063.stdout:1/828: write d1/d5/d82/d9b/d77/d7d/dc2/f35 [4845231,43803] 0 2024-09-16T01:25:24.190 INFO:tasks.workunit.client.0.smithi063.stdout:6/862: dread d3/d30/d39/dac/db5/fad [0,4194304] 0 2024-09-16T01:25:24.190 INFO:tasks.workunit.client.0.smithi063.stdout:2/940: link d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d45/fd0 d3/d7/d8/d19/d3c/d53/d7f/f143 0 2024-09-16T01:25:24.190 INFO:tasks.workunit.client.0.smithi063.stdout:3/872: mkdir d2/d11/d37/d40/d5e/d3b/d68/d12d 0 2024-09-16T01:25:24.192 INFO:tasks.workunit.client.0.smithi063.stdout:5/970: chown d5/d12/f76 3338 1 2024-09-16T01:25:24.192 INFO:tasks.workunit.client.0.smithi063.stdout:4/844: chown d5/d3b/d57/d68/d90/lc7 120827 1 2024-09-16T01:25:24.193 INFO:tasks.workunit.client.0.smithi063.stdout:0/889: link d1/df/d2c/dde/l10c d1/d2e/d50/l146 0 2024-09-16T01:25:24.194 INFO:tasks.workunit.client.0.smithi063.stdout:2/941: rmdir d3/d77 39 2024-09-16T01:25:24.195 INFO:tasks.workunit.client.0.smithi063.stdout:9/867: rmdir d7/d9/d20/de3/de7/d14/d34 39 2024-09-16T01:25:24.195 INFO:tasks.workunit.client.0.smithi063.stdout:7/775: dwrite d7/d1c/d1f/d29/d88/d96/fdc [0,4194304] 0 2024-09-16T01:25:24.196 INFO:tasks.workunit.client.0.smithi063.stdout:3/873: chown d2/d11/d37/l61 0 1 2024-09-16T01:25:24.196 INFO:tasks.workunit.client.0.smithi063.stdout:1/829: chown d1/d5/f1a 515073 1 2024-09-16T01:25:24.198 INFO:tasks.workunit.client.0.smithi063.stdout:5/971: readlink d5/d18/d29/d48/d7b/l7a 0 2024-09-16T01:25:24.199 INFO:tasks.workunit.client.0.smithi063.stdout:8/700: dwrite d5/db/d12/d1a/d1e/d68/f84 [0,4194304] 0 2024-09-16T01:25:24.200 INFO:tasks.workunit.client.0.smithi063.stdout:7/776: readlink d7/l11 0 2024-09-16T01:25:24.202 INFO:tasks.workunit.client.0.smithi063.stdout:6/863: mkdir d3/d48/d28/d3e/d44/da4/d5a/d81/d136 0 2024-09-16T01:25:24.203 INFO:tasks.workunit.client.0.smithi063.stdout:1/830: truncate d1/d12/f5b 1029027 0 2024-09-16T01:25:24.204 INFO:tasks.workunit.client.0.smithi063.stdout:0/890: fsync d1/df/d34/f139 0 2024-09-16T01:25:24.205 INFO:tasks.workunit.client.0.smithi063.stdout:3/874: mkdir d2/d11/d37/db6/d12e 0 2024-09-16T01:25:24.205 INFO:tasks.workunit.client.0.smithi063.stdout:5/972: write d5/d12/f40 [248198,107140] 0 2024-09-16T01:25:24.205 INFO:tasks.workunit.client.0.smithi063.stdout:1/831: readlink d1/d5/d15/d1b/lf8 0 2024-09-16T01:25:24.206 INFO:tasks.workunit.client.0.smithi063.stdout:7/777: mkdir d7/d1c/d1f/d29/dbf/d39/dfc 0 2024-09-16T01:25:24.209 INFO:tasks.workunit.client.0.smithi063.stdout:6/864: mkdir d3/d48/d28/d113/d137 0 2024-09-16T01:25:24.213 INFO:tasks.workunit.client.0.smithi063.stdout:9/868: symlink d7/d9/d20/de3/de7/db2/dca/d121/l132 0 2024-09-16T01:25:24.213 INFO:tasks.workunit.client.0.smithi063.stdout:4/845: creat d5/d3b/df/d1c/d29/d20/d30/df9/f119 x:0 0 0 2024-09-16T01:25:24.213 INFO:tasks.workunit.client.0.smithi063.stdout:0/891: rename d1/d2e/dab/lba to d1/df/d2c/d43/l147 0 2024-09-16T01:25:24.213 INFO:tasks.workunit.client.0.smithi063.stdout:1/832: rmdir d1/d5/d15/d1b 39 2024-09-16T01:25:24.214 INFO:tasks.workunit.client.0.smithi063.stdout:6/865: fsync d3/d30/d8d/d102/d91/f8a 0 2024-09-16T01:25:24.214 INFO:tasks.workunit.client.0.smithi063.stdout:9/869: symlink d7/d4a/d9d/l133 0 2024-09-16T01:25:24.215 INFO:tasks.workunit.client.0.smithi063.stdout:4/846: fdatasync d5/d3b/f2d 0 2024-09-16T01:25:24.217 INFO:tasks.workunit.client.0.smithi063.stdout:5/973: symlink d5/l159 0 2024-09-16T01:25:24.219 INFO:tasks.workunit.client.0.smithi063.stdout:2/942: rename d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d45/fd0 to d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/dda/f144 0 2024-09-16T01:25:24.219 INFO:tasks.workunit.client.0.smithi063.stdout:1/833: read d1/f3 [269939,130109] 0 2024-09-16T01:25:24.220 INFO:tasks.workunit.client.0.smithi063.stdout:0/892: mknod d1/d1c/c148 0 2024-09-16T01:25:24.221 INFO:tasks.workunit.client.0.smithi063.stdout:4/847: dread - d5/d3b/df/d1c/d29/d32/d60/d10b/fba zero size 2024-09-16T01:25:24.222 INFO:tasks.workunit.client.0.smithi063.stdout:3/875: getdents d2/d11/d37/d40/d5e/d3b/d68/dd2 0 2024-09-16T01:25:24.224 INFO:tasks.workunit.client.0.smithi063.stdout:1/834: stat d1/d5/d15/d1b/lf8 0 2024-09-16T01:25:24.225 INFO:tasks.workunit.client.0.smithi063.stdout:0/893: symlink d1/d1c/dcd/l149 0 2024-09-16T01:25:24.227 INFO:tasks.workunit.client.0.smithi063.stdout:7/778: rename d7/d1c/d1f/d29/d72/dc9/ccd to d7/d1c/d1f/d29/dbf/d39/d9d/de2/cfd 0 2024-09-16T01:25:24.228 INFO:tasks.workunit.client.0.smithi063.stdout:5/974: rename d5 to d5/d18/d29/d48/d7b/dc2/d15a 22 2024-09-16T01:25:24.229 INFO:tasks.workunit.client.0.smithi063.stdout:3/876: dread - d2/d11/d37/d40/d5e/d3b/da1/f116 zero size 2024-09-16T01:25:24.232 INFO:tasks.workunit.client.0.smithi063.stdout:1/835: write d1/d5/d15/fb2 [773498,30757] 0 2024-09-16T01:25:24.233 INFO:tasks.workunit.client.0.smithi063.stdout:4/848: write d5/d3b/df/d1c/f39 [1986016,91052] 0 2024-09-16T01:25:24.233 INFO:tasks.workunit.client.0.smithi063.stdout:8/701: dwrite d5/d8c/d74/f96 [0,4194304] 0 2024-09-16T01:25:24.233 INFO:tasks.workunit.client.0.smithi063.stdout:9/870: dwrite d7/d9/d20/de3/de7/db2/f94 [0,4194304] 0 2024-09-16T01:25:24.233 INFO:tasks.workunit.client.0.smithi063.stdout:0/894: mkdir d1/d30/d52/d9d/dcf/d14a 0 2024-09-16T01:25:24.238 INFO:tasks.workunit.client.0.smithi063.stdout:0/895: stat d1/d30/d52/d5a 0 2024-09-16T01:25:24.240 INFO:tasks.workunit.client.0.smithi063.stdout:2/943: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/fbf [1550615,46361] 0 2024-09-16T01:25:24.242 INFO:tasks.workunit.client.0.smithi063.stdout:5/975: creat d5/d18/d29/d48/dad/d157/f15b x:0 0 0 2024-09-16T01:25:24.243 INFO:tasks.workunit.client.0.smithi063.stdout:9/871: rename d7/c1a to d7/d116/c134 0 2024-09-16T01:25:24.246 INFO:tasks.workunit.client.0.smithi063.stdout:3/877: creat d2/d11/d69/d80/d8a/f12f x:0 0 0 2024-09-16T01:25:24.247 INFO:tasks.workunit.client.0.smithi063.stdout:7/779: dwrite d7/d56/f64 [0,4194304] 0 2024-09-16T01:25:24.254 INFO:tasks.workunit.client.0.smithi063.stdout:0/896: unlink d1/df/f9c 0 2024-09-16T01:25:24.256 INFO:tasks.workunit.client.0.smithi063.stdout:7/780: chown d7/d56/d57/d60/ce7 93 1 2024-09-16T01:25:24.262 INFO:tasks.workunit.client.0.smithi063.stdout:8/702: dwrite d5/d8c/dbd/fd0 [0,4194304] 0 2024-09-16T01:25:24.265 INFO:tasks.workunit.client.0.smithi063.stdout:5/976: unlink d5/d18/d29/d48/d7b/d85/df9/d142/f124 0 2024-09-16T01:25:24.267 INFO:tasks.workunit.client.0.smithi063.stdout:4/849: dwrite d5/f8c [0,4194304] 0 2024-09-16T01:25:24.268 INFO:tasks.workunit.client.0.smithi063.stdout:1/836: dread d1/d5/d15/f29 [0,4194304] 0 2024-09-16T01:25:24.271 INFO:tasks.workunit.client.0.smithi063.stdout:7/781: write d7/d56/d57/d73/f7e [2503317,96918] 0 2024-09-16T01:25:24.272 INFO:tasks.workunit.client.0.smithi063.stdout:4/850: fdatasync d5/d3b/d5c/f9d 0 2024-09-16T01:25:24.272 INFO:tasks.workunit.client.0.smithi063.stdout:0/897: mkdir d1/df/d12a/d14b 0 2024-09-16T01:25:24.274 INFO:tasks.workunit.client.0.smithi063.stdout:2/944: dread d3/d7/f22 [0,4194304] 0 2024-09-16T01:25:24.274 INFO:tasks.workunit.client.0.smithi063.stdout:9/872: dwrite d7/d9/d20/de3/de7/f42 [0,4194304] 0 2024-09-16T01:25:24.276 INFO:tasks.workunit.client.0.smithi063.stdout:8/703: fsync d5/db/d12/d3d/d69/daa/d40/f51 0 2024-09-16T01:25:24.277 INFO:tasks.workunit.client.0.smithi063.stdout:2/945: stat d3/d77/ff5 0 2024-09-16T01:25:24.278 INFO:tasks.workunit.client.0.smithi063.stdout:0/898: chown d1/d30/d52/d9d/deb/fe5 4087329 1 2024-09-16T01:25:24.279 INFO:tasks.workunit.client.0.smithi063.stdout:1/837: rename d1/dd/d3b/la1 to d1/d5/d63/l113 0 2024-09-16T01:25:24.280 INFO:tasks.workunit.client.0.smithi063.stdout:7/782: creat d7/d1c/d1f/d66/ffe x:0 0 0 2024-09-16T01:25:24.281 INFO:tasks.workunit.client.0.smithi063.stdout:9/873: read d7/d9/d20/de3/de7/f52 [2091944,61991] 0 2024-09-16T01:25:24.281 INFO:tasks.workunit.client.0.smithi063.stdout:8/704: mkdir d5/d8c/dbd/de4 0 2024-09-16T01:25:24.283 INFO:tasks.workunit.client.0.smithi063.stdout:0/899: unlink d1/d1c/fad 0 2024-09-16T01:25:24.284 INFO:tasks.workunit.client.0.smithi063.stdout:8/705: stat d5/d8c/d74/d87/fd7 0 2024-09-16T01:25:24.284 INFO:tasks.workunit.client.0.smithi063.stdout:7/783: dread - d7/d56/f71 zero size 2024-09-16T01:25:24.284 INFO:tasks.workunit.client.0.smithi063.stdout:3/878: dread d2/d11/d37/d40/d5e/d3b/d45/d9f/ff7 [0,4194304] 0 2024-09-16T01:25:24.286 INFO:tasks.workunit.client.0.smithi063.stdout:9/874: write d7/d9/d20/de3/de7/db2/f92 [541831,42513] 0 2024-09-16T01:25:24.288 INFO:tasks.workunit.client.0.smithi063.stdout:4/851: getdents d5/d3b/df/d1c/d29/d32/d60/d61 0 2024-09-16T01:25:24.289 INFO:tasks.workunit.client.0.smithi063.stdout:2/946: unlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d45/fe7 0 2024-09-16T01:25:24.291 INFO:tasks.workunit.client.0.smithi063.stdout:8/706: symlink d5/d8c/dbd/de4/le5 0 2024-09-16T01:25:24.294 INFO:tasks.workunit.client.0.smithi063.stdout:4/852: read - d5/d3b/d57/d66/d9b/ff5 zero size 2024-09-16T01:25:24.294 INFO:tasks.workunit.client.0.smithi063.stdout:3/879: write d2/d11/d37/d40/d5e/d3b/d68/dd2/ff5 [182865,77521] 0 2024-09-16T01:25:24.294 INFO:tasks.workunit.client.0.smithi063.stdout:9/875: truncate d7/d4a/f93 855338 0 2024-09-16T01:25:24.296 INFO:tasks.workunit.client.0.smithi063.stdout:5/977: dwrite d5/d12/f4a [0,4194304] 0 2024-09-16T01:25:24.296 INFO:tasks.workunit.client.0.smithi063.stdout:2/947: chown d3/d7/d8/d19/d3c/d53/f83 1 1 2024-09-16T01:25:24.296 INFO:tasks.workunit.client.0.smithi063.stdout:7/784: getdents d7/d1c/d1f/d29/d88/d96/dca 0 2024-09-16T01:25:24.297 INFO:tasks.workunit.client.0.smithi063.stdout:4/853: fdatasync d5/d3b/df/d1c/f39 0 2024-09-16T01:25:24.298 INFO:tasks.workunit.client.0.smithi063.stdout:1/838: dwrite d1/d5/d15/d18/db6/fc1 [0,4194304] 0 2024-09-16T01:25:24.298 INFO:tasks.workunit.client.0.smithi063.stdout:0/900: write d1/d2e/d48/dc3/f127 [7586454,42785] 0 2024-09-16T01:25:24.301 INFO:tasks.workunit.client.0.smithi063.stdout:3/880: chown d2/d11/d37/d40/d5e/d3b/d94/d30 250 1 2024-09-16T01:25:24.303 INFO:tasks.workunit.client.0.smithi063.stdout:0/901: dread - d1/df/d2c/d43/f132 zero size 2024-09-16T01:25:24.304 INFO:tasks.workunit.client.0.smithi063.stdout:9/876: mkdir d7/d9/d20/de3/de7/db2/dc6/d135 0 2024-09-16T01:25:24.304 INFO:tasks.workunit.client.0.smithi063.stdout:1/839: write d1/d5/d15/d18/fca [3531578,120191] 0 2024-09-16T01:25:24.307 INFO:tasks.workunit.client.0.smithi063.stdout:0/902: symlink d1/df/d12a/l14c 0 2024-09-16T01:25:24.308 INFO:tasks.workunit.client.0.smithi063.stdout:9/877: mknod d7/d9/d20/c136 0 2024-09-16T01:25:24.309 INFO:tasks.workunit.client.0.smithi063.stdout:1/840: unlink d1/d5/d82/faa 0 2024-09-16T01:25:24.310 INFO:tasks.workunit.client.0.smithi063.stdout:5/978: rename d5/d18/d29/d48/d66/l129 to d5/d18/d29/d48/d7b/l15c 0 2024-09-16T01:25:24.310 INFO:tasks.workunit.client.0.smithi063.stdout:4/854: truncate d5/d3b/df/d1c/d29/d20/d30/df9/f119 750147 0 2024-09-16T01:25:24.313 INFO:tasks.workunit.client.0.smithi063.stdout:2/948: rmdir d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d13d 0 2024-09-16T01:25:24.313 INFO:tasks.workunit.client.0.smithi063.stdout:1/841: fsync d1/d5/d15/d18/d4b/fbd 0 2024-09-16T01:25:24.314 INFO:tasks.workunit.client.0.smithi063.stdout:0/903: chown d1/d30/d52/d5a/d36/ffc 0 1 2024-09-16T01:25:24.314 INFO:tasks.workunit.client.0.smithi063.stdout:5/979: chown d5/d18/d29/d48/dad/f121 16 1 2024-09-16T01:25:24.316 INFO:tasks.workunit.client.0.smithi063.stdout:9/878: write d7/d9/d20/de3/de7/d14/f31 [4621099,36081] 0 2024-09-16T01:25:24.317 INFO:tasks.workunit.client.0.smithi063.stdout:7/785: dwrite d7/d1c/d1f/d29/d88/d96/dca/ffa [0,4194304] 0 2024-09-16T01:25:24.320 INFO:tasks.workunit.client.0.smithi063.stdout:9/879: readlink d7/d9/d20/de3/de7/d14/d63/d5f/dab/dd1/le5 0 2024-09-16T01:25:24.321 INFO:tasks.workunit.client.0.smithi063.stdout:1/842: symlink d1/dd/l114 0 2024-09-16T01:25:24.322 INFO:tasks.workunit.client.0.smithi063.stdout:0/904: unlink d1/l3 0 2024-09-16T01:25:24.322 INFO:tasks.workunit.client.0.smithi063.stdout:4/855: truncate d5/d3b/df/d1c/f39 2608158 0 2024-09-16T01:25:24.324 INFO:tasks.workunit.client.0.smithi063.stdout:1/843: read - d1/d5/d6f/d8f/fc4 zero size 2024-09-16T01:25:24.324 INFO:tasks.workunit.client.0.smithi063.stdout:5/980: rmdir d5/d18/d29/d52/d12e/de4/d105/d13a 39 2024-09-16T01:25:24.327 INFO:tasks.workunit.client.0.smithi063.stdout:0/905: rmdir d1/d30/d52/d5a/d36/d133 0 2024-09-16T01:25:24.329 INFO:tasks.workunit.client.0.smithi063.stdout:4/856: creat d5/d3b/df/d1c/d29/d32/d60/df4/f11a x:0 0 0 2024-09-16T01:25:24.332 INFO:tasks.workunit.client.0.smithi063.stdout:7/786: dwrite d7/d1c/d1f/d29/d72/dc9/fce [0,4194304] 0 2024-09-16T01:25:24.333 INFO:tasks.workunit.client.0.smithi063.stdout:4/857: rmdir d5/d3b/d57 39 2024-09-16T01:25:24.334 INFO:tasks.workunit.client.0.smithi063.stdout:7/787: chown d7/d1c/lb1 374 1 2024-09-16T01:25:24.335 INFO:tasks.workunit.client.0.smithi063.stdout:1/844: link d1/d5/d82/d9b/d77/d7d/dc2/dad/ffb d1/d5/d15/f115 0 2024-09-16T01:25:24.335 INFO:tasks.workunit.client.0.smithi063.stdout:3/881: dread d2/d11/d37/d40/d5e/d3b/d68/fdf [0,4194304] 0 2024-09-16T01:25:24.338 INFO:tasks.workunit.client.0.smithi063.stdout:4/858: mknod d5/d3b/df/c11b 0 2024-09-16T01:25:24.338 INFO:tasks.workunit.client.0.smithi063.stdout:7/788: chown d7/d1c/d1f/d29/dbf/d39/d65/f9b 120 1 2024-09-16T01:25:24.339 INFO:tasks.workunit.client.0.smithi063.stdout:1/845: unlink d1/d5/d15/d18/d4b/f112 0 2024-09-16T01:25:24.339 INFO:tasks.workunit.client.0.smithi063.stdout:9/880: dread d7/fa8 [0,4194304] 0 2024-09-16T01:25:24.340 INFO:tasks.workunit.client.0.smithi063.stdout:0/906: dwrite d1/df/f40 [0,4194304] 0 2024-09-16T01:25:24.343 INFO:tasks.workunit.client.0.smithi063.stdout:9/881: write d7/d9/ffe [2059211,125341] 0 2024-09-16T01:25:24.345 INFO:tasks.workunit.client.0.smithi063.stdout:1/846: creat d1/d5/d15/d1b/f116 x:0 0 0 2024-09-16T01:25:24.348 INFO:tasks.workunit.client.0.smithi063.stdout:7/789: truncate d7/d1c/d1f/d29/dbf/d39/f6f 1032541 0 2024-09-16T01:25:24.352 INFO:tasks.workunit.client.0.smithi063.stdout:4/859: dwrite d5/d3b/d57/d66/fe2 [0,4194304] 0 2024-09-16T01:25:24.352 INFO:tasks.workunit.client.0.smithi063.stdout:9/882: rename d7/d4a/dba/dfd to d7/d9/d20/de3/de7/d14/d38/d137 0 2024-09-16T01:25:24.355 INFO:tasks.workunit.client.0.smithi063.stdout:7/790: getdents d7/d1c/d1f/d29/dbf/d40/d6c/dc1 0 2024-09-16T01:25:24.355 INFO:tasks.workunit.client.0.smithi063.stdout:1/847: rename d1/dd/d3b/db3/fe3 to d1/d5/d82/d9b/d77/d7d/dda/f117 0 2024-09-16T01:25:24.357 INFO:tasks.workunit.client.0.smithi063.stdout:9/883: truncate d7/d4a/dba/f6d 730952 0 2024-09-16T01:25:24.357 INFO:tasks.workunit.client.0.smithi063.stdout:1/848: dread - d1/d5/d82/fb4 zero size 2024-09-16T01:25:24.358 INFO:tasks.workunit.client.0.smithi063.stdout:7/791: read d7/d1c/d1f/d29/d88/d98/fbe [373622,57206] 0 2024-09-16T01:25:24.359 INFO:tasks.workunit.client.0.smithi063.stdout:4/860: truncate d5/d3b/df/d1c/d29/d32/f64 2555424 0 2024-09-16T01:25:24.359 INFO:tasks.workunit.client.0.smithi063.stdout:7/792: chown d7/d56/f71 0 1 2024-09-16T01:25:24.360 INFO:tasks.workunit.client.0.smithi063.stdout:7/793: write f5 [5699187,44883] 0 2024-09-16T01:25:24.360 INFO:tasks.workunit.client.0.smithi063.stdout:1/849: rename d1/d5/f10 to d1/dd/d3b/dbe/d10d/f118 0 2024-09-16T01:25:24.361 INFO:tasks.workunit.client.0.smithi063.stdout:4/861: fsync d5/d3b/df/d1c/d29/d32/d60/d10b/fd8 0 2024-09-16T01:25:24.362 INFO:tasks.workunit.client.0.smithi063.stdout:7/794: chown d7/d1c/d1f/d66/f82 851 1 2024-09-16T01:25:24.362 INFO:tasks.workunit.client.0.smithi063.stdout:9/884: rmdir d7/d9/d20/de3/de7/d14/d63/d5f/dab 39 2024-09-16T01:25:24.364 INFO:tasks.workunit.client.0.smithi063.stdout:4/862: mknod d5/d3b/df/d1c/d29/d20/d98/c11c 0 2024-09-16T01:25:24.364 INFO:tasks.workunit.client.0.smithi063.stdout:1/850: mkdir d1/d5/d6f/dd2/de1/d100/d119 0 2024-09-16T01:25:24.369 INFO:tasks.workunit.client.0.smithi063.stdout:1/851: getdents d1/dd 0 2024-09-16T01:25:24.370 INFO:tasks.workunit.client.0.smithi063.stdout:4/863: rename d5/d3b/df/d1c/d29/d32/d4e/f54 to d5/d3b/df/d1c/d29/d20/d98/ddf/f11d 0 2024-09-16T01:25:24.370 INFO:tasks.workunit.client.0.smithi063.stdout:7/795: dwrite d7/d1c/d1f/d29/dbf/d40/fa9 [0,4194304] 0 2024-09-16T01:25:24.373 INFO:tasks.workunit.client.0.smithi063.stdout:4/864: write d5/d3b/d5c/fbf [2056485,46819] 0 2024-09-16T01:25:24.374 INFO:tasks.workunit.client.0.smithi063.stdout:1/852: dread d1/d5/d82/d9b/f9e [0,4194304] 0 2024-09-16T01:25:24.377 INFO:tasks.workunit.client.0.smithi063.stdout:4/865: fsync d5/d3b/d57/dce/d10d/d10e/f110 0 2024-09-16T01:25:24.378 INFO:tasks.workunit.client.0.smithi063.stdout:1/853: symlink d1/d5/l11a 0 2024-09-16T01:25:24.378 INFO:tasks.workunit.client.0.smithi063.stdout:9/885: dwrite d7/d116/d129/f44 [4194304,4194304] 0 2024-09-16T01:25:24.378 INFO:tasks.workunit.client.0.smithi063.stdout:7/796: unlink d7/d1c/d1f/d29/dbf/c92 0 2024-09-16T01:25:24.380 INFO:tasks.workunit.client.0.smithi063.stdout:4/866: write d5/d3b/d57/d66/db7/dc9/f111 [542071,2721] 0 2024-09-16T01:25:24.380 INFO:tasks.workunit.client.0.smithi063.stdout:1/854: symlink d1/l11b 0 2024-09-16T01:25:24.381 INFO:tasks.workunit.client.0.smithi063.stdout:7/797: truncate d7/d56/d6b/d86/fb3 794497 0 2024-09-16T01:25:24.383 INFO:tasks.workunit.client.0.smithi063.stdout:7/798: write d7/d1c/d1f/fac [19180,4708] 0 2024-09-16T01:25:24.384 INFO:tasks.workunit.client.0.smithi063.stdout:1/855: stat d1/d5/d82/d9b/d77/d7d/dc2/lba 0 2024-09-16T01:25:24.385 INFO:tasks.workunit.client.0.smithi063.stdout:4/867: mknod d5/d3b/d57/d68/dc5/c11e 0 2024-09-16T01:25:24.387 INFO:tasks.workunit.client.0.smithi063.stdout:1/856: symlink d1/d5/d15/d18/d4b/l11c 0 2024-09-16T01:25:24.387 INFO:tasks.workunit.client.0.smithi063.stdout:7/799: creat d7/d1c/d1f/d29/d88/d96/fff x:0 0 0 2024-09-16T01:25:24.388 INFO:tasks.workunit.client.0.smithi063.stdout:1/857: read - d1/d5/d15/d1b/fea zero size 2024-09-16T01:25:24.388 INFO:tasks.workunit.client.0.smithi063.stdout:4/868: truncate d5/d3b/df/d1c/d29/f4a 2647654 0 2024-09-16T01:25:24.390 INFO:tasks.workunit.client.0.smithi063.stdout:7/800: creat d7/d1c/d1f/d29/dbf/d39/d9d/f100 x:0 0 0 2024-09-16T01:25:24.391 INFO:tasks.workunit.client.0.smithi063.stdout:1/858: chown d1/d5/d82/d9b/d77/d7d/dc2/dad/l9a 80 1 2024-09-16T01:25:24.393 INFO:tasks.workunit.client.0.smithi063.stdout:7/801: mkdir d7/d1c/d1f/d66/d101 0 2024-09-16T01:25:24.395 INFO:tasks.workunit.client.0.smithi063.stdout:7/802: read - d7/d56/d57/d73/d91/db4/fb8 zero size 2024-09-16T01:25:24.395 INFO:tasks.workunit.client.0.smithi063.stdout:4/869: dwrite d5/d3b/d57/d68/f99 [0,4194304] 0 2024-09-16T01:25:24.397 INFO:tasks.workunit.client.0.smithi063.stdout:1/859: write d1/dd/fb9 [327113,46836] 0 2024-09-16T01:25:24.397 INFO:tasks.workunit.client.0.smithi063.stdout:4/870: dread - d5/d3b/d57/d68/f85 zero size 2024-09-16T01:25:24.400 INFO:tasks.workunit.client.0.smithi063.stdout:7/803: symlink d7/d56/l102 0 2024-09-16T01:25:24.403 INFO:tasks.workunit.client.0.smithi063.stdout:1/860: dread d1/d5/d82/d9b/d77/d7d/dc2/f37 [0,4194304] 0 2024-09-16T01:25:24.403 INFO:tasks.workunit.client.0.smithi063.stdout:7/804: mknod d7/d1c/d1f/d66/ded/c103 0 2024-09-16T01:25:24.403 INFO:tasks.workunit.client.0.smithi063.stdout:1/861: stat d1/dd/l6d 0 2024-09-16T01:25:24.406 INFO:tasks.workunit.client.0.smithi063.stdout:1/862: unlink d1/d5/d6f/d8f/fc4 0 2024-09-16T01:25:24.406 INFO:tasks.workunit.client.0.smithi063.stdout:7/805: getdents d7/d56/d57/d60/db9/dd8 0 2024-09-16T01:25:24.407 INFO:tasks.workunit.client.0.smithi063.stdout:1/863: readlink d1/d5/l11a 0 2024-09-16T01:25:24.409 INFO:tasks.workunit.client.0.smithi063.stdout:7/806: chown d7/d1c/d1f/d29/d88/d96/fff 504741529 1 2024-09-16T01:25:24.409 INFO:tasks.workunit.client.0.smithi063.stdout:7/807: stat d7/d1c/d1f/d66/f7f 0 2024-09-16T01:25:24.410 INFO:tasks.workunit.client.0.smithi063.stdout:1/864: dread d1/d12/fa7 [0,4194304] 0 2024-09-16T01:25:24.413 INFO:tasks.workunit.client.0.smithi063.stdout:7/808: getdents d7/d1c/d1f/d29/d88 0 2024-09-16T01:25:24.413 INFO:tasks.workunit.client.0.smithi063.stdout:7/809: fsync d7/d1c/d1f/d29/dbf/d40/f89 0 2024-09-16T01:25:24.414 INFO:tasks.workunit.client.0.smithi063.stdout:1/865: write d1/f3e [1420288,1306] 0 2024-09-16T01:25:24.417 INFO:tasks.workunit.client.0.smithi063.stdout:1/866: creat d1/d5/d15/d18/db6/f11d x:0 0 0 2024-09-16T01:25:24.420 INFO:tasks.workunit.client.0.smithi063.stdout:1/867: creat d1/d5/d6f/dd2/f11e x:0 0 0 2024-09-16T01:25:24.421 INFO:tasks.workunit.client.0.smithi063.stdout:7/810: dwrite d7/d1c/d1f/d29/dbf/d40/d6c/fe8 [4194304,4194304] 0 2024-09-16T01:25:24.423 INFO:tasks.workunit.client.0.smithi063.stdout:7/811: write d7/d1c/d1f/d29/dbf/d39/d9d/fda [790036,70548] 0 2024-09-16T01:25:24.427 INFO:tasks.workunit.client.0.smithi063.stdout:7/812: symlink d7/d56/d57/d60/db9/l104 0 2024-09-16T01:25:24.427 INFO:tasks.workunit.client.0.smithi063.stdout:1/868: dwrite d1/f3 [0,4194304] 0 2024-09-16T01:25:24.430 INFO:tasks.workunit.client.0.smithi063.stdout:7/813: symlink d7/d1c/d1f/d29/db5/l105 0 2024-09-16T01:25:24.431 INFO:tasks.workunit.client.0.smithi063.stdout:1/869: truncate d1/d5/d82/d9b/d77/d7d/fb7 899049 0 2024-09-16T01:25:24.432 INFO:tasks.workunit.client.0.smithi063.stdout:7/814: mknod d7/d1c/d1f/d29/dbf/d39/d9d/c106 0 2024-09-16T01:25:24.433 INFO:tasks.workunit.client.0.smithi063.stdout:1/870: read d1/dd/d3b/f58 [8332512,98547] 0 2024-09-16T01:25:24.436 INFO:tasks.workunit.client.0.smithi063.stdout:1/871: rename d1/dd/l114 to d1/d5/d82/d9b/d77/d7d/l11f 0 2024-09-16T01:25:24.446 INFO:tasks.workunit.client.0.smithi063.stdout:1/872: write d1/dd/d3b/fa0 [173623,70557] 0 2024-09-16T01:25:24.447 INFO:tasks.workunit.client.0.smithi063.stdout:1/873: chown d1/d5/d15/d18/d4b/dae 1898448530 1 2024-09-16T01:25:24.447 INFO:tasks.workunit.client.0.smithi063.stdout:1/874: chown d1/d5/d15/d18/db6/f11d 5631341 1 2024-09-16T01:25:24.453 INFO:tasks.workunit.client.0.smithi063.stdout:1/875: dwrite d1/d5/d15/d18/f69 [0,4194304] 0 2024-09-16T01:25:24.456 INFO:tasks.workunit.client.0.smithi063.stdout:1/876: mkdir d1/d5/d82/d9b/d77/d7d/dda/df6/d120 0 2024-09-16T01:25:24.458 INFO:tasks.workunit.client.0.smithi063.stdout:1/877: write d1/dd/d3b/f44 [5582154,117433] 0 2024-09-16T01:25:24.467 INFO:tasks.workunit.client.0.smithi063.stdout:1/878: dwrite d1/d5/d82/d9b/d77/d7d/dcb/fe2 [0,4194304] 0 2024-09-16T01:25:24.469 INFO:tasks.workunit.client.0.smithi063.stdout:1/879: mknod d1/d5/d82/d9b/d77/d86/dc6/c121 0 2024-09-16T01:25:24.477 INFO:tasks.workunit.client.0.smithi063.stdout:1/880: dwrite d1/d5/d82/d9b/d77/d86/fc9 [0,4194304] 0 2024-09-16T01:25:24.493 INFO:tasks.workunit.client.0.smithi063.stdout:1/881: dread d1/d12/d21/f46 [0,4194304] 0 2024-09-16T01:25:24.585 INFO:tasks.workunit.client.0.smithi063.stdout:6/866: sync 2024-09-16T01:25:24.586 INFO:tasks.workunit.client.0.smithi063.stdout:6/867: chown d3/d48/d28/d3e/d68/db4/l135 99374600 1 2024-09-16T01:25:24.587 INFO:tasks.workunit.client.0.smithi063.stdout:6/868: mknod d3/d48/d28/d113/c138 0 2024-09-16T01:25:24.589 INFO:tasks.workunit.client.0.smithi063.stdout:6/869: fsync d3/d48/d28/d3e/d44/da4/d5a/d6b/f90 0 2024-09-16T01:25:24.594 INFO:tasks.workunit.client.0.smithi063.stdout:6/870: dwrite d3/d48/d28/d3e/d44/da4/d5a/d6b/ff0 [0,4194304] 0 2024-09-16T01:25:24.596 INFO:tasks.workunit.client.0.smithi063.stdout:6/871: truncate d3/d41/d89/ffd 760274 0 2024-09-16T01:25:24.598 INFO:tasks.workunit.client.0.smithi063.stdout:6/872: creat d3/d30/d8d/d102/f139 x:0 0 0 2024-09-16T01:25:24.601 INFO:tasks.workunit.client.0.smithi063.stdout:6/873: creat d3/d30/d39/d69/d95/db0/f13a x:0 0 0 2024-09-16T01:25:24.603 INFO:tasks.workunit.client.0.smithi063.stdout:6/874: symlink d3/d30/l13b 0 2024-09-16T01:25:24.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:24 smithi063 ceph-mon[31070]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 62 MiB/s rd, 211 MiB/s wr, 342 op/s 2024-09-16T01:25:24.613 INFO:tasks.workunit.client.0.smithi063.stdout:6/875: dread d3/d30/f4e [0,4194304] 0 2024-09-16T01:25:24.616 INFO:tasks.workunit.client.0.smithi063.stdout:6/876: rename d3/d48/d28/c4b to d3/d48/d28/d3e/d68/db4/c13c 0 2024-09-16T01:25:24.617 INFO:tasks.workunit.client.0.smithi063.stdout:6/877: write d3/d41/d89/ffd [30856,77330] 0 2024-09-16T01:25:24.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:24 smithi192 ceph-mon[34775]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 62 MiB/s rd, 211 MiB/s wr, 342 op/s 2024-09-16T01:25:24.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:24 smithi162 ceph-mon[34539]: pgmap v397: 97 pgs: 97 active+clean; 1.5 GiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 62 MiB/s rd, 211 MiB/s wr, 342 op/s 2024-09-16T01:25:24.714 INFO:tasks.workunit.client.0.smithi063.stdout:8/707: sync 2024-09-16T01:25:24.714 INFO:tasks.workunit.client.0.smithi063.stdout:2/949: sync 2024-09-16T01:25:24.718 INFO:tasks.workunit.client.0.smithi063.stdout:8/708: rename d5/db/d12/d3d/d69/daa/d40/d4a/l65 to d5/db/d12/d1a/d60/le6 0 2024-09-16T01:25:24.720 INFO:tasks.workunit.client.0.smithi063.stdout:2/950: rename d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/db7/l139 to d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d12e/l145 0 2024-09-16T01:25:24.723 INFO:tasks.workunit.client.0.smithi063.stdout:8/709: dwrite d5/db/d12/d1a/d1e/d68/f84 [0,4194304] 0 2024-09-16T01:25:24.725 INFO:tasks.workunit.client.0.smithi063.stdout:8/710: read - d5/db/d12/d1a/d60/d7a/f9f zero size 2024-09-16T01:25:24.727 INFO:tasks.workunit.client.0.smithi063.stdout:2/951: link d3/l5c d3/d7/d8/d19/d8c/d21/d9c/dd4/l146 0 2024-09-16T01:25:24.729 INFO:tasks.workunit.client.0.smithi063.stdout:2/952: truncate d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/f111 662996 0 2024-09-16T01:25:24.731 INFO:tasks.workunit.client.0.smithi063.stdout:2/953: rename d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/da1 to d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/da1/d147 22 2024-09-16T01:25:24.732 INFO:tasks.workunit.client.0.smithi063.stdout:2/954: chown d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/dda 1174775 1 2024-09-16T01:25:24.767 INFO:tasks.workunit.client.0.smithi063.stdout:2/955: chown d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/c73 31 1 2024-09-16T01:25:24.773 INFO:tasks.workunit.client.0.smithi063.stdout:2/956: dwrite d3/d77/ff5 [0,4194304] 0 2024-09-16T01:25:24.775 INFO:tasks.workunit.client.0.smithi063.stdout:2/957: write d3/d7/d8/d19/d8c/d21/d9c/dd4/fe0 [851946,103434] 0 2024-09-16T01:25:24.778 INFO:tasks.workunit.client.0.smithi063.stdout:2/958: read d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/da7/faf [118449,65087] 0 2024-09-16T01:25:24.783 INFO:tasks.workunit.client.0.smithi063.stdout:2/959: unlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/f7a 0 2024-09-16T01:25:24.786 INFO:tasks.workunit.client.0.smithi063.stdout:2/960: mkdir d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d148 0 2024-09-16T01:25:24.788 INFO:tasks.workunit.client.0.smithi063.stdout:2/961: creat d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/dfe/d12f/f149 x:0 0 0 2024-09-16T01:25:24.791 INFO:tasks.workunit.client.0.smithi063.stdout:2/962: dread d3/d7/d8/d19/d3c/d53/f83 [0,4194304] 0 2024-09-16T01:25:24.792 INFO:tasks.workunit.client.0.smithi063.stdout:2/963: chown d3/d7/d8/d19/d3c/d53/d7f/c92 37 1 2024-09-16T01:25:24.796 INFO:tasks.workunit.client.0.smithi063.stdout:2/964: rmdir d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d148 0 2024-09-16T01:25:24.797 INFO:tasks.workunit.client.0.smithi063.stdout:5/981: sync 2024-09-16T01:25:24.798 INFO:tasks.workunit.client.0.smithi063.stdout:2/965: mkdir d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/dda/d14a 0 2024-09-16T01:25:24.798 INFO:tasks.workunit.client.0.smithi063.stdout:5/982: symlink d5/d7f/dcb/l15d 0 2024-09-16T01:25:24.802 INFO:tasks.workunit.client.0.smithi063.stdout:5/983: creat d5/d18/d29/d48/d66/f15e x:0 0 0 2024-09-16T01:25:24.803 INFO:tasks.workunit.client.0.smithi063.stdout:2/966: truncate d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/d45/d6e/fa8 2267302 0 2024-09-16T01:25:24.804 INFO:tasks.workunit.client.0.smithi063.stdout:2/967: stat d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34 0 2024-09-16T01:25:24.805 INFO:tasks.workunit.client.0.smithi063.stdout:5/984: creat d5/d18/d29/d52/f15f x:0 0 0 2024-09-16T01:25:24.807 INFO:tasks.workunit.client.0.smithi063.stdout:2/968: symlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/l14b 0 2024-09-16T01:25:24.820 INFO:tasks.workunit.client.0.smithi063.stdout:2/969: dwrite d3/fcb [0,4194304] 0 2024-09-16T01:25:24.821 INFO:tasks.workunit.client.0.smithi063.stdout:2/970: chown d3/d7/d8/d19/d8c/l40 105 1 2024-09-16T01:25:24.897 INFO:tasks.workunit.client.0.smithi063.stdout:3/882: sync 2024-09-16T01:25:24.897 INFO:tasks.workunit.client.0.smithi063.stdout:0/907: sync 2024-09-16T01:25:24.897 INFO:tasks.workunit.client.0.smithi063.stdout:6/878: sync 2024-09-16T01:25:24.897 INFO:tasks.workunit.client.0.smithi063.stdout:7/815: sync 2024-09-16T01:25:24.897 INFO:tasks.workunit.client.0.smithi063.stdout:4/871: sync 2024-09-16T01:25:24.897 INFO:tasks.workunit.client.0.smithi063.stdout:9/886: sync 2024-09-16T01:25:24.897 INFO:tasks.workunit.client.0.smithi063.stdout:1/882: sync 2024-09-16T01:25:24.898 INFO:tasks.workunit.client.0.smithi063.stdout:7/816: stat d7 0 2024-09-16T01:25:24.898 INFO:tasks.workunit.client.0.smithi063.stdout:4/872: stat d5/d3b/d5c/fcf 0 2024-09-16T01:25:24.898 INFO:tasks.workunit.client.0.smithi063.stdout:9/887: readlink d7/d116/d129/l127 0 2024-09-16T01:25:24.900 INFO:tasks.workunit.client.0.smithi063.stdout:3/883: dread - d2/d11/d37/d40/d5e/d3b/d94/d30/f73 zero size 2024-09-16T01:25:24.902 INFO:tasks.workunit.client.0.smithi063.stdout:1/883: rename d1/d5/d15/d1b/lf8 to d1/dd/d3b/ddc/l122 0 2024-09-16T01:25:24.902 INFO:tasks.workunit.client.0.smithi063.stdout:0/908: write d1/d30/d52/d5a/d36/d41/f61 [980448,14226] 0 2024-09-16T01:25:24.903 INFO:tasks.workunit.client.0.smithi063.stdout:6/879: getdents d3/d30/d39 0 2024-09-16T01:25:24.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/884: symlink d1/dd/d3b/db3/l123 0 2024-09-16T01:25:24.905 INFO:tasks.workunit.client.0.smithi063.stdout:0/909: dread - d1/d30/d52/d5a/d44/fae zero size 2024-09-16T01:25:24.905 INFO:tasks.workunit.client.0.smithi063.stdout:1/885: stat d1/d12/d21/lc3 0 2024-09-16T01:25:24.907 INFO:tasks.workunit.client.0.smithi063.stdout:0/910: truncate d1/d30/d52/f9f 552931 0 2024-09-16T01:25:24.907 INFO:tasks.workunit.client.0.smithi063.stdout:0/911: chown d1/df/d2c/f55 7 1 2024-09-16T01:25:24.908 INFO:tasks.workunit.client.0.smithi063.stdout:1/886: creat d1/d5/d15/d1b/f124 x:0 0 0 2024-09-16T01:25:24.908 INFO:tasks.workunit.client.0.smithi063.stdout:4/873: rename d5/d3b/d5c/fbf to d5/d3b/df/d1c/d29/d32/d60/df4/f11f 0 2024-09-16T01:25:24.909 INFO:tasks.workunit.client.0.smithi063.stdout:7/817: getdents d7/d1c/d1f/d29/db5 0 2024-09-16T01:25:24.909 INFO:tasks.workunit.client.0.smithi063.stdout:1/887: chown d1/d5/d15/d1b/f124 2357 1 2024-09-16T01:25:24.910 INFO:tasks.workunit.client.0.smithi063.stdout:3/884: creat d2/d11/d69/dfe/f130 x:0 0 0 2024-09-16T01:25:24.912 INFO:tasks.workunit.client.0.smithi063.stdout:1/888: getdents d1/dd/d3b/dbe 0 2024-09-16T01:25:24.914 INFO:tasks.workunit.client.0.smithi063.stdout:1/889: write d1/d5/d15/f62 [2507083,42891] 0 2024-09-16T01:25:24.915 INFO:tasks.workunit.client.0.smithi063.stdout:4/874: creat d5/d3b/d57/dce/d10d/f120 x:0 0 0 2024-09-16T01:25:24.916 INFO:tasks.workunit.client.0.smithi063.stdout:6/880: write d3/d30/d39/d69/d95/f9f [548323,5768] 0 2024-09-16T01:25:24.918 INFO:tasks.workunit.client.0.smithi063.stdout:0/912: truncate d1/df/d17/f81 1425489 0 2024-09-16T01:25:24.918 INFO:tasks.workunit.client.0.smithi063.stdout:0/913: fdatasync d1/d2e/d48/f108 0 2024-09-16T01:25:24.919 INFO:tasks.workunit.client.0.smithi063.stdout:4/875: chown d5/d3b/df/l3d 167 1 2024-09-16T01:25:24.920 INFO:tasks.workunit.client.0.smithi063.stdout:3/885: mkdir d2/d11/d69/d80/d131 0 2024-09-16T01:25:24.921 INFO:tasks.workunit.client.0.smithi063.stdout:6/881: rmdir d3/d30/d39/dac/db5 39 2024-09-16T01:25:24.921 INFO:tasks.workunit.client.0.smithi063.stdout:6/882: write d3/d10/f11f [63118,95055] 0 2024-09-16T01:25:24.923 INFO:tasks.workunit.client.0.smithi063.stdout:9/888: rename d7/d4a/dba/f6d to d7/d9/d20/de3/de7/d14/d63/d5f/dab/f138 0 2024-09-16T01:25:24.923 INFO:tasks.workunit.client.0.smithi063.stdout:6/883: fdatasync d3/d48/d28/d3e/d44/da4/f3a 0 2024-09-16T01:25:24.924 INFO:tasks.workunit.client.0.smithi063.stdout:3/886: mknod d2/d11/d37/d40/d5e/c132 0 2024-09-16T01:25:24.926 INFO:tasks.workunit.client.0.smithi063.stdout:1/890: rename d1/d5/d15/d18/d4b/f94 to d1/d5/d6f/dd2/de1/d100/d119/f125 0 2024-09-16T01:25:24.927 INFO:tasks.workunit.client.0.smithi063.stdout:7/818: getdents d7/d1c/d1f/d29/dbf 0 2024-09-16T01:25:24.927 INFO:tasks.workunit.client.0.smithi063.stdout:3/887: mknod d2/d11/d37/d40/d5e/d97/c133 0 2024-09-16T01:25:24.928 INFO:tasks.workunit.client.0.smithi063.stdout:0/914: truncate d1/df/ff1 1745810 0 2024-09-16T01:25:24.930 INFO:tasks.workunit.client.0.smithi063.stdout:7/819: write d7/d1c/d1f/d29/dbf/d40/d6c/fc3 [593057,10974] 0 2024-09-16T01:25:24.931 INFO:tasks.workunit.client.0.smithi063.stdout:0/915: mkdir d1/df/d2c/db6/d14d 0 2024-09-16T01:25:24.932 INFO:tasks.workunit.client.0.smithi063.stdout:9/889: truncate d7/d9/d20/de3/de7/f24 961757 0 2024-09-16T01:25:24.933 INFO:tasks.workunit.client.0.smithi063.stdout:3/888: chown d2/d5b/db4/cba 2 1 2024-09-16T01:25:24.934 INFO:tasks.workunit.client.0.smithi063.stdout:6/884: link d3/d30/d39/dac/db5/fad d3/d48/d28/d3e/d44/d8c/f13d 0 2024-09-16T01:25:24.935 INFO:tasks.workunit.client.0.smithi063.stdout:1/891: truncate d1/d5/d15/d18/fca 113277 0 2024-09-16T01:25:24.936 INFO:tasks.workunit.client.0.smithi063.stdout:7/820: mkdir d7/d1c/d1f/d66/d70/da2/d107 0 2024-09-16T01:25:24.938 INFO:tasks.workunit.client.0.smithi063.stdout:4/876: dwrite d5/d3b/d57/dce/fda [0,4194304] 0 2024-09-16T01:25:24.939 INFO:tasks.workunit.client.0.smithi063.stdout:0/916: creat d1/f14e x:0 0 0 2024-09-16T01:25:24.940 INFO:tasks.workunit.client.0.smithi063.stdout:4/877: stat d5/l7b 0 2024-09-16T01:25:24.941 INFO:tasks.workunit.client.0.smithi063.stdout:7/821: fsync d7/d56/d57/d73/fcf 0 2024-09-16T01:25:24.941 INFO:tasks.workunit.client.0.smithi063.stdout:1/892: write d1/d5/d15/f19 [9128260,76002] 0 2024-09-16T01:25:24.944 INFO:tasks.workunit.client.0.smithi063.stdout:3/889: dread d2/d11/d37/d40/d5e/d3b/d68/d6b/f110 [0,4194304] 0 2024-09-16T01:25:24.945 INFO:tasks.workunit.client.0.smithi063.stdout:6/885: truncate d3/d48/d28/d3e/f43 1802138 0 2024-09-16T01:25:24.945 INFO:tasks.workunit.client.0.smithi063.stdout:4/878: chown d5/d3b/d5c/cde 1296729 1 2024-09-16T01:25:24.946 INFO:tasks.workunit.client.0.smithi063.stdout:0/917: mknod d1/df/d17/c14f 0 2024-09-16T01:25:24.946 INFO:tasks.workunit.client.0.smithi063.stdout:9/890: dread d7/d9/d20/de3/de7/db2/dc6/ddb/ff5 [0,4194304] 0 2024-09-16T01:25:24.948 INFO:tasks.workunit.client.0.smithi063.stdout:1/893: write d1/d5/d82/d9b/d77/d7d/dcb/fe2 [823708,31660] 0 2024-09-16T01:25:24.948 INFO:tasks.workunit.client.0.smithi063.stdout:7/822: chown d7/d1c/d1f/d29/d88/d96/fff 6475660 1 2024-09-16T01:25:24.948 INFO:tasks.workunit.client.0.smithi063.stdout:6/886: chown d3/d30/d39/dac/db5/fad 18502 1 2024-09-16T01:25:24.949 INFO:tasks.workunit.client.0.smithi063.stdout:3/890: creat d2/d11/d69/d80/d131/f134 x:0 0 0 2024-09-16T01:25:24.952 INFO:tasks.workunit.client.0.smithi063.stdout:3/891: dread - d2/d5b/f9a zero size 2024-09-16T01:25:24.952 INFO:tasks.workunit.client.0.smithi063.stdout:7/823: creat d7/d1c/d1f/d66/d70/f108 x:0 0 0 2024-09-16T01:25:24.954 INFO:tasks.workunit.client.0.smithi063.stdout:9/891: truncate d7/d9/d20/de3/de7/f77 1095609 0 2024-09-16T01:25:24.955 INFO:tasks.workunit.client.0.smithi063.stdout:3/892: stat d2/d11/d69/d80/d8a/fa8 0 2024-09-16T01:25:24.955 INFO:tasks.workunit.client.0.smithi063.stdout:1/894: creat d1/d5/d15/d18/d4b/f126 x:0 0 0 2024-09-16T01:25:24.955 INFO:tasks.workunit.client.0.smithi063.stdout:0/918: link d1/d30/d52/d5a/l23 d1/d30/dff/l150 0 2024-09-16T01:25:24.955 INFO:tasks.workunit.client.0.smithi063.stdout:7/824: fsync d7/d1c/d1f/d29/f4e 0 2024-09-16T01:25:24.957 INFO:tasks.workunit.client.0.smithi063.stdout:4/879: rename d5/d3b/df/d1c/d29/d32/d60/d10b/fba to d5/d3b/df/d1c/d29/d20/f121 0 2024-09-16T01:25:24.957 INFO:tasks.workunit.client.0.smithi063.stdout:7/825: dread - d7/d56/d57/d73/fcf zero size 2024-09-16T01:25:24.958 INFO:tasks.workunit.client.0.smithi063.stdout:8/711: sync 2024-09-16T01:25:24.958 INFO:tasks.workunit.client.0.smithi063.stdout:4/880: stat d5/d3b/df/d1c/f36 0 2024-09-16T01:25:24.960 INFO:tasks.workunit.client.0.smithi063.stdout:1/895: creat d1/d5/d15/d18/db6/d105/f127 x:0 0 0 2024-09-16T01:25:24.962 INFO:tasks.workunit.client.0.smithi063.stdout:6/887: truncate d3/d48/f26 3794834 0 2024-09-16T01:25:24.962 INFO:tasks.workunit.client.0.smithi063.stdout:7/826: mknod d7/d1c/d1f/d29/d72/dc9/c109 0 2024-09-16T01:25:24.963 INFO:tasks.workunit.client.0.smithi063.stdout:9/892: mknod d7/d9/d20/de3/de7/d14/d63/c139 0 2024-09-16T01:25:24.965 INFO:tasks.workunit.client.0.smithi063.stdout:6/888: fsync d3/d30/d39/dac/db5/dcf/dee/ff2 0 2024-09-16T01:25:24.965 INFO:tasks.workunit.client.0.smithi063.stdout:8/712: creat d5/db/d12/d1a/d1e/d93/fe7 x:0 0 0 2024-09-16T01:25:24.965 INFO:tasks.workunit.client.0.smithi063.stdout:3/893: write d2/d5b/fa4 [853304,43588] 0 2024-09-16T01:25:24.966 INFO:tasks.workunit.client.0.smithi063.stdout:1/896: rmdir d1/d5/d82 39 2024-09-16T01:25:24.967 INFO:tasks.workunit.client.0.smithi063.stdout:4/881: unlink d5/d3b/df/d1c/d29/dd4/dbc/f108 0 2024-09-16T01:25:24.969 INFO:tasks.workunit.client.0.smithi063.stdout:9/893: rename d7/d4a/dba/c73 to d7/d116/c13a 0 2024-09-16T01:25:24.970 INFO:tasks.workunit.client.0.smithi063.stdout:8/713: write d5/db/d12/d3d/d69/daa/f9b [883137,76550] 0 2024-09-16T01:25:24.970 INFO:tasks.workunit.client.0.smithi063.stdout:0/919: dwrite d1/d30/d52/d5a/d76/f142 [0,4194304] 0 2024-09-16T01:25:24.972 INFO:tasks.workunit.client.0.smithi063.stdout:1/897: mknod d1/dd/c128 0 2024-09-16T01:25:24.972 INFO:tasks.workunit.client.0.smithi063.stdout:6/889: symlink d3/d48/d28/d113/d137/l13e 0 2024-09-16T01:25:24.976 INFO:tasks.workunit.client.0.smithi063.stdout:1/898: symlink d1/dd/d3b/db3/l129 0 2024-09-16T01:25:24.977 INFO:tasks.workunit.client.0.smithi063.stdout:4/882: mknod d5/d3b/df/d1c/d29/c122 0 2024-09-16T01:25:24.978 INFO:tasks.workunit.client.0.smithi063.stdout:3/894: dread d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/f114 [0,4194304] 0 2024-09-16T01:25:24.979 INFO:tasks.workunit.client.0.smithi063.stdout:4/883: write d5/f8c [3885759,34270] 0 2024-09-16T01:25:24.980 INFO:tasks.workunit.client.0.smithi063.stdout:7/827: link d7/c33 d7/d1c/d1f/d66/d70/c10a 0 2024-09-16T01:25:24.981 INFO:tasks.workunit.client.0.smithi063.stdout:6/890: dread d3/d48/f97 [0,4194304] 0 2024-09-16T01:25:24.983 INFO:tasks.workunit.client.0.smithi063.stdout:1/899: symlink d1/d5/d82/d9b/d77/d7d/dcb/l12a 0 2024-09-16T01:25:24.983 INFO:tasks.workunit.client.0.smithi063.stdout:9/894: rename d7/lef to d7/d9/d20/de3/de7/d14/d63/l13b 0 2024-09-16T01:25:24.985 INFO:tasks.workunit.client.0.smithi063.stdout:8/714: dwrite d5/db/d12/d3d/d69/daa/f90 [4194304,4194304] 0 2024-09-16T01:25:24.985 INFO:tasks.workunit.client.0.smithi063.stdout:3/895: mknod d2/d11/c135 0 2024-09-16T01:25:24.989 INFO:tasks.workunit.client.0.smithi063.stdout:4/884: truncate d5/f2e 749450 0 2024-09-16T01:25:24.990 INFO:tasks.workunit.client.0.smithi063.stdout:8/715: read - d5/d86/fd6 zero size 2024-09-16T01:25:24.991 INFO:tasks.workunit.client.0.smithi063.stdout:1/900: creat d1/d5/f12b x:0 0 0 2024-09-16T01:25:24.993 INFO:tasks.workunit.client.0.smithi063.stdout:6/891: dread d3/d30/f4e [0,4194304] 0 2024-09-16T01:25:24.995 INFO:tasks.workunit.client.0.smithi063.stdout:1/901: chown d1/d12/d21/c45 2505471 1 2024-09-16T01:25:24.995 INFO:tasks.workunit.client.0.smithi063.stdout:4/885: stat d5/d3b/d57/d66/d9b/d7a/f83 0 2024-09-16T01:25:24.997 INFO:tasks.workunit.client.0.smithi063.stdout:0/920: rename d1/df/d2c/f39 to d1/df/d17/f151 0 2024-09-16T01:25:24.998 INFO:tasks.workunit.client.0.smithi063.stdout:8/716: write d5/db/d12/d3d/d69/daa/f9b [858910,120524] 0 2024-09-16T01:25:24.999 INFO:tasks.workunit.client.0.smithi063.stdout:6/892: write d3/d41/fc9 [86523,4938] 0 2024-09-16T01:25:25.003 INFO:tasks.workunit.client.0.smithi063.stdout:7/828: dread d7/d1c/d1f/f32 [4194304,4194304] 0 2024-09-16T01:25:25.003 INFO:tasks.workunit.client.0.smithi063.stdout:3/896: dwrite d2/d11/d18/f2d [4194304,4194304] 0 2024-09-16T01:25:25.004 INFO:tasks.workunit.client.0.smithi063.stdout:0/921: rmdir d1/df/d17 39 2024-09-16T01:25:25.008 INFO:tasks.workunit.client.0.smithi063.stdout:1/902: fsync d1/d5/d82/d9b/d77/d7d/fb7 0 2024-09-16T01:25:25.008 INFO:tasks.workunit.client.0.smithi063.stdout:8/717: truncate d5/db/d12/d1a/fc3 378674 0 2024-09-16T01:25:25.010 INFO:tasks.workunit.client.0.smithi063.stdout:9/895: dwrite d7/d116/d129/f2c [4194304,4194304] 0 2024-09-16T01:25:25.011 INFO:tasks.workunit.client.0.smithi063.stdout:6/893: rmdir d3/d48/d28/d3e/d44/d52/d11c 0 2024-09-16T01:25:25.012 INFO:tasks.workunit.client.0.smithi063.stdout:7/829: truncate d7/d56/d57/f78 751600 0 2024-09-16T01:25:25.013 INFO:tasks.workunit.client.0.smithi063.stdout:4/886: dwrite d5/d3b/f1d [0,4194304] 0 2024-09-16T01:25:25.013 INFO:tasks.workunit.client.0.smithi063.stdout:9/896: readlink d7/d4a/d4d/l120 0 2024-09-16T01:25:25.013 INFO:tasks.workunit.client.0.smithi063.stdout:8/718: read - d5/db/d12/d1a/d1e/d93/fe7 zero size 2024-09-16T01:25:25.014 INFO:tasks.workunit.client.0.smithi063.stdout:6/894: dread - d3/d41/d105/f106 zero size 2024-09-16T01:25:25.015 INFO:tasks.workunit.client.0.smithi063.stdout:1/903: creat d1/dd/d3b/f12c x:0 0 0 2024-09-16T01:25:25.017 INFO:tasks.workunit.client.0.smithi063.stdout:0/922: write d1/d30/d52/db3/fa1 [1229549,22533] 0 2024-09-16T01:25:25.024 INFO:tasks.workunit.client.0.smithi063.stdout:7/830: rename d7/d56/c2d to d7/d1c/d1f/d29/d88/c10b 0 2024-09-16T01:25:25.024 INFO:tasks.workunit.client.0.smithi063.stdout:6/895: write d3/d30/d39/d69/fb9 [7034514,86402] 0 2024-09-16T01:25:25.025 INFO:tasks.workunit.client.0.smithi063.stdout:8/719: chown d5/d9/l8a 174 1 2024-09-16T01:25:25.027 INFO:tasks.workunit.client.0.smithi063.stdout:0/923: symlink d1/d30/d52/db3/l152 0 2024-09-16T01:25:25.027 INFO:tasks.workunit.client.0.smithi063.stdout:7/831: write d7/d1c/d1f/d29/dbf/d40/d6c/fe8 [1516281,17412] 0 2024-09-16T01:25:25.029 INFO:tasks.workunit.client.0.smithi063.stdout:9/897: symlink d7/d9/d20/de3/de7/db2/dca/l13c 0 2024-09-16T01:25:25.031 INFO:tasks.workunit.client.0.smithi063.stdout:1/904: write d1/d5/d82/d9b/d77/d7d/dc2/f37 [3798691,73909] 0 2024-09-16T01:25:25.036 INFO:tasks.workunit.client.0.smithi063.stdout:4/887: rmdir d5/d3b/df/d1c/d29/d20/d98/df1 0 2024-09-16T01:25:25.036 INFO:tasks.workunit.client.0.smithi063.stdout:8/720: dwrite d5/db/d12/d3d/f9c [0,4194304] 0 2024-09-16T01:25:25.038 INFO:tasks.workunit.client.0.smithi063.stdout:1/905: mknod d1/d5/d82/d9b/d77/d7d/dda/df6/d120/c12d 0 2024-09-16T01:25:25.038 INFO:tasks.workunit.client.0.smithi063.stdout:0/924: dwrite d1/d2e/d48/f98 [0,4194304] 0 2024-09-16T01:25:25.039 INFO:tasks.workunit.client.0.smithi063.stdout:6/896: link d3/d48/la9 d3/d41/d9b/l13f 0 2024-09-16T01:25:25.041 INFO:tasks.workunit.client.0.smithi063.stdout:4/888: mkdir d5/d3b/d57/d66/d123 0 2024-09-16T01:25:25.042 INFO:tasks.workunit.client.0.smithi063.stdout:6/897: write d3/d41/f115 [625607,94683] 0 2024-09-16T01:25:25.042 INFO:tasks.workunit.client.0.smithi063.stdout:8/721: mknod d5/db/d12/d1a/d60/ce8 0 2024-09-16T01:25:25.044 INFO:tasks.workunit.client.0.smithi063.stdout:1/906: mkdir d1/d5/d82/d9b/d77/d8a/d12e 0 2024-09-16T01:25:25.045 INFO:tasks.workunit.client.0.smithi063.stdout:8/722: readlink l2 0 2024-09-16T01:25:25.046 INFO:tasks.workunit.client.0.smithi063.stdout:4/889: chown d5/d3b/df/d1c/d29/dd4 259357975 1 2024-09-16T01:25:25.048 INFO:tasks.workunit.client.0.smithi063.stdout:6/898: dread - d3/d48/d28/d3e/d44/da4/f10b zero size 2024-09-16T01:25:25.049 INFO:tasks.workunit.client.0.smithi063.stdout:8/723: chown d5/db/d12/d1a/d1e/d93/ld2 1077 1 2024-09-16T01:25:25.050 INFO:tasks.workunit.client.0.smithi063.stdout:0/925: mknod d1/df/d2c/db6/d14d/c153 0 2024-09-16T01:25:25.051 INFO:tasks.workunit.client.0.smithi063.stdout:6/899: mknod d3/d41/d89/c140 0 2024-09-16T01:25:25.051 INFO:tasks.workunit.client.0.smithi063.stdout:1/907: rename d1/d5/d15/de0 to d1/d5/d15/d1b/d12f 0 2024-09-16T01:25:25.124 INFO:tasks.workunit.client.0.smithi063.stdout:5/985: sync 2024-09-16T01:25:25.124 INFO:tasks.workunit.client.0.smithi063.stdout:2/971: sync 2024-09-16T01:25:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:4/890: dread d5/d3b/df/d1c/d29/d20/f23 [0,4194304] 0 2024-09-16T01:25:25.132 INFO:tasks.workunit.client.0.smithi063.stdout:9/898: dwrite d7/d116/d129/f98 [0,4194304] 0 2024-09-16T01:25:25.133 INFO:tasks.workunit.client.0.smithi063.stdout:8/724: write d5/db/d12/d1a/d60/d7a/f9f [1223999,47139] 0 2024-09-16T01:25:25.135 INFO:tasks.workunit.client.0.smithi063.stdout:0/926: symlink d1/df/d2c/d43/d90/l154 0 2024-09-16T01:25:25.135 INFO:tasks.workunit.client.0.smithi063.stdout:4/891: rmdir d5/d3b/d57/d66 39 2024-09-16T01:25:25.135 INFO:tasks.workunit.client.0.smithi063.stdout:8/725: chown d5/db/d12/d3d/fc6 27037421 1 2024-09-16T01:25:25.137 INFO:tasks.workunit.client.0.smithi063.stdout:9/899: stat d7/d9/d20/de3/de7/f24 0 2024-09-16T01:25:25.138 INFO:tasks.workunit.client.0.smithi063.stdout:6/900: getdents d3/d30/d8d 0 2024-09-16T01:25:25.139 INFO:tasks.workunit.client.0.smithi063.stdout:4/892: chown d5/d3b/f2d 48928031 1 2024-09-16T01:25:25.139 INFO:tasks.workunit.client.0.smithi063.stdout:5/986: write d5/d18/d29/d48/d98/d118/fd7 [949985,84943] 0 2024-09-16T01:25:25.141 INFO:tasks.workunit.client.0.smithi063.stdout:2/972: unlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/dc2/dde/f10a 0 2024-09-16T01:25:25.142 INFO:tasks.workunit.client.0.smithi063.stdout:6/901: write d3/d30/d39/d69/fb9 [863994,83853] 0 2024-09-16T01:25:25.142 INFO:tasks.workunit.client.0.smithi063.stdout:5/987: chown d5/d18/d29/d48/d98 2866 1 2024-09-16T01:25:25.142 INFO:tasks.workunit.client.0.smithi063.stdout:1/908: getdents d1/d5/d82/d9b/d77/d7d/dc2/dad 0 2024-09-16T01:25:25.143 INFO:tasks.workunit.client.0.smithi063.stdout:9/900: mknod d7/d4a/d4d/d96/c13d 0 2024-09-16T01:25:25.145 INFO:tasks.workunit.client.0.smithi063.stdout:8/726: truncate d5/db/d12/f57 1320410 0 2024-09-16T01:25:25.147 INFO:tasks.workunit.client.0.smithi063.stdout:2/973: read d3/d77/f89 [3638763,61482] 0 2024-09-16T01:25:25.149 INFO:tasks.workunit.client.0.smithi063.stdout:8/727: chown d5/d8c/l71 438 1 2024-09-16T01:25:25.150 INFO:tasks.workunit.client.0.smithi063.stdout:6/902: write d3/d48/d28/d3e/d68/fd5 [545348,54267] 0 2024-09-16T01:25:25.156 INFO:tasks.workunit.client.0.smithi063.stdout:2/974: write d3/d7/d8/d19/d3c/d53/f83 [40146,88223] 0 2024-09-16T01:25:25.158 INFO:tasks.workunit.client.0.smithi063.stdout:6/903: mknod d3/d10/d11a/d125/c141 0 2024-09-16T01:25:25.161 INFO:tasks.workunit.client.0.smithi063.stdout:8/728: rmdir d5/d86/dd5 0 2024-09-16T01:25:25.163 INFO:tasks.workunit.client.0.smithi063.stdout:4/893: dread d5/d3b/df/d1c/d29/d32/f5b [0,4194304] 0 2024-09-16T01:25:25.165 INFO:tasks.workunit.client.0.smithi063.stdout:5/988: dwrite d5/d18/d29/d48/d98/d94/f92 [0,4194304] 0 2024-09-16T01:25:25.169 INFO:tasks.workunit.client.0.smithi063.stdout:1/909: dwrite d1/d5/d15/f115 [0,4194304] 0 2024-09-16T01:25:25.169 INFO:tasks.workunit.client.0.smithi063.stdout:0/927: dread d1/f31 [0,4194304] 0 2024-09-16T01:25:25.171 INFO:tasks.workunit.client.0.smithi063.stdout:9/901: dwrite d7/d9/d20/de3/de7/d14/d63/d5f/fa7 [0,4194304] 0 2024-09-16T01:25:25.174 INFO:tasks.workunit.client.0.smithi063.stdout:1/910: write d1/d5/fe4 [926126,73974] 0 2024-09-16T01:25:25.175 INFO:tasks.workunit.client.0.smithi063.stdout:8/729: mknod d5/db/d12/d3d/d69/daa/d40/d4a/ce9 0 2024-09-16T01:25:25.175 INFO:tasks.workunit.client.0.smithi063.stdout:9/902: write d7/d116/d129/f44 [9771897,92087] 0 2024-09-16T01:25:25.176 INFO:tasks.workunit.client.0.smithi063.stdout:5/989: rmdir d5/d18/d29/d48 39 2024-09-16T01:25:25.181 INFO:tasks.workunit.client.0.smithi063.stdout:5/990: stat d5/d12/f4c 0 2024-09-16T01:25:25.183 INFO:tasks.workunit.client.0.smithi063.stdout:4/894: creat d5/d3b/df/d1c/d29/d32/d60/d10b/f124 x:0 0 0 2024-09-16T01:25:25.185 INFO:tasks.workunit.client.0.smithi063.stdout:8/730: write d5/d8c/d74/f96 [130229,103607] 0 2024-09-16T01:25:25.188 INFO:tasks.workunit.client.0.smithi063.stdout:9/903: creat d7/d9/d20/de3/de7/db2/dca/f13e x:0 0 0 2024-09-16T01:25:25.190 INFO:tasks.workunit.client.0.smithi063.stdout:1/911: getdents d1/d5/d82/d9b/d77 0 2024-09-16T01:25:25.190 INFO:tasks.workunit.client.0.smithi063.stdout:0/928: dwrite d1/df/d17/f151 [4194304,4194304] 0 2024-09-16T01:25:25.191 INFO:tasks.workunit.client.0.smithi063.stdout:6/904: dread d3/d48/d28/f77 [0,4194304] 0 2024-09-16T01:25:25.192 INFO:tasks.workunit.client.0.smithi063.stdout:5/991: write d5/d7f/df1/fd8 [218760,23733] 0 2024-09-16T01:25:25.194 INFO:tasks.workunit.client.0.smithi063.stdout:9/904: fdatasync d7/d9/d20/de3/de7/d14/f31 0 2024-09-16T01:25:25.197 INFO:tasks.workunit.client.0.smithi063.stdout:8/731: symlink d5/db/d12/d3d/d69/daa/d40/d4a/lea 0 2024-09-16T01:25:25.198 INFO:tasks.workunit.client.0.smithi063.stdout:5/992: stat d5/d12/d91/d72/ca7 0 2024-09-16T01:25:25.199 INFO:tasks.workunit.client.0.smithi063.stdout:2/975: dread d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/db7/fcf [0,4194304] 0 2024-09-16T01:25:25.200 INFO:tasks.workunit.client.0.smithi063.stdout:4/895: rename d5/d3b/df/d1c/d29/lea to d5/d3b/d57/d66/db7/l125 0 2024-09-16T01:25:25.200 INFO:tasks.workunit.client.0.smithi063.stdout:8/732: fdatasync d5/db/d12/d1a/f2c 0 2024-09-16T01:25:25.201 INFO:tasks.workunit.client.0.smithi063.stdout:6/905: symlink d3/d48/d28/d3e/d44/da4/d5a/l142 0 2024-09-16T01:25:25.201 INFO:tasks.workunit.client.0.smithi063.stdout:0/929: mkdir d1/d1c/d155 0 2024-09-16T01:25:25.204 INFO:tasks.workunit.client.0.smithi063.stdout:1/912: dwrite d1/dd/d3b/f44 [0,4194304] 0 2024-09-16T01:25:25.204 INFO:tasks.workunit.client.0.smithi063.stdout:3/897: sync 2024-09-16T01:25:25.205 INFO:tasks.workunit.client.0.smithi063.stdout:4/896: symlink d5/d3b/d57/dce/l126 0 2024-09-16T01:25:25.205 INFO:tasks.workunit.client.0.smithi063.stdout:6/906: rmdir d3/d30 39 2024-09-16T01:25:25.206 INFO:tasks.workunit.client.0.smithi063.stdout:9/905: fsync d7/d9/d20/de3/de7/d14/d63/d5f/dab/f138 0 2024-09-16T01:25:25.206 INFO:tasks.workunit.client.0.smithi063.stdout:5/993: creat d5/d18/d29/d48/d7b/f160 x:0 0 0 2024-09-16T01:25:25.207 INFO:tasks.workunit.client.0.smithi063.stdout:2/976: rmdir d3/d7/d8/d19/d8c/d21/d9c/dd4/d122 39 2024-09-16T01:25:25.209 INFO:tasks.workunit.client.0.smithi063.stdout:8/733: dread d5/d9/f7b [0,4194304] 0 2024-09-16T01:25:25.211 INFO:tasks.workunit.client.0.smithi063.stdout:1/913: creat d1/d5/d6f/dd2/f130 x:0 0 0 2024-09-16T01:25:25.213 INFO:tasks.workunit.client.0.smithi063.stdout:5/994: stat d5/d18/d29/d48/d7b/d14a/d153 0 2024-09-16T01:25:25.213 INFO:tasks.workunit.client.0.smithi063.stdout:6/907: truncate d3/d48/def/f110 763527 0 2024-09-16T01:25:25.214 INFO:tasks.workunit.client.0.smithi063.stdout:4/897: truncate d5/d3b/f19 3327406 0 2024-09-16T01:25:25.217 INFO:tasks.workunit.client.0.smithi063.stdout:1/914: write d1/d5/d15/f29 [4560436,32170] 0 2024-09-16T01:25:25.218 INFO:tasks.workunit.client.0.smithi063.stdout:0/930: dwrite d1/d2e/d48/f108 [0,4194304] 0 2024-09-16T01:25:25.219 INFO:tasks.workunit.client.0.smithi063.stdout:5/995: rmdir d5/d7f 39 2024-09-16T01:25:25.219 INFO:tasks.workunit.client.0.smithi063.stdout:6/908: readlink d3/d30/d39/dac/l109 0 2024-09-16T01:25:25.220 INFO:tasks.workunit.client.0.smithi063.stdout:9/906: unlink d7/d9/d20/de3/de7/d14/d63/d5f/c8d 0 2024-09-16T01:25:25.221 INFO:tasks.workunit.client.0.smithi063.stdout:8/734: readlink d5/db/d12/d3d/d69/daa/d40/d4a/la3 0 2024-09-16T01:25:25.222 INFO:tasks.workunit.client.0.smithi063.stdout:4/898: fsync d5/d3b/df/d1c/d29/f65 0 2024-09-16T01:25:25.223 INFO:tasks.workunit.client.0.smithi063.stdout:1/915: mkdir d1/dd/d3b/d131 0 2024-09-16T01:25:25.224 INFO:tasks.workunit.client.0.smithi063.stdout:0/931: creat d1/d2e/d73/f156 x:0 0 0 2024-09-16T01:25:25.226 INFO:tasks.workunit.client.0.smithi063.stdout:3/898: truncate d2/d11/d18/f2d 6940354 0 2024-09-16T01:25:25.227 INFO:tasks.workunit.client.0.smithi063.stdout:6/909: dread d3/d41/f115 [0,4194304] 0 2024-09-16T01:25:25.227 INFO:tasks.workunit.client.0.smithi063.stdout:9/907: mkdir d7/d116/d129/d13f 0 2024-09-16T01:25:25.228 INFO:tasks.workunit.client.0.smithi063.stdout:8/735: write d5/db/d12/d1a/d1e/d68/f84 [136829,32570] 0 2024-09-16T01:25:25.228 INFO:tasks.workunit.client.0.smithi063.stdout:4/899: readlink d5/d3b/df/d1c/d29/d32/d4e/l5f 0 2024-09-16T01:25:25.229 INFO:tasks.workunit.client.0.smithi063.stdout:6/910: readlink d3/l1a 0 2024-09-16T01:25:25.230 INFO:tasks.workunit.client.0.smithi063.stdout:0/932: mknod d1/df/d2c/db6/d14d/c157 0 2024-09-16T01:25:25.231 INFO:tasks.workunit.client.0.smithi063.stdout:1/916: rmdir d1/dd/d3b/d131 0 2024-09-16T01:25:25.232 INFO:tasks.workunit.client.0.smithi063.stdout:3/899: write d2/d11/d37/d40/d5e/d3b/d68/d6d/ff9 [1665267,119402] 0 2024-09-16T01:25:25.233 INFO:tasks.workunit.client.0.smithi063.stdout:1/917: stat d1/d5/l10c 0 2024-09-16T01:25:25.234 INFO:tasks.workunit.client.0.smithi063.stdout:2/977: truncate d3/d7/d8/d19/d8c/d21/d9c/dd4/fe0 820739 0 2024-09-16T01:25:25.234 INFO:tasks.workunit.client.0.smithi063.stdout:9/908: read d7/d9/d20/de3/de7/db2/dc6/ffa [920628,12253] 0 2024-09-16T01:25:25.235 INFO:tasks.workunit.client.0.smithi063.stdout:6/911: mknod d3/d30/d39/dac/c143 0 2024-09-16T01:25:25.236 INFO:tasks.workunit.client.0.smithi063.stdout:8/736: link d5/d86/fd6 d5/d86/feb 0 2024-09-16T01:25:25.239 INFO:tasks.workunit.client.0.smithi063.stdout:1/918: creat d1/d5/d15/d18/f132 x:0 0 0 2024-09-16T01:25:25.240 INFO:tasks.workunit.client.0.smithi063.stdout:9/909: write d7/d9/d20/de3/ff3 [30334,57562] 0 2024-09-16T01:25:25.240 INFO:tasks.workunit.client.0.smithi063.stdout:4/900: creat d5/d3b/df/d1c/d29/d32/d60/f127 x:0 0 0 2024-09-16T01:25:25.240 INFO:tasks.workunit.client.0.smithi063.stdout:2/978: chown d3/d7/d8/d19/d3c/d53/fb4 1 1 2024-09-16T01:25:25.243 INFO:tasks.workunit.client.0.smithi063.stdout:5/996: dread d5/d18/d29/d48/dad/f10a [0,4194304] 0 2024-09-16T01:25:25.246 INFO:tasks.workunit.client.0.smithi063.stdout:2/979: write d3/d7/d8/d19/f129 [203159,78343] 0 2024-09-16T01:25:25.246 INFO:tasks.workunit.client.0.smithi063.stdout:9/910: mkdir d7/d9/d140 0 2024-09-16T01:25:25.246 INFO:tasks.workunit.client.0.smithi063.stdout:1/919: symlink d1/d5/d6f/dd2/de1/d100/d109/l133 0 2024-09-16T01:25:25.247 INFO:tasks.workunit.client.0.smithi063.stdout:4/901: creat d5/d3b/d57/d66/db7/f128 x:0 0 0 2024-09-16T01:25:25.248 INFO:tasks.workunit.client.0.smithi063.stdout:8/737: creat d5/db/d12/d3d/d69/daa/d40/fec x:0 0 0 2024-09-16T01:25:25.251 INFO:tasks.workunit.client.0.smithi063.stdout:6/912: dread d3/d48/d28/f77 [0,4194304] 0 2024-09-16T01:25:25.254 INFO:tasks.workunit.client.0.smithi063.stdout:9/911: write d7/d116/d129/df1/f106 [916243,9520] 0 2024-09-16T01:25:25.255 INFO:tasks.workunit.client.0.smithi063.stdout:0/933: dwrite d1/d30/d52/d9d/deb/f7b [0,4194304] 0 2024-09-16T01:25:25.255 INFO:tasks.workunit.client.0.smithi063.stdout:3/900: dwrite d2/d11/d37/d40/d5e/d3b/d68/fff [0,4194304] 0 2024-09-16T01:25:25.257 INFO:tasks.workunit.client.0.smithi063.stdout:1/920: creat d1/dd/d3b/dbe/d10d/f134 x:0 0 0 2024-09-16T01:25:25.258 INFO:tasks.workunit.client.0.smithi063.stdout:6/913: write d3/d41/f7a [3137878,36147] 0 2024-09-16T01:25:25.266 INFO:tasks.workunit.client.0.smithi063.stdout:0/934: chown d1/d30/d52/d5a/d36/d41/f6a 91133185 1 2024-09-16T01:25:25.267 INFO:tasks.workunit.client.0.smithi063.stdout:1/921: creat d1/dd/d3b/f135 x:0 0 0 2024-09-16T01:25:25.267 INFO:tasks.workunit.client.0.smithi063.stdout:5/997: rename d5/d18/d29/d48/f80 to d5/d18/d29/d48/d66/db1/d120/f161 0 2024-09-16T01:25:25.267 INFO:tasks.workunit.client.0.smithi063.stdout:8/738: dwrite d5/fc1 [0,4194304] 0 2024-09-16T01:25:25.268 INFO:tasks.workunit.client.0.smithi063.stdout:6/914: fsync d3/d48/d28/d3e/d44/da4/d5a/fe2 0 2024-09-16T01:25:25.270 INFO:tasks.workunit.client.0.smithi063.stdout:4/902: dread d5/d3b/df/d1c/d29/d32/f5b [0,4194304] 0 2024-09-16T01:25:25.271 INFO:tasks.workunit.client.0.smithi063.stdout:0/935: symlink d1/df/d12a/l158 0 2024-09-16T01:25:25.272 INFO:tasks.workunit.client.0.smithi063.stdout:3/901: dread d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/ff1 [0,4194304] 0 2024-09-16T01:25:25.272 INFO:tasks.workunit.client.0.smithi063.stdout:9/912: mknod d7/d9/d20/de3/de7/d14/d38/df7/c141 0 2024-09-16T01:25:25.273 INFO:tasks.workunit.client.0.smithi063.stdout:6/915: readlink d3/d48/d28/d3e/d44/da4/l12c 0 2024-09-16T01:25:25.274 INFO:tasks.workunit.client.0.smithi063.stdout:1/922: mknod d1/dd/d3b/c136 0 2024-09-16T01:25:25.274 INFO:tasks.workunit.client.0.smithi063.stdout:4/903: read - d5/d3b/d57/f101 zero size 2024-09-16T01:25:25.276 INFO:tasks.workunit.client.0.smithi063.stdout:8/739: symlink d5/db/d12/d3d/d69/daa/d40/d4a/led 0 2024-09-16T01:25:25.277 INFO:tasks.workunit.client.0.smithi063.stdout:2/980: rename d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/f6c to d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/f14c 0 2024-09-16T01:25:25.278 INFO:tasks.workunit.client.0.smithi063.stdout:4/904: symlink d5/d3b/d57/d66/d9b/d7a/l129 0 2024-09-16T01:25:25.278 INFO:tasks.workunit.client.0.smithi063.stdout:1/923: symlink d1/d5/d82/d9b/d77/d7d/dda/df6/l137 0 2024-09-16T01:25:25.279 INFO:tasks.workunit.client.0.smithi063.stdout:6/916: mkdir d3/d48/d28/d3e/d44/d144 0 2024-09-16T01:25:25.280 INFO:tasks.workunit.client.0.smithi063.stdout:8/740: mknod d5/d8c/d74/cee 0 2024-09-16T01:25:25.283 INFO:tasks.workunit.client.0.smithi063.stdout:2/981: readlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/l8f 0 2024-09-16T01:25:25.283 INFO:tasks.workunit.client.0.smithi063.stdout:4/905: creat d5/d3b/df/d1c/d29/d32/d4e/f12a x:0 0 0 2024-09-16T01:25:25.284 INFO:tasks.workunit.client.0.smithi063.stdout:6/917: creat d3/d30/d39/f145 x:0 0 0 2024-09-16T01:25:25.284 INFO:tasks.workunit.client.0.smithi063.stdout:9/913: link d7/d9/d20/de3/de7/d14/cda d7/c142 0 2024-09-16T01:25:25.287 INFO:tasks.workunit.client.0.smithi063.stdout:4/906: symlink d5/d3b/d5c/l12b 0 2024-09-16T01:25:25.289 INFO:tasks.workunit.client.0.smithi063.stdout:5/998: rename d5/d12/fa4 to d5/d18/d29/d48/dad/d157/f162 0 2024-09-16T01:25:25.291 INFO:tasks.workunit.client.0.smithi063.stdout:9/914: write d7/d9/d20/de3/de7/f42 [3794169,123991] 0 2024-09-16T01:25:25.292 INFO:tasks.workunit.client.0.smithi063.stdout:1/924: dwrite d1/d5/d15/d18/d4b/f5f [4194304,4194304] 0 2024-09-16T01:25:25.294 INFO:tasks.workunit.client.0.smithi063.stdout:6/918: write d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/faa [599544,72887] 0 2024-09-16T01:25:25.296 INFO:tasks.workunit.client.0.smithi063.stdout:0/936: dread d1/fa [0,4194304] 0 2024-09-16T01:25:25.298 INFO:tasks.workunit.client.0.smithi063.stdout:5/999: chown d5/d18/d29/d48/d98/c61 40704816 1 2024-09-16T01:25:25.299 INFO:tasks.workunit.client.0.smithi063.stdout:1/925: rmdir d1/d5/d6f 39 2024-09-16T01:25:25.300 INFO:tasks.workunit.client.0.smithi063.stdout:8/741: dwrite d5/db/d12/d3d/d69/daa/d40/d4a/fca [0,4194304] 0 2024-09-16T01:25:25.301 INFO:tasks.workunit.client.0.smithi063.stdout:9/915: chown d7/d9/d20/de3/de7/d14/d34/l41 3088888 1 2024-09-16T01:25:25.302 INFO:tasks.workunit.client.0.smithi063.stdout:2/982: link d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/f6d d3/d7/d8/d19/d8c/f14d 0 2024-09-16T01:25:25.303 INFO:tasks.workunit.client.0.smithi063.stdout:0/937: creat d1/d30/d52/d5a/d44/f159 x:0 0 0 2024-09-16T01:25:25.304 INFO:tasks.workunit.client.0.smithi063.stdout:4/907: rename d5/d3b/d57/d66/db7/dc9/f111 to d5/d3b/d57/dce/d10d/d10e/f12c 0 2024-09-16T01:25:25.305 INFO:tasks.workunit.client.0.smithi063.stdout:8/742: readlink d5/db/d12/d3d/d69/daa/l44 0 2024-09-16T01:25:25.306 INFO:tasks.workunit.client.0.smithi063.stdout:1/926: creat d1/d5/d15/d18/db6/f138 x:0 0 0 2024-09-16T01:25:25.307 INFO:tasks.workunit.client.0.smithi063.stdout:4/908: write d5/d3b/d57/faf [3626246,38737] 0 2024-09-16T01:25:25.310 INFO:tasks.workunit.client.0.smithi063.stdout:1/927: dread - d1/d5/d15/d1b/f124 zero size 2024-09-16T01:25:25.311 INFO:tasks.workunit.client.0.smithi063.stdout:2/983: write d3/d7/d8/d19/d3c/d53/d7f/d80/fdd [374559,22418] 0 2024-09-16T01:25:25.311 INFO:tasks.workunit.client.0.smithi063.stdout:6/919: dwrite d3/d48/ff8 [0,4194304] 0 2024-09-16T01:25:25.315 INFO:tasks.workunit.client.0.smithi063.stdout:0/938: write d1/d30/d52/d9d/deb/fe5 [174167,11069] 0 2024-09-16T01:25:25.316 INFO:tasks.workunit.client.0.smithi063.stdout:2/984: stat d3/d7/d8/df1 0 2024-09-16T01:25:25.316 INFO:tasks.workunit.client.0.smithi063.stdout:6/920: write d3/d10/f11f [663364,41709] 0 2024-09-16T01:25:25.318 INFO:tasks.workunit.client.0.smithi063.stdout:1/928: write d1/d5/d82/d9b/d77/d7d/fcd [103021,107538] 0 2024-09-16T01:25:25.322 INFO:tasks.workunit.client.0.smithi063.stdout:0/939: creat d1/d2e/dc1/f15a x:0 0 0 2024-09-16T01:25:25.325 INFO:tasks.workunit.client.0.smithi063.stdout:8/743: dwrite d5/db/d12/d1a/d1e/d68/fe1 [0,4194304] 0 2024-09-16T01:25:25.327 INFO:tasks.workunit.client.0.smithi063.stdout:2/985: fdatasync d3/d7/d8/d19/d8c/d21/d9c/dd4/f136 0 2024-09-16T01:25:25.330 INFO:tasks.workunit.client.0.smithi063.stdout:4/909: write d5/d3b/df/d1c/d29/d20/d98/ddf/f11d [1176640,107238] 0 2024-09-16T01:25:25.331 INFO:tasks.workunit.client.0.smithi063.stdout:2/986: creat d3/dbc/f14e x:0 0 0 2024-09-16T01:25:25.332 INFO:tasks.workunit.client.0.smithi063.stdout:9/916: dwrite d7/d9/d20/de3/de7/d14/f65 [0,4194304] 0 2024-09-16T01:25:25.332 INFO:tasks.workunit.client.0.smithi063.stdout:1/929: getdents d1/d5/d82/d9b/d77/d7d 0 2024-09-16T01:25:25.336 INFO:tasks.workunit.client.0.smithi063.stdout:4/910: symlink d5/d3b/d57/dce/l12d 0 2024-09-16T01:25:25.337 INFO:tasks.workunit.client.0.smithi063.stdout:9/917: mkdir d7/d9/d143 0 2024-09-16T01:25:25.338 INFO:tasks.workunit.client.0.smithi063.stdout:0/940: rename d1/d30/d52/d5a/d44/ff9 to d1/f15b 0 2024-09-16T01:25:25.341 INFO:tasks.workunit.client.0.smithi063.stdout:6/921: rename d3/d48/d28/d3e/d44/da4/d5a/cc6 to d3/d30/d39/dac/db5/dcf/c146 0 2024-09-16T01:25:25.342 INFO:tasks.workunit.client.0.smithi063.stdout:0/941: write d1/d2e/d48/f98 [3667670,107345] 0 2024-09-16T01:25:25.342 INFO:tasks.workunit.client.0.smithi063.stdout:9/918: mkdir d7/d9/d140/d144 0 2024-09-16T01:25:25.345 INFO:tasks.workunit.client.0.smithi063.stdout:8/744: dwrite d5/db/d12/f57 [0,4194304] 0 2024-09-16T01:25:25.345 INFO:tasks.workunit.client.0.smithi063.stdout:0/942: stat d1/d30/d95/db5 0 2024-09-16T01:25:25.345 INFO:tasks.workunit.client.0.smithi063.stdout:2/987: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/fdc [2599178,62697] 0 2024-09-16T01:25:25.346 INFO:tasks.workunit.client.0.smithi063.stdout:1/930: rename d1/d12/f5b to d1/d5/d82/d9b/d77/d7d/dc2/dad/f139 0 2024-09-16T01:25:25.347 INFO:tasks.workunit.client.0.smithi063.stdout:9/919: chown d7/d116/d129/df1/f107 1 1 2024-09-16T01:25:25.350 INFO:tasks.workunit.client.0.smithi063.stdout:4/911: rename d5/d3b/df/d1c/d29/d20/d98/c11c to d5/d3b/d57/d68/d90/c12e 0 2024-09-16T01:25:25.351 INFO:tasks.workunit.client.0.smithi063.stdout:8/745: symlink d5/db/d12/d1a/d60/da8/lef 0 2024-09-16T01:25:25.351 INFO:tasks.workunit.client.0.smithi063.stdout:9/920: dread - d7/d9/d20/de3/de7/d14/f124 zero size 2024-09-16T01:25:25.356 INFO:tasks.workunit.client.0.smithi063.stdout:6/922: rename d3/d48/fcc to d3/d30/f147 0 2024-09-16T01:25:25.357 INFO:tasks.workunit.client.0.smithi063.stdout:2/988: dread d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/fbf [0,4194304] 0 2024-09-16T01:25:25.358 INFO:tasks.workunit.client.0.smithi063.stdout:4/912: symlink d5/d3b/df/d1c/d29/d20/d98/ddf/l12f 0 2024-09-16T01:25:25.360 INFO:tasks.workunit.client.0.smithi063.stdout:6/923: write d3/d30/d8d/d102/d91/f8e [1574788,54147] 0 2024-09-16T01:25:25.361 INFO:tasks.workunit.client.0.smithi063.stdout:9/921: creat d7/d9/d20/de3/de7/d14/d63/f145 x:0 0 0 2024-09-16T01:25:25.361 INFO:tasks.workunit.client.0.smithi063.stdout:0/943: dwrite d1/d2e/d48/dc3/fe1 [0,4194304] 0 2024-09-16T01:25:25.363 INFO:tasks.workunit.client.0.smithi063.stdout:4/913: symlink d5/d3b/l130 0 2024-09-16T01:25:25.364 INFO:tasks.workunit.client.0.smithi063.stdout:2/989: fsync d3/d7/d8/d19/d3c/d53/d7f/d80/f95 0 2024-09-16T01:25:25.365 INFO:tasks.workunit.client.0.smithi063.stdout:0/944: symlink d1/d1c/dcd/l15c 0 2024-09-16T01:25:25.366 INFO:tasks.workunit.client.0.smithi063.stdout:8/746: getdents d5/db/d12/d1a/d1e/d93 0 2024-09-16T01:25:25.367 INFO:tasks.workunit.client.0.smithi063.stdout:9/922: symlink d7/d9/d20/de3/de7/db2/dca/l146 0 2024-09-16T01:25:25.368 INFO:tasks.workunit.client.0.smithi063.stdout:4/914: readlink d5/d3b/d57/dce/l117 0 2024-09-16T01:25:25.369 INFO:tasks.workunit.client.0.smithi063.stdout:0/945: write d1/d30/d52/d5a/d44/f159 [396371,129499] 0 2024-09-16T01:25:25.372 INFO:tasks.workunit.client.0.smithi063.stdout:1/931: dwrite d1/d5/d82/d9b/f79 [0,4194304] 0 2024-09-16T01:25:25.373 INFO:tasks.workunit.client.0.smithi063.stdout:8/747: write d5/db/d12/db0/fcb [905539,67053] 0 2024-09-16T01:25:25.373 INFO:tasks.workunit.client.0.smithi063.stdout:4/915: mknod d5/d3b/d57/d66/c131 0 2024-09-16T01:25:25.376 INFO:tasks.workunit.client.0.smithi063.stdout:9/923: creat d7/d116/d129/d13f/f147 x:0 0 0 2024-09-16T01:25:25.381 INFO:tasks.workunit.client.0.smithi063.stdout:4/916: unlink d5/d3b/f19 0 2024-09-16T01:25:25.385 INFO:tasks.workunit.client.0.smithi063.stdout:2/990: dwrite d3/d7/d8/d19/d8c/dcc/d118/f142 [0,4194304] 0 2024-09-16T01:25:25.386 INFO:tasks.workunit.client.0.smithi063.stdout:8/748: link d5/d8c/dbd/l7f d5/d8c/dbd/lf0 0 2024-09-16T01:25:25.389 INFO:tasks.workunit.client.0.smithi063.stdout:1/932: dread d1/d5/d82/d9b/f79 [0,4194304] 0 2024-09-16T01:25:25.389 INFO:tasks.workunit.client.0.smithi063.stdout:6/924: dwrite d3/d48/d28/d3e/d44/d8c/f13d [0,4194304] 0 2024-09-16T01:25:25.389 INFO:tasks.workunit.client.0.smithi063.stdout:9/924: rename c6 to d7/d9/d20/de3/de7/db2/dca/c148 0 2024-09-16T01:25:25.389 INFO:tasks.workunit.client.0.smithi063.stdout:0/946: dwrite d1/d30/d52/d5a/d36/fe9 [0,4194304] 0 2024-09-16T01:25:25.391 INFO:tasks.workunit.client.0.smithi063.stdout:4/917: link d5/d3b/d57/d66/fe2 d5/d3b/d57/d66/d123/f132 0 2024-09-16T01:25:25.393 INFO:tasks.workunit.client.0.smithi063.stdout:8/749: creat d5/db/d12/d1a/d60/ff1 x:0 0 0 2024-09-16T01:25:25.394 INFO:tasks.workunit.client.0.smithi063.stdout:6/925: mkdir d3/d48/d28/d3e/d44/d8c/d148 0 2024-09-16T01:25:25.395 INFO:tasks.workunit.client.0.smithi063.stdout:4/918: fsync d5/d3b/df/d1c/fdc 0 2024-09-16T01:25:25.395 INFO:tasks.workunit.client.0.smithi063.stdout:2/991: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/f104 [248976,122423] 0 2024-09-16T01:25:25.396 INFO:tasks.workunit.client.0.smithi063.stdout:8/750: chown d5/d8c/d74/d87 5475 1 2024-09-16T01:25:25.396 INFO:tasks.workunit.client.0.smithi063.stdout:9/925: rename d7/d4a/f53 to d7/d116/d129/f149 0 2024-09-16T01:25:25.399 INFO:tasks.workunit.client.0.smithi063.stdout:9/926: stat d7/d9/d20/de3/de7/d14/d23/d109 0 2024-09-16T01:25:25.401 INFO:tasks.workunit.client.0.smithi063.stdout:0/947: truncate d1/d30/d52/d5a/d36/d41/f4d 69473 0 2024-09-16T01:25:25.402 INFO:tasks.workunit.client.0.smithi063.stdout:2/992: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/f63 [1850565,100581] 0 2024-09-16T01:25:25.404 INFO:tasks.workunit.client.0.smithi063.stdout:0/948: mkdir d1/d30/dff/d15d 0 2024-09-16T01:25:25.405 INFO:tasks.workunit.client.0.smithi063.stdout:2/993: fsync d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/f3e 0 2024-09-16T01:25:25.405 INFO:tasks.workunit.client.0.smithi063.stdout:9/927: fsync d7/d9/d20/de3/de7/f5d 0 2024-09-16T01:25:25.408 INFO:tasks.workunit.client.0.smithi063.stdout:0/949: write d1/d2e/d48/dcb/f124 [246284,18724] 0 2024-09-16T01:25:25.411 INFO:tasks.workunit.client.0.smithi063.stdout:8/751: getdents d5/db/d12/d3d/d69/daa/d40/d4a 0 2024-09-16T01:25:25.411 INFO:tasks.workunit.client.0.smithi063.stdout:9/928: symlink d7/d4a/l14a 0 2024-09-16T01:25:25.412 INFO:tasks.workunit.client.0.smithi063.stdout:1/933: dread d1/d5/d82/d9b/fa3 [0,4194304] 0 2024-09-16T01:25:25.414 INFO:tasks.workunit.client.0.smithi063.stdout:0/950: write d1/d2e/d48/faf [23483,57765] 0 2024-09-16T01:25:25.414 INFO:tasks.workunit.client.0.smithi063.stdout:4/919: dwrite d5/d3b/d57/d68/f85 [0,4194304] 0 2024-09-16T01:25:25.417 INFO:tasks.workunit.client.0.smithi063.stdout:1/934: rmdir d1/dd/d3b/dbe/d10d 39 2024-09-16T01:25:25.419 INFO:tasks.workunit.client.0.smithi063.stdout:9/929: symlink d7/d9/d20/de3/de7/db2/dc6/ddb/l14b 0 2024-09-16T01:25:25.419 INFO:tasks.workunit.client.0.smithi063.stdout:2/994: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/f74 [859288,1221] 0 2024-09-16T01:25:25.419 INFO:tasks.workunit.client.0.smithi063.stdout:8/752: write d5/db/d12/d1a/fa6 [242949,102543] 0 2024-09-16T01:25:25.421 INFO:tasks.workunit.client.0.smithi063.stdout:4/920: rmdir d5/d3b/df/d1c/d29/d20/d98 39 2024-09-16T01:25:25.423 INFO:tasks.workunit.client.0.smithi063.stdout:1/935: mknod d1/d5/d82/d9b/d77/d7d/dc2/dad/c13a 0 2024-09-16T01:25:25.424 INFO:tasks.workunit.client.0.smithi063.stdout:0/951: truncate d1/df/d2c/d43/fa0 3018955 0 2024-09-16T01:25:25.426 INFO:tasks.workunit.client.0.smithi063.stdout:8/753: mkdir d5/db/df2 0 2024-09-16T01:25:25.427 INFO:tasks.workunit.client.0.smithi063.stdout:4/921: symlink d5/d3b/d57/l133 0 2024-09-16T01:25:25.429 INFO:tasks.workunit.client.0.smithi063.stdout:9/930: dread d7/d9/d20/de3/de7/d14/d63/d5f/fa7 [0,4194304] 0 2024-09-16T01:25:25.430 INFO:tasks.workunit.client.0.smithi063.stdout:8/754: truncate d5/f83 1618126 0 2024-09-16T01:25:25.430 INFO:tasks.workunit.client.0.smithi063.stdout:7/832: sync 2024-09-16T01:25:25.431 INFO:tasks.workunit.client.0.smithi063.stdout:8/755: readlink d5/db/d12/lcf 0 2024-09-16T01:25:25.433 INFO:tasks.workunit.client.0.smithi063.stdout:0/952: rename d1/d30/l13a to d1/l15e 0 2024-09-16T01:25:25.433 INFO:tasks.workunit.client.0.smithi063.stdout:7/833: write d7/d1c/d1f/d29/dbf/d39/d9d/fda [1837633,49034] 0 2024-09-16T01:25:25.435 INFO:tasks.workunit.client.0.smithi063.stdout:2/995: truncate d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f/da7/f101 218670 0 2024-09-16T01:25:25.437 INFO:tasks.workunit.client.0.smithi063.stdout:7/834: write d7/d56/d57/d73/f75 [399659,85983] 0 2024-09-16T01:25:25.438 INFO:tasks.workunit.client.0.smithi063.stdout:2/996: readlink d3/lb9 0 2024-09-16T01:25:25.439 INFO:tasks.workunit.client.0.smithi063.stdout:1/936: rename d1/dd/c48 to d1/d5/d15/d1b/d12f/c13b 0 2024-09-16T01:25:25.440 INFO:tasks.workunit.client.0.smithi063.stdout:8/756: link d5/db/d12/d3d/d69/daa/f9b d5/db/d12/d1a/d1e/d93/db8/ff3 0 2024-09-16T01:25:25.441 INFO:tasks.workunit.client.0.smithi063.stdout:7/835: chown d7/d1c/d1f/d29/d72/c7a 3444134 1 2024-09-16T01:25:25.442 INFO:tasks.workunit.client.0.smithi063.stdout:9/931: truncate d7/d9/d20/de3/de7/d14/d23/fcf 2477746 0 2024-09-16T01:25:25.442 INFO:tasks.workunit.client.0.smithi063.stdout:9/932: dread - d7/d9/d20/de3/de7/d14/d63/f145 zero size 2024-09-16T01:25:25.443 INFO:tasks.workunit.client.0.smithi063.stdout:4/922: rename d5/d3b/d57/d66/db7/cc0 to d5/d3b/df/d1c/d29/d20/d30/df9/c134 0 2024-09-16T01:25:25.443 INFO:tasks.workunit.client.0.smithi063.stdout:9/933: chown d7/d4a/fbf 4373 1 2024-09-16T01:25:25.444 INFO:tasks.workunit.client.0.smithi063.stdout:8/757: unlink d5/db/d12/d1a/l4c 0 2024-09-16T01:25:25.445 INFO:tasks.workunit.client.0.smithi063.stdout:9/934: read - d7/d9/d20/de3/de7/db2/f115 zero size 2024-09-16T01:25:25.446 INFO:tasks.workunit.client.0.smithi063.stdout:4/923: creat d5/d3b/d57/d66/db7/f135 x:0 0 0 2024-09-16T01:25:25.446 INFO:tasks.workunit.client.0.smithi063.stdout:0/953: write d1/d30/d95/fc5 [2755196,68900] 0 2024-09-16T01:25:25.448 INFO:tasks.workunit.client.0.smithi063.stdout:8/758: unlink d5/d8c/dbd/fdb 0 2024-09-16T01:25:25.451 INFO:tasks.workunit.client.0.smithi063.stdout:4/924: mknod d5/d3b/c136 0 2024-09-16T01:25:25.453 INFO:tasks.workunit.client.0.smithi063.stdout:2/997: rename d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d37/d4f to d3/d7/d8/d19/d126/d14f 0 2024-09-16T01:25:25.454 INFO:tasks.workunit.client.0.smithi063.stdout:8/759: dwrite d5/db/d12/f57 [0,4194304] 0 2024-09-16T01:25:25.458 INFO:tasks.workunit.client.0.smithi063.stdout:9/935: creat d7/d9/d20/de3/de7/d14/f14c x:0 0 0 2024-09-16T01:25:25.459 INFO:tasks.workunit.client.0.smithi063.stdout:0/954: rename d1/d30/d95/c135 to d1/d30/dff/c15f 0 2024-09-16T01:25:25.461 INFO:tasks.workunit.client.0.smithi063.stdout:8/760: rmdir d5/d9/d2f 39 2024-09-16T01:25:25.462 INFO:tasks.workunit.client.0.smithi063.stdout:2/998: write d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d4e/d105/d34/f104 [1030981,77518] 0 2024-09-16T01:25:25.464 INFO:tasks.workunit.client.0.smithi063.stdout:4/925: creat d5/d3b/df/d1c/d29/d32/f137 x:0 0 0 2024-09-16T01:25:25.464 INFO:tasks.workunit.client.0.smithi063.stdout:7/836: dwrite d7/f5e [0,4194304] 0 2024-09-16T01:25:25.464 INFO:tasks.workunit.client.0.smithi063.stdout:0/955: dread - d1/df/d34/da6/f143 zero size 2024-09-16T01:25:25.465 INFO:tasks.workunit.client.0.smithi063.stdout:9/936: fdatasync d7/d9/d20/de3/de7/db2/dc6/ddb/fff 0 2024-09-16T01:25:25.465 INFO:tasks.workunit.client.0.smithi063.stdout:8/761: dread - d5/db/d12/d3d/fba zero size 2024-09-16T01:25:25.468 INFO:tasks.workunit.client.0.smithi063.stdout:4/926: chown d5/d3b/df/d1c/d29/d32/d60/d10b/df8 132683418 1 2024-09-16T01:25:25.469 INFO:tasks.workunit.client.0.smithi063.stdout:2/999: symlink d3/d7/d8/d19/d8c/d21/d9c/dd4/d122/d8a/db7/l150 0 2024-09-16T01:25:25.470 INFO:tasks.workunit.client.0.smithi063.stdout:8/762: symlink d5/d8c/d74/d87/lf4 0 2024-09-16T01:25:25.472 INFO:tasks.workunit.client.0.smithi063.stdout:4/927: mknod d5/d3b/d57/d68/dc5/c138 0 2024-09-16T01:25:25.473 INFO:tasks.workunit.client.0.smithi063.stdout:0/956: dread d1/fb4 [0,4194304] 0 2024-09-16T01:25:25.474 INFO:tasks.workunit.client.0.smithi063.stdout:7/837: link d7/d56/d57/d60/f61 d7/d56/d57/d60/db9/f10c 0 2024-09-16T01:25:25.476 INFO:tasks.workunit.client.0.smithi063.stdout:8/763: unlink d5/db/f2a 0 2024-09-16T01:25:25.479 INFO:tasks.workunit.client.0.smithi063.stdout:7/838: mknod d7/d1c/d1f/d29/dbf/d40/dad/c10d 0 2024-09-16T01:25:25.479 INFO:tasks.workunit.client.0.smithi063.stdout:9/937: getdents d7/d9/d20/de3/de7/d14/d63/d5f/dab 0 2024-09-16T01:25:25.480 INFO:tasks.workunit.client.0.smithi063.stdout:7/839: stat f5 0 2024-09-16T01:25:25.482 INFO:tasks.workunit.client.0.smithi063.stdout:7/840: fsync d7/d1c/dd2/fd3 0 2024-09-16T01:25:25.482 INFO:tasks.workunit.client.0.smithi063.stdout:0/957: dwrite d1/df/d34/f45 [0,4194304] 0 2024-09-16T01:25:25.486 INFO:tasks.workunit.client.0.smithi063.stdout:8/764: link d5/d9/f7b d5/d8c/d74/db7/ff5 0 2024-09-16T01:25:25.489 INFO:tasks.workunit.client.0.smithi063.stdout:8/765: chown d5/db/d12/d1a/d60/le6 11 1 2024-09-16T01:25:25.489 INFO:tasks.workunit.client.0.smithi063.stdout:0/958: symlink d1/d1c/l160 0 2024-09-16T01:25:25.490 INFO:tasks.workunit.client.0.smithi063.stdout:7/841: dwrite d7/d1c/d1f/d29/d88/fd7 [0,4194304] 0 2024-09-16T01:25:25.492 INFO:tasks.workunit.client.0.smithi063.stdout:8/766: creat d5/db/df2/ff6 x:0 0 0 2024-09-16T01:25:25.494 INFO:tasks.workunit.client.0.smithi063.stdout:8/767: dread - d5/db/d12/d1a/fe2 zero size 2024-09-16T01:25:25.498 INFO:tasks.workunit.client.0.smithi063.stdout:0/959: symlink d1/d30/d52/d9d/dcf/d14a/l161 0 2024-09-16T01:25:25.500 INFO:tasks.workunit.client.0.smithi063.stdout:9/938: dread d7/d9/d20/de3/de7/d14/f35 [0,4194304] 0 2024-09-16T01:25:25.501 INFO:tasks.workunit.client.0.smithi063.stdout:0/960: mknod d1/d30/d52/d9d/c162 0 2024-09-16T01:25:25.503 INFO:tasks.workunit.client.0.smithi063.stdout:9/939: mkdir d7/d9/d20/de3/de7/db2/dca/d14d 0 2024-09-16T01:25:25.504 INFO:tasks.workunit.client.0.smithi063.stdout:0/961: mkdir d1/d30/d52/d5a/d163 0 2024-09-16T01:25:25.508 INFO:tasks.workunit.client.0.smithi063.stdout:9/940: creat d7/f14e x:0 0 0 2024-09-16T01:25:25.508 INFO:tasks.workunit.client.0.smithi063.stdout:7/842: dwrite d7/d1c/d1f/d29/f52 [0,4194304] 0 2024-09-16T01:25:25.509 INFO:tasks.workunit.client.0.smithi063.stdout:8/768: dread d5/db/d12/d1a/d1e/f32 [0,4194304] 0 2024-09-16T01:25:25.512 INFO:tasks.workunit.client.0.smithi063.stdout:0/962: rename d1/d30/d52/d5a/d36/l7d to d1/d30/d52/d5a/d44/dbc/l164 0 2024-09-16T01:25:25.512 INFO:tasks.workunit.client.0.smithi063.stdout:9/941: rmdir d7/d4a/dba 39 2024-09-16T01:25:25.513 INFO:tasks.workunit.client.0.smithi063.stdout:7/843: creat d7/d56/d57/d60/db9/de0/f10e x:0 0 0 2024-09-16T01:25:25.513 INFO:tasks.workunit.client.0.smithi063.stdout:0/963: mkdir d1/df/d2c/d43/d165 0 2024-09-16T01:25:25.514 INFO:tasks.workunit.client.0.smithi063.stdout:7/844: fsync d7/d56/d6b/d86/fb3 0 2024-09-16T01:25:25.514 INFO:tasks.workunit.client.0.smithi063.stdout:8/769: rmdir d5/db/d12/d3d 39 2024-09-16T01:25:25.516 INFO:tasks.workunit.client.0.smithi063.stdout:7/845: chown d7/d56/d57/d73/d91/db4/lc4 187120396 1 2024-09-16T01:25:25.516 INFO:tasks.workunit.client.0.smithi063.stdout:8/770: mknod d5/db/d12/d1a/d60/cf7 0 2024-09-16T01:25:25.518 INFO:tasks.workunit.client.0.smithi063.stdout:8/771: write d5/db/d12/fa7 [533152,126453] 0 2024-09-16T01:25:25.519 INFO:tasks.workunit.client.0.smithi063.stdout:9/942: dread d7/f81 [0,4194304] 0 2024-09-16T01:25:25.521 INFO:tasks.workunit.client.0.smithi063.stdout:8/772: fdatasync d5/f10 0 2024-09-16T01:25:25.524 INFO:tasks.workunit.client.0.smithi063.stdout:9/943: mknod d7/d9/d20/de3/de7/d14/d23/c14f 0 2024-09-16T01:25:25.525 INFO:tasks.workunit.client.0.smithi063.stdout:7/846: dwrite d7/d1c/d1f/f4d [0,4194304] 0 2024-09-16T01:25:25.527 INFO:tasks.workunit.client.0.smithi063.stdout:9/944: chown d7/l8 235120 1 2024-09-16T01:25:25.527 INFO:tasks.workunit.client.0.smithi063.stdout:0/964: dwrite d1/d1c/f4b [0,4194304] 0 2024-09-16T01:25:25.530 INFO:tasks.workunit.client.0.smithi063.stdout:9/945: creat d7/d9/d20/de3/f150 x:0 0 0 2024-09-16T01:25:25.531 INFO:tasks.workunit.client.0.smithi063.stdout:9/946: fdatasync d7/d116/d129/d13f/f147 0 2024-09-16T01:25:25.532 INFO:tasks.workunit.client.0.smithi063.stdout:0/965: rename d1/d30/d52/d5a/d36/fb2 to d1/df/d34/da6/f166 0 2024-09-16T01:25:25.533 INFO:tasks.workunit.client.0.smithi063.stdout:0/966: read - d1/df/d2c/d43/d90/f125 zero size 2024-09-16T01:25:25.534 INFO:tasks.workunit.client.0.smithi063.stdout:0/967: stat d1/d2e/d48/dcb 0 2024-09-16T01:25:25.539 INFO:tasks.workunit.client.0.smithi063.stdout:0/968: unlink d1/d30/d52/d5a/d44/f159 0 2024-09-16T01:25:25.539 INFO:tasks.workunit.client.0.smithi063.stdout:7/847: dread d7/f14 [0,4194304] 0 2024-09-16T01:25:25.545 INFO:tasks.workunit.client.0.smithi063.stdout:9/947: dwrite d7/d4a/f93 [0,4194304] 0 2024-09-16T01:25:25.546 INFO:tasks.workunit.client.0.smithi063.stdout:0/969: dread d1/df/d2c/f117 [0,4194304] 0 2024-09-16T01:25:25.548 INFO:tasks.workunit.client.0.smithi063.stdout:7/848: link d7/d1c/d1f/d29/dbf/d40/d6c/fbd d7/d56/d57/d60/db9/de0/f10f 0 2024-09-16T01:25:25.549 INFO:tasks.workunit.client.0.smithi063.stdout:0/970: chown d1/df/d2c/db6/c10a 1057 1 2024-09-16T01:25:25.549 INFO:tasks.workunit.client.0.smithi063.stdout:9/948: chown d7/d9/d20/de3/de7/d14/d34/f84 181747 1 2024-09-16T01:25:25.549 INFO:tasks.workunit.client.0.smithi063.stdout:0/971: dread - d1/f140 zero size 2024-09-16T01:25:25.551 INFO:tasks.workunit.client.0.smithi063.stdout:0/972: truncate d1/f14e 168164 0 2024-09-16T01:25:25.552 INFO:tasks.workunit.client.0.smithi063.stdout:9/949: symlink d7/d9/l151 0 2024-09-16T01:25:25.553 INFO:tasks.workunit.client.0.smithi063.stdout:0/973: creat d1/df/d12a/f167 x:0 0 0 2024-09-16T01:25:25.555 INFO:tasks.workunit.client.0.smithi063.stdout:7/849: link d7/d1c/d1f/d29/dbf/f1b d7/d1c/d1f/d29/dbf/d39/dfc/f110 0 2024-09-16T01:25:25.555 INFO:tasks.workunit.client.0.smithi063.stdout:9/950: write d7/d4a/dba/fee [639505,36280] 0 2024-09-16T01:25:25.556 INFO:tasks.workunit.client.0.smithi063.stdout:9/951: write d7/d9/d20/de3/ff3 [1116546,111357] 0 2024-09-16T01:25:25.557 INFO:tasks.workunit.client.0.smithi063.stdout:7/850: fdatasync d7/f3e 0 2024-09-16T01:25:25.560 INFO:tasks.workunit.client.0.smithi063.stdout:9/952: write d7/d116/d129/d13f/f147 [311355,30547] 0 2024-09-16T01:25:25.561 INFO:tasks.workunit.client.0.smithi063.stdout:9/953: stat d7/d4a/f93 0 2024-09-16T01:25:25.562 INFO:tasks.workunit.client.0.smithi063.stdout:0/974: dwrite d1/df/d34/da6/f143 [0,4194304] 0 2024-09-16T01:25:25.563 INFO:tasks.workunit.client.0.smithi063.stdout:0/975: chown d1/df/d12a/l14c 3513213 1 2024-09-16T01:25:25.563 INFO:tasks.workunit.client.0.smithi063.stdout:9/954: chown d7/d9/d20/de3/de7/d14/d23 1933962746 1 2024-09-16T01:25:25.563 INFO:tasks.workunit.client.0.smithi063.stdout:7/851: rename d7/f3e to d7/d1c/d1f/df5/f111 0 2024-09-16T01:25:25.564 INFO:tasks.workunit.client.0.smithi063.stdout:7/852: stat d7/dd6 0 2024-09-16T01:25:25.564 INFO:tasks.workunit.client.0.smithi063.stdout:0/976: chown d1/d2e/d48/dc3/f127 21 1 2024-09-16T01:25:25.565 INFO:tasks.workunit.client.0.smithi063.stdout:7/853: write d7/d56/f55 [4661817,5257] 0 2024-09-16T01:25:25.566 INFO:tasks.workunit.client.0.smithi063.stdout:0/977: fsync d1/d2e/d48/f98 0 2024-09-16T01:25:25.567 INFO:tasks.workunit.client.0.smithi063.stdout:0/978: write d1/d30/d52/fa3 [1860281,61751] 0 2024-09-16T01:25:25.570 INFO:tasks.workunit.client.0.smithi063.stdout:9/955: link d7/d9/f74 d7/d9/d20/de3/de7/d14/d63/d5f/dab/dd1/f152 0 2024-09-16T01:25:25.571 INFO:tasks.workunit.client.0.smithi063.stdout:7/854: dread d7/d1c/d1f/d29/d88/fd7 [0,4194304] 0 2024-09-16T01:25:25.574 INFO:tasks.workunit.client.0.smithi063.stdout:7/855: mkdir d7/d1c/d1f/d29/d88/d96/dca/d112 0 2024-09-16T01:25:25.575 INFO:tasks.workunit.client.0.smithi063.stdout:9/956: mkdir d7/d9/d20/de3/de7/db2/dca/d121/d153 0 2024-09-16T01:25:25.575 INFO:tasks.workunit.client.0.smithi063.stdout:0/979: dwrite d1/fb4 [0,4194304] 0 2024-09-16T01:25:25.578 INFO:tasks.workunit.client.0.smithi063.stdout:0/980: symlink d1/d30/d52/d9d/dcf/d14a/l168 0 2024-09-16T01:25:25.581 INFO:tasks.workunit.client.0.smithi063.stdout:0/981: creat d1/d30/d52/d5a/d163/f169 x:0 0 0 2024-09-16T01:25:25.582 INFO:tasks.workunit.client.0.smithi063.stdout:0/982: dread - d1/d2e/d50/fd4 zero size 2024-09-16T01:25:25.583 INFO:tasks.workunit.client.0.smithi063.stdout:0/983: stat d1/d30/d52/f13d 0 2024-09-16T01:25:25.584 INFO:tasks.workunit.client.0.smithi063.stdout:7/856: dread d7/d56/d57/f5c [0,4194304] 0 2024-09-16T01:25:25.586 INFO:tasks.workunit.client.0.smithi063.stdout:9/957: rename d7/d9/d20/de3/de7/d14/d63/d5f/dab to d7/d116/d129/df1/d154 0 2024-09-16T01:25:25.598 INFO:tasks.workunit.client.0.smithi063.stdout:7/857: dread d7/d56/f31 [0,4194304] 0 2024-09-16T01:25:25.603 INFO:tasks.workunit.client.0.smithi063.stdout:9/958: dread d7/d9/d20/de3/de7/db2/f94 [4194304,4194304] 0 2024-09-16T01:25:25.605 INFO:tasks.workunit.client.0.smithi063.stdout:7/858: truncate d7/d56/d57/d73/fdb 3031294 0 2024-09-16T01:25:25.606 INFO:tasks.workunit.client.0.smithi063.stdout:9/959: creat d7/d9/d143/f155 x:0 0 0 2024-09-16T01:25:25.609 INFO:tasks.workunit.client.0.smithi063.stdout:7/859: dwrite d7/f9 [4194304,4194304] 0 2024-09-16T01:25:25.611 INFO:tasks.workunit.client.0.smithi063.stdout:9/960: rename d7/d9/d20/de3/de7/d14/d63/c112 to d7/d4a/dba/c156 0 2024-09-16T01:25:25.611 INFO:tasks.workunit.client.0.smithi063.stdout:7/860: symlink d7/d56/d57/d60/db9/dd8/l113 0 2024-09-16T01:25:25.612 INFO:tasks.workunit.client.0.smithi063.stdout:9/961: creat d7/d116/f157 x:0 0 0 2024-09-16T01:25:25.613 INFO:tasks.workunit.client.0.smithi063.stdout:7/861: write d7/d56/f55 [4433635,129427] 0 2024-09-16T01:25:25.615 INFO:tasks.workunit.client.0.smithi063.stdout:7/862: mkdir d7/d56/d6b/d86/d114 0 2024-09-16T01:25:25.616 INFO:tasks.workunit.client.0.smithi063.stdout:7/863: dread - d7/d1c/d1f/d66/ffe zero size 2024-09-16T01:25:25.617 INFO:tasks.workunit.client.0.smithi063.stdout:9/962: getdents d7/d4a/d4d/d96 0 2024-09-16T01:25:25.618 INFO:tasks.workunit.client.0.smithi063.stdout:7/864: read d7/fe [19561,113663] 0 2024-09-16T01:25:25.619 INFO:tasks.workunit.client.0.smithi063.stdout:7/865: readlink d7/d1c/d1f/d29/dbf/l35 0 2024-09-16T01:25:25.620 INFO:tasks.workunit.client.0.smithi063.stdout:7/866: dread d7/d1c/d1f/df5/f111 [0,4194304] 0 2024-09-16T01:25:25.628 INFO:tasks.workunit.client.0.smithi063.stdout:7/867: write d7/d56/d6b/d86/f5f [96191,109668] 0 2024-09-16T01:25:25.631 INFO:tasks.workunit.client.0.smithi063.stdout:7/868: creat d7/d1c/d1f/d29/dbf/d39/d9d/f115 x:0 0 0 2024-09-16T01:25:25.632 INFO:tasks.workunit.client.0.smithi063.stdout:9/963: dread d7/d9/d20/de3/de7/db2/f90 [0,4194304] 0 2024-09-16T01:25:25.637 INFO:tasks.workunit.client.0.smithi063.stdout:7/869: dwrite d7/d56/d57/d73/fcf [0,4194304] 0 2024-09-16T01:25:25.638 INFO:tasks.workunit.client.0.smithi063.stdout:7/870: stat d7/d56/d57/d60/db9 0 2024-09-16T01:25:25.638 INFO:tasks.workunit.client.0.smithi063.stdout:9/964: getdents d7/d9/d20/de3/de7/db2/dc6 0 2024-09-16T01:25:25.641 INFO:tasks.workunit.client.0.smithi063.stdout:9/965: write d7/d9/d20/de3/de7/d14/f29 [3220814,126865] 0 2024-09-16T01:25:25.642 INFO:tasks.workunit.client.0.smithi063.stdout:9/966: chown d7/d4a/dba/d7f 27083 1 2024-09-16T01:25:25.644 INFO:tasks.workunit.client.0.smithi063.stdout:7/871: dread d7/d56/d57/d60/f61 [0,4194304] 0 2024-09-16T01:25:25.645 INFO:tasks.workunit.client.0.smithi063.stdout:9/967: mknod d7/d4a/c158 0 2024-09-16T01:25:25.647 INFO:tasks.workunit.client.0.smithi063.stdout:9/968: creat d7/d116/d129/df1/f159 x:0 0 0 2024-09-16T01:25:25.652 INFO:tasks.workunit.client.0.smithi063.stdout:7/872: dwrite d7/d1c/d1f/f28 [4194304,4194304] 0 2024-09-16T01:25:25.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/873: mknod d7/d56/d57/d73/c116 0 2024-09-16T01:25:25.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/874: read - d7/d56/d57/d73/fe1 zero size 2024-09-16T01:25:25.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/875: fsync d7/f48 0 2024-09-16T01:25:25.654 INFO:tasks.workunit.client.0.smithi063.stdout:7/876: read - d7/d1c/d1f/d66/ffe zero size 2024-09-16T01:25:25.656 INFO:tasks.workunit.client.0.smithi063.stdout:7/877: fsync d7/d56/d57/d73/fcf 0 2024-09-16T01:25:25.656 INFO:tasks.workunit.client.0.smithi063.stdout:9/969: dread d7/d9/d20/de3/de7/d14/d38/fbe [0,4194304] 0 2024-09-16T01:25:25.668 INFO:tasks.workunit.client.0.smithi063.stdout:3/902: sync 2024-09-16T01:25:25.668 INFO:tasks.workunit.client.0.smithi063.stdout:9/970: dread d7/d9/d20/de3/de7/d14/f29 [0,4194304] 0 2024-09-16T01:25:25.669 INFO:tasks.workunit.client.0.smithi063.stdout:9/971: fdatasync d7/d9/d20/de3/de7/d14/f124 0 2024-09-16T01:25:25.670 INFO:tasks.workunit.client.0.smithi063.stdout:3/903: creat d2/d5b/d90/f136 x:0 0 0 2024-09-16T01:25:25.672 INFO:tasks.workunit.client.0.smithi063.stdout:9/972: chown d7/d9/d20/de3/de7/d14/d23/fcf 2253798 1 2024-09-16T01:25:25.672 INFO:tasks.workunit.client.0.smithi063.stdout:7/878: dread d7/d1c/d1f/d29/dbf/d40/d6c/f6e [4194304,4194304] 0 2024-09-16T01:25:25.673 INFO:tasks.workunit.client.0.smithi063.stdout:3/904: creat d2/d11/d37/d40/d5e/d3b/d45/d9f/f137 x:0 0 0 2024-09-16T01:25:25.673 INFO:tasks.workunit.client.0.smithi063.stdout:7/879: fdatasync d7/d56/f31 0 2024-09-16T01:25:25.675 INFO:tasks.workunit.client.0.smithi063.stdout:3/905: creat d2/d11/d18/f138 x:0 0 0 2024-09-16T01:25:25.676 INFO:tasks.workunit.client.0.smithi063.stdout:7/880: write d7/d56/d57/d60/db9/f10c [1014827,105347] 0 2024-09-16T01:25:25.691 INFO:tasks.workunit.client.0.smithi063.stdout:7/881: fsync d7/d1c/d1f/d29/dbf/d39/fd9 0 2024-09-16T01:25:25.697 INFO:tasks.workunit.client.0.smithi063.stdout:3/906: dwrite d2/d11/d37/d40/d5e/d3b/d68/d6d/f10c [0,4194304] 0 2024-09-16T01:25:25.698 INFO:tasks.workunit.client.0.smithi063.stdout:3/907: fdatasync d2/d11/d69/dfe/f130 0 2024-09-16T01:25:25.698 INFO:tasks.workunit.client.0.smithi063.stdout:7/882: dread d7/d1c/d1f/d29/dbf/d40/d6c/f6e [4194304,4194304] 0 2024-09-16T01:25:25.699 INFO:tasks.workunit.client.0.smithi063.stdout:9/973: dread d7/d9/ffe [0,4194304] 0 2024-09-16T01:25:25.700 INFO:tasks.workunit.client.0.smithi063.stdout:3/908: rmdir d2/d11/d69/d80/d8a/d8e 39 2024-09-16T01:25:25.703 INFO:tasks.workunit.client.0.smithi063.stdout:3/909: truncate d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/f114 918550 0 2024-09-16T01:25:25.703 INFO:tasks.workunit.client.0.smithi063.stdout:7/883: creat d7/d1c/f117 x:0 0 0 2024-09-16T01:25:25.706 INFO:tasks.workunit.client.0.smithi063.stdout:7/884: mkdir d7/d1c/d1f/d29/db5/d118 0 2024-09-16T01:25:25.706 INFO:tasks.workunit.client.0.smithi063.stdout:9/974: getdents d7/d116/d129/d13f 0 2024-09-16T01:25:25.708 INFO:tasks.workunit.client.0.smithi063.stdout:3/910: rename d2/d11/d37/d40/d5e/d3b/d68/d6d/f103 to d2/d11/d37/d40/d5e/d97/f139 0 2024-09-16T01:25:25.709 INFO:tasks.workunit.client.0.smithi063.stdout:9/975: dread - d7/d4a/d4d/d96/da2/fb5 zero size 2024-09-16T01:25:25.709 INFO:tasks.workunit.client.0.smithi063.stdout:7/885: mknod d7/d1c/d1f/d66/d101/c119 0 2024-09-16T01:25:25.711 INFO:tasks.workunit.client.0.smithi063.stdout:9/976: symlink d7/d9/d20/de3/de7/d14/d38/l15a 0 2024-09-16T01:25:25.712 INFO:tasks.workunit.client.0.smithi063.stdout:7/886: getdents d7/d1c/d1f/d29/d88/d96/dca/d112 0 2024-09-16T01:25:25.714 INFO:tasks.workunit.client.0.smithi063.stdout:3/911: dwrite d2/d11/d37/d40/d5e/d3b/d45/d9f/ff7 [0,4194304] 0 2024-09-16T01:25:25.715 INFO:tasks.workunit.client.0.smithi063.stdout:7/887: unlink d7/d1c/d1f/d66/d70/f108 0 2024-09-16T01:25:25.717 INFO:tasks.workunit.client.0.smithi063.stdout:9/977: link d7/d116/d129/c32 d7/d4a/d4d/c15b 0 2024-09-16T01:25:25.717 INFO:tasks.workunit.client.0.smithi063.stdout:9/978: fsync d7/d116/d129/f78 0 2024-09-16T01:25:25.718 INFO:tasks.workunit.client.0.smithi063.stdout:7/888: creat d7/d56/d6b/d86/d114/f11a x:0 0 0 2024-09-16T01:25:25.729 INFO:tasks.workunit.client.0.smithi063.stdout:7/889: truncate d7/d1c/d1f/d66/f8b 2726327 0 2024-09-16T01:25:25.831 INFO:tasks.workunit.client.0.smithi063.stdout:7/890: mkdir d7/d56/d57/d60/d11b 0 2024-09-16T01:25:25.833 INFO:tasks.workunit.client.0.smithi063.stdout:9/979: dwrite d7/d116/d129/df1/d154/f138 [0,4194304] 0 2024-09-16T01:25:25.835 INFO:tasks.workunit.client.0.smithi063.stdout:9/980: write d7/d4a/f93 [2768412,46159] 0 2024-09-16T01:25:25.838 INFO:tasks.workunit.client.0.smithi063.stdout:9/981: getdents d7/d9/d20/de3/de7/db2/dca/d14d 0 2024-09-16T01:25:25.839 INFO:tasks.workunit.client.0.smithi063.stdout:9/982: read - d7/d9/d20/de3/de7/db2/dca/f13e zero size 2024-09-16T01:25:25.840 INFO:tasks.workunit.client.0.smithi063.stdout:9/983: chown d7/d4a/d4d/d96/fd2 1891043 1 2024-09-16T01:25:25.848 INFO:tasks.workunit.client.0.smithi063.stdout:7/891: dread d7/d1c/d1f/d66/f82 [0,4194304] 0 2024-09-16T01:25:25.849 INFO:tasks.workunit.client.0.smithi063.stdout:7/892: chown d7/d1c/d1f/d29/d72/dc9/c109 1532571151 1 2024-09-16T01:25:25.850 INFO:tasks.workunit.client.0.smithi063.stdout:7/893: write d7/d1c/d1f/d29/dbf/d39/d9d/f100 [986610,43516] 0 2024-09-16T01:25:25.852 INFO:tasks.workunit.client.0.smithi063.stdout:7/894: mkdir d7/d56/d57/d60/db9/de0/deb/d11c 0 2024-09-16T01:25:25.853 INFO:tasks.workunit.client.0.smithi063.stdout:6/926: sync 2024-09-16T01:25:25.853 INFO:tasks.workunit.client.0.smithi063.stdout:4/928: sync 2024-09-16T01:25:25.853 INFO:tasks.workunit.client.0.smithi063.stdout:8/773: sync 2024-09-16T01:25:25.853 INFO:tasks.workunit.client.0.smithi063.stdout:1/937: sync 2024-09-16T01:25:25.853 INFO:tasks.workunit.client.0.smithi063.stdout:0/984: sync 2024-09-16T01:25:25.854 INFO:tasks.workunit.client.0.smithi063.stdout:7/895: mknod d7/d56/d57/d73/d91/db4/c11d 0 2024-09-16T01:25:25.855 INFO:tasks.workunit.client.0.smithi063.stdout:6/927: chown d3/d48/d28/d3e/d44/da4/d5a/d81/d136 48092266 1 2024-09-16T01:25:25.856 INFO:tasks.workunit.client.0.smithi063.stdout:8/774: mknod d5/d8c/d74/d87/cf8 0 2024-09-16T01:25:25.857 INFO:tasks.workunit.client.0.smithi063.stdout:0/985: mknod d1/d1c/c16a 0 2024-09-16T01:25:25.861 INFO:tasks.workunit.client.0.smithi063.stdout:6/928: symlink d3/d41/d105/l149 0 2024-09-16T01:25:25.861 INFO:tasks.workunit.client.0.smithi063.stdout:8/775: truncate d5/db/d12/d1a/fa6 688237 0 2024-09-16T01:25:25.861 INFO:tasks.workunit.client.0.smithi063.stdout:7/896: rename d7/d1c/d1f/d29/d88/cee to d7/d1c/d1f/d29/daf/c11e 0 2024-09-16T01:25:25.861 INFO:tasks.workunit.client.0.smithi063.stdout:6/929: chown d3/d48/d28/d3e/d44/d52/cd9 1343741 1 2024-09-16T01:25:25.861 INFO:tasks.workunit.client.0.smithi063.stdout:1/938: link d1/d5/d82/d9b/d77/d7d/cd9 d1/d5/d6f/dd2/de1/d100/d119/c13c 0 2024-09-16T01:25:25.862 INFO:tasks.workunit.client.0.smithi063.stdout:0/986: link d1/d30/d52/db3/fa1 d1/d2e/d73/f16b 0 2024-09-16T01:25:25.862 INFO:tasks.workunit.client.0.smithi063.stdout:8/776: rmdir d5/d8c 39 2024-09-16T01:25:25.864 INFO:tasks.workunit.client.0.smithi063.stdout:6/930: creat d3/d48/d28/d3e/d44/d144/f14a x:0 0 0 2024-09-16T01:25:25.865 INFO:tasks.workunit.client.0.smithi063.stdout:8/777: write d5/d9/d98/fa4 [3064158,108868] 0 2024-09-16T01:25:25.865 INFO:tasks.workunit.client.0.smithi063.stdout:1/939: creat d1/d5/f13d x:0 0 0 2024-09-16T01:25:25.867 INFO:tasks.workunit.client.0.smithi063.stdout:4/929: dwrite d5/f6 [0,4194304] 0 2024-09-16T01:25:25.869 INFO:tasks.workunit.client.0.smithi063.stdout:6/931: symlink d3/d48/d28/d113/l14b 0 2024-09-16T01:25:25.870 INFO:tasks.workunit.client.0.smithi063.stdout:0/987: creat d1/df/d2c/f16c x:0 0 0 2024-09-16T01:25:25.872 INFO:tasks.workunit.client.0.smithi063.stdout:1/940: write d1/dd/d3b/dbe/d10d/f134 [521199,13672] 0 2024-09-16T01:25:25.872 INFO:tasks.workunit.client.0.smithi063.stdout:8/778: chown d5/db/d12/d3d/c49 3224502 1 2024-09-16T01:25:25.872 INFO:tasks.workunit.client.0.smithi063.stdout:6/932: fdatasync d3/d48/d28/d3e/d68/db4/fce 0 2024-09-16T01:25:25.875 INFO:tasks.workunit.client.0.smithi063.stdout:6/933: dread - d3/d30/d39/dac/db5/f119 zero size 2024-09-16T01:25:25.880 INFO:tasks.workunit.client.0.smithi063.stdout:7/897: dread f5 [0,4194304] 0 2024-09-16T01:25:25.881 INFO:tasks.workunit.client.0.smithi063.stdout:6/934: creat d3/d10/d124/f14c x:0 0 0 2024-09-16T01:25:25.885 INFO:tasks.workunit.client.0.smithi063.stdout:6/935: stat d3/d48/d28/d3e/d68/l6c 0 2024-09-16T01:25:25.885 INFO:tasks.workunit.client.0.smithi063.stdout:0/988: dwrite d1/d30/faa [0,4194304] 0 2024-09-16T01:25:25.885 INFO:tasks.workunit.client.0.smithi063.stdout:4/930: dwrite d5/d3b/df/d1c/d29/d20/d98/dcc/fd9 [0,4194304] 0 2024-09-16T01:25:25.886 INFO:tasks.workunit.client.0.smithi063.stdout:6/936: fsync d3/d48/d28/f2e 0 2024-09-16T01:25:25.888 INFO:tasks.workunit.client.0.smithi063.stdout:6/937: readlink d3/d30/d39/d69/l80 0 2024-09-16T01:25:25.889 INFO:tasks.workunit.client.0.smithi063.stdout:6/938: chown d3/d30/ca3 225180194 1 2024-09-16T01:25:25.890 INFO:tasks.workunit.client.0.smithi063.stdout:4/931: creat d5/d3b/d57/d66/f139 x:0 0 0 2024-09-16T01:25:25.890 INFO:tasks.workunit.client.0.smithi063.stdout:7/898: truncate d7/f9 7302085 0 2024-09-16T01:25:25.892 INFO:tasks.workunit.client.0.smithi063.stdout:1/941: dread d1/d5/d15/d18/f101 [0,4194304] 0 2024-09-16T01:25:25.893 INFO:tasks.workunit.client.0.smithi063.stdout:7/899: readlink d7/la 0 2024-09-16T01:25:25.894 INFO:tasks.workunit.client.0.smithi063.stdout:6/939: write d3/d48/d28/d3e/d68/fd5 [1350019,51411] 0 2024-09-16T01:25:25.894 INFO:tasks.workunit.client.0.smithi063.stdout:0/989: dwrite d1/d1c/f2d [0,4194304] 0 2024-09-16T01:25:25.895 INFO:tasks.workunit.client.0.smithi063.stdout:4/932: write d5/d3b/d57/d66/d9b/d7a/feb [4540892,117003] 0 2024-09-16T01:25:25.899 INFO:tasks.workunit.client.0.smithi063.stdout:0/990: mknod d1/d30/d52/d9d/deb/c16d 0 2024-09-16T01:25:25.900 INFO:tasks.workunit.client.0.smithi063.stdout:1/942: rename d1/d5/d82/d9b/d77/d7d/da5 to d1/d5/d82/d9b/d13e 0 2024-09-16T01:25:25.903 INFO:tasks.workunit.client.0.smithi063.stdout:1/943: unlink d1/d5/d82/d9b/d77/d7d/dda/df6/d120/c12d 0 2024-09-16T01:25:25.906 INFO:tasks.workunit.client.0.smithi063.stdout:6/940: rename d3/d10/d49/f5c to d3/d48/d28/d113/d137/f14d 0 2024-09-16T01:25:25.908 INFO:tasks.workunit.client.0.smithi063.stdout:6/941: write d3/d41/d105/f106 [444458,58028] 0 2024-09-16T01:25:25.908 INFO:tasks.workunit.client.0.smithi063.stdout:7/900: link d7/d1c/d1f/f32 d7/d56/d57/d73/d91/db4/f11f 0 2024-09-16T01:25:25.909 INFO:tasks.workunit.client.0.smithi063.stdout:0/991: rename d1/d2e/f96 to d1/d2e/d48/dc3/f16e 0 2024-09-16T01:25:25.911 INFO:tasks.workunit.client.0.smithi063.stdout:6/942: chown d3/c7 66157 1 2024-09-16T01:25:25.913 INFO:tasks.workunit.client.0.smithi063.stdout:7/901: creat d7/d56/f120 x:0 0 0 2024-09-16T01:25:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:4/933: getdents d5/d3b 0 2024-09-16T01:25:25.915 INFO:tasks.workunit.client.0.smithi063.stdout:1/944: truncate d1/d5/d82/d9b/f79 2190525 0 2024-09-16T01:25:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:1/945: write d1/fe5 [1078394,25218] 0 2024-09-16T01:25:25.918 INFO:tasks.workunit.client.0.smithi063.stdout:4/934: rmdir d5/d3b/d57/d66/db7 39 2024-09-16T01:25:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:6/943: dwrite d3/d10/d49/f10a [0,4194304] 0 2024-09-16T01:25:25.920 INFO:tasks.workunit.client.0.smithi063.stdout:0/992: getdents d1/df/d2c/db6/d14d 0 2024-09-16T01:25:25.921 INFO:tasks.workunit.client.0.smithi063.stdout:0/993: dread - d1/d30/d52/d5a/d44/fae zero size 2024-09-16T01:25:25.922 INFO:tasks.workunit.client.0.smithi063.stdout:7/902: rename d7/d56/d57/d60/db9/de0/fe4 to d7/d1c/d1f/d29/db5/f121 0 2024-09-16T01:25:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:1/946: fsync d1/d5/d82/d9b/f9e 0 2024-09-16T01:25:25.924 INFO:tasks.workunit.client.0.smithi063.stdout:6/944: truncate d3/d30/d39/d69/d95/db0/f13a 27354 0 2024-09-16T01:25:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:4/935: dread - d5/d3b/d57/d66/db7/f135 zero size 2024-09-16T01:25:25.926 INFO:tasks.workunit.client.0.smithi063.stdout:6/945: fdatasync d3/d48/d28/d113/f128 0 2024-09-16T01:25:25.930 INFO:tasks.workunit.client.0.smithi063.stdout:0/994: getdents d1/d2e/d48/dcb 0 2024-09-16T01:25:25.931 INFO:tasks.workunit.client.0.smithi063.stdout:6/946: read d3/d48/d28/d3e/d44/da4/d5a/d6b/fd4 [388321,10500] 0 2024-09-16T01:25:25.934 INFO:tasks.workunit.client.0.smithi063.stdout:1/947: dwrite d1/dd/d3b/fa0 [0,4194304] 0 2024-09-16T01:25:25.939 INFO:tasks.workunit.client.0.smithi063.stdout:1/948: read d1/d5/d15/d18/d4b/fbd [3160310,57894] 0 2024-09-16T01:25:25.940 INFO:tasks.workunit.client.0.smithi063.stdout:6/947: dwrite d3/d41/d89/ffd [0,4194304] 0 2024-09-16T01:25:25.942 INFO:tasks.workunit.client.0.smithi063.stdout:0/995: dread d1/d30/d52/db3/fd8 [0,4194304] 0 2024-09-16T01:25:25.943 INFO:tasks.workunit.client.0.smithi063.stdout:7/903: dread d7/d1c/d1f/d29/dbf/d39/f9f [0,4194304] 0 2024-09-16T01:25:25.945 INFO:tasks.workunit.client.0.smithi063.stdout:6/948: mkdir d3/d48/d28/d3e/d68/db4/d14e 0 2024-09-16T01:25:25.948 INFO:tasks.workunit.client.0.smithi063.stdout:1/949: dread d1/d5/d15/d18/d4b/f5f [4194304,4194304] 0 2024-09-16T01:25:25.950 INFO:tasks.workunit.client.0.smithi063.stdout:6/949: mkdir d3/d30/d8d/d102/d14f 0 2024-09-16T01:25:25.952 INFO:tasks.workunit.client.0.smithi063.stdout:4/936: dread d5/d3b/d57/f79 [0,4194304] 0 2024-09-16T01:25:25.954 INFO:tasks.workunit.client.0.smithi063.stdout:0/996: dwrite d1/f14e [0,4194304] 0 2024-09-16T01:25:25.954 INFO:tasks.workunit.client.0.smithi063.stdout:7/904: dwrite d7/d56/d57/d60/fa5 [0,4194304] 0 2024-09-16T01:25:25.955 INFO:tasks.workunit.client.0.smithi063.stdout:6/950: readlink d3/d48/d28/d3e/d44/da4/d5a/l99 0 2024-09-16T01:25:25.955 INFO:tasks.workunit.client.0.smithi063.stdout:1/950: creat d1/d5/d6f/dd2/de1/d100/f13f x:0 0 0 2024-09-16T01:25:25.958 INFO:tasks.workunit.client.0.smithi063.stdout:7/905: mknod d7/d56/d6b/d86/d114/c122 0 2024-09-16T01:25:25.959 INFO:tasks.workunit.client.0.smithi063.stdout:1/951: symlink d1/d5/d15/d18/d4b/dae/l140 0 2024-09-16T01:25:25.961 INFO:tasks.workunit.client.0.smithi063.stdout:0/997: truncate d1/d2e/d48/dc3/fe4 160992 0 2024-09-16T01:25:25.963 INFO:tasks.workunit.client.0.smithi063.stdout:6/951: link d3/d30/d8d/fd0 d3/d30/f150 0 2024-09-16T01:25:25.965 INFO:tasks.workunit.client.0.smithi063.stdout:0/998: creat d1/d30/d52/d9d/f16f x:0 0 0 2024-09-16T01:25:25.966 INFO:tasks.workunit.client.0.smithi063.stdout:6/952: readlink d3/d48/d28/d3e/d44/da4/d5a/l99 0 2024-09-16T01:25:25.968 INFO:tasks.workunit.client.0.smithi063.stdout:1/952: dwrite d1/dd/d3b/dbe/d10d/f134 [0,4194304] 0 2024-09-16T01:25:25.968 INFO:tasks.workunit.client.0.smithi063.stdout:4/937: read d5/d3b/d57/dce/fda [43611,28655] 0 2024-09-16T01:25:25.969 INFO:tasks.workunit.client.0.smithi063.stdout:3/912: sync 2024-09-16T01:25:25.970 INFO:tasks.workunit.client.0.smithi063.stdout:3/913: fsync d2/d11/d18/f83 0 2024-09-16T01:25:25.972 INFO:tasks.workunit.client.0.smithi063.stdout:4/938: mknod d5/d3b/d5c/c13a 0 2024-09-16T01:25:25.979 INFO:tasks.workunit.client.0.smithi063.stdout:4/939: mkdir d5/d3b/d57/dce/d10d/d13b 0 2024-09-16T01:25:25.979 INFO:tasks.workunit.client.0.smithi063.stdout:1/953: write d1/d5/fac [169446,16950] 0 2024-09-16T01:25:25.983 INFO:tasks.workunit.client.0.smithi063.stdout:0/999: dwrite d1/df/d34/da6/f143 [4194304,4194304] 0 2024-09-16T01:25:25.984 INFO:tasks.workunit.client.0.smithi063.stdout:7/906: dread d7/d1c/d1f/d66/f7f [0,4194304] 0 2024-09-16T01:25:25.984 INFO:tasks.workunit.client.0.smithi063.stdout:6/953: dwrite d3/d48/d28/d3e/d44/da4/f50 [0,4194304] 0 2024-09-16T01:25:25.984 INFO:tasks.workunit.client.0.smithi063.stdout:3/914: rename d2/d11/d37/d40/d5e/d3b/d94/f77 to d2/d11/d69/dfe/f13a 0 2024-09-16T01:25:25.989 INFO:tasks.workunit.client.0.smithi063.stdout:1/954: mknod d1/d5/d15/d18/d4b/dae/c141 0 2024-09-16T01:25:25.990 INFO:tasks.workunit.client.0.smithi063.stdout:6/954: fdatasync d3/d48/d28/d3e/d44/da4/d5a/d6b/fd4 0 2024-09-16T01:25:25.991 INFO:tasks.workunit.client.0.smithi063.stdout:3/915: unlink d2/d11/d18/l43 0 2024-09-16T01:25:25.992 INFO:tasks.workunit.client.0.smithi063.stdout:1/955: read d1/dd/f74 [2750940,5727] 0 2024-09-16T01:25:25.993 INFO:tasks.workunit.client.0.smithi063.stdout:9/984: sync 2024-09-16T01:25:25.993 INFO:tasks.workunit.client.0.smithi063.stdout:8/779: sync 2024-09-16T01:25:25.996 INFO:tasks.workunit.client.0.smithi063.stdout:6/955: rename d3/d41/d89/fcb to d3/d48/d28/d3e/d44/da4/d5a/d81/f151 0 2024-09-16T01:25:25.997 INFO:tasks.workunit.client.0.smithi063.stdout:6/956: chown d3/d30/d39/dac/c143 15826 1 2024-09-16T01:25:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:9/985: dwrite d7/d9/d20/de3/de7/d14/d38/f70 [0,4194304] 0 2024-09-16T01:25:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:8/780: unlink d5/db/d12/d3d/fc6 0 2024-09-16T01:25:26.037 INFO:tasks.workunit.client.0.smithi063.stdout:4/940: write d5/d3b/df/d1c/d29/d20/f23 [548157,104523] 0 2024-09-16T01:25:26.046 INFO:tasks.workunit.client.0.smithi063.stdout:1/956: dwrite d1/d5/d15/d18/d4b/f6e [0,4194304] 0 2024-09-16T01:25:26.047 INFO:tasks.workunit.client.0.smithi063.stdout:6/957: fdatasync d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/f83 0 2024-09-16T01:25:26.049 INFO:tasks.workunit.client.0.smithi063.stdout:8/781: dread d5/db/d12/d1a/fc3 [0,4194304] 0 2024-09-16T01:25:26.049 INFO:tasks.workunit.client.0.smithi063.stdout:9/986: creat d7/d9/d20/de3/de7/db2/dc6/f15c x:0 0 0 2024-09-16T01:25:26.049 INFO:tasks.workunit.client.0.smithi063.stdout:4/941: mknod d5/d3b/df/d1c/d29/d32/d60/df4/c13c 0 2024-09-16T01:25:26.050 INFO:tasks.workunit.client.0.smithi063.stdout:1/957: mknod d1/d5/d15/c142 0 2024-09-16T01:25:26.050 INFO:tasks.workunit.client.0.smithi063.stdout:6/958: dread - d3/d48/d28/d3e/d44/d144/f14a zero size 2024-09-16T01:25:26.051 INFO:tasks.workunit.client.0.smithi063.stdout:7/907: dread d7/d1c/d1f/d29/d72/dc9/fce [0,4194304] 0 2024-09-16T01:25:26.051 INFO:tasks.workunit.client.0.smithi063.stdout:4/942: chown d5/d3b/d57/f7d 27412 1 2024-09-16T01:25:26.051 INFO:tasks.workunit.client.0.smithi063.stdout:1/958: dread - d1/d5/d6f/dd2/f11e zero size 2024-09-16T01:25:26.052 INFO:tasks.workunit.client.0.smithi063.stdout:9/987: creat d7/d4a/d4d/f15d x:0 0 0 2024-09-16T01:25:26.053 INFO:tasks.workunit.client.0.smithi063.stdout:7/908: write d7/d1c/d1f/f4d [2532648,1563] 0 2024-09-16T01:25:26.054 INFO:tasks.workunit.client.0.smithi063.stdout:4/943: write d5/d3b/d57/d68/f85 [971394,115756] 0 2024-09-16T01:25:26.054 INFO:tasks.workunit.client.0.smithi063.stdout:8/782: rename d5/d8c/c73 to d5/d8c/d74/db7/cf9 0 2024-09-16T01:25:26.056 INFO:tasks.workunit.client.0.smithi063.stdout:4/944: stat d5/l10 0 2024-09-16T01:25:26.058 INFO:tasks.workunit.client.0.smithi063.stdout:4/945: write d5/d3b/df/d1c/d29/d32/f137 [37933,526] 0 2024-09-16T01:25:26.058 INFO:tasks.workunit.client.0.smithi063.stdout:1/959: link d1/d5/d6f/d8f/lf3 d1/d5/d15/d18/db6/l143 0 2024-09-16T01:25:26.059 INFO:tasks.workunit.client.0.smithi063.stdout:7/909: mknod d7/d56/d57/d60/df9/c123 0 2024-09-16T01:25:26.060 INFO:tasks.workunit.client.0.smithi063.stdout:8/783: dread d5/d9/f7b [0,4194304] 0 2024-09-16T01:25:26.064 INFO:tasks.workunit.client.0.smithi063.stdout:7/910: write d7/d56/d57/d60/db9/dd8/df1/ff7 [590552,68183] 0 2024-09-16T01:25:26.065 INFO:tasks.workunit.client.0.smithi063.stdout:8/784: symlink d5/db/d12/d1a/d1e/d93/db8/lfa 0 2024-09-16T01:25:26.068 INFO:tasks.workunit.client.0.smithi063.stdout:7/911: mkdir d7/d1c/d1f/d66/d124 0 2024-09-16T01:25:26.069 INFO:tasks.workunit.client.0.smithi063.stdout:1/960: dread d1/d5/f13 [0,4194304] 0 2024-09-16T01:25:26.070 INFO:tasks.workunit.client.0.smithi063.stdout:1/961: chown d1/d5/f13d 7 1 2024-09-16T01:25:26.070 INFO:tasks.workunit.client.0.smithi063.stdout:7/912: truncate d7/d1c/d1f/d29/d72/fa8 435649 0 2024-09-16T01:25:26.071 INFO:tasks.workunit.client.0.smithi063.stdout:9/988: getdents d7/d9/d20/de3/de7/d14/d34 0 2024-09-16T01:25:26.073 INFO:tasks.workunit.client.0.smithi063.stdout:9/989: chown d7/d9/d20/de3/de7/db2/f94 1 1 2024-09-16T01:25:26.073 INFO:tasks.workunit.client.0.smithi063.stdout:1/962: truncate d1/dd/d3b/db3/fdb 833280 0 2024-09-16T01:25:26.074 INFO:tasks.workunit.client.0.smithi063.stdout:8/785: link d5/db/d12/d1a/d1e/f32 d5/db/d12/db0/ffb 0 2024-09-16T01:25:26.076 INFO:tasks.workunit.client.0.smithi063.stdout:8/786: chown d5/d9/d98/cc4 2 1 2024-09-16T01:25:26.077 INFO:tasks.workunit.client.0.smithi063.stdout:9/990: read - d7/d9/d20/de3/de7/db2/dc6/ddb/f104 zero size 2024-09-16T01:25:26.078 INFO:tasks.workunit.client.0.smithi063.stdout:8/787: write d5/d9/f35 [4156783,46411] 0 2024-09-16T01:25:26.080 INFO:tasks.workunit.client.0.smithi063.stdout:9/991: fdatasync d7/d4a/fbf 0 2024-09-16T01:25:26.082 INFO:tasks.workunit.client.0.smithi063.stdout:1/963: truncate d1/d5/d15/d18/f101 4959372 0 2024-09-16T01:25:26.086 INFO:tasks.workunit.client.0.smithi063.stdout:1/964: link d1/d5/fb5 d1/d5/d63/f144 0 2024-09-16T01:25:26.087 INFO:tasks.workunit.client.0.smithi063.stdout:8/788: dwrite d5/db/d12/d3d/fbc [4194304,4194304] 0 2024-09-16T01:25:26.087 INFO:tasks.workunit.client.0.smithi063.stdout:7/913: dread d7/f77 [0,4194304] 0 2024-09-16T01:25:26.089 INFO:tasks.workunit.client.0.smithi063.stdout:8/789: readlink d5/d9/l8a 0 2024-09-16T01:25:26.090 INFO:tasks.workunit.client.0.smithi063.stdout:7/914: chown d7/d56/d57/d60/db9/de0/deb 39 1 2024-09-16T01:25:26.093 INFO:tasks.workunit.client.0.smithi063.stdout:1/965: mknod d1/d5/d82/d9b/d77/d7d/dda/df6/d120/c145 0 2024-09-16T01:25:26.094 INFO:tasks.workunit.client.0.smithi063.stdout:7/915: stat d7/d1c/d1f/d29/d72/d9e 0 2024-09-16T01:25:26.096 INFO:tasks.workunit.client.0.smithi063.stdout:4/946: dwrite d5/d3b/df/d1c/d29/d20/d98/fbd [0,4194304] 0 2024-09-16T01:25:26.096 INFO:tasks.workunit.client.0.smithi063.stdout:8/790: chown d5/db/d12/d1a/d1e/d93/db8/lfa 59916013 1 2024-09-16T01:25:26.099 INFO:tasks.workunit.client.0.smithi063.stdout:4/947: fsync d5/d3b/d57/f101 0 2024-09-16T01:25:26.099 INFO:tasks.workunit.client.0.smithi063.stdout:9/992: dwrite d7/d9/d20/de3/de7/db2/f90 [0,4194304] 0 2024-09-16T01:25:26.100 INFO:tasks.workunit.client.0.smithi063.stdout:7/916: symlink d7/d1c/d1f/d66/d101/l125 0 2024-09-16T01:25:26.105 INFO:tasks.workunit.client.0.smithi063.stdout:7/917: mkdir d7/d56/d57/d126 0 2024-09-16T01:25:26.106 INFO:tasks.workunit.client.0.smithi063.stdout:1/966: dwrite d1/f3e [0,4194304] 0 2024-09-16T01:25:26.109 INFO:tasks.workunit.client.0.smithi063.stdout:4/948: truncate d5/d3b/df/d1c/d29/d32/f5b 2841645 0 2024-09-16T01:25:26.109 INFO:tasks.workunit.client.0.smithi063.stdout:1/967: dread - d1/d5/d15/d18/db6/f11d zero size 2024-09-16T01:25:26.111 INFO:tasks.workunit.client.0.smithi063.stdout:9/993: dread d7/d9/d20/de3/de7/db2/faa [0,4194304] 0 2024-09-16T01:25:26.114 INFO:tasks.workunit.client.0.smithi063.stdout:9/994: chown d7/d4a/dba/f54 264150 1 2024-09-16T01:25:26.114 INFO:tasks.workunit.client.0.smithi063.stdout:8/791: dread d5/f83 [0,4194304] 0 2024-09-16T01:25:26.116 INFO:tasks.workunit.client.0.smithi063.stdout:7/918: getdents d7/d56/d57/d60/db9/de0/deb/d11c 0 2024-09-16T01:25:26.116 INFO:tasks.workunit.client.0.smithi063.stdout:4/949: readlink d5/d3b/df/d1c/d29/d32/d60/d10b/lb1 0 2024-09-16T01:25:26.118 INFO:tasks.workunit.client.0.smithi063.stdout:9/995: mkdir d7/d9/d20/de3/de7/db2/d15e 0 2024-09-16T01:25:26.118 INFO:tasks.workunit.client.0.smithi063.stdout:7/919: read d7/d1c/d1f/d29/d88/d98/fef [2980188,109218] 0 2024-09-16T01:25:26.119 INFO:tasks.workunit.client.0.smithi063.stdout:8/792: truncate d5/db/d12/d1a/d1e/f36 613813 0 2024-09-16T01:25:26.120 INFO:tasks.workunit.client.0.smithi063.stdout:8/793: write d5/d86/f95 [306424,16577] 0 2024-09-16T01:25:26.120 INFO:tasks.workunit.client.0.smithi063.stdout:4/950: symlink d5/d3b/df/d1c/d29/d20/l13d 0 2024-09-16T01:25:26.127 INFO:tasks.workunit.client.0.smithi063.stdout:7/920: rmdir d7/d1c/d1f/d29/dbf/d40/d6c/dc1 0 2024-09-16T01:25:26.129 INFO:tasks.workunit.client.0.smithi063.stdout:9/996: dread d7/d9/d20/de3/de7/db2/dc6/ffa [0,4194304] 0 2024-09-16T01:25:26.130 INFO:tasks.workunit.client.0.smithi063.stdout:4/951: dwrite d5/f2e [0,4194304] 0 2024-09-16T01:25:26.130 INFO:tasks.workunit.client.0.smithi063.stdout:8/794: link d5/db/d12/d1a/d60/le6 d5/d86/lfc 0 2024-09-16T01:25:26.132 INFO:tasks.workunit.client.0.smithi063.stdout:7/921: chown d7/d56/d57/d60/fa5 72 1 2024-09-16T01:25:26.134 INFO:tasks.workunit.client.0.smithi063.stdout:1/968: dwrite d1/d5/f1a [4194304,4194304] 0 2024-09-16T01:25:26.134 INFO:tasks.workunit.client.0.smithi063.stdout:7/922: chown d7/d1c/lb1 0 1 2024-09-16T01:25:26.137 INFO:tasks.workunit.client.0.smithi063.stdout:9/997: rename d7/d9/d20/de3/de7/fc2 to d7/d9/d140/f15f 0 2024-09-16T01:25:26.140 INFO:tasks.workunit.client.0.smithi063.stdout:1/969: symlink d1/d5/d15/d18/d4b/l146 0 2024-09-16T01:25:26.140 INFO:tasks.workunit.client.0.smithi063.stdout:8/795: write d5/d9/f7b [1276648,50140] 0 2024-09-16T01:25:26.144 INFO:tasks.workunit.client.0.smithi063.stdout:4/952: dwrite d5/d3b/d5c/f114 [0,4194304] 0 2024-09-16T01:25:26.148 INFO:tasks.workunit.client.0.smithi063.stdout:7/923: getdents d7/d1c/d1f/d29/d88/d96 0 2024-09-16T01:25:26.149 INFO:tasks.workunit.client.0.smithi063.stdout:9/998: symlink d7/d9/d20/de3/de7/db2/dca/d121/l160 0 2024-09-16T01:25:26.149 INFO:tasks.workunit.client.0.smithi063.stdout:1/970: write d1/d5/d82/d9b/d77/d7d/dc2/dad/f65 [1062751,129757] 0 2024-09-16T01:25:26.150 INFO:tasks.workunit.client.0.smithi063.stdout:8/796: symlink d5/db/d12/d1a/d1e/d68/dc9/lfd 0 2024-09-16T01:25:26.152 INFO:tasks.workunit.client.0.smithi063.stdout:7/924: write d7/d1c/d1f/d29/f4e [1802218,58767] 0 2024-09-16T01:25:26.153 INFO:tasks.workunit.client.0.smithi063.stdout:9/999: creat d7/d4a/dba/d7f/f161 x:0 0 0 2024-09-16T01:25:26.154 INFO:tasks.workunit.client.0.smithi063.stdout:1/971: creat d1/d5/d6f/dd2/de1/d100/d119/f147 x:0 0 0 2024-09-16T01:25:26.158 INFO:tasks.workunit.client.0.smithi063.stdout:7/925: read d7/d56/f64 [2014685,113835] 0 2024-09-16T01:25:26.158 INFO:tasks.workunit.client.0.smithi063.stdout:4/953: dwrite d5/d3b/d57/d66/db7/f135 [0,4194304] 0 2024-09-16T01:25:26.160 INFO:tasks.workunit.client.0.smithi063.stdout:1/972: chown d1/dd/d3b/db3/l129 13853427 1 2024-09-16T01:25:26.163 INFO:tasks.workunit.client.0.smithi063.stdout:7/926: fdatasync d7/d56/d57/d60/fa5 0 2024-09-16T01:25:26.163 INFO:tasks.workunit.client.0.smithi063.stdout:4/954: write d5/d3b/d57/dce/fe9 [723970,56994] 0 2024-09-16T01:25:26.164 INFO:tasks.workunit.client.0.smithi063.stdout:8/797: dwrite d5/db/df2/ff6 [0,4194304] 0 2024-09-16T01:25:26.167 INFO:tasks.workunit.client.0.smithi063.stdout:8/798: chown d5/db/d12/d1a/d1e/d68/fe1 20095265 1 2024-09-16T01:25:26.167 INFO:tasks.workunit.client.0.smithi063.stdout:4/955: fsync d5/d3b/df/d1c/d29/d32/d60/d61/f52 0 2024-09-16T01:25:26.168 INFO:tasks.workunit.client.0.smithi063.stdout:1/973: rename d1/dd/d3b/f44 to d1/d5/d82/d9b/d13e/f148 0 2024-09-16T01:25:26.168 INFO:tasks.workunit.client.0.smithi063.stdout:7/927: write d7/d56/d6b/d86/f69 [1240917,84670] 0 2024-09-16T01:25:26.169 INFO:tasks.workunit.client.0.smithi063.stdout:4/956: chown d5/f2e 18 1 2024-09-16T01:25:26.170 INFO:tasks.workunit.client.0.smithi063.stdout:8/799: mkdir d5/db/d12/d1a/d1e/d93/dfe 0 2024-09-16T01:25:26.172 INFO:tasks.workunit.client.0.smithi063.stdout:7/928: creat d7/d1c/d1f/d66/d101/f127 x:0 0 0 2024-09-16T01:25:26.174 INFO:tasks.workunit.client.0.smithi063.stdout:8/800: symlink d5/db/d12/d3d/d69/daa/d40/d4a/lff 0 2024-09-16T01:25:26.178 INFO:tasks.workunit.client.0.smithi063.stdout:8/801: mkdir d5/d8c/d74/d100 0 2024-09-16T01:25:26.179 INFO:tasks.workunit.client.0.smithi063.stdout:8/802: stat d5/d9/le 0 2024-09-16T01:25:26.180 INFO:tasks.workunit.client.0.smithi063.stdout:8/803: symlink d5/d9/d98/l101 0 2024-09-16T01:25:26.181 INFO:tasks.workunit.client.0.smithi063.stdout:4/957: truncate d5/d3b/d57/d66/d9b/d7a/feb 304980 0 2024-09-16T01:25:26.182 INFO:tasks.workunit.client.0.smithi063.stdout:1/974: dread d1/d5/d82/d9b/d77/d7d/dcb/fe2 [0,4194304] 0 2024-09-16T01:25:26.183 INFO:tasks.workunit.client.0.smithi063.stdout:8/804: unlink d5/d8c/d74/d87/lf4 0 2024-09-16T01:25:26.184 INFO:tasks.workunit.client.0.smithi063.stdout:4/958: mknod d5/d3b/df/d1c/d29/dd4/dbc/c13e 0 2024-09-16T01:25:26.188 INFO:tasks.workunit.client.0.smithi063.stdout:8/805: getdents d5/db/d12/d1a 0 2024-09-16T01:25:26.188 INFO:tasks.workunit.client.0.smithi063.stdout:7/929: dread d7/d1c/d1f/d29/dbf/d39/dfc/f110 [0,4194304] 0 2024-09-16T01:25:26.191 INFO:tasks.workunit.client.0.smithi063.stdout:1/975: dwrite d1/d5/d82/d9b/d77/d7d/dc2/f35 [0,4194304] 0 2024-09-16T01:25:26.192 INFO:tasks.workunit.client.0.smithi063.stdout:8/806: symlink d5/l102 0 2024-09-16T01:25:26.194 INFO:tasks.workunit.client.0.smithi063.stdout:7/930: unlink d7/d1c/d1f/d29/d88/d96/ce6 0 2024-09-16T01:25:26.199 INFO:tasks.workunit.client.0.smithi063.stdout:4/959: truncate d5/d3b/d57/d66/d9b/f8a 3066949 0 2024-09-16T01:25:26.200 INFO:tasks.workunit.client.0.smithi063.stdout:3/916: sync 2024-09-16T01:25:26.202 INFO:tasks.workunit.client.0.smithi063.stdout:7/931: write d7/d1c/d1f/d29/dbf/d40/fa9 [3130242,61022] 0 2024-09-16T01:25:26.203 INFO:tasks.workunit.client.0.smithi063.stdout:1/976: dwrite d1/d5/f13 [4194304,4194304] 0 2024-09-16T01:25:26.204 INFO:tasks.workunit.client.0.smithi063.stdout:8/807: dread d5/db/df2/ff6 [0,4194304] 0 2024-09-16T01:25:26.206 INFO:tasks.workunit.client.0.smithi063.stdout:3/917: fdatasync d2/d11/d37/d40/d5e/d3b/d45/d9f/fe6 0 2024-09-16T01:25:26.207 INFO:tasks.workunit.client.0.smithi063.stdout:7/932: read d7/d1c/d1f/d29/f4e [757633,106711] 0 2024-09-16T01:25:26.210 INFO:tasks.workunit.client.0.smithi063.stdout:8/808: creat d5/db/f103 x:0 0 0 2024-09-16T01:25:26.210 INFO:tasks.workunit.client.0.smithi063.stdout:4/960: link d5/d3b/l130 d5/d3b/df/d1c/d29/d20/d98/l13f 0 2024-09-16T01:25:26.213 INFO:tasks.workunit.client.0.smithi063.stdout:3/918: fsync d2/d11/d37/d40/d5e/d3b/d68/d6d/de5/fec 0 2024-09-16T01:25:26.213 INFO:tasks.workunit.client.0.smithi063.stdout:8/809: write d5/db/d12/d1a/d60/ff1 [960208,79522] 0 2024-09-16T01:25:26.213 INFO:tasks.workunit.client.0.smithi063.stdout:1/977: rename d1/d5/d15/cf0 to d1/d12/c149 0 2024-09-16T01:25:26.215 INFO:tasks.workunit.client.0.smithi063.stdout:3/919: readlink d2/d11/d37/d40/d5e/l46 0 2024-09-16T01:25:26.217 INFO:tasks.workunit.client.0.smithi063.stdout:1/978: symlink d1/d5/d15/d18/l14a 0 2024-09-16T01:25:26.219 INFO:tasks.workunit.client.0.smithi063.stdout:7/933: dwrite d7/d1c/d1f/d29/d88/d98/fbe [0,4194304] 0 2024-09-16T01:25:26.220 INFO:tasks.workunit.client.0.smithi063.stdout:1/979: write d1/d5/f1a [6569005,71157] 0 2024-09-16T01:25:26.222 INFO:tasks.workunit.client.0.smithi063.stdout:3/920: rename d2/fbf to d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/f13b 0 2024-09-16T01:25:26.223 INFO:tasks.workunit.client.0.smithi063.stdout:3/921: chown d2 11 1 2024-09-16T01:25:26.226 INFO:tasks.workunit.client.0.smithi063.stdout:1/980: getdents d1/d5/d6f/dd2/de1 0 2024-09-16T01:25:26.228 INFO:tasks.workunit.client.0.smithi063.stdout:3/922: getdents d2/d11/d69/d80 0 2024-09-16T01:25:26.229 INFO:tasks.workunit.client.0.smithi063.stdout:8/810: dread d5/d9/d2f/f85 [0,4194304] 0 2024-09-16T01:25:26.229 INFO:tasks.workunit.client.0.smithi063.stdout:1/981: symlink d1/d12/l14b 0 2024-09-16T01:25:26.230 INFO:tasks.workunit.client.0.smithi063.stdout:3/923: rmdir d2/d11/d69 39 2024-09-16T01:25:26.231 INFO:tasks.workunit.client.0.smithi063.stdout:4/961: dread d5/d3b/d57/d66/d9b/d7a/fbb [0,4194304] 0 2024-09-16T01:25:26.231 INFO:tasks.workunit.client.0.smithi063.stdout:1/982: rmdir d1/d5/d15/d18/d4b/dae 39 2024-09-16T01:25:26.233 INFO:tasks.workunit.client.0.smithi063.stdout:1/983: dread - d1/d5/d15/d1b/f116 zero size 2024-09-16T01:25:26.233 INFO:tasks.workunit.client.0.smithi063.stdout:8/811: symlink d5/db/d12/d1a/l104 0 2024-09-16T01:25:26.233 INFO:tasks.workunit.client.0.smithi063.stdout:3/924: fsync d2/d11/d37/d40/d5e/d3b/d94/d30/d7f/fae 0 2024-09-16T01:25:26.233 INFO:tasks.workunit.client.0.smithi063.stdout:4/962: readlink d5/d3b/df/d1c/d29/d32/la8 0 2024-09-16T01:25:26.235 INFO:tasks.workunit.client.0.smithi063.stdout:7/934: dread d7/d1c/d1f/d29/dbf/d40/f58 [0,4194304] 0 2024-09-16T01:25:26.237 INFO:tasks.workunit.client.0.smithi063.stdout:8/812: symlink d5/db/d12/d3d/d69/daa/l105 0 2024-09-16T01:25:26.239 INFO:tasks.workunit.client.0.smithi063.stdout:8/813: dread - d5/db/d12/d3d/d69/daa/d40/d4a/fde zero size 2024-09-16T01:25:26.239 INFO:tasks.workunit.client.0.smithi063.stdout:3/925: dread d2/d11/d37/d40/d5e/d3b/d94/f5c [0,4194304] 0 2024-09-16T01:25:26.239 INFO:tasks.workunit.client.0.smithi063.stdout:4/963: fdatasync d5/d3b/df/d1c/d29/d32/d60/f107 0 2024-09-16T01:25:26.240 INFO:tasks.workunit.client.0.smithi063.stdout:1/984: getdents d1/d5/d6f/dd2 0 2024-09-16T01:25:26.243 INFO:tasks.workunit.client.0.smithi063.stdout:1/985: read d1/d5/f7 [189660,58015] 0 2024-09-16T01:25:26.244 INFO:tasks.workunit.client.0.smithi063.stdout:4/964: unlink d5/d3b/df/d1c/d29/fa9 0 2024-09-16T01:25:26.245 INFO:tasks.workunit.client.0.smithi063.stdout:8/814: read d5/db/d12/d3d/d69/daa/d40/d4a/fdd [7564077,117671] 0 2024-09-16T01:25:26.245 INFO:tasks.workunit.client.0.smithi063.stdout:7/935: dwrite d7/d1c/d1f/d29/d88/d96/dca/ffa [4194304,4194304] 0 2024-09-16T01:25:26.247 INFO:tasks.workunit.client.0.smithi063.stdout:3/926: symlink d2/d11/d37/d40/d5e/d3b/d68/l13c 0 2024-09-16T01:25:26.248 INFO:tasks.workunit.client.0.smithi063.stdout:3/927: readlink d2/d11/d37/d40/d5e/l7b 0 2024-09-16T01:25:26.248 INFO:tasks.workunit.client.0.smithi063.stdout:4/965: stat d5/d3b/df/c46 0 2024-09-16T01:25:26.250 INFO:tasks.workunit.client.0.smithi063.stdout:4/966: chown d5/d3b/df/d1c/d29/d32/d60/d61/c91 12 1 2024-09-16T01:25:26.250 INFO:tasks.workunit.client.0.smithi063.stdout:1/986: link d1/d5/d6f/c7b d1/d5/d82/d9b/d77/d7d/dcb/df9/c14c 0 2024-09-16T01:25:26.252 INFO:tasks.workunit.client.0.smithi063.stdout:4/967: write d5/d3b/df/d1c/d29/d32/d60/d61/fa4 [4994447,41882] 0 2024-09-16T01:25:26.252 INFO:tasks.workunit.client.0.smithi063.stdout:1/987: stat d1/dd/d3b/ddc/l122 0 2024-09-16T01:25:26.252 INFO:tasks.workunit.client.0.smithi063.stdout:7/936: rename d7/d1c/d1f/d29/dbf/d39/dfc/f110 to d7/d1c/d1f/d66/d70/da2/f128 0 2024-09-16T01:25:26.253 INFO:tasks.workunit.client.0.smithi063.stdout:1/988: read - d1/dd/d3b/f12c zero size 2024-09-16T01:25:26.254 INFO:tasks.workunit.client.0.smithi063.stdout:3/928: symlink d2/d11/d69/dfe/l13d 0 2024-09-16T01:25:26.255 INFO:tasks.workunit.client.0.smithi063.stdout:7/937: truncate d7/d1c/d1f/d66/d101/f127 733943 0 2024-09-16T01:25:26.256 INFO:tasks.workunit.client.0.smithi063.stdout:1/989: mkdir d1/dd/d3b/dbe/d10d/d14d 0 2024-09-16T01:25:26.258 INFO:tasks.workunit.client.0.smithi063.stdout:3/929: write d2/d11/d37/d40/d5e/f36 [1360623,34208] 0 2024-09-16T01:25:26.259 INFO:tasks.workunit.client.0.smithi063.stdout:6/959: sync 2024-09-16T01:25:26.261 INFO:tasks.workunit.client.0.smithi063.stdout:8/815: getdents d5/db/d12/d1a/d60 0 2024-09-16T01:25:26.262 INFO:tasks.workunit.client.0.smithi063.stdout:3/930: fdatasync d2/f33 0 2024-09-16T01:25:26.263 INFO:tasks.workunit.client.0.smithi063.stdout:6/960: chown d3/d48/d28/d3e/d44/da4/l12c 8 1 2024-09-16T01:25:26.264 INFO:tasks.workunit.client.0.smithi063.stdout:7/938: rename d7/d56/d6b/fd0 to d7/d1c/d1f/d29/dbf/d39/d65/f129 0 2024-09-16T01:25:26.269 INFO:tasks.workunit.client.0.smithi063.stdout:1/990: dwrite d1/d5/f76 [0,4194304] 0 2024-09-16T01:25:26.269 INFO:tasks.workunit.client.0.smithi063.stdout:3/931: fsync d2/d11/d69/d80/d8a/fc5 0 2024-09-16T01:25:26.269 INFO:tasks.workunit.client.0.smithi063.stdout:8/816: fdatasync d5/db/d12/d1a/d60/d7a/f9f 0 2024-09-16T01:25:26.269 INFO:tasks.workunit.client.0.smithi063.stdout:6/961: symlink d3/d48/d28/d3e/d68/db4/l152 0 2024-09-16T01:25:26.270 INFO:tasks.workunit.client.0.smithi063.stdout:1/991: rmdir d1/d5/d82/d9b 39 2024-09-16T01:25:26.271 INFO:tasks.workunit.client.0.smithi063.stdout:4/968: dwrite d5/d3b/df/d1c/d29/f4a [0,4194304] 0 2024-09-16T01:25:26.271 INFO:tasks.workunit.client.0.smithi063.stdout:3/932: creat d2/d11/d37/db6/f13e x:0 0 0 2024-09-16T01:25:26.273 INFO:tasks.workunit.client.0.smithi063.stdout:1/992: creat d1/d5/d82/d9b/f14e x:0 0 0 2024-09-16T01:25:26.274 INFO:tasks.workunit.client.0.smithi063.stdout:7/939: mknod d7/d56/d57/d60/db9/de0/deb/d11c/c12a 0 2024-09-16T01:25:26.274 INFO:tasks.workunit.client.0.smithi063.stdout:8/817: rmdir d5/db/d12 39 2024-09-16T01:25:26.276 INFO:tasks.workunit.client.0.smithi063.stdout:1/993: read - d1/d5/d82/d9b/f14e zero size 2024-09-16T01:25:26.277 INFO:tasks.workunit.client.0.smithi063.stdout:7/940: write d7/d56/d57/d73/fcf [4674200,3382] 0 2024-09-16T01:25:26.278 INFO:tasks.workunit.client.0.smithi063.stdout:4/969: symlink d5/d3b/df/d1c/d29/d32/d60/ddb/l140 0 2024-09-16T01:25:26.280 INFO:tasks.workunit.client.0.smithi063.stdout:1/994: unlink d1/d5/la8 0 2024-09-16T01:25:26.280 INFO:tasks.workunit.client.0.smithi063.stdout:3/933: truncate d2/d11/d37/d40/d5e/d3b/d68/d6d/de5/fec 119430 0 2024-09-16T01:25:26.282 INFO:tasks.workunit.client.0.smithi063.stdout:7/941: write d7/d56/d57/d73/f7e [2769897,68915] 0 2024-09-16T01:25:26.284 INFO:tasks.workunit.client.0.smithi063.stdout:3/934: write d2/d11/d69/d80/d8a/ff6 [1288900,50643] 0 2024-09-16T01:25:26.284 INFO:tasks.workunit.client.0.smithi063.stdout:8/818: rename d5/db/d12/d3d/d69/daa/d40/d4a/lea to d5/d9/d98/l106 0 2024-09-16T01:25:26.288 INFO:tasks.workunit.client.0.smithi063.stdout:4/970: getdents d5/d3b/d57/dce/d10d/d10e 0 2024-09-16T01:25:26.289 INFO:tasks.workunit.client.0.smithi063.stdout:6/962: dread d3/f65 [0,4194304] 0 2024-09-16T01:25:26.289 INFO:tasks.workunit.client.0.smithi063.stdout:8/819: mknod d5/db/d12/d1a/d60/c107 0 2024-09-16T01:25:26.292 INFO:tasks.workunit.client.0.smithi063.stdout:1/995: dwrite d1/d5/d15/d1b/fea [0,4194304] 0 2024-09-16T01:25:26.292 INFO:tasks.workunit.client.0.smithi063.stdout:3/935: truncate d2/d11/d37/d40/d5e/d3b/da1/f116 749975 0 2024-09-16T01:25:26.295 INFO:tasks.workunit.client.0.smithi063.stdout:1/996: chown d1/d5/d15/f29 13219615 1 2024-09-16T01:25:26.296 INFO:tasks.workunit.client.0.smithi063.stdout:3/936: stat d2/d11/d37/d40/d5e/d3b/d68/d6b/l109 0 2024-09-16T01:25:26.297 INFO:tasks.workunit.client.0.smithi063.stdout:8/820: rename d5/db/d12/d3d/f9c to d5/db/d12/d3d/d69/daa/d40/f108 0 2024-09-16T01:25:26.299 INFO:tasks.workunit.client.0.smithi063.stdout:1/997: creat d1/d5/d82/d9b/d77/d7d/dda/df6/f14f x:0 0 0 2024-09-16T01:25:26.300 INFO:tasks.workunit.client.0.smithi063.stdout:3/937: rename d2/d11 to d2/d11/d69/d80/d8a/d8e/d13f 22 2024-09-16T01:25:26.301 INFO:tasks.workunit.client.0.smithi063.stdout:6/963: dread d3/d30/d8d/d102/f93 [0,4194304] 0 2024-09-16T01:25:26.302 INFO:tasks.workunit.client.0.smithi063.stdout:1/998: fsync d1/d5/d82/d9b/d77/d8a/f7f 0 2024-09-16T01:25:26.302 INFO:tasks.workunit.client.0.smithi063.stdout:8/821: dread - d5/db/d12/d1a/fa0 zero size 2024-09-16T01:25:26.302 INFO:tasks.workunit.client.0.smithi063.stdout:3/938: write d2/d11/d37/d40/d5e/d3b/d68/d6d/f10c [2177447,16084] 0 2024-09-16T01:25:26.303 INFO:tasks.workunit.client.0.smithi063.stdout:6/964: chown d3/d48/d28/d3e/d44/da4/f50 5 1 2024-09-16T01:25:26.305 INFO:tasks.workunit.client.0.smithi063.stdout:8/822: write d5/db/df2/ff6 [4524589,40948] 0 2024-09-16T01:25:26.308 INFO:tasks.workunit.client.0.smithi063.stdout:4/971: write d5/d3b/df/d1c/d29/d32/d4e/f9f [754458,70827] 0 2024-09-16T01:25:26.310 INFO:tasks.workunit.client.0.smithi063.stdout:1/999: dwrite d1/d12/ff4 [0,4194304] 0 2024-09-16T01:25:26.311 INFO:tasks.workunit.client.0.smithi063.stdout:6/965: creat d3/d30/d39/d69/f153 x:0 0 0 2024-09-16T01:25:26.315 INFO:tasks.workunit.client.0.smithi063.stdout:3/939: dwrite d2/d11/d37/d40/d5e/d3b/d68/fdf [0,4194304] 0 2024-09-16T01:25:26.316 INFO:tasks.workunit.client.0.smithi063.stdout:8/823: truncate d5/db/d12/d3d/d69/daa/f90 7399770 0 2024-09-16T01:25:26.318 INFO:tasks.workunit.client.0.smithi063.stdout:3/940: chown d2/d11/d69/d80/d8a/f12f 24899577 1 2024-09-16T01:25:26.318 INFO:tasks.workunit.client.0.smithi063.stdout:6/966: getdents d3/d41 0 2024-09-16T01:25:26.321 INFO:tasks.workunit.client.0.smithi063.stdout:4/972: link d5/d3b/df/d1c/d29/d20/d98/ddf/ff6 d5/d3b/df/d1c/d29/d32/d4e/f141 0 2024-09-16T01:25:26.322 INFO:tasks.workunit.client.0.smithi063.stdout:6/967: chown d3/d30/d39/dac/db5/da7/lbe 145259 1 2024-09-16T01:25:26.326 INFO:tasks.workunit.client.0.smithi063.stdout:3/941: write d2/d11/d37/d40/d5e/d3b/d45/f50 [5642702,84205] 0 2024-09-16T01:25:26.326 INFO:tasks.workunit.client.0.smithi063.stdout:8/824: write d5/db/d12/d1a/d1e/fb1 [843456,123522] 0 2024-09-16T01:25:26.331 INFO:tasks.workunit.client.0.smithi063.stdout:8/825: symlink d5/db/d12/d3d/l109 0 2024-09-16T01:25:26.332 INFO:tasks.workunit.client.0.smithi063.stdout:4/973: dwrite d5/d3b/df/d1c/d29/dd4/dbc/fd6 [4194304,4194304] 0 2024-09-16T01:25:26.333 INFO:tasks.workunit.client.0.smithi063.stdout:6/968: dwrite d3/d48/d28/d3e/d44/f6a [0,4194304] 0 2024-09-16T01:25:26.335 INFO:tasks.workunit.client.0.smithi063.stdout:3/942: rename d2/d5b/f7a to d2/d11/d69/d80/d131/f140 0 2024-09-16T01:25:26.338 INFO:tasks.workunit.client.0.smithi063.stdout:8/826: unlink d5/db/d12/d1a/d1e/d93/l99 0 2024-09-16T01:25:26.338 INFO:tasks.workunit.client.0.smithi063.stdout:3/943: dread d2/d11/d37/d40/d5e/d3b/d68/d6d/d6e/f84 [0,4194304] 0 2024-09-16T01:25:26.340 INFO:tasks.workunit.client.0.smithi063.stdout:6/969: chown d3/d48/la9 287904 1 2024-09-16T01:25:26.340 INFO:tasks.workunit.client.0.smithi063.stdout:4/974: read d5/d3b/df/d1c/d29/d32/f5e [2233511,119359] 0 2024-09-16T01:25:26.342 INFO:tasks.workunit.client.0.smithi063.stdout:8/827: write d5/db/d12/d1a/d1e/fa9 [1303125,43549] 0 2024-09-16T01:25:26.343 INFO:tasks.workunit.client.0.smithi063.stdout:4/975: write d5/d3b/df/d1c/d29/d20/f23 [2209635,66995] 0 2024-09-16T01:25:26.344 INFO:tasks.workunit.client.0.smithi063.stdout:8/828: chown d5/l1b 1980 1 2024-09-16T01:25:26.345 INFO:tasks.workunit.client.0.smithi063.stdout:4/976: write d5/d3b/d57/d66/f139 [142183,41693] 0 2024-09-16T01:25:26.347 INFO:tasks.workunit.client.0.smithi063.stdout:3/944: dread d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/f13b [0,4194304] 0 2024-09-16T01:25:26.348 INFO:tasks.workunit.client.0.smithi063.stdout:8/829: mkdir d5/db/d12/db0/d10a 0 2024-09-16T01:25:26.350 INFO:tasks.workunit.client.0.smithi063.stdout:3/945: write d2/d11/d37/d40/d5e/d3b/d94/f2f [3839852,102258] 0 2024-09-16T01:25:26.351 INFO:tasks.workunit.client.0.smithi063.stdout:8/830: rmdir d5/db 39 2024-09-16T01:25:26.352 INFO:tasks.workunit.client.0.smithi063.stdout:4/977: rename d5/d3b/d57/d66/db7/dc9/lee to d5/d3b/d57/d66/l142 0 2024-09-16T01:25:26.353 INFO:tasks.workunit.client.0.smithi063.stdout:3/946: mknod d2/d5b/db4/c141 0 2024-09-16T01:25:26.357 INFO:tasks.workunit.client.0.smithi063.stdout:3/947: symlink d2/d11/d37/d40/d5e/ddc/l142 0 2024-09-16T01:25:26.357 INFO:tasks.workunit.client.0.smithi063.stdout:6/970: dread d3/d48/d28/f33 [0,4194304] 0 2024-09-16T01:25:26.359 INFO:tasks.workunit.client.0.smithi063.stdout:3/948: fdatasync d2/d5b/d90/fc7 0 2024-09-16T01:25:26.359 INFO:tasks.workunit.client.0.smithi063.stdout:6/971: stat d3/d48/d28/cd3 0 2024-09-16T01:25:26.361 INFO:tasks.workunit.client.0.smithi063.stdout:8/831: dwrite d5/fd3 [0,4194304] 0 2024-09-16T01:25:26.363 INFO:tasks.workunit.client.0.smithi063.stdout:3/949: chown d2/d11/d37/d40/d5e/d3b/l7d 117 1 2024-09-16T01:25:26.365 INFO:tasks.workunit.client.0.smithi063.stdout:4/978: dwrite d5/f42 [0,4194304] 0 2024-09-16T01:25:26.366 INFO:tasks.workunit.client.0.smithi063.stdout:4/979: fsync d5/d3b/df/d1c/d29/f4a 0 2024-09-16T01:25:26.368 INFO:tasks.workunit.client.0.smithi063.stdout:8/832: rename d5/d8c/d74/f96 to d5/db/d12/d3d/d69/f10b 0 2024-09-16T01:25:26.371 INFO:tasks.workunit.client.0.smithi063.stdout:4/980: unlink d5/d3b/df/d1c/d29/dd4/dbc/fc2 0 2024-09-16T01:25:26.372 INFO:tasks.workunit.client.0.smithi063.stdout:3/950: rename d2/d11/d69/d85/lfd to d2/d11/d37/db6/d12e/l143 0 2024-09-16T01:25:26.375 INFO:tasks.workunit.client.0.smithi063.stdout:8/833: read d5/db/d12/d1a/f4b [42141,68464] 0 2024-09-16T01:25:26.376 INFO:tasks.workunit.client.0.smithi063.stdout:4/981: symlink d5/d3b/df/d1c/d29/d32/d60/ddb/l143 0 2024-09-16T01:25:26.377 INFO:tasks.workunit.client.0.smithi063.stdout:3/951: creat d2/d11/d37/dce/f144 x:0 0 0 2024-09-16T01:25:26.378 INFO:tasks.workunit.client.0.smithi063.stdout:4/982: fdatasync d5/d3b/df/d1c/d29/d32/d60/df4/f11a 0 2024-09-16T01:25:26.379 INFO:tasks.workunit.client.0.smithi063.stdout:6/972: dread d3/d10/f23 [4194304,4194304] 0 2024-09-16T01:25:26.379 INFO:tasks.workunit.client.0.smithi063.stdout:8/834: getdents d5/d8c 0 2024-09-16T01:25:26.380 INFO:tasks.workunit.client.0.smithi063.stdout:3/952: dread - d2/d11/d37/d40/d5e/d3b/d68/dd2/f12a zero size 2024-09-16T01:25:26.381 INFO:tasks.workunit.client.0.smithi063.stdout:4/983: write d5/d3b/d57/d68/d90/faa [5094317,128845] 0 2024-09-16T01:25:26.382 INFO:tasks.workunit.client.0.smithi063.stdout:8/835: fdatasync d5/db/d12/f38 0 2024-09-16T01:25:26.382 INFO:tasks.workunit.client.0.smithi063.stdout:4/984: fdatasync d5/d3b/df/d1c/fdc 0 2024-09-16T01:25:26.383 INFO:tasks.workunit.client.0.smithi063.stdout:3/953: chown d2/d11/d37/d40/d5e/ddc/c119 149263890 1 2024-09-16T01:25:26.383 INFO:tasks.workunit.client.0.smithi063.stdout:8/836: stat l2 0 2024-09-16T01:25:26.384 INFO:tasks.workunit.client.0.smithi063.stdout:6/973: creat d3/d30/d39/d69/d95/d10f/f154 x:0 0 0 2024-09-16T01:25:26.385 INFO:tasks.workunit.client.0.smithi063.stdout:6/974: truncate d3/d10/f11b 571503 0 2024-09-16T01:25:26.386 INFO:tasks.workunit.client.0.smithi063.stdout:3/954: chown d2/d11/d37/d40/d5e/d3b/d68/c117 105 1 2024-09-16T01:25:26.386 INFO:tasks.workunit.client.0.smithi063.stdout:3/955: chown d2/d5b/c11e 490184 1 2024-09-16T01:25:26.387 INFO:tasks.workunit.client.0.smithi063.stdout:4/985: mknod d5/d3b/df/d1c/d29/d20/d98/ddf/c144 0 2024-09-16T01:25:26.387 INFO:tasks.workunit.client.0.smithi063.stdout:8/837: creat d5/db/d12/db0/d10a/f10c x:0 0 0 2024-09-16T01:25:26.388 INFO:tasks.workunit.client.0.smithi063.stdout:6/975: mknod d3/d48/d28/d3e/d44/da4/d5a/d6b/d7d/c155 0 2024-09-16T01:25:26.388 INFO:tasks.workunit.client.0.smithi063.stdout:3/956: chown d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/lc3 530066657 1 2024-09-16T01:25:26.396 INFO:tasks.workunit.client.0.smithi063.stdout:8/838: write d5/d8c/d74/d87/fa5 [975644,15290] 0 2024-09-16T01:25:26.398 INFO:tasks.workunit.client.0.smithi063.stdout:8/839: mknod d5/db/d12/d3d/c10d 0 2024-09-16T01:25:26.401 INFO:tasks.workunit.client.0.smithi063.stdout:6/976: dwrite d3/d30/d8d/d102/d91/f87 [0,4194304] 0 2024-09-16T01:25:26.402 INFO:tasks.workunit.client.0.smithi063.stdout:4/986: dread d5/d3b/df/d1c/d29/d20/d98/dcc/fd9 [0,4194304] 0 2024-09-16T01:25:26.402 INFO:tasks.workunit.client.0.smithi063.stdout:8/840: symlink d5/d8c/d74/d100/l10e 0 2024-09-16T01:25:26.403 INFO:tasks.workunit.client.0.smithi063.stdout:4/987: stat d5/d3b/d57/l103 0 2024-09-16T01:25:26.404 INFO:tasks.workunit.client.0.smithi063.stdout:6/977: mknod d3/d30/d39/d69/d95/db0/c156 0 2024-09-16T01:25:26.405 INFO:tasks.workunit.client.0.smithi063.stdout:4/988: write d5/d3b/df/d1c/d29/d20/d98/fbd [2265426,84859] 0 2024-09-16T01:25:26.406 INFO:tasks.workunit.client.0.smithi063.stdout:8/841: symlink d5/db/d12/d1a/d1e/l10f 0 2024-09-16T01:25:26.406 INFO:tasks.workunit.client.0.smithi063.stdout:4/989: chown d5/d3b/f2d 47 1 2024-09-16T01:25:26.409 INFO:tasks.workunit.client.0.smithi063.stdout:4/990: mkdir d5/d3b/d57/d66/d9b/d145 0 2024-09-16T01:25:26.411 INFO:tasks.workunit.client.0.smithi063.stdout:6/978: link d3/d30/d39/dac/db5/dcf/dee/ff2 d3/d30/d8d/d102/d91/f157 0 2024-09-16T01:25:26.413 INFO:tasks.workunit.client.0.smithi063.stdout:6/979: fsync d3/d30/f4e 0 2024-09-16T01:25:26.414 INFO:tasks.workunit.client.0.smithi063.stdout:8/842: dwrite d5/db/d12/d3d/d69/daa/d40/fb3 [0,4194304] 0 2024-09-16T01:25:26.415 INFO:tasks.workunit.client.0.smithi063.stdout:4/991: rename d5/d3b/df/d1c/d29/d20/d30/df9 to d5/d3b/df/d1c/d29/d32/d4e/d146 0 2024-09-16T01:25:26.417 INFO:tasks.workunit.client.0.smithi063.stdout:4/992: chown d5/d3b/d57/dce/l126 44688 1 2024-09-16T01:25:26.418 INFO:tasks.workunit.client.0.smithi063.stdout:8/843: rename d5/d9/f6c to d5/db/d12/d1a/d1e/d93/f110 0 2024-09-16T01:25:26.419 INFO:tasks.workunit.client.0.smithi063.stdout:6/980: dread d3/d48/d28/d3e/d44/da4/f50 [0,4194304] 0 2024-09-16T01:25:26.419 INFO:tasks.workunit.client.0.smithi063.stdout:8/844: stat d5/db/d12/d3d/d69/daa/d40/d4a/lff 0 2024-09-16T01:25:26.422 INFO:tasks.workunit.client.0.smithi063.stdout:4/993: unlink d5/d3b/cd0 0 2024-09-16T01:25:26.425 INFO:tasks.workunit.client.0.smithi063.stdout:4/994: write d5/d3b/d57/f7d [5047193,12780] 0 2024-09-16T01:25:26.426 INFO:tasks.workunit.client.0.smithi063.stdout:8/845: link d5/db/d12/ca1 d5/d8c/dbd/c111 0 2024-09-16T01:25:26.429 INFO:tasks.workunit.client.0.smithi063.stdout:4/995: creat d5/d3b/d57/d66/d9b/f147 x:0 0 0 2024-09-16T01:25:26.429 INFO:tasks.workunit.client.0.smithi063.stdout:6/981: dwrite d3/d30/d39/dac/db5/dcf/fea [0,4194304] 0 2024-09-16T01:25:26.430 INFO:tasks.workunit.client.0.smithi063.stdout:8/846: symlink d5/db/d12/d3d/d69/daa/d40/l112 0 2024-09-16T01:25:26.433 INFO:tasks.workunit.client.0.smithi063.stdout:6/982: mknod d3/d30/d8d/d102/c158 0 2024-09-16T01:25:26.436 INFO:tasks.workunit.client.0.smithi063.stdout:8/847: rename d5/db/d12/d1a/d60/d7a/f9f to d5/db/d12/d1a/d60/da8/f113 0 2024-09-16T01:25:26.436 INFO:tasks.workunit.client.0.smithi063.stdout:4/996: truncate d5/d3b/d57/d66/d9b/d7a/feb 1165948 0 2024-09-16T01:25:26.437 INFO:tasks.workunit.client.0.smithi063.stdout:8/848: chown d5/db/d12/d1a/d60/d7a 164 1 2024-09-16T01:25:26.439 INFO:tasks.workunit.client.0.smithi063.stdout:8/849: chown d5/db/d12/d1a/laf 7550196 1 2024-09-16T01:25:26.439 INFO:tasks.workunit.client.0.smithi063.stdout:4/997: write d5/d3b/df/d1c/d29/d20/d30/fc3 [1246001,125247] 0 2024-09-16T01:25:26.440 INFO:tasks.workunit.client.0.smithi063.stdout:8/850: chown d5/d8c/d74/c9e 21436 1 2024-09-16T01:25:26.442 INFO:tasks.workunit.client.0.smithi063.stdout:8/851: dread - d5/db/d12/d1a/d1e/d93/db8/fe3 zero size 2024-09-16T01:25:26.445 INFO:tasks.workunit.client.0.smithi063.stdout:8/852: chown d5/db/d12/d1a/f2c 81431811 1 2024-09-16T01:25:26.447 INFO:tasks.workunit.client.0.smithi063.stdout:8/853: chown d5/db/f103 0 1 2024-09-16T01:25:26.448 INFO:tasks.workunit.client.0.smithi063.stdout:8/854: chown d5/d8c/d74 47 1 2024-09-16T01:25:26.450 INFO:tasks.workunit.client.0.smithi063.stdout:6/983: dwrite d3/d10/d49/f9e [0,4194304] 0 2024-09-16T01:25:26.452 INFO:tasks.workunit.client.0.smithi063.stdout:4/998: dwrite d5/d3b/df/d1c/d29/d20/d98/ddf/ff6 [0,4194304] 0 2024-09-16T01:25:26.453 INFO:tasks.workunit.client.0.smithi063.stdout:4/999: stat d5/d3b/d57/d66/fe2 0 2024-09-16T01:25:26.456 INFO:tasks.workunit.client.0.smithi063.stdout:8/855: dread d5/db/d12/d3d/d69/daa/f9b [0,4194304] 0 2024-09-16T01:25:26.469 INFO:tasks.workunit.client.0.smithi063.stdout:8/856: dread d5/db/d12/d1a/d60/f91 [0,4194304] 0 2024-09-16T01:25:26.557 INFO:tasks.workunit.client.0.smithi063.stdout:8/857: getdents d5/db/d12/d1a/d1e 0 2024-09-16T01:25:26.558 INFO:tasks.workunit.client.0.smithi063.stdout:8/858: chown d5/db/d12/d3d/d69/daa/d40/d4a/cc2 47714 1 2024-09-16T01:25:26.559 INFO:tasks.workunit.client.0.smithi063.stdout:8/859: truncate d5/db/d12/d3d/d69/daa/f9b 1556312 0 2024-09-16T01:25:26.564 INFO:tasks.workunit.client.0.smithi063.stdout:8/860: truncate d5/d8c/d74/d87/fa5 963017 0 2024-09-16T01:25:26.564 INFO:tasks.workunit.client.0.smithi063.stdout:8/861: read d5/fd3 [3225050,69813] 0 2024-09-16T01:25:26.566 INFO:tasks.workunit.client.0.smithi063.stdout:8/862: mkdir d5/d9/d114 0 2024-09-16T01:25:26.568 INFO:tasks.workunit.client.0.smithi063.stdout:8/863: getdents d5/d9/d114 0 2024-09-16T01:25:26.569 INFO:tasks.workunit.client.0.smithi063.stdout:8/864: write d5/d8c/d74/db7/ff5 [1074945,72778] 0 2024-09-16T01:25:26.572 INFO:tasks.workunit.client.0.smithi063.stdout:8/865: unlink d5/db/d12/d1a/d1e/d68/lc8 0 2024-09-16T01:25:26.572 INFO:tasks.workunit.client.0.smithi063.stdout:8/866: chown d5/db/f103 516498423 1 2024-09-16T01:25:26.574 INFO:tasks.workunit.client.0.smithi063.stdout:8/867: mkdir d5/d8c/dbd/d115 0 2024-09-16T01:25:26.574 INFO:tasks.workunit.client.0.smithi063.stdout:8/868: readlink d5/d9/l8a 0 2024-09-16T01:25:26.575 INFO:tasks.workunit.client.0.smithi063.stdout:8/869: chown d5/db/d12/d1a/fa0 5375610 1 2024-09-16T01:25:26.580 INFO:tasks.workunit.client.0.smithi063.stdout:8/870: dwrite d5/db/d12/d3d/fba [0,4194304] 0 2024-09-16T01:25:26.582 INFO:tasks.workunit.client.0.smithi063.stdout:8/871: readlink d5/db/d12/d1a/d60/d7a/lae 0 2024-09-16T01:25:26.584 INFO:tasks.workunit.client.0.smithi063.stdout:8/872: mknod d5/db/d12/d1a/d1e/d93/c116 0 2024-09-16T01:25:26.587 INFO:tasks.workunit.client.0.smithi063.stdout:8/873: symlink d5/db/d12/d1a/d1e/d68/dc9/l117 0 2024-09-16T01:25:26.590 INFO:tasks.workunit.client.0.smithi063.stdout:8/874: link d5/db/d12/d3d/d69/daa/d40/d4a/cc2 d5/db/d12/d3d/d69/daa/d40/d4a/c118 0 2024-09-16T01:25:26.591 INFO:tasks.workunit.client.0.smithi063.stdout:8/875: read - d5/db/d12/d3d/d69/daa/f97 zero size 2024-09-16T01:25:26.593 INFO:tasks.workunit.client.0.smithi063.stdout:8/876: symlink d5/db/d12/d3d/d69/l119 0 2024-09-16T01:25:26.595 INFO:tasks.workunit.client.0.smithi063.stdout:8/877: creat d5/d86/f11a x:0 0 0 2024-09-16T01:25:26.604 INFO:tasks.workunit.client.0.smithi063.stdout:8/878: dwrite d5/f94 [0,4194304] 0 2024-09-16T01:25:26.607 INFO:tasks.workunit.client.0.smithi063.stdout:8/879: creat d5/d8c/f11b x:0 0 0 2024-09-16T01:25:26.609 INFO:tasks.workunit.client.0.smithi063.stdout:7/942: sync 2024-09-16T01:25:26.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:26 smithi063 ceph-mon[31070]: pgmap v398: 97 pgs: 97 active+clean; 1.6 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 205 MiB/s wr, 374 op/s 2024-09-16T01:25:26.612 INFO:tasks.workunit.client.0.smithi063.stdout:7/943: creat d7/d1c/d1f/d29/dbf/f12b x:0 0 0 2024-09-16T01:25:26.614 INFO:tasks.workunit.client.0.smithi063.stdout:8/880: dwrite d5/db/d12/d1a/d1e/d93/db8/fe3 [0,4194304] 0 2024-09-16T01:25:26.619 INFO:tasks.workunit.client.0.smithi063.stdout:8/881: rename d5/d8c/f11b to d5/db/f11c 0 2024-09-16T01:25:26.619 INFO:tasks.workunit.client.0.smithi063.stdout:7/944: dwrite d7/d1c/d1f/d29/d88/fd7 [0,4194304] 0 2024-09-16T01:25:26.622 INFO:tasks.workunit.client.0.smithi063.stdout:7/945: chown d7/d1c/d1f/d29/d88/c10b 6237908 1 2024-09-16T01:25:26.626 INFO:tasks.workunit.client.0.smithi063.stdout:8/882: dwrite d5/d9/d98/fd9 [0,4194304] 0 2024-09-16T01:25:26.628 INFO:tasks.workunit.client.0.smithi063.stdout:8/883: chown d5/db/d12/d3d 2 1 2024-09-16T01:25:26.630 INFO:tasks.workunit.client.0.smithi063.stdout:8/884: write d5/db/d12/d3d/fba [1631485,125111] 0 2024-09-16T01:25:26.633 INFO:tasks.workunit.client.0.smithi063.stdout:7/946: dwrite d7/d1c/d1f/d29/dbf/d40/d6c/fc3 [4194304,4194304] 0 2024-09-16T01:25:26.635 INFO:tasks.workunit.client.0.smithi063.stdout:8/885: mkdir d5/d9/d98/d11d 0 2024-09-16T01:25:26.637 INFO:tasks.workunit.client.0.smithi063.stdout:7/947: mkdir d7/d1c/d1f/d12c 0 2024-09-16T01:25:26.638 INFO:tasks.workunit.client.0.smithi063.stdout:8/886: mknod d5/db/d12/d1a/d60/d7a/c11e 0 2024-09-16T01:25:26.641 INFO:tasks.workunit.client.0.smithi063.stdout:7/948: truncate d7/d56/d57/f78 120213 0 2024-09-16T01:25:26.644 INFO:tasks.workunit.client.0.smithi063.stdout:3/957: sync 2024-09-16T01:25:26.645 INFO:tasks.workunit.client.0.smithi063.stdout:8/887: dwrite d5/db/d12/db0/fcb [0,4194304] 0 2024-09-16T01:25:26.645 INFO:tasks.workunit.client.0.smithi063.stdout:7/949: mkdir d7/d56/d57/d60/db9/de0/deb/d11c/d12d 0 2024-09-16T01:25:26.646 INFO:tasks.workunit.client.0.smithi063.stdout:3/958: readlink d2/d11/d37/d40/d5e/d3b/d68/d6d/d79/lc3 0 2024-09-16T01:25:26.653 INFO:tasks.workunit.client.0.smithi063.stdout:7/950: dread d7/d1c/d1f/d29/dbf/d39/d9d/f100 [0,4194304] 0 2024-09-16T01:25:26.653 INFO:tasks.workunit.client.0.smithi063.stdout:3/959: link d2/d11/d37/d40/d5e/d3b/d45/d9f/f101 d2/d11/d37/d40/d5e/d3b/d94/d30/f145 0 2024-09-16T01:25:26.654 INFO:tasks.workunit.client.0.smithi063.stdout:8/888: dwrite d5/d8c/d74/d87/fd7 [0,4194304] 0 2024-09-16T01:25:26.655 INFO:tasks.workunit.client.0.smithi063.stdout:7/951: write d7/d56/f55 [5638301,71488] 0 2024-09-16T01:25:26.658 INFO:tasks.workunit.client.0.smithi063.stdout:7/952: read d7/d56/d57/d73/f75 [353923,67430] 0 2024-09-16T01:25:26.658 INFO:tasks.workunit.client.0.smithi063.stdout:8/889: unlink d5/db/d12/f64 0 2024-09-16T01:25:26.660 INFO:tasks.workunit.client.0.smithi063.stdout:3/960: creat d2/d11/d37/d40/d5e/ddc/d121/f146 x:0 0 0 2024-09-16T01:25:26.664 INFO:tasks.workunit.client.0.smithi063.stdout:8/890: rmdir d5/d8c/d74/db7 39 2024-09-16T01:25:26.665 INFO:tasks.workunit.client.0.smithi063.stdout:3/961: mknod d2/d11/d69/d80/d131/c147 0 2024-09-16T01:25:26.671 INFO:tasks.workunit.client.0.smithi063.stdout:7/953: dread d7/d1c/d1f/d29/dbf/d40/fa9 [0,4194304] 0 2024-09-16T01:25:26.676 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:26 smithi192 ceph-mon[34775]: pgmap v398: 97 pgs: 97 active+clean; 1.6 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 205 MiB/s wr, 374 op/s 2024-09-16T01:25:26.677 INFO:tasks.workunit.client.0.smithi063.stdout:7/954: getdents d7/d56/d57/d60/de9 0 2024-09-16T01:25:26.677 INFO:tasks.workunit.client.0.smithi063.stdout:8/891: dwrite d5/db/d12/d3d/d69/daa/d40/d4a/f8b [0,4194304] 0 2024-09-16T01:25:26.679 INFO:tasks.workunit.client.0.smithi063.stdout:8/892: symlink d5/db/d12/d3d/d69/daa/d40/l11f 0 2024-09-16T01:25:26.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:26 smithi162 ceph-mon[34539]: pgmap v398: 97 pgs: 97 active+clean; 1.6 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 205 MiB/s wr, 374 op/s 2024-09-16T01:25:26.684 INFO:tasks.workunit.client.0.smithi063.stdout:8/893: fdatasync d5/db/d12/d1a/d1e/d93/f9a 0 2024-09-16T01:25:26.684 INFO:tasks.workunit.client.0.smithi063.stdout:3/962: dread d2/d11/d18/fd [0,4194304] 0 2024-09-16T01:25:26.685 INFO:tasks.workunit.client.0.smithi063.stdout:7/955: dwrite d7/d1c/d1f/d66/d101/f127 [0,4194304] 0 2024-09-16T01:25:26.687 INFO:tasks.workunit.client.0.smithi063.stdout:7/956: creat d7/d1c/dd2/f12e x:0 0 0 2024-09-16T01:25:26.689 INFO:tasks.workunit.client.0.smithi063.stdout:8/894: write d5/f83 [898199,97717] 0 2024-09-16T01:25:26.691 INFO:tasks.workunit.client.0.smithi063.stdout:8/895: fdatasync d5/db/d12/fa7 0 2024-09-16T01:25:26.694 INFO:tasks.workunit.client.0.smithi063.stdout:8/896: read d5/d9/d2f/f85 [1768445,89657] 0 2024-09-16T01:25:26.695 INFO:tasks.workunit.client.0.smithi063.stdout:3/963: dwrite d2/f75 [0,4194304] 0 2024-09-16T01:25:26.697 INFO:tasks.workunit.client.0.smithi063.stdout:7/957: dwrite d7/d56/fbc [0,4194304] 0 2024-09-16T01:25:26.698 INFO:tasks.workunit.client.0.smithi063.stdout:8/897: chown d5/db/d12/d3d/d69/daa/d40/d4a/fca 877559 1 2024-09-16T01:25:26.702 INFO:tasks.workunit.client.0.smithi063.stdout:7/958: rename d7/d56/ff8 to d7/d1c/d1f/d12c/f12f 0 2024-09-16T01:25:26.703 INFO:tasks.workunit.client.0.smithi063.stdout:8/898: write d5/db/d12/d1a/d60/f91 [1849793,54153] 0 2024-09-16T01:25:26.705 INFO:tasks.workunit.client.0.smithi063.stdout:3/964: dread d2/d11/d69/d80/d8a/ff6 [0,4194304] 0 2024-09-16T01:25:26.706 INFO:tasks.workunit.client.0.smithi063.stdout:8/899: rmdir d5/db/d12/d1a/d1e 39 2024-09-16T01:25:26.707 INFO:tasks.workunit.client.0.smithi063.stdout:3/965: dread - d2/d11/d37/dce/f144 zero size 2024-09-16T01:25:26.709 INFO:tasks.workunit.client.0.smithi063.stdout:7/959: rename d7/d1c/d1f/d29/dbf/d39/d65/l79 to d7/d56/d57/d60/db9/de0/deb/d11c/l130 0 2024-09-16T01:25:26.713 INFO:tasks.workunit.client.0.smithi063.stdout:7/960: dread d7/d56/d6b/d86/f5f [0,4194304] 0 2024-09-16T01:25:26.714 INFO:tasks.workunit.client.0.smithi063.stdout:8/900: link d5/d8c/d74/d87/cf8 d5/d8c/dbd/c120 0 2024-09-16T01:25:26.718 INFO:tasks.workunit.client.0.smithi063.stdout:8/901: write d5/db/d12/d3d/d69/daa/d40/d4a/fdd [8276665,12478] 0 2024-09-16T01:25:26.722 INFO:tasks.workunit.client.0.smithi063.stdout:7/961: dwrite d7/d56/fbc [4194304,4194304] 0 2024-09-16T01:25:26.724 INFO:tasks.workunit.client.0.smithi063.stdout:8/902: rmdir d5/db/d12/d3d/d69/daa/d40 39 2024-09-16T01:25:26.725 INFO:tasks.workunit.client.0.smithi063.stdout:8/903: write d5/f83 [2380692,46842] 0 2024-09-16T01:25:26.725 INFO:tasks.workunit.client.0.smithi063.stdout:3/966: dread d2/d11/d37/d40/d5e/d97/f126 [0,4194304] 0 2024-09-16T01:25:26.727 INFO:tasks.workunit.client.0.smithi063.stdout:7/962: link d7/d1c/d1f/d66/l99 d7/d56/d57/d60/db9/de0/deb/l131 0 2024-09-16T01:25:26.728 INFO:tasks.workunit.client.0.smithi063.stdout:8/904: creat d5/db/d12/db0/f121 x:0 0 0 2024-09-16T01:25:26.729 INFO:tasks.workunit.client.0.smithi063.stdout:3/967: rmdir d2/d5b/db4 39 2024-09-16T01:25:26.734 INFO:tasks.workunit.client.0.smithi063.stdout:6/984: sync 2024-09-16T01:25:26.734 INFO:tasks.workunit.client.0.smithi063.stdout:8/905: dwrite d5/db/d12/db0/d10a/f10c [0,4194304] 0 2024-09-16T01:25:26.736 INFO:tasks.workunit.client.0.smithi063.stdout:3/968: rename d2/d11/d37/d40/d5e/d3b/d94 to d2/d11/d37/d40/d5e/ddc/d148 0 2024-09-16T01:25:26.736 INFO:tasks.workunit.client.0.smithi063.stdout:6/985: chown d3/d30/l3d 2 1 2024-09-16T01:25:26.738 INFO:tasks.workunit.client.0.smithi063.stdout:8/906: truncate d5/db/d12/d1a/fe2 299119 0 2024-09-16T01:25:26.739 INFO:tasks.workunit.client.0.smithi063.stdout:6/986: creat d3/d10/d11a/f159 x:0 0 0 2024-09-16T01:25:26.742 INFO:tasks.workunit.client.0.smithi063.stdout:3/969: link d2/d11/d37/d40/d5e/ddc/d148/d30/d7f/da6/cd7 d2/d11/d37/d40/d5e/ddc/d121/c149 0 2024-09-16T01:25:26.745 INFO:tasks.workunit.client.0.smithi063.stdout:6/987: dwrite d3/d30/d39/f145 [0,4194304] 0 2024-09-16T01:25:26.745 INFO:tasks.workunit.client.0.smithi063.stdout:3/970: mkdir d2/d11/d37/db1/dc2/d14a 0 2024-09-16T01:25:26.746 INFO:tasks.workunit.client.0.smithi063.stdout:6/988: fsync d3/d30/f78 0 2024-09-16T01:25:26.749 INFO:tasks.workunit.client.0.smithi063.stdout:3/971: mkdir d2/dc1/d14b 0 2024-09-16T01:25:26.752 INFO:tasks.workunit.client.0.smithi063.stdout:3/972: mkdir d2/d11/d37/db1/dc2/d14c 0 2024-09-16T01:25:26.752 INFO:tasks.workunit.client.0.smithi063.stdout:6/989: dwrite d3/d48/d28/d3e/d44/da4/d5a/d6b/feb [0,4194304] 0 2024-09-16T01:25:26.755 INFO:tasks.workunit.client.0.smithi063.stdout:3/973: creat d2/d11/d69/dfe/f14d x:0 0 0 2024-09-16T01:25:26.755 INFO:tasks.workunit.client.0.smithi063.stdout:3/974: chown d2/d11/d37 58 1 2024-09-16T01:25:26.756 INFO:tasks.workunit.client.0.smithi063.stdout:6/990: mkdir d3/d41/d9b/d15a 0 2024-09-16T01:25:26.758 INFO:tasks.workunit.client.0.smithi063.stdout:6/991: getdents d3/d30/d8d/d102/d14f 0 2024-09-16T01:25:26.760 INFO:tasks.workunit.client.0.smithi063.stdout:6/992: mknod d3/d10/d11a/c15b 0 2024-09-16T01:25:26.770 INFO:tasks.workunit.client.0.smithi063.stdout:6/993: dwrite d3/f57 [0,4194304] 0 2024-09-16T01:25:26.770 INFO:tasks.workunit.client.0.smithi063.stdout:3/975: dread d2/d11/d69/d80/d131/f140 [0,4194304] 0 2024-09-16T01:25:26.772 INFO:tasks.workunit.client.0.smithi063.stdout:6/994: write d3/d10/d49/f9e [2280195,104749] 0 2024-09-16T01:25:26.774 INFO:tasks.workunit.client.0.smithi063.stdout:6/995: mkdir d3/d41/d9b/d15c 0 2024-09-16T01:25:26.777 INFO:tasks.workunit.client.0.smithi063.stdout:6/996: fdatasync d3/d30/d8d/d102/d91/f157 0 2024-09-16T01:25:26.780 INFO:tasks.workunit.client.0.smithi063.stdout:3/976: rename d2/d11/d37/d40/d5e/d3b/d45 to d2/d11/d69/d85/d14e 0 2024-09-16T01:25:26.781 INFO:tasks.workunit.client.0.smithi063.stdout:6/997: rename d3/d30/d39/dac/db5/da7/lfc to d3/d30/d8d/d102/d91/d114/l15d 0 2024-09-16T01:25:26.782 INFO:tasks.workunit.client.0.smithi063.stdout:6/998: chown d3/d10/d49/f10a 56783761 1 2024-09-16T01:25:26.783 INFO:tasks.workunit.client.0.smithi063.stdout:3/977: symlink d2/d11/d37/d40/d5e/ddc/d148/l14f 0 2024-09-16T01:25:26.785 INFO:tasks.workunit.client.0.smithi063.stdout:3/978: creat d2/d11/d69/d85/f150 x:0 0 0 2024-09-16T01:25:26.788 INFO:tasks.workunit.client.0.smithi063.stdout:6/999: dwrite d3/d48/d28/f118 [0,4194304] 0 2024-09-16T01:25:26.796 INFO:tasks.workunit.client.0.smithi063.stdout:3/979: dwrite d2/d11/d37/d40/d5e/f20 [0,4194304] 0 2024-09-16T01:25:26.799 INFO:tasks.workunit.client.0.smithi063.stdout:3/980: read d2/d11/d37/d40/d5e/d3b/d68/d6d/f10c [3980344,126294] 0 2024-09-16T01:25:26.801 INFO:tasks.workunit.client.0.smithi063.stdout:3/981: mknod d2/d11/d37/db1/dc2/d14a/c151 0 2024-09-16T01:25:26.803 INFO:tasks.workunit.client.0.smithi063.stdout:3/982: rename d2/d11/d69/d85/d14e/l5a to d2/d11/d37/d40/d5e/ddc/l152 0 2024-09-16T01:25:26.806 INFO:tasks.workunit.client.0.smithi063.stdout:3/983: mknod d2/d11/d37/db1/dc2/d14c/c153 0 2024-09-16T01:25:26.808 INFO:tasks.workunit.client.0.smithi063.stdout:3/984: mknod d2/d11/d37/d40/d5e/d97/c154 0 2024-09-16T01:25:26.808 INFO:tasks.workunit.client.0.smithi063.stdout:3/985: fsync d2/d11/d37/d40/d5e/d3b/d68/dd2/f12a 0 2024-09-16T01:25:26.809 INFO:tasks.workunit.client.0.smithi063.stdout:3/986: write d2/d11/f100 [376379,122194] 0 2024-09-16T01:25:26.813 INFO:tasks.workunit.client.0.smithi063.stdout:3/987: mkdir d2/d11/d37/d40/d5e/ddc/d155 0 2024-09-16T01:25:26.817 INFO:tasks.workunit.client.0.smithi063.stdout:3/988: dwrite d2/d11/d37/d40/d5e/d3b/d68/dd2/de2/f114 [0,4194304] 0 2024-09-16T01:25:26.819 INFO:tasks.workunit.client.0.smithi063.stdout:3/989: write d2/d11/d37/d40/d5e/d3b/d68/d6d/f122 [482060,6881] 0 2024-09-16T01:25:26.823 INFO:tasks.workunit.client.0.smithi063.stdout:3/990: rmdir d2/d11/d37/dab/d10b 0 2024-09-16T01:25:26.825 INFO:tasks.workunit.client.0.smithi063.stdout:3/991: stat d2/d11/d37/d40/d5e/d3b/d68/c117 0 2024-09-16T01:25:26.826 INFO:tasks.workunit.client.0.smithi063.stdout:3/992: mkdir d2/d5b/d90/d156 0 2024-09-16T01:25:26.827 INFO:tasks.workunit.client.0.smithi063.stdout:3/993: readlink d2/d11/d69/d85/d14e/d9f/la5 0 2024-09-16T01:25:26.827 INFO:tasks.workunit.client.0.smithi063.stdout:3/994: readlink d2/d11/d37/d40/d5e/l82 0 2024-09-16T01:25:26.835 INFO:tasks.workunit.client.0.smithi063.stdout:3/995: dwrite d2/d11/f1d [0,4194304] 0 2024-09-16T01:25:26.837 INFO:tasks.workunit.client.0.smithi063.stdout:3/996: mknod d2/d11/d37/db1/dc2/d129/c157 0 2024-09-16T01:25:26.841 INFO:tasks.workunit.client.0.smithi063.stdout:3/997: creat d2/d11/d37/d40/d5e/ddc/f158 x:0 0 0 2024-09-16T01:25:26.842 INFO:tasks.workunit.client.0.smithi063.stdout:3/998: read d2/f81 [468959,34584] 0 2024-09-16T01:25:26.857 INFO:tasks.workunit.client.0.smithi063.stdout:3/999: dread d2/d11/d69/d80/d8a/fa8 [0,4194304] 0 2024-09-16T01:25:26.894 INFO:tasks.workunit.client.0.smithi063.stdout:7/963: sync 2024-09-16T01:25:26.894 INFO:tasks.workunit.client.0.smithi063.stdout:8/907: sync 2024-09-16T01:25:26.895 INFO:tasks.workunit.client.0.smithi063.stdout:8/908: readlink d5/l102 0 2024-09-16T01:25:26.897 INFO:tasks.workunit.client.0.smithi063.stdout:8/909: rename d5/db/d12/d1a/d1e to d5/db/d12/d1a/d1e/d68/d122 22 2024-09-16T01:25:26.901 INFO:tasks.workunit.client.0.smithi063.stdout:8/910: dread d5/db/df2/ff6 [4194304,4194304] 0 2024-09-16T01:25:26.901 INFO:tasks.workunit.client.0.smithi063.stdout:7/964: dwrite d7/d1c/d1f/d29/d72/fa8 [0,4194304] 0 2024-09-16T01:25:26.905 INFO:tasks.workunit.client.0.smithi063.stdout:8/911: write d5/db/d12/d3d/d69/daa/d40/fb3 [3614259,104292] 0 2024-09-16T01:25:26.905 INFO:tasks.workunit.client.0.smithi063.stdout:8/912: dread - d5/db/fd1 zero size 2024-09-16T01:25:26.906 INFO:tasks.workunit.client.0.smithi063.stdout:7/965: rename d7/d1c/d1f/d29/d72/dc9/fce to d7/d56/d57/d60/db9/de0/f132 0 2024-09-16T01:25:26.908 INFO:tasks.workunit.client.0.smithi063.stdout:8/913: creat d5/db/d12/db0/f123 x:0 0 0 2024-09-16T01:25:26.908 INFO:tasks.workunit.client.0.smithi063.stdout:7/966: stat d7/d1c/d1f/d29/d88/d98/fbe 0 2024-09-16T01:25:26.910 INFO:tasks.workunit.client.0.smithi063.stdout:7/967: creat d7/d56/d6b/d86/f133 x:0 0 0 2024-09-16T01:25:26.911 INFO:tasks.workunit.client.0.smithi063.stdout:8/914: rename d5/db/d12/d1a/d1e/d93/fe7 to d5/d9/d2f/f124 0 2024-09-16T01:25:26.912 INFO:tasks.workunit.client.0.smithi063.stdout:8/915: chown d5/db/d12/lcf 5855984 1 2024-09-16T01:25:26.912 INFO:tasks.workunit.client.0.smithi063.stdout:7/968: mkdir d7/dd6/d134 0 2024-09-16T01:25:26.914 INFO:tasks.workunit.client.0.smithi063.stdout:8/916: mkdir d5/d8c/d74/d87/d125 0 2024-09-16T01:25:26.917 INFO:tasks.workunit.client.0.smithi063.stdout:7/969: link d7/d1c/d1f/d29/fb7 d7/d1c/d1f/d66/d70/da2/f135 0 2024-09-16T01:25:26.919 INFO:tasks.workunit.client.0.smithi063.stdout:7/970: read d7/d56/d57/d60/db9/dd8/df1/ff7 [634958,113751] 0 2024-09-16T01:25:26.919 INFO:tasks.workunit.client.0.smithi063.stdout:8/917: link d5/db/d12/d3d/lbb d5/db/d12/d1a/d1e/d93/dfe/l126 0 2024-09-16T01:25:26.921 INFO:tasks.workunit.client.0.smithi063.stdout:8/918: creat d5/db/d12/d1a/d60/f127 x:0 0 0 2024-09-16T01:25:26.922 INFO:tasks.workunit.client.0.smithi063.stdout:7/971: link d7/d1c/d1f/d29/dbf/d39/d9d/f100 d7/d1c/d1f/d29/d88/d98/f136 0 2024-09-16T01:25:26.923 INFO:tasks.workunit.client.0.smithi063.stdout:8/919: unlink d5/db/d12/d3d/d69/cb6 0 2024-09-16T01:25:26.924 INFO:tasks.workunit.client.0.smithi063.stdout:7/972: mknod d7/d56/d6b/d86/d114/c137 0 2024-09-16T01:25:26.925 INFO:tasks.workunit.client.0.smithi063.stdout:8/920: write d5/d86/f95 [1273343,103435] 0 2024-09-16T01:25:26.926 INFO:tasks.workunit.client.0.smithi063.stdout:7/973: symlink d7/d1c/d1f/d29/d72/l138 0 2024-09-16T01:25:26.928 INFO:tasks.workunit.client.0.smithi063.stdout:7/974: mkdir d7/d1c/d1f/d29/dbf/d39/d139 0 2024-09-16T01:25:26.929 INFO:tasks.workunit.client.0.smithi063.stdout:8/921: rmdir d5/d8c/d74/d87/d125 0 2024-09-16T01:25:26.930 INFO:tasks.workunit.client.0.smithi063.stdout:7/975: mkdir d7/d1c/d1f/d29/d88/d13a 0 2024-09-16T01:25:26.931 INFO:tasks.workunit.client.0.smithi063.stdout:7/976: fdatasync d7/d56/f71 0 2024-09-16T01:25:26.933 INFO:tasks.workunit.client.0.smithi063.stdout:8/922: link d5/db/d12/d1a/f4b d5/d9/d98/f128 0 2024-09-16T01:25:26.934 INFO:tasks.workunit.client.0.smithi063.stdout:8/923: chown d5/db/d12/d1a/d60/ff1 3608 1 2024-09-16T01:25:26.935 INFO:tasks.workunit.client.0.smithi063.stdout:8/924: chown d5/db/d12/d1a/d60/da8/f113 0 1 2024-09-16T01:25:26.938 INFO:tasks.workunit.client.0.smithi063.stdout:7/977: fsync d7/d1c/d1f/d29/fb7 0 2024-09-16T01:25:26.939 INFO:tasks.workunit.client.0.smithi063.stdout:7/978: chown d7/d1c/d1f/d29/dbf/d40/d6c/fc3 80098 1 2024-09-16T01:25:26.950 INFO:tasks.workunit.client.0.smithi063.stdout:8/925: dwrite d5/d86/feb [0,4194304] 0 2024-09-16T01:25:26.951 INFO:tasks.workunit.client.0.smithi063.stdout:7/979: dread d7/fe [0,4194304] 0 2024-09-16T01:25:26.958 INFO:tasks.workunit.client.0.smithi063.stdout:8/926: truncate d5/db/d12/d1a/d1e/d68/dc9/f56 1316084 0 2024-09-16T01:25:26.959 INFO:tasks.workunit.client.0.smithi063.stdout:7/980: dwrite d7/f77 [0,4194304] 0 2024-09-16T01:25:26.961 INFO:tasks.workunit.client.0.smithi063.stdout:7/981: write d7/d1c/d1f/d29/d88/d96/dca/ffa [2429914,96260] 0 2024-09-16T01:25:26.962 INFO:tasks.workunit.client.0.smithi063.stdout:8/927: getdents d5/d8c/d74 0 2024-09-16T01:25:26.963 INFO:tasks.workunit.client.0.smithi063.stdout:8/928: readlink d5/d9/d2f/l5d 0 2024-09-16T01:25:26.966 INFO:tasks.workunit.client.0.smithi063.stdout:7/982: rename d7/d1c/d1f/d12c to d7/d1c/d1f/d29/dbf/d39/d65/d13b 0 2024-09-16T01:25:26.968 INFO:tasks.workunit.client.0.smithi063.stdout:8/929: read d5/db/d12/d3d/d69/f6d [3676941,111843] 0 2024-09-16T01:25:26.968 INFO:tasks.workunit.client.0.smithi063.stdout:7/983: dread - d7/d1c/d1f/d29/dbf/d40/fab zero size 2024-09-16T01:25:26.970 INFO:tasks.workunit.client.0.smithi063.stdout:7/984: write d7/d1c/d1f/d29/d88/d96/dca/ffa [5202071,70169] 0 2024-09-16T01:25:26.973 INFO:tasks.workunit.client.0.smithi063.stdout:7/985: creat d7/d1c/d1f/d29/d72/dc9/f13c x:0 0 0 2024-09-16T01:25:26.974 INFO:tasks.workunit.client.0.smithi063.stdout:8/930: dwrite d5/db/f103 [0,4194304] 0 2024-09-16T01:25:26.978 INFO:tasks.workunit.client.0.smithi063.stdout:7/986: fdatasync d7/d56/d57/d73/fdb 0 2024-09-16T01:25:26.981 INFO:tasks.workunit.client.0.smithi063.stdout:7/987: creat d7/d56/d57/d73/d91/db4/f13d x:0 0 0 2024-09-16T01:25:26.982 INFO:tasks.workunit.client.0.smithi063.stdout:7/988: write d7/d56/d57/d73/fcf [4769954,59992] 0 2024-09-16T01:25:26.983 INFO:tasks.workunit.client.0.smithi063.stdout:8/931: getdents d5/db/d12/d1a/d60 0 2024-09-16T01:25:26.984 INFO:tasks.workunit.client.0.smithi063.stdout:7/989: creat d7/d56/d57/d60/db9/de0/f13e x:0 0 0 2024-09-16T01:25:26.985 INFO:tasks.workunit.client.0.smithi063.stdout:7/990: write d7/d56/d57/d73/d91/fd1 [1215627,7321] 0 2024-09-16T01:25:26.986 INFO:tasks.workunit.client.0.smithi063.stdout:7/991: chown d7/d1c/d1f/d29/dbf/f22 12 1 2024-09-16T01:25:26.989 INFO:tasks.workunit.client.0.smithi063.stdout:7/992: creat d7/d56/d57/d73/d91/f13f x:0 0 0 2024-09-16T01:25:26.990 INFO:tasks.workunit.client.0.smithi063.stdout:7/993: write d7/d1c/d1f/d29/db5/f121 [3092753,1204] 0 2024-09-16T01:25:26.991 INFO:tasks.workunit.client.0.smithi063.stdout:7/994: rmdir d7/d56/d57/d73 39 2024-09-16T01:25:26.996 INFO:tasks.workunit.client.0.smithi063.stdout:7/995: dwrite d7/d56/d57/d60/f63 [0,4194304] 0 2024-09-16T01:25:26.998 INFO:tasks.workunit.client.0.smithi063.stdout:7/996: chown d7/d56/d57/d60/f63 4197 1 2024-09-16T01:25:26.998 INFO:tasks.workunit.client.0.smithi063.stdout:7/997: fsync d7/d1c/d1f/d29/d72/d9e/fea 0 2024-09-16T01:25:27.000 INFO:tasks.workunit.client.0.smithi063.stdout:7/998: symlink d7/d56/d57/d126/l140 0 2024-09-16T01:25:27.010 INFO:tasks.workunit.client.0.smithi063.stdout:7/999: dread d7/d1c/d1f/d29/dbf/d40/d6c/fe8 [0,4194304] 0 2024-09-16T01:25:27.095 INFO:tasks.workunit.client.0.smithi063.stdout:8/932: sync 2024-09-16T01:25:27.097 INFO:tasks.workunit.client.0.smithi063.stdout:8/933: rmdir d5/db/d12/d1a/d1e 39 2024-09-16T01:25:27.098 INFO:tasks.workunit.client.0.smithi063.stdout:8/934: chown d5/d86/f11a 1 1 2024-09-16T01:25:27.110 INFO:tasks.workunit.client.0.smithi063.stdout:8/935: dread d5/db/d12/d3d/d69/f6d [0,4194304] 0 2024-09-16T01:25:27.112 INFO:tasks.workunit.client.0.smithi063.stdout:8/936: symlink d5/db/d12/d3d/d69/daa/l129 0 2024-09-16T01:25:27.115 INFO:tasks.workunit.client.0.smithi063.stdout:8/937: getdents d5/d8c/dbd/de4 0 2024-09-16T01:25:27.116 INFO:tasks.workunit.client.0.smithi063.stdout:8/938: read d5/fc1 [710494,74699] 0 2024-09-16T01:25:27.118 INFO:tasks.workunit.client.0.smithi063.stdout:8/939: mknod d5/d9/d98/c12a 0 2024-09-16T01:25:27.123 INFO:tasks.workunit.client.0.smithi063.stdout:8/940: dwrite d5/db/d12/d1a/d1e/fb1 [0,4194304] 0 2024-09-16T01:25:27.124 INFO:tasks.workunit.client.0.smithi063.stdout:8/941: stat d5/db/d12/d3d/d69/daa/d40 0 2024-09-16T01:25:27.130 INFO:tasks.workunit.client.0.smithi063.stdout:8/942: getdents d5/db/d12/d1a 0 2024-09-16T01:25:27.132 INFO:tasks.workunit.client.0.smithi063.stdout:8/943: creat d5/d8c/d74/d87/f12b x:0 0 0 2024-09-16T01:25:27.137 INFO:tasks.workunit.client.0.smithi063.stdout:8/944: dwrite d5/db/d12/d3d/d69/daa/d40/d4a/fdd [0,4194304] 0 2024-09-16T01:25:27.140 INFO:tasks.workunit.client.0.smithi063.stdout:8/945: creat d5/db/d12/db0/d10a/f12c x:0 0 0 2024-09-16T01:25:27.142 INFO:tasks.workunit.client.0.smithi063.stdout:8/946: truncate d5/d8c/d74/d87/fa5 1476458 0 2024-09-16T01:25:27.152 INFO:tasks.workunit.client.0.smithi063.stdout:8/947: dwrite d5/db/d12/d1a/d1e/d93/f9a [0,4194304] 0 2024-09-16T01:25:27.156 INFO:tasks.workunit.client.0.smithi063.stdout:8/948: dread d5/d8c/d74/d87/fd7 [0,4194304] 0 2024-09-16T01:25:27.158 INFO:tasks.workunit.client.0.smithi063.stdout:8/949: fdatasync d5/d8c/fe0 0 2024-09-16T01:25:27.162 INFO:tasks.workunit.client.0.smithi063.stdout:8/950: getdents d5/db/d12/db0/d10a 0 2024-09-16T01:25:27.163 INFO:tasks.workunit.client.0.smithi063.stdout:8/951: fdatasync d5/db/d12/d3d/d69/daa/fda 0 2024-09-16T01:25:27.169 INFO:tasks.workunit.client.0.smithi063.stdout:8/952: write d5/d8c/d74/db7/fc7 [1022806,24739] 0 2024-09-16T01:25:27.170 INFO:tasks.workunit.client.0.smithi063.stdout:8/953: dread - d5/db/d12/d3d/d69/daa/d40/d4a/fde zero size 2024-09-16T01:25:27.174 INFO:tasks.workunit.client.0.smithi063.stdout:8/954: dread d5/db/d12/d1a/f4b [0,4194304] 0 2024-09-16T01:25:27.178 INFO:tasks.workunit.client.0.smithi063.stdout:8/955: dwrite d5/f58 [0,4194304] 0 2024-09-16T01:25:27.184 INFO:tasks.workunit.client.0.smithi063.stdout:8/956: rename d5/db/d12/d3d/d69/daa/d40/fb3 to d5/db/d12/db0/d10a/f12d 0 2024-09-16T01:25:27.185 INFO:tasks.workunit.client.0.smithi063.stdout:8/957: read d5/db/d12/d1a/d1e/d93/f9a [2758878,113485] 0 2024-09-16T01:25:27.187 INFO:tasks.workunit.client.0.smithi063.stdout:8/958: truncate d5/d8c/fe0 489268 0 2024-09-16T01:25:27.192 INFO:tasks.workunit.client.0.smithi063.stdout:8/959: dread d5/d86/fd6 [0,4194304] 0 2024-09-16T01:25:27.193 INFO:tasks.workunit.client.0.smithi063.stdout:8/960: write d5/d8c/dbd/fd0 [2437239,64134] 0 2024-09-16T01:25:27.195 INFO:tasks.workunit.client.0.smithi063.stdout:8/961: creat d5/d8c/d74/f12e x:0 0 0 2024-09-16T01:25:27.196 INFO:tasks.workunit.client.0.smithi063.stdout:8/962: chown d5/db/d12/d1a/d1e/d68/dc9/fd8 133 1 2024-09-16T01:25:27.202 INFO:tasks.workunit.client.0.smithi063.stdout:8/963: mkdir d5/db/d12/d12f 0 2024-09-16T01:25:27.202 INFO:tasks.workunit.client.0.smithi063.stdout:8/964: mkdir d5/db/d12/d1a/d1e/d93/db8/d130 0 2024-09-16T01:25:27.204 INFO:tasks.workunit.client.0.smithi063.stdout:8/965: dread d5/db/d12/d1a/d1e/d93/f9a [0,4194304] 0 2024-09-16T01:25:27.209 INFO:tasks.workunit.client.0.smithi063.stdout:8/966: rename d5/d9/d98 to d5/d8c/d74/db7/d131 0 2024-09-16T01:25:27.216 INFO:tasks.workunit.client.0.smithi063.stdout:8/967: truncate d5/db/d12/db0/d10a/f10c 2802165 0 2024-09-16T01:25:27.217 INFO:tasks.workunit.client.0.smithi063.stdout:8/968: creat d5/db/d12/db0/f132 x:0 0 0 2024-09-16T01:25:27.218 INFO:tasks.workunit.client.0.smithi063.stdout:8/969: readlink d5/db/d12/d3d/d69/daa/l105 0 2024-09-16T01:25:27.219 INFO:tasks.workunit.client.0.smithi063.stdout:8/970: mkdir d5/d9/d133 0 2024-09-16T01:25:27.220 INFO:tasks.workunit.client.0.smithi063.stdout:8/971: chown d5/db/d12/d3d/fbc 78714 1 2024-09-16T01:25:27.223 INFO:tasks.workunit.client.0.smithi063.stdout:8/972: link d5/db/d12/d3d/fbc d5/db/d12/db0/d10a/f134 0 2024-09-16T01:25:27.229 INFO:tasks.workunit.client.0.smithi063.stdout:8/973: dread d5/d8c/d74/d87/fa5 [0,4194304] 0 2024-09-16T01:25:27.231 INFO:tasks.workunit.client.0.smithi063.stdout:8/974: symlink d5/db/d12/d1a/d60/l135 0 2024-09-16T01:25:27.234 INFO:tasks.workunit.client.0.smithi063.stdout:8/975: dread d5/db/d12/db0/fcb [0,4194304] 0 2024-09-16T01:25:27.235 INFO:tasks.workunit.client.0.smithi063.stdout:8/976: write d5/db/d12/d1a/fa0 [785454,38908] 0 2024-09-16T01:25:27.242 INFO:tasks.workunit.client.0.smithi063.stdout:8/977: write d5/db/d12/d1a/d1e/d68/dc9/f56 [487354,119622] 0 2024-09-16T01:25:27.247 INFO:tasks.workunit.client.0.smithi063.stdout:8/978: dwrite d5/db/d12/d3d/d69/daa/d40/d4a/fca [0,4194304] 0 2024-09-16T01:25:27.249 INFO:tasks.workunit.client.0.smithi063.stdout:8/979: write d5/d8c/dbd/fd0 [1505407,105920] 0 2024-09-16T01:25:27.251 INFO:tasks.workunit.client.0.smithi063.stdout:8/980: creat d5/d86/f136 x:0 0 0 2024-09-16T01:25:27.257 INFO:tasks.workunit.client.0.smithi063.stdout:8/981: dwrite d5/db/d12/db0/d10a/f12c [0,4194304] 0 2024-09-16T01:25:27.262 INFO:tasks.workunit.client.0.smithi063.stdout:8/982: rename d5/db/d12/d3d/d69/daa/c3e to d5/db/d12/db0/d10a/c137 0 2024-09-16T01:25:27.265 INFO:tasks.workunit.client.0.smithi063.stdout:8/983: link d5/db/d12/d1a/d1e/d93/f110 d5/d9/d133/f138 0 2024-09-16T01:25:27.267 INFO:tasks.workunit.client.0.smithi063.stdout:8/984: mkdir d5/db/d12/d139 0 2024-09-16T01:25:27.267 INFO:tasks.workunit.client.0.smithi063.stdout:8/985: chown d5/d9/d133 1260557 1 2024-09-16T01:25:27.269 INFO:tasks.workunit.client.0.smithi063.stdout:8/986: mkdir d5/db/d12/d1a/d60/d13a 0 2024-09-16T01:25:27.271 INFO:tasks.workunit.client.0.smithi063.stdout:8/987: unlink d5/d8c/d74/d87/cad 0 2024-09-16T01:25:27.273 INFO:tasks.workunit.client.0.smithi063.stdout:8/988: creat d5/f13b x:0 0 0 2024-09-16T01:25:27.396 INFO:tasks.workunit.client.0.smithi063.stdout:8/989: sync 2024-09-16T01:25:27.402 INFO:tasks.workunit.client.0.smithi063.stdout:8/990: dwrite d5/db/d12/d3d/d69/daa/d40/d4a/fca [0,4194304] 0 2024-09-16T01:25:27.404 INFO:tasks.workunit.client.0.smithi063.stdout:8/991: creat d5/db/d12/d1a/d60/d7a/f13c x:0 0 0 2024-09-16T01:25:27.405 INFO:tasks.workunit.client.0.smithi063.stdout:8/992: write d5/db/d12/d1a/d1e/d68/dc9/f56 [726676,130650] 0 2024-09-16T01:25:27.406 INFO:tasks.workunit.client.0.smithi063.stdout:8/993: fsync d5/f83 0 2024-09-16T01:25:27.412 INFO:tasks.workunit.client.0.smithi063.stdout:8/994: getdents d5/d8c/d74/d100 0 2024-09-16T01:25:27.413 INFO:tasks.workunit.client.0.smithi063.stdout:8/995: readlink d5/db/d12/d3d/d69/daa/d40/l11f 0 2024-09-16T01:25:27.414 INFO:tasks.workunit.client.0.smithi063.stdout:8/996: write d5/db/d12/db0/f132 [720894,125281] 0 2024-09-16T01:25:27.416 INFO:tasks.workunit.client.0.smithi063.stdout:8/997: creat d5/db/d12/d3d/f13d x:0 0 0 2024-09-16T01:25:27.418 INFO:tasks.workunit.client.0.smithi063.stdout:8/998: mkdir d5/d8c/dbd/d13e 0 2024-09-16T01:25:27.419 INFO:tasks.workunit.client.0.smithi063.stdout:8/999: fsync d5/db/d12/d1a/d60/da8/f113 0 2024-09-16T01:25:27.425 INFO:tasks.workunit.client.0.smithi063.stderr:+ rm -rf -- ./tmp.82pyWvR6Li 2024-09-16T01:25:28.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:25:28.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:28 smithi063 ceph-mon[31070]: pgmap v399: 97 pgs: 97 active+clean; 2.0 GiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s rd, 261 MiB/s wr, 473 op/s 2024-09-16T01:25:28.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:28 smithi192 ceph-mon[34775]: pgmap v399: 97 pgs: 97 active+clean; 2.0 GiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s rd, 261 MiB/s wr, 473 op/s 2024-09-16T01:25:28.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:28 smithi162 ceph-mon[34539]: pgmap v399: 97 pgs: 97 active+clean; 2.0 GiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 85 MiB/s rd, 261 MiB/s wr, 473 op/s 2024-09-16T01:25:28.728 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:25:29.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.226+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/3805635605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08102ef0 msgr2=0x7f7a0810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:29.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.227+0000 7f7a0e1b0640 1 --2- 172.21.15.63:0/3805635605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08102ef0 0x7f7a0810da40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009cd0 tx=0x7f7a0002a970 comp rx=0 tx=0).stop 2024-09-16T01:25:29.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.227+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/3805635605 shutdown_connections 2024-09-16T01:25:29.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.227+0000 7f7a0e1b0640 1 --2- 172.21.15.63:0/3805635605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08102ef0 0x7f7a0810da40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.227+0000 7f7a0e1b0640 1 --2- 172.21.15.63:0/3805635605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a08102570 0x7f7a081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.227+0000 7f7a0e1b0640 1 --2- 172.21.15.63:0/3805635605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a08100e20 0x7f7a08101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.227+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/3805635605 >> 172.21.15.63:0/3805635605 conn(0x7f7a080fc7d0 msgr2=0x7f7a080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.227+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/3805635605 shutdown_connections 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.227+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/3805635605 wait complete. 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.227+0000 7f7a0e1b0640 1 Processor -- start 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a0e1b0640 1 -- start start 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a0e1b0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a08100e20 0x7f7a08198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a0e1b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08102570 0x7f7a08198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a0e1b0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a08102ef0 0x7f7a0819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a0e1b0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7a08110e30 con 0x7f7a08100e20 2024-09-16T01:25:29.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a0e1b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a08110cb0 con 0x7f7a08102570 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a0e1b0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7a08110fb0 con 0x7f7a08102ef0 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a077fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a08100e20 0x7f7a08198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a077fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a08100e20 0x7f7a08198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34102/0 (socket says 172.21.15.63:34102) 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a077fe640 1 -- 172.21.15.63:0/2590078391 learned_addr learned my addr 172.21.15.63:0/2590078391 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a06ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08102570 0x7f7a08198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a07fff640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a08102ef0 0x7f7a0819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a077fe640 1 -- 172.21.15.63:0/2590078391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a08102ef0 msgr2=0x7f7a0819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a077fe640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a08102ef0 0x7f7a0819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a077fe640 1 -- 172.21.15.63:0/2590078391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08102570 msgr2=0x7f7a08198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a077fe640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08102570 0x7f7a08198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a077fe640 1 -- 172.21.15.63:0/2590078391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0819d3c0 con 0x7f7a08100e20 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a07fff640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a08102ef0 0x7f7a0819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a06ffd640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08102570 0x7f7a08198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.228+0000 7f7a077fe640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a08100e20 0x7f7a08198410 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f79f800e9f0 tx=0x7f79f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.229+0000 7f7a04ff9640 1 -- 172.21.15.63:0/2590078391 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f800cd80 con 0x7f7a08100e20 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.229+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/2590078391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0819d6b0 con 0x7f7a08100e20 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.229+0000 7f7a04ff9640 1 -- 172.21.15.63:0/2590078391 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f79f80108e0 con 0x7f7a08100e20 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.229+0000 7f7a04ff9640 1 -- 172.21.15.63:0/2590078391 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8018920 con 0x7f7a08100e20 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.229+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/2590078391 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a081a4f90 con 0x7f7a08100e20 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.231+0000 7f7a10589740 1 Processor -- start 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.231+0000 7f7a10589740 1 -- start start 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a10589740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c2894a0 0x56098c289880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a10589740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c294140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a10589740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c294680 0x56098c296a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a10589740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56098c1ef2e0 con 0x56098c294680 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a10589740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56098c196ce0 con 0x56098c2894a0 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a10589740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56098c1eb2a0 con 0x56098c289dc0 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c2894a0 0x56098c289880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c2894a0 0x56098c289880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:43470/0 (socket says 172.21.15.63:43470) 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a07fff640 1 -- 172.21.15.63:0/1962602995 learned_addr learned my addr 172.21.15.63:0/1962602995 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a04ff9640 1 -- 172.21.15.63:0/2590078391 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f79f8010a90 con 0x7f7a08100e20 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a07fff640 1 -- 172.21.15.63:0/1962602995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 msgr2=0x56098c294140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a07fff640 1 --2- 172.21.15.63:0/1962602995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c294140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a07fff640 1 -- 172.21.15.63:0/1962602995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c294680 msgr2=0x56098c296a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a07fff640 1 --2- 172.21.15.63:0/1962602995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c294680 0x56098c296a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a07fff640 1 -- 172.21.15.63:0/1962602995 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56098c17b440 con 0x56098c2894a0 2024-09-16T01:25:29.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.232+0000 7f7a07fff640 1 --2- 172.21.15.63:0/1962602995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c2894a0 0x56098c289880 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a00005cc0 tx=0x7f7a00009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9321aa2241cd37f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.233+0000 7f79edffb640 1 -- 172.21.15.63:0/1962602995 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00034070 con 0x56098c2894a0 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.233+0000 7f79edffb640 1 -- 172.21.15.63:0/1962602995 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a00003970 con 0x56098c2894a0 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.233+0000 7f79edffb640 1 -- 172.21.15.63:0/1962602995 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00004040 con 0x56098c2894a0 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.233+0000 7f7a04ff9640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79f00a3240 0x7f79f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.233+0000 7f7a077fe640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79f00a3240 0x7f79f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.233+0000 7f7a04ff9640 1 -- 172.21.15.63:0/2590078391 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f79f80cfc90 con 0x7f7a08100e20 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 -- 172.21.15.63:0/1962602995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c2894a0 msgr2=0x56098c289880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 --2- 172.21.15.63:0/1962602995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c2894a0 0x56098c289880 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a00005cc0 tx=0x7f7a00009a20 comp rx=0 tx=0).stop 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a077fe640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79f00a3240 0x7f79f00a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f79f809c240 tx=0x7f79f80cff10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 -- 172.21.15.63:0/1962602995 shutdown_connections 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 --2- 172.21.15.63:0/1962602995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c294680 0x56098c296a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 --2- 172.21.15.63:0/1962602995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c294140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 --2- 172.21.15.63:0/1962602995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c2894a0 0x56098c289880 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 -- 172.21.15.63:0/1962602995 >> 172.21.15.63:0/1962602995 conn(0x56098c285a30 msgr2=0x56098c285e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 -- 172.21.15.63:0/1962602995 shutdown_connections 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 -- 172.21.15.63:0/1962602995 wait complete. 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 -- start start 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.234+0000 7f7a10589740 1 Processor -- start 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a10589740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c293fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a10589740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c289dc0 0x56098c291250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c293fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a10589740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c294680 0x56098c291790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a10589740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56098c297250 con 0x56098c2894a0 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c293fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34124/0 (socket says 172.21.15.63:34124) 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a10589740 1 -- 172.21.15.63:0/1716779336 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56098c1aa050 con 0x56098c289dc0 2024-09-16T01:25:29.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a10589740 1 -- 172.21.15.63:0/1716779336 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56098c2973d0 con 0x56098c294680 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a07fff640 1 -- 172.21.15.63:0/1716779336 learned_addr learned my addr 172.21.15.63:0/1716779336 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a10589740 10 client.0 _ll_register_callbacks cb 0x56098c1ea160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a06ffd640 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c289dc0 0x56098c291250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a07fff640 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c294680 0x56098c291790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a07fff640 1 -- 172.21.15.63:0/1716779336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c294680 msgr2=0x56098c291790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a07fff640 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c294680 0x56098c291790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a07fff640 1 -- 172.21.15.63:0/1716779336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c289dc0 msgr2=0x56098c291250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a07fff640 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c289dc0 0x56098c291250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a07fff640 1 -- 172.21.15.63:0/1716779336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56098bf603c0 con 0x56098c2894a0 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f7a07fff640 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c293fa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009bf0 tx=0x7f7a000098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46420bba9b192213 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.235+0000 7f79e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:25:29.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f79e6ffd640 1 -- 172.21.15.63:0/1716779336 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00034040 con 0x56098c2894a0 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f7a10589740 1 -- 172.21.15.63:0/1716779336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a00003970 con 0x56098c2894a0 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f79e6ffd640 1 -- 172.21.15.63:0/1716779336 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7a000308c0 con 0x56098c2894a0 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f79e6ffd640 1 -- 172.21.15.63:0/1716779336 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7a00058050 con 0x56098c2894a0 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f7a10589740 10 client.15468 fetch_fsmap learned FSMap version 26 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f7a10589740 1 -- 172.21.15.63:0/1716779336 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56098c297250 con 0x56098c2894a0 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f79e6ffd640 1 -- 172.21.15.63:0/1716779336 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a00003970 con 0x56098c2894a0 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f79e6ffd640 1 -- 172.21.15.63:0/1716779336 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7a00044c00 con 0x56098c2894a0 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f7a10589740 10 client.15468 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f7a10589740 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f7a10589740 20 client.15468 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f7a10589740 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56098c2a3d60 0x56098c2a6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f7a10589740 4 client.15468 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:25:29.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f7a10589740 1 -- 172.21.15.63:0/1716779336 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56098c1fc850 con 0x56098c2a3d60 2024-09-16T01:25:29.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.236+0000 7f7a06ffd640 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56098c2a3d60 0x56098c2a6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.237+0000 7f7a06ffd640 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56098c2a3d60 0x56098c2a6150 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75516be293c1618 server_cookie=97aeb0e1bd052e76 in_seq=0 out_seq=0 2024-09-16T01:25:29.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.237+0000 7f79e6ffd640 10 client.15468 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:29.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.238+0000 7f79e6ffd640 1 -- 172.21.15.63:0/1716779336 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56098c1fc850 con 0x56098c2a3d60 2024-09-16T01:25:29.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.238+0000 7f79e6ffd640 10 client.15468 handle_command_reply: tid=0 2024-09-16T01:25:29.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.238+0000 7f7a10589740 1 client.15468 shutdown 2024-09-16T01:25:29.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.238+0000 7f7a10589740 1 -- 172.21.15.63:0/1716779336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 msgr2=0x56098c293fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:29.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.238+0000 7f7a10589740 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c293fa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009bf0 tx=0x7f7a000098e0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.239+0000 7f7a10589740 1 -- 172.21.15.63:0/1716779336 shutdown_connections 2024-09-16T01:25:29.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.239+0000 7f7a10589740 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c294680 0x56098c291790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.239+0000 7f7a10589740 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c289dc0 0x56098c291250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.239+0000 7f7a10589740 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56098c2a3d60 0x56098c2a6150 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.239+0000 7f79e6ffd640 0 client.15468 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:29.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.239+0000 7f7a10589740 1 --2- 172.21.15.63:0/1716779336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c293fa0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.239+0000 7f7a10589740 1 -- 172.21.15.63:0/1716779336 >> 172.21.15.63:0/1716779336 conn(0x56098c285a30 msgr2=0x56098c28b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:29.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.239+0000 7f7a10589740 1 -- 172.21.15.63:0/1716779336 shutdown_connections 2024-09-16T01:25:29.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.239+0000 7f7a10589740 1 -- 172.21.15.63:0/1716779336 wait complete. 2024-09-16T01:25:29.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.239+0000 7f7a10589740 20 client.15468 trim_cache size 0 max 16384 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.260+0000 7f7a10589740 1 Processor -- start 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.260+0000 7f7a10589740 1 -- start start 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.260+0000 7f7a10589740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c2a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.260+0000 7f7a10589740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c2ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.260+0000 7f7a10589740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 0x56098c2abea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.260+0000 7f7a10589740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081afdf0 con 0x56098c2894a0 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.260+0000 7f7a10589740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081ad6c0 con 0x56098c294680 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.260+0000 7f7a10589740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081ab4f0 con 0x56098c289dc0 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.260+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c2a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c2a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34138/0 (socket says 172.21.15.63:34138) 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a07fff640 1 -- 172.21.15.63:0/4065167427 learned_addr learned my addr 172.21.15.63:0/4065167427 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:29.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a06ffd640 1 --2- 172.21.15.63:0/4065167427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c2ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a07fff640 1 --2- 172.21.15.63:0/4065167427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 0x56098c2abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a07fff640 1 -- 172.21.15.63:0/4065167427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 msgr2=0x56098c2ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a07fff640 1 --2- 172.21.15.63:0/4065167427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c2ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a07fff640 1 -- 172.21.15.63:0/4065167427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 msgr2=0x56098c2abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a07fff640 1 --2- 172.21.15.63:0/4065167427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 0x56098c2abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a07fff640 1 -- 172.21.15.63:0/4065167427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56098c289bf0 con 0x56098c2894a0 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a06ffd640 1 --2- 172.21.15.63:0/4065167427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c2ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f7a07fff640 1 --2- 172.21.15.63:0/4065167427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c2a04e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7a00039520 tx=0x7f7a00009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a41dd0cab289de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f79ed7fa640 1 -- 172.21.15.63:0/4065167427 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00034070 con 0x56098c2894a0 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f79ed7fa640 1 -- 172.21.15.63:0/4065167427 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a0004a040 con 0x56098c2894a0 2024-09-16T01:25:29.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.261+0000 7f79ed7fa640 1 -- 172.21.15.63:0/4065167427 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00039a30 con 0x56098c2894a0 2024-09-16T01:25:29.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.262+0000 7f7a10589740 1 -- 172.21.15.63:0/4065167427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 msgr2=0x56098c2a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:29.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.262+0000 7f7a10589740 1 --2- 172.21.15.63:0/4065167427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c2a04e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7a00039520 tx=0x7f7a00009a20 comp rx=0 tx=0).stop 2024-09-16T01:25:29.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.262+0000 7f7a10589740 1 -- 172.21.15.63:0/4065167427 shutdown_connections 2024-09-16T01:25:29.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.262+0000 7f7a10589740 1 --2- 172.21.15.63:0/4065167427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 0x56098c2abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.262+0000 7f7a10589740 1 --2- 172.21.15.63:0/4065167427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c2ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.262+0000 7f7a10589740 1 --2- 172.21.15.63:0/4065167427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c2a04e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.262+0000 7f7a10589740 1 -- 172.21.15.63:0/4065167427 >> 172.21.15.63:0/4065167427 conn(0x56098c285a30 msgr2=0x56098c28c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.262+0000 7f7a10589740 1 -- 172.21.15.63:0/4065167427 shutdown_connections 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.262+0000 7f7a10589740 1 -- 172.21.15.63:0/4065167427 wait complete. 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a10589740 1 -- start start 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a10589740 1 Processor -- start 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a10589740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c29c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a10589740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c29cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a10589740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 0x56098c297fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a10589740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081abb80 con 0x56098c2894a0 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a10589740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081acff0 con 0x56098c294680 2024-09-16T01:25:29.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a10589740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081ac250 con 0x56098c289dc0 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a10589740 10 client.0 _ll_register_callbacks cb 0x7f79f8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a07fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c29c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a06ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c29cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a06ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c29cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:37106/0 (socket says 172.21.15.63:37106) 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.263+0000 7f7a06ffd640 1 -- 172.21.15.63:0/2980332247 learned_addr learned my addr 172.21.15.63:0/2980332247 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a07fff640 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 0x56098c297fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a06ffd640 1 -- 172.21.15.63:0/2980332247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 msgr2=0x56098c297fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a06ffd640 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 0x56098c297fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a06ffd640 1 -- 172.21.15.63:0/2980332247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 msgr2=0x56098c29c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a06ffd640 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c29c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a06ffd640 1 -- 172.21.15.63:0/2980332247 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56098c2987d0 con 0x56098c289dc0 2024-09-16T01:25:29.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a07fff640 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 0x56098c297fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a06ffd640 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c29cf10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x56098c286db0 tx=0x7f79fc004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a54086dcc9ac87ef server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f79e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f79e6ffd640 1 -- 172.21.15.63:0/2980332247 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0035f0 con 0x56098c289dc0 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f79e6ffd640 1 -- 172.21.15.63:0/2980332247 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f79fc003790 con 0x56098c289dc0 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a10589740 1 -- 172.21.15.63:0/2980332247 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a0004a040 con 0x56098c289dc0 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f79e6ffd640 1 -- 172.21.15.63:0/2980332247 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f79fc003990 con 0x56098c289dc0 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a10589740 10 client.25069 fetch_fsmap learned FSMap version 26 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.264+0000 7f7a10589740 1 -- 172.21.15.63:0/2980332247 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56098c30e630 con 0x56098c289dc0 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f79e6ffd640 1 -- 172.21.15.63:0/2980332247 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f79fc01f390 con 0x56098c289dc0 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f79e6ffd640 1 -- 172.21.15.63:0/2980332247 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f79fc027430 con 0x56098c289dc0 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f7a10589740 10 client.25069 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f7a10589740 10 client.25069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:25:29.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f7a10589740 20 client.25069 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f7a10589740 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56098c30edf0 0x56098c311210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f7a10589740 4 client.25069 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f7a10589740 1 -- 172.21.15.63:0/2980332247 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7a0004a040 con 0x56098c30edf0 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f7a07fff640 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56098c30edf0 0x56098c311210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f7a07fff640 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56098c30edf0 0x56098c311210 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae4c6eac7ebd0357 server_cookie=e89951c4312caf61 in_seq=0 out_seq=0 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.265+0000 7f79e6ffd640 10 client.25069 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f79e6ffd640 1 -- 172.21.15.63:0/2980332247 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f7a0004a040 con 0x56098c30edf0 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f79e6ffd640 10 client.25069 handle_command_reply: tid=0 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f7a10589740 1 client.25069 shutdown 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f7a10589740 1 -- 172.21.15.63:0/2980332247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 msgr2=0x56098c29cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f7a10589740 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c29cf10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x56098c286db0 tx=0x7f79fc004410 comp rx=0 tx=0).stop 2024-09-16T01:25:29.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f7a10589740 1 -- 172.21.15.63:0/2980332247 shutdown_connections 2024-09-16T01:25:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f7a10589740 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56098c294680 0x56098c297fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f7a10589740 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56098c289dc0 0x56098c29cf10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f7a10589740 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x56098c30edf0 0x56098c311210 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f7a10589740 1 --2- 172.21.15.63:0/2980332247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x56098c2894a0 0x56098c29c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f7a10589740 1 -- 172.21.15.63:0/2980332247 >> 172.21.15.63:0/2980332247 conn(0x56098c285a30 msgr2=0x56098c28bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.266+0000 7f79e6ffd640 0 client.25069 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.267+0000 7f7a10589740 1 -- 172.21.15.63:0/2980332247 shutdown_connections 2024-09-16T01:25:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.267+0000 7f7a10589740 1 -- 172.21.15.63:0/2980332247 wait complete. 2024-09-16T01:25:29.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.267+0000 7f7a10589740 20 client.25069 trim_cache size 0 max 16384 2024-09-16T01:25:29.273 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:25:29.274 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-16T01:25:29.274 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {} 2024-09-16T01:25:29.274 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:25:29.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.267+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/2590078391 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79f00a3240 msgr2=0x7f79f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.267+0000 7f7a0e1b0640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79f00a3240 0x7f79f00a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f79f809c240 tx=0x7f79f80cff10 comp rx=0 tx=0).stop 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.267+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/2590078391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a08100e20 msgr2=0x7f7a08198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.267+0000 7f7a0e1b0640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a08100e20 0x7f7a08198410 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f79f800e9f0 tx=0x7f79f800eeb0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.268+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/2590078391 shutdown_connections 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.268+0000 7f7a0e1b0640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79f00a3240 0x7f79f00a5700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.268+0000 7f7a0e1b0640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a08102ef0 0x7f7a0819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.268+0000 7f7a0e1b0640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08102570 0x7f7a08198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.268+0000 7f7a0e1b0640 1 --2- 172.21.15.63:0/2590078391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a08100e20 0x7f7a08198410 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.268+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/2590078391 >> 172.21.15.63:0/2590078391 conn(0x7f7a080fc7d0 msgr2=0x7f7a0806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.268+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/2590078391 shutdown_connections 2024-09-16T01:25:29.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:29.268+0000 7f7a0e1b0640 1 -- 172.21.15.63:0/2590078391 wait complete. 2024-09-16T01:25:30.069 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-16T01:25:30.069 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:25:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:25:30.606 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:30 smithi063 ceph-mon[31070]: pgmap v400: 97 pgs: 97 active+clean; 2.0 GiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 179 MiB/s wr, 350 op/s 2024-09-16T01:25:30.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:30 smithi192 ceph-mon[34775]: pgmap v400: 97 pgs: 97 active+clean; 2.0 GiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 179 MiB/s wr, 350 op/s 2024-09-16T01:25:30.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:30 smithi162 ceph-mon[34539]: pgmap v400: 97 pgs: 97 active+clean; 2.0 GiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 65 MiB/s rd, 179 MiB/s wr, 350 op/s 2024-09-16T01:25:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.851+0000 7f1f7a102640 1 -- 172.21.15.63:0/671181029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f74100e20 msgr2=0x7f1f74101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.851+0000 7f1f7a102640 1 --2- 172.21.15.63:0/671181029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f74100e20 0x7f1f74101200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009900 tx=0x7f1f6402a480 comp rx=0 tx=0).stop 2024-09-16T01:25:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.851+0000 7f1f7a102640 1 -- 172.21.15.63:0/671181029 shutdown_connections 2024-09-16T01:25:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.851+0000 7f1f7a102640 1 --2- 172.21.15.63:0/671181029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f74102ef0 0x7f1f7410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.851+0000 7f1f7a102640 1 --2- 172.21.15.63:0/671181029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f74102570 0x7f1f741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.851+0000 7f1f7a102640 1 --2- 172.21.15.63:0/671181029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f74100e20 0x7f1f74101200 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.851+0000 7f1f7a102640 1 -- 172.21.15.63:0/671181029 >> 172.21.15.63:0/671181029 conn(0x7f1f740fc7d0 msgr2=0x7f1f740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.851+0000 7f1f7a102640 1 -- 172.21.15.63:0/671181029 shutdown_connections 2024-09-16T01:25:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.851+0000 7f1f7a102640 1 -- 172.21.15.63:0/671181029 wait complete. 2024-09-16T01:25:30.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f7a102640 1 Processor -- start 2024-09-16T01:25:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f7a102640 1 -- start start 2024-09-16T01:25:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f7a102640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f74100e20 0x7f1f74198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f7a102640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f74102570 0x7f1f741989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f7a102640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f74102ef0 0x7f1f7419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f7a102640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1f74110e30 con 0x7f1f74100e20 2024-09-16T01:25:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f7a102640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1f74110cb0 con 0x7f1f74102ef0 2024-09-16T01:25:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f7a102640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1f74110fb0 con 0x7f1f74102570 2024-09-16T01:25:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f737fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f74100e20 0x7f1f74198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f737fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f74100e20 0x7f1f74198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34158/0 (socket says 172.21.15.63:34158) 2024-09-16T01:25:30.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f737fe640 1 -- 172.21.15.63:0/3064853468 learned_addr learned my addr 172.21.15.63:0/3064853468 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f72ffd640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f74102570 0x7f1f741989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.852+0000 7f1f73fff640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f74102ef0 0x7f1f7419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f737fe640 1 -- 172.21.15.63:0/3064853468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f74102570 msgr2=0x7f1f741989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f737fe640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f74102570 0x7f1f741989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f737fe640 1 -- 172.21.15.63:0/3064853468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f74102ef0 msgr2=0x7f1f7419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f737fe640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f74102ef0 0x7f1f7419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f737fe640 1 -- 172.21.15.63:0/3064853468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7419d410 con 0x7f1f74100e20 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f72ffd640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f74102570 0x7f1f741989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f737fe640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f74100e20 0x7f1f74198460 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006010 tx=0x7f1f640040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f70ff9640 1 -- 172.21.15.63:0/3064853468 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6403f030 con 0x7f1f74100e20 2024-09-16T01:25:30.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f70ff9640 1 -- 172.21.15.63:0/3064853468 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1f640044c0 con 0x7f1f74100e20 2024-09-16T01:25:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f7a102640 1 -- 172.21.15.63:0/3064853468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7419d6a0 con 0x7f1f74100e20 2024-09-16T01:25:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f70ff9640 1 -- 172.21.15.63:0/3064853468 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64035070 con 0x7f1f74100e20 2024-09-16T01:25:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.853+0000 7f1f7a102640 1 -- 172.21.15.63:0/3064853468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f741a4fe0 con 0x7f1f74100e20 2024-09-16T01:25:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.854+0000 7f1f7a102640 1 -- 172.21.15.63:0/3064853468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f741021b0 con 0x7f1f74100e20 2024-09-16T01:25:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.855+0000 7f1f70ff9640 1 -- 172.21.15.63:0/3064853468 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1f64042030 con 0x7f1f74100e20 2024-09-16T01:25:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.856+0000 7f1f70ff9640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f600a32c0 0x7f1f600a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.857+0000 7f1f72ffd640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f600a32c0 0x7f1f600a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.857+0000 7f1f70ff9640 1 -- 172.21.15.63:0/3064853468 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1f640efd80 con 0x7f1f74100e20 2024-09-16T01:25:30.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.857+0000 7f1f72ffd640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f600a32c0 0x7f1f600a5780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1f740fffa0 tx=0x7f1f5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:30.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:30.861+0000 7f1f70ff9640 1 -- 172.21.15.63:0/3064853468 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f640bc450 con 0x7f1f74100e20 2024-09-16T01:25:31.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.084+0000 7f1f7a102640 1 -- 172.21.15.63:0/3064853468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f74101200 con 0x7f1f74100e20 2024-09-16T01:25:31.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.085+0000 7f1f70ff9640 1 -- 172.21.15.63:0/3064853468 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11912 (secure 0 0 0) 0x7f1f74101200 con 0x7f1f74100e20 2024-09-16T01:25:31.087 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:25:31.088 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"btime":"2024-09-16T01:24:43:130913+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:24:43.087565+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24445,24460,24467]},"id":1}]} 2024-09-16T01:25:31.088 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 26 2024-09-16T01:25:31.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 -- 172.21.15.63:0/3064853468 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f600a32c0 msgr2=0x7f1f600a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:31.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f600a32c0 0x7f1f600a5780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1f740fffa0 tx=0x7f1f5c005f90 comp rx=0 tx=0).stop 2024-09-16T01:25:31.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 -- 172.21.15.63:0/3064853468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f74100e20 msgr2=0x7f1f74198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:31.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f74100e20 0x7f1f74198460 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006010 tx=0x7f1f640040c0 comp rx=0 tx=0).stop 2024-09-16T01:25:31.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 -- 172.21.15.63:0/3064853468 shutdown_connections 2024-09-16T01:25:31.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f1f600a32c0 0x7f1f600a5780 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:31.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f74102ef0 0x7f1f7419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:31.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f74102570 0x7f1f741989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:31.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 --2- 172.21.15.63:0/3064853468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f74100e20 0x7f1f74198460 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:31.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 -- 172.21.15.63:0/3064853468 >> 172.21.15.63:0/3064853468 conn(0x7f1f740fc7d0 msgr2=0x7f1f7406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:31.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 -- 172.21.15.63:0/3064853468 shutdown_connections 2024-09-16T01:25:31.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:31.087+0000 7f1f7a102640 1 -- 172.21.15.63:0/3064853468 wait complete. 2024-09-16T01:25:31.459 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:31 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3064853468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:25:31.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:31 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3064853468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:25:31.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:31 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3064853468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:25:31.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-16T01:25:32.079 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:25:32.496 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:32 smithi063 ceph-mon[31070]: pgmap v401: 97 pgs: 97 active+clean; 2.0 GiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 196 MiB/s wr, 421 op/s 2024-09-16T01:25:32.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.588+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/2379928164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e341082a0 msgr2=0x7f2e3410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:32.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.588+0000 7f2e3c5b8640 1 --2- 172.21.15.63:0/2379928164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e341082a0 0x7f2e3410ec40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c009cd0 tx=0x7f2e2c02a8e0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.588+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/2379928164 shutdown_connections 2024-09-16T01:25:32.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.588+0000 7f2e3c5b8640 1 --2- 172.21.15.63:0/2379928164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e341082a0 0x7f2e3410ec40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.588+0000 7f2e3c5b8640 1 --2- 172.21.15.63:0/2379928164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e341036e0 0x7f2e34107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.588+0000 7f2e3c5b8640 1 --2- 172.21.15.63:0/2379928164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e34102d30 0x7f2e34103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.588+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/2379928164 >> 172.21.15.63:0/2379928164 conn(0x7f2e340fc7d0 msgr2=0x7f2e340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.588+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/2379928164 shutdown_connections 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.588+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/2379928164 wait complete. 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e3c5b8640 1 Processor -- start 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e3c5b8640 1 -- start start 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e3c5b8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e34102d30 0x7f2e34100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e3c5b8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e341036e0 0x7f2e34100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e3c5b8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e341082a0 0x7f2e34101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e3c5b8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34111f50 con 0x7f2e341036e0 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e3c5b8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34111dd0 con 0x7f2e341082a0 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e3c5b8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341120d0 con 0x7f2e34102d30 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e39b53640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e341036e0 0x7f2e34100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e39b53640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e341036e0 0x7f2e34100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34176/0 (socket says 172.21.15.63:34176) 2024-09-16T01:25:32.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e39b53640 1 -- 172.21.15.63:0/1870493968 learned_addr learned my addr 172.21.15.63:0/1870493968 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:32.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e3a354640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e34102d30 0x7f2e34100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.589+0000 7f2e3ab55640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e341082a0 0x7f2e34101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e39b53640 1 -- 172.21.15.63:0/1870493968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e34102d30 msgr2=0x7f2e34100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:32.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e39b53640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e34102d30 0x7f2e34100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e39b53640 1 -- 172.21.15.63:0/1870493968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e341082a0 msgr2=0x7f2e34101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:32.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e39b53640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e341082a0 0x7f2e34101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e39b53640 1 -- 172.21.15.63:0/1870493968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e341a6a10 con 0x7f2e341036e0 2024-09-16T01:25:32.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e39b53640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e341036e0 0x7f2e34100ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400e9f0 tx=0x7f2e2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:32.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e2b7fe640 1 -- 172.21.15.63:0/1870493968 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400ccc0 con 0x7f2e341036e0 2024-09-16T01:25:32.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e2b7fe640 1 -- 172.21.15.63:0/1870493968 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e240108e0 con 0x7f2e341036e0 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/1870493968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e341a6d00 con 0x7f2e341036e0 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e2b7fe640 1 -- 172.21.15.63:0/1870493968 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e240187e0 con 0x7f2e341036e0 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.590+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/1870493968 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e341a7230 con 0x7f2e341036e0 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.592+0000 7f2e2b7fe640 1 -- 172.21.15.63:0/1870493968 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2e24010a90 con 0x7f2e341036e0 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3e991740 1 Processor -- start 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3e991740 1 -- start start 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 0x561e6526b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e65276370 0x561e65278760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3e991740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x561e651d12f0 con 0x561e6526cb40 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3e991740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561e65178cf0 con 0x561e6526b5d0 2024-09-16T01:25:32.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3e991740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561e651cd2b0 con 0x561e65276370 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e2b7fe640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e200a32c0 0x7f2e200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3a354640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3a354640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:43554/0 (socket says 172.21.15.63:43554) 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e3a354640 1 -- 172.21.15.63:0/923629059 learned_addr learned my addr 172.21.15.63:0/923629059 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.593+0000 7f2e39b53640 1 --2- 172.21.15.63:0/923629059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e65276370 0x561e65278760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e3ab55640 1 --2- 172.21.15.63:0/923629059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 0x561e6526b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e2b7fe640 1 -- 172.21.15.63:0/1870493968 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f2e240cfb40 con 0x7f2e341036e0 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e3ab55640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e200a32c0 0x7f2e200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e3a354640 1 -- 172.21.15.63:0/923629059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e65276370 msgr2=0x561e65278760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e3a354640 1 --2- 172.21.15.63:0/923629059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e65276370 0x561e65278760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e3a354640 1 -- 172.21.15.63:0/923629059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 msgr2=0x561e6526b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e3a354640 1 --2- 172.21.15.63:0/923629059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 0x561e6526b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e3a354640 1 -- 172.21.15.63:0/923629059 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6515d3a0 con 0x561e6526b5d0 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e3a354640 1 --2- 172.21.15.63:0/923629059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526ba10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009cf0 tx=0x7f2e30011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a44841d07a2833 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e28ff9640 1 -- 172.21.15.63:0/923629059 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30004230 con 0x561e6526b5d0 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e28ff9640 1 -- 172.21.15.63:0/923629059 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e300043d0 con 0x561e6526b5d0 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e28ff9640 1 -- 172.21.15.63:0/923629059 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30019890 con 0x561e6526b5d0 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.594+0000 7f2e3ab55640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e200a32c0 0x7f2e200a5780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c005e10 tx=0x7f2e2c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.595+0000 7f2e3e991740 1 -- 172.21.15.63:0/923629059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 msgr2=0x561e6526ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.595+0000 7f2e3e991740 1 --2- 172.21.15.63:0/923629059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526ba10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009cf0 tx=0x7f2e30011810 comp rx=0 tx=0).stop 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.595+0000 7f2e3e991740 1 -- 172.21.15.63:0/923629059 shutdown_connections 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.595+0000 7f2e3e991740 1 --2- 172.21.15.63:0/923629059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e65276370 0x561e65278760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.595+0000 7f2e3e991740 1 --2- 172.21.15.63:0/923629059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526ba10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.595+0000 7f2e3e991740 1 --2- 172.21.15.63:0/923629059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 0x561e6526b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.595+0000 7f2e3e991740 1 -- 172.21.15.63:0/923629059 >> 172.21.15.63:0/923629059 conn(0x561e65234310 msgr2=0x561e65267c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.595+0000 7f2e3e991740 1 -- 172.21.15.63:0/923629059 shutdown_connections 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.595+0000 7f2e3e991740 1 -- 172.21.15.63:0/923629059 wait complete. 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.595+0000 7f2e3e991740 1 -- start start 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e3e991740 1 Processor -- start 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526b5d0 0x561e65275d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526cb40 0x561e65272fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e65276370 0x561e65273570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e3e991740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x561e65279070 con 0x561e6526b5d0 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e3e991740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561e6518c060 con 0x561e65276370 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e3e991740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561e652791f0 con 0x561e6526cb40 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e3e991740 10 client.0 _ll_register_callbacks cb 0x561e64edf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e39b53640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526cb40 0x561e65272fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e3a354640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526b5d0 0x561e65275d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e3ab55640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e65276370 0x561e65273570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e39b53640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526cb40 0x561e65272fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:37192/0 (socket says 172.21.15.63:37192) 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e39b53640 1 -- 172.21.15.63:0/2439360709 learned_addr learned my addr 172.21.15.63:0/2439360709 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e39b53640 1 -- 172.21.15.63:0/2439360709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e65276370 msgr2=0x561e65273570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e39b53640 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e65276370 0x561e65273570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e39b53640 1 -- 172.21.15.63:0/2439360709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526b5d0 msgr2=0x561e65275d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e39b53640 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526b5d0 0x561e65275d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.596+0000 7f2e39b53640 1 -- 172.21.15.63:0/2439360709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e64f423c0 con 0x561e6526cb40 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e39b53640 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526cb40 0x561e65272fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400f010 tx=0x7f2e240670f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5bce75f73042bd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e1dffb640 1 -- 172.21.15.63:0/2439360709 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24026040 con 0x561e6526cb40 2024-09-16T01:25:32.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e1dffb640 1 -- 172.21.15.63:0/2439360709 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f2e240a00a0 con 0x561e6526cb40 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e3e991740 1 -- 172.21.15.63:0/2439360709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e300043d0 con 0x561e6526cb40 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e1dffb640 1 -- 172.21.15.63:0/2439360709 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2e240a4dd0 con 0x561e6526cb40 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e3e991740 10 client.25087 fetch_fsmap learned FSMap version 26 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e3e991740 1 -- 172.21.15.63:0/2439360709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561e65284af0 con 0x561e6526cb40 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e1dffb640 1 -- 172.21.15.63:0/2439360709 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e300043d0 con 0x561e6526cb40 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e1dffb640 1 -- 172.21.15.63:0/2439360709 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2e2409b6f0 con 0x561e6526cb40 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e3e991740 10 client.25087 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e3e991740 10 client.25087 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e3e991740 20 client.25087 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e3e991740 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x561e65285fb0 0x561e65288430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e3e991740 4 client.25087 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.597+0000 7f2e3e991740 1 -- 172.21.15.63:0/2439360709 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e651de860 con 0x561e65285fb0 2024-09-16T01:25:32.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.598+0000 7f2e3a354640 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x561e65285fb0 0x561e65288430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.598+0000 7f2e3a354640 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x561e65285fb0 0x561e65288430 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b279aed6dba75369 server_cookie=9b9c24e962089328 in_seq=0 out_seq=0 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.598+0000 7f2e1dffb640 10 client.25087 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e1dffb640 1 -- 172.21.15.63:0/2439360709 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e651de860 con 0x561e65285fb0 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e1dffb640 10 client.25087 handle_command_reply: tid=0 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 client.25087 shutdown 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 -- 172.21.15.63:0/2439360709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526cb40 msgr2=0x561e65272fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526cb40 0x561e65272fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400f010 tx=0x7f2e240670f0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 -- 172.21.15.63:0/2439360709 shutdown_connections 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x561e65285fb0 0x561e65288430 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e65276370 0x561e65273570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526cb40 0x561e65272fd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 --2- 172.21.15.63:0/2439360709 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526b5d0 0x561e65275d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e1dffb640 0 client.25087 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:25:32.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 -- 172.21.15.63:0/2439360709 >> 172.21.15.63:0/2439360709 conn(0x561e65234310 msgr2=0x561e6526d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:32.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 -- 172.21.15.63:0/2439360709 shutdown_connections 2024-09-16T01:25:32.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 1 -- 172.21.15.63:0/2439360709 wait complete. 2024-09-16T01:25:32.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.599+0000 7f2e3e991740 20 client.25087 trim_cache size 0 max 16384 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.613+0000 7f2e3e991740 1 Processor -- start 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.613+0000 7f2e3e991740 1 -- start start 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.613+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.613+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 0x561e65282340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.613+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e65276370 0x561e652720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.613+0000 7f2e3e991740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341b2050 con 0x561e6526cb40 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.613+0000 7f2e3e991740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341af920 con 0x561e6526b5d0 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.613+0000 7f2e3e991740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341ad750 con 0x561e65276370 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e39b53640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 0x561e65282340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e3a354640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e3ab55640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e65276370 0x561e652720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e39b53640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 0x561e65282340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34198/0 (socket says 172.21.15.63:34198) 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e39b53640 1 -- 172.21.15.63:0/2495786486 learned_addr learned my addr 172.21.15.63:0/2495786486 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e39b53640 1 -- 172.21.15.63:0/2495786486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e65276370 msgr2=0x561e652720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e39b53640 1 --2- 172.21.15.63:0/2495786486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e65276370 0x561e652720c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e39b53640 1 -- 172.21.15.63:0/2495786486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 msgr2=0x561e6526c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e39b53640 1 --2- 172.21.15.63:0/2495786486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e39b53640 1 -- 172.21.15.63:0/2495786486 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e65271520 con 0x561e6526cb40 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e3a354640 1 --2- 172.21.15.63:0/2495786486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e39b53640 1 --2- 172.21.15.63:0/2495786486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 0x561e65282340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2e2409bf10 tx=0x7f2e240985e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c8204f4c62bbd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e1ffff640 1 -- 172.21.15.63:0/2495786486 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2409bb70 con 0x561e6526cb40 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e1ffff640 1 -- 172.21.15.63:0/2495786486 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e240982d0 con 0x561e6526cb40 2024-09-16T01:25:32.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.614+0000 7f2e1ffff640 1 -- 172.21.15.63:0/2495786486 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e240a02c0 con 0x561e6526cb40 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.615+0000 7f2e3e991740 1 -- 172.21.15.63:0/2495786486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 msgr2=0x561e65282340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.615+0000 7f2e3e991740 1 --2- 172.21.15.63:0/2495786486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 0x561e65282340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2e2409bf10 tx=0x7f2e240985e0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.615+0000 7f2e3e991740 1 -- 172.21.15.63:0/2495786486 shutdown_connections 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.615+0000 7f2e3e991740 1 --2- 172.21.15.63:0/2495786486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e65276370 0x561e652720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.615+0000 7f2e3e991740 1 --2- 172.21.15.63:0/2495786486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e6526cb40 0x561e65282340 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.615+0000 7f2e3e991740 1 --2- 172.21.15.63:0/2495786486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526b5d0 0x561e6526c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.615+0000 7f2e3e991740 1 -- 172.21.15.63:0/2495786486 >> 172.21.15.63:0/2495786486 conn(0x561e65234310 msgr2=0x561e65262a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.615+0000 7f2e3e991740 1 -- 172.21.15.63:0/2495786486 shutdown_connections 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.615+0000 7f2e3e991740 1 -- 172.21.15.63:0/2495786486 wait complete. 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3e991740 1 -- start start 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3e991740 1 Processor -- start 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526b5d0 0x561e6527e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526cb40 0x561e6526fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3e991740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e65276370 0x561e6526ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3e991740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341adde0 con 0x561e65276370 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3e991740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341af250 con 0x561e6526cb40 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3e991740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341ae4b0 con 0x561e6526b5d0 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3e991740 10 client.0 _ll_register_callbacks cb 0x7f2e2409c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3ab55640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e65276370 0x561e6526ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3ab55640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e65276370 0x561e6526ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34212/0 (socket says 172.21.15.63:34212) 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3a354640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526b5d0 0x561e6527e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e3ab55640 1 -- 172.21.15.63:0/3424812354 learned_addr learned my addr 172.21.15.63:0/3424812354 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.616+0000 7f2e39b53640 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526cb40 0x561e6526fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e3ab55640 1 -- 172.21.15.63:0/3424812354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526b5d0 msgr2=0x561e6527e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e3ab55640 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526b5d0 0x561e6527e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e3ab55640 1 -- 172.21.15.63:0/3424812354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526cb40 msgr2=0x561e6526fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e3ab55640 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526cb40 0x561e6526fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e3ab55640 1 -- 172.21.15.63:0/3424812354 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e65270580 con 0x561e65276370 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e3a354640 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526b5d0 0x561e6527e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e39b53640 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526cb40 0x561e6526fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e3ab55640 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e65276370 0x561e6526ffc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c035000 tx=0x7f2e2c004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2767f245150602aa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e1dffb640 1 -- 172.21.15.63:0/3424812354 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c058060 con 0x561e65276370 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e3e991740 1 -- 172.21.15.63:0/3424812354 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e240982d0 con 0x561e65276370 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e1dffb640 1 -- 172.21.15.63:0/3424812354 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f2e2c0305a0 con 0x561e65276370 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e1dffb640 1 -- 172.21.15.63:0/3424812354 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2e2c003e10 con 0x561e65276370 2024-09-16T01:25:32.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e3e991740 10 client.15498 fetch_fsmap learned FSMap version 26 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.617+0000 7f2e3e991740 1 -- 172.21.15.63:0/3424812354 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561e652f0a60 con 0x561e65276370 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.618+0000 7f2e1dffb640 1 -- 172.21.15.63:0/3424812354 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e240982d0 con 0x561e65276370 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.618+0000 7f2e1dffb640 1 -- 172.21.15.63:0/3424812354 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2e2c030070 con 0x561e65276370 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.618+0000 7f2e3e991740 10 client.15498 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.618+0000 7f2e3e991740 10 client.15498 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.618+0000 7f2e3e991740 20 client.15498 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.618+0000 7f2e3e991740 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x561e652f1180 0x561e652f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.618+0000 7f2e3e991740 4 client.15498 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.618+0000 7f2e3e991740 1 -- 172.21.15.63:0/3424812354 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e651d8d70 con 0x561e652f1180 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.618+0000 7f2e3a354640 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x561e652f1180 0x561e652f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3a354640 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x561e652f1180 0x561e652f3570 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5210ceb252a271e0 server_cookie=8b29eff1afea4a99 in_seq=0 out_seq=0 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e1dffb640 10 client.15498 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:25:32.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e1dffb640 1 -- 172.21.15.63:0/3424812354 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e651d8d70 con 0x561e652f1180 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e1dffb640 10 client.15498 handle_command_reply: tid=0 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 client.15498 shutdown 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 -- 172.21.15.63:0/3424812354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e65276370 msgr2=0x561e6526ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e65276370 0x561e6526ffc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c035000 tx=0x7f2e2c004a60 comp rx=0 tx=0).stop 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 -- 172.21.15.63:0/3424812354 shutdown_connections 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x561e652f1180 0x561e652f3570 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x561e65276370 0x561e6526ffc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e6526cb40 0x561e6526fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 --2- 172.21.15.63:0/3424812354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e6526b5d0 0x561e6527e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 -- 172.21.15.63:0/3424812354 >> 172.21.15.63:0/3424812354 conn(0x561e65234310 msgr2=0x561e652720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e1dffb640 0 client.15498 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 -- 172.21.15.63:0/3424812354 shutdown_connections 2024-09-16T01:25:32.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 1 -- 172.21.15.63:0/3424812354 wait complete. 2024-09-16T01:25:32.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.619+0000 7f2e3e991740 20 client.15498 trim_cache size 0 max 16384 2024-09-16T01:25:32.635 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:25:32.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/1870493968 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e200a32c0 msgr2=0x7f2e200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e200a32c0 0x7f2e200a5780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c005e10 tx=0x7f2e2c005da0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/1870493968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e341036e0 msgr2=0x7f2e34100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e341036e0 0x7f2e34100ed0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400e9f0 tx=0x7f2e2400eeb0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/1870493968 shutdown_connections 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f2e200a32c0 0x7f2e200a5780 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e341082a0 0x7f2e34101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e341036e0 0x7f2e34100ed0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 --2- 172.21.15.63:0/1870493968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e34102d30 0x7f2e34100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/1870493968 >> 172.21.15.63:0/1870493968 conn(0x7f2e340fc7d0 msgr2=0x7f2e34106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/1870493968 shutdown_connections 2024-09-16T01:25:32.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:32.620+0000 7f2e3c5b8640 1 -- 172.21.15.63:0/1870493968 wait complete. 2024-09-16T01:25:32.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:32 smithi192 ceph-mon[34775]: pgmap v401: 97 pgs: 97 active+clean; 2.0 GiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 196 MiB/s wr, 421 op/s 2024-09-16T01:25:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:32 smithi162 ceph-mon[34539]: pgmap v401: 97 pgs: 97 active+clean; 2.0 GiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 196 MiB/s wr, 421 op/s 2024-09-16T01:25:33.555 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-16T01:25:33.828 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:25:34.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.320+0000 7f05e9ba3640 1 -- 172.21.15.63:0/557976766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05e4102d30 msgr2=0x7f05e4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:34.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.320+0000 7f05e9ba3640 1 --2- 172.21.15.63:0/557976766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05e4102d30 0x7f05e4103110 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009930 tx=0x7f05d402a420 comp rx=0 tx=0).stop 2024-09-16T01:25:34.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.320+0000 7f05e9ba3640 1 -- 172.21.15.63:0/557976766 shutdown_connections 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.320+0000 7f05e9ba3640 1 --2- 172.21.15.63:0/557976766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e41082a0 0x7f05e410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.320+0000 7f05e9ba3640 1 --2- 172.21.15.63:0/557976766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e41036e0 0x7f05e4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.320+0000 7f05e9ba3640 1 --2- 172.21.15.63:0/557976766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05e4102d30 0x7f05e4103110 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.320+0000 7f05e9ba3640 1 -- 172.21.15.63:0/557976766 >> 172.21.15.63:0/557976766 conn(0x7f05e40fc7d0 msgr2=0x7f05e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.320+0000 7f05e9ba3640 1 -- 172.21.15.63:0/557976766 shutdown_connections 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.320+0000 7f05e9ba3640 1 -- 172.21.15.63:0/557976766 wait complete. 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.321+0000 7f05e9ba3640 1 Processor -- start 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.321+0000 7f05e9ba3640 1 -- start start 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e9ba3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e4102d30 0x7f05e4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e9ba3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e41036e0 0x7f05e4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e9ba3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05e41082a0 0x7f05e419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e9ba3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4111f50 con 0x7f05e41082a0 2024-09-16T01:25:34.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e9ba3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4111dd0 con 0x7f05e41036e0 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e9ba3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41120d0 con 0x7f05e4102d30 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05e41082a0 0x7f05e419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e4102d30 0x7f05e4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05e41082a0 0x7f05e419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34236/0 (socket says 172.21.15.63:34236) 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e4102d30 0x7f05e4198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:37244/0 (socket says 172.21.15.63:37244) 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e3fff640 1 -- 172.21.15.63:0/3217274548 learned_addr learned my addr 172.21.15.63:0/3217274548 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e41036e0 0x7f05e4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e3fff640 1 -- 172.21.15.63:0/3217274548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e4102d30 msgr2=0x7f05e4198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e3fff640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e4102d30 0x7f05e4198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e3fff640 1 -- 172.21.15.63:0/3217274548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e41036e0 msgr2=0x7f05e4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e3fff640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e41036e0 0x7f05e4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e3fff640 1 -- 172.21.15.63:0/3217274548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e419d4c0 con 0x7f05e41082a0 2024-09-16T01:25:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e37fe640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e4102d30 0x7f05e4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.322+0000 7f05e3fff640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05e41082a0 0x7f05e419cde0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00eaa0 tx=0x7f05dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.323+0000 7f05e0ff9640 1 -- 172.21.15.63:0/3217274548 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc00cdb0 con 0x7f05e41082a0 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.323+0000 7f05e0ff9640 1 -- 172.21.15.63:0/3217274548 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05dc005020 con 0x7f05e41082a0 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.323+0000 7f05e9ba3640 1 -- 172.21.15.63:0/3217274548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e419d7b0 con 0x7f05e41082a0 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.323+0000 7f05e0ff9640 1 -- 172.21.15.63:0/3217274548 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0116d0 con 0x7f05e41082a0 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.323+0000 7f05e9ba3640 1 -- 172.21.15.63:0/3217274548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e41a5090 con 0x7f05e41082a0 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.325+0000 7f05e0ff9640 1 -- 172.21.15.63:0/3217274548 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f05dc0051d0 con 0x7f05e41082a0 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.325+0000 7f05ebf7c740 1 Processor -- start 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.325+0000 7f05ebf7c740 1 -- start start 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a06b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 0x555b8a06ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a076370 0x555b8a078760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555b89fd12f0 con 0x555b8a06cb40 2024-09-16T01:25:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555b89f78cf0 con 0x555b8a076370 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555b89fcd2b0 con 0x555b8a06b5d0 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a06b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 0x555b8a06ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e0ff9640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05cc0a3240 0x7f05cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a06b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34246/0 (socket says 172.21.15.63:34246) 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 0x555b8a06ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:37254/0 (socket says 172.21.15.63:37254) 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e2ffd640 1 -- 172.21.15.63:0/4259221509 learned_addr learned my addr 172.21.15.63:0/4259221509 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/4259221509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a076370 0x555b8a078760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e3fff640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05cc0a3240 0x7f05cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e0ff9640 1 -- 172.21.15.63:0/3217274548 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f05dc0cfa10 con 0x7f05e41082a0 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e2ffd640 1 -- 172.21.15.63:0/4259221509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 msgr2=0x555b8a06ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/4259221509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 0x555b8a06ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e2ffd640 1 -- 172.21.15.63:0/4259221509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a076370 msgr2=0x555b8a078760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/4259221509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a076370 0x555b8a078760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e2ffd640 1 -- 172.21.15.63:0/4259221509 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b89f5d3a0 con 0x555b8a06cb40 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.326+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/4259221509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a06b090 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x555b8a06c070 tx=0x7f05d8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb3856ea72cd1ab server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.327+0000 7f05e3fff640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05cc0a3240 0x7f05cc0a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f05dc098ab0 tx=0x7f05dc01d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.327+0000 7f05c9ffb640 1 -- 172.21.15.63:0/4259221509 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8013ce0 con 0x555b8a06cb40 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.327+0000 7f05c9ffb640 1 -- 172.21.15.63:0/4259221509 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05d8013120 con 0x555b8a06cb40 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.327+0000 7f05c9ffb640 1 -- 172.21.15.63:0/4259221509 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d800fdc0 con 0x555b8a06cb40 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 -- 172.21.15.63:0/4259221509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 msgr2=0x555b8a06b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/4259221509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a06b090 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x555b8a06c070 tx=0x7f05d8005850 comp rx=0 tx=0).stop 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 -- 172.21.15.63:0/4259221509 shutdown_connections 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/4259221509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a076370 0x555b8a078760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/4259221509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 0x555b8a06ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/4259221509 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a06b090 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 -- 172.21.15.63:0/4259221509 >> 172.21.15.63:0/4259221509 conn(0x555b8a034310 msgr2=0x555b8a067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 -- 172.21.15.63:0/4259221509 shutdown_connections 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 -- 172.21.15.63:0/4259221509 wait complete. 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 -- start start 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.328+0000 7f05ebf7c740 1 Processor -- start 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06b5d0 0x555b8a075da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a073050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a076370 0x555b8a0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555b8a079010 con 0x555b8a06cb40 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555b89f8c060 con 0x555b8a06b5d0 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555b8a079190 con 0x555b8a076370 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05ebf7c740 10 client.0 _ll_register_callbacks cb 0x555b89cdf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a076370 0x555b8a0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34248/0 (socket says 172.21.15.63:34248) 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e37fe640 1 -- 172.21.15.63:0/2735638157 learned_addr learned my addr 172.21.15.63:0/2735638157 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06b5d0 0x555b8a075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e37fe640 1 -- 172.21.15.63:0/2735638157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a076370 msgr2=0x555b8a0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e37fe640 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a076370 0x555b8a0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e37fe640 1 -- 172.21.15.63:0/2735638157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06b5d0 msgr2=0x555b8a075da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e37fe640 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06b5d0 0x555b8a075da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e37fe640 1 -- 172.21.15.63:0/2735638157 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b89d423c0 con 0x555b8a06cb40 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05e37fe640 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a073050 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f05d402a940 tx=0x7f05d4031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddbd8d061802085 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.329+0000 7f05c2ffd640 1 -- 172.21.15.63:0/2735638157 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4035040 con 0x555b8a06cb40 2024-09-16T01:25:34.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05c2ffd640 1 -- 172.21.15.63:0/2735638157 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f05d4004450 con 0x555b8a06cb40 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05ebf7c740 1 -- 172.21.15.63:0/2735638157 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05d8013120 con 0x555b8a06cb40 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05c2ffd640 1 -- 172.21.15.63:0/2735638157 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f05d4031900 con 0x555b8a06cb40 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05ebf7c740 10 client.15510 fetch_fsmap learned FSMap version 26 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05ebf7c740 1 -- 172.21.15.63:0/2735638157 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555b8a084af0 con 0x555b8a06cb40 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05c2ffd640 1 -- 172.21.15.63:0/2735638157 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05d8013120 con 0x555b8a06cb40 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05c2ffd640 1 -- 172.21.15.63:0/2735638157 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f05d40035f0 con 0x555b8a06cb40 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05ebf7c740 10 client.15510 fetch_fsmap finished waiting for FSMap version 26 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05ebf7c740 10 client.15510 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05ebf7c740 20 client.15510 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x555b8a085fb0 0x555b8a0883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05ebf7c740 4 client.15510 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05ebf7c740 1 -- 172.21.15.63:0/2735638157 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b89fde860 con 0x555b8a085fb0 2024-09-16T01:25:34.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.330+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x555b8a085fb0 0x555b8a0883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.331+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x555b8a085fb0 0x555b8a0883a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6fb922be884d4169 server_cookie=431c94b3865c21d3 in_seq=0 out_seq=0 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.331+0000 7f05c2ffd640 10 client.15510 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05c2ffd640 1 -- 172.21.15.63:0/2735638157 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b89fde860 con 0x555b8a085fb0 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05c2ffd640 10 client.15510 handle_command_reply: tid=0 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05ebf7c740 1 client.15510 shutdown 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05ebf7c740 1 -- 172.21.15.63:0/2735638157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 msgr2=0x555b8a073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a073050 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f05d402a940 tx=0x7f05d4031810 comp rx=0 tx=0).stop 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05ebf7c740 1 -- 172.21.15.63:0/2735638157 shutdown_connections 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x555b8a085fb0 0x555b8a0883a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05c2ffd640 0 client.15510 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a076370 0x555b8a0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06cb40 0x555b8a073050 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/2735638157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06b5d0 0x555b8a075da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.332+0000 7f05ebf7c740 1 -- 172.21.15.63:0/2735638157 >> 172.21.15.63:0/2735638157 conn(0x555b8a034310 msgr2=0x555b8a06d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:34.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.333+0000 7f05ebf7c740 1 -- 172.21.15.63:0/2735638157 shutdown_connections 2024-09-16T01:25:34.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.333+0000 7f05ebf7c740 1 -- 172.21.15.63:0/2735638157 wait complete. 2024-09-16T01:25:34.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.333+0000 7f05ebf7c740 20 client.15510 trim_cache size 0 max 16384 2024-09-16T01:25:34.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05ebf7c740 1 Processor -- start 2024-09-16T01:25:34.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05ebf7c740 1 -- start start 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 0x555b8a06e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 0x555b8a06e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a076370 0x555b8a08dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41adb70 con 0x555b8a076370 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41ab440 con 0x555b8a06cb40 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41a9290 con 0x555b8a06b5d0 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a076370 0x555b8a08dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 0x555b8a06e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a076370 0x555b8a08dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34258/0 (socket says 172.21.15.63:34258) 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05e2ffd640 1 -- 172.21.15.63:0/3687988238 learned_addr learned my addr 172.21.15.63:0/3687988238 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.347+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/3687988238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 0x555b8a06e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.348+0000 7f05e37fe640 1 -- 172.21.15.63:0/3687988238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 msgr2=0x555b8a06e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:34.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.348+0000 7f05e37fe640 1 --2- 172.21.15.63:0/3687988238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 0x555b8a06e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.348+0000 7f05e37fe640 1 -- 172.21.15.63:0/3687988238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a076370 msgr2=0x555b8a08dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:34.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.348+0000 7f05e37fe640 1 --2- 172.21.15.63:0/3687988238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a076370 0x555b8a08dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.348+0000 7f05e37fe640 1 -- 172.21.15.63:0/3687988238 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b8a068960 con 0x555b8a06cb40 2024-09-16T01:25:34.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.348+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/3687988238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a076370 0x555b8a08dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:34.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.348+0000 7f05e37fe640 1 --2- 172.21.15.63:0/3687988238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 0x555b8a06e660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05d4031440 tx=0x7f05d402a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d832203c267e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:34.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.348+0000 7f05c97fa640 1 -- 172.21.15.63:0/3687988238 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4055020 con 0x555b8a06cb40 2024-09-16T01:25:34.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.348+0000 7f05c97fa640 1 -- 172.21.15.63:0/3687988238 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05d40054e0 con 0x555b8a06cb40 2024-09-16T01:25:34.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.348+0000 7f05c97fa640 1 -- 172.21.15.63:0/3687988238 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4035070 con 0x555b8a06cb40 2024-09-16T01:25:34.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.349+0000 7f05ebf7c740 1 -- 172.21.15.63:0/3687988238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 msgr2=0x555b8a06e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:34.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.349+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/3687988238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 0x555b8a06e660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f05d4031440 tx=0x7f05d402a420 comp rx=0 tx=0).stop 2024-09-16T01:25:34.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.349+0000 7f05ebf7c740 1 -- 172.21.15.63:0/3687988238 shutdown_connections 2024-09-16T01:25:34.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.349+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/3687988238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a076370 0x555b8a08dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.349+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/3687988238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 0x555b8a06e660 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.349+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/3687988238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a06b5d0 0x555b8a06e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.349+0000 7f05ebf7c740 1 -- 172.21.15.63:0/3687988238 >> 172.21.15.63:0/3687988238 conn(0x555b8a034310 msgr2=0x555b8a0750d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:34.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.349+0000 7f05ebf7c740 1 -- 172.21.15.63:0/3687988238 shutdown_connections 2024-09-16T01:25:34.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.349+0000 7f05ebf7c740 1 -- 172.21.15.63:0/3687988238 wait complete. 2024-09-16T01:25:34.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.349+0000 7f05ebf7c740 1 -- start start 2024-09-16T01:25:34.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05ebf7c740 1 Processor -- start 2024-09-16T01:25:34.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06b5d0 0x555b8a07e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 0x555b8a07e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05ebf7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a076370 0x555b8a07b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41a9900 con 0x555b8a06b5d0 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41aad70 con 0x555b8a06cb40 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05ebf7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41a9fd0 con 0x555b8a076370 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05ebf7c740 10 client.0 _ll_register_callbacks cb 0x7f05d4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06b5d0 0x555b8a07e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05e2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06b5d0 0x555b8a07e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34264/0 (socket says 172.21.15.63:34264) 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05e37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 0x555b8a07e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05e2ffd640 1 -- 172.21.15.63:0/1151578728 learned_addr learned my addr 172.21.15.63:0/1151578728 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a076370 0x555b8a07b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05e37fe640 1 -- 172.21.15.63:0/1151578728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a076370 msgr2=0x555b8a07b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05e37fe640 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a076370 0x555b8a07b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05e37fe640 1 -- 172.21.15.63:0/1151578728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06b5d0 msgr2=0x555b8a07e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05e37fe640 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06b5d0 0x555b8a07e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.350+0000 7f05e37fe640 1 -- 172.21.15.63:0/1151578728 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b8a07b930 con 0x555b8a06cb40 2024-09-16T01:25:34.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.351+0000 7f05e37fe640 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 0x555b8a07e960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x555b8a066420 tx=0x7f05d4005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=796b7d7a9a49b9b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:34.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.351+0000 7f05c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:25:34.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.353+0000 7f05c2ffd640 1 -- 172.21.15.63:0/1151578728 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4035070 con 0x555b8a06cb40 2024-09-16T01:25:34.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.353+0000 7f05c2ffd640 1 -- 172.21.15.63:0/1151578728 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f05d4032030 con 0x555b8a06cb40 2024-09-16T01:25:34.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.353+0000 7f05ebf7c740 1 -- 172.21.15.63:0/1151578728 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05d40054e0 con 0x555b8a06cb40 2024-09-16T01:25:34.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.353+0000 7f05c2ffd640 1 -- 172.21.15.63:0/1151578728 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f05d4055040 con 0x555b8a06cb40 2024-09-16T01:25:34.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.353+0000 7f05ebf7c740 10 client.25094 fetch_fsmap learned FSMap version 27 2024-09-16T01:25:34.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.353+0000 7f05ebf7c740 1 -- 172.21.15.63:0/1151578728 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555b8a0f1390 con 0x555b8a06cb40 2024-09-16T01:25:34.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.353+0000 7f05c2ffd640 1 -- 172.21.15.63:0/1151578728 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05d40054e0 con 0x555b8a06cb40 2024-09-16T01:25:34.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.354+0000 7f05c2ffd640 1 -- 172.21.15.63:0/1151578728 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f05d40327b0 con 0x555b8a06cb40 2024-09-16T01:25:34.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.354+0000 7f05ebf7c740 10 client.25094 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.354+0000 7f05ebf7c740 10 client.25094 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.354+0000 7f05ebf7c740 20 client.25094 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.354+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x555b8a0f1940 0x555b8a0f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.354+0000 7f05ebf7c740 4 client.25094 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.354+0000 7f05ebf7c740 1 -- 172.21.15.63:0/1151578728 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b89fd8d70 con 0x555b8a0f1940 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.354+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x555b8a0f1940 0x555b8a0f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.354+0000 7f05e2ffd640 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x555b8a0f1940 0x555b8a0f3d30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6142bacc42e20efa server_cookie=67983cdbd9279c74 in_seq=0 out_seq=0 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.354+0000 7f05c2ffd640 10 client.25094 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05c2ffd640 1 -- 172.21.15.63:0/1151578728 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b89fd8d70 con 0x555b8a0f1940 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05c2ffd640 10 client.25094 handle_command_reply: tid=0 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 client.25094 shutdown 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 -- 172.21.15.63:0/1151578728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 msgr2=0x555b8a07e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:34.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 0x555b8a07e960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x555b8a066420 tx=0x7f05d4005e50 comp rx=0 tx=0).stop 2024-09-16T01:25:34.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 -- 172.21.15.63:0/1151578728 shutdown_connections 2024-09-16T01:25:34.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x555b8a0f1940 0x555b8a0f3d30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555b8a076370 0x555b8a07b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05c2ffd640 0 client.25094 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:25:34.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555b8a06cb40 0x555b8a07e960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 --2- 172.21.15.63:0/1151578728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555b8a06b5d0 0x555b8a07e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 -- 172.21.15.63:0/1151578728 >> 172.21.15.63:0/1151578728 conn(0x555b8a034310 msgr2=0x555b8a0664e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:34.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 -- 172.21.15.63:0/1151578728 shutdown_connections 2024-09-16T01:25:34.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 1 -- 172.21.15.63:0/1151578728 wait complete. 2024-09-16T01:25:34.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.355+0000 7f05ebf7c740 20 client.25094 trim_cache size 0 max 16384 2024-09-16T01:25:34.362 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:25:34.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 -- 172.21.15.63:0/3217274548 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05cc0a3240 msgr2=0x7f05cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05cc0a3240 0x7f05cc0a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f05dc098ab0 tx=0x7f05dc01d000 comp rx=0 tx=0).stop 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 -- 172.21.15.63:0/3217274548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05e41082a0 msgr2=0x7f05e419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05e41082a0 0x7f05e419cde0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00eaa0 tx=0x7f05dc00ef60 comp rx=0 tx=0).stop 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 -- 172.21.15.63:0/3217274548 shutdown_connections 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05cc0a3240 0x7f05cc0a5700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05e41082a0 0x7f05e419cde0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05e41036e0 0x7f05e4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 --2- 172.21.15.63:0/3217274548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e4102d30 0x7f05e4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 -- 172.21.15.63:0/3217274548 >> 172.21.15.63:0/3217274548 conn(0x7f05e40fc7d0 msgr2=0x7f05e4105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 -- 172.21.15.63:0/3217274548 shutdown_connections 2024-09-16T01:25:34.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:34.356+0000 7f05e9ba3640 1 -- 172.21.15.63:0/3217274548 wait complete. 2024-09-16T01:25:34.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:34 smithi063 ceph-mon[31070]: pgmap v402: 97 pgs: 97 active+clean; 1.8 GiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 146 MiB/s wr, 319 op/s 2024-09-16T01:25:34.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:34 smithi192 ceph-mon[34775]: pgmap v402: 97 pgs: 97 active+clean; 1.8 GiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 146 MiB/s wr, 319 op/s 2024-09-16T01:25:34.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:34 smithi162 ceph-mon[34539]: pgmap v402: 97 pgs: 97 active+clean; 1.8 GiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 57 MiB/s rd, 146 MiB/s wr, 319 op/s 2024-09-16T01:25:35.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-16T01:25:35.394 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:25:35.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:35 smithi063 ceph-mon[31070]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:25:35.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:35 smithi192 ceph-mon[34775]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:25:35.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:35 smithi162 ceph-mon[34539]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:25:35.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 -- 172.21.15.63:0/304471939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0528106f20 msgr2=0x7f052810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:35.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 --2- 172.21.15.63:0/304471939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0528106f20 0x7f052810eaa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0520009ca0 tx=0x7f052002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 -- 172.21.15.63:0/304471939 shutdown_connections 2024-09-16T01:25:35.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 --2- 172.21.15.63:0/304471939 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0528106f20 0x7f052810eaa0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 --2- 172.21.15.63:0/304471939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05281027a0 0x7f05281067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 --2- 172.21.15.63:0/304471939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0528101df0 0x7f05281021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 -- 172.21.15.63:0/304471939 >> 172.21.15.63:0/304471939 conn(0x7f05280fd8f0 msgr2=0x7f05280ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:35.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 -- 172.21.15.63:0/304471939 shutdown_connections 2024-09-16T01:25:35.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 -- 172.21.15.63:0/304471939 wait complete. 2024-09-16T01:25:35.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 Processor -- start 2024-09-16T01:25:35.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.876+0000 7f052d56a640 1 -- start start 2024-09-16T01:25:35.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f052d56a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0528101df0 0x7f052819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f052d56a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05281027a0 0x7f052819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f052d56a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0528106f20 0x7f052819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f052d56a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0528111e30 con 0x7f0528106f20 2024-09-16T01:25:35.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f052d56a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0528111cb0 con 0x7f0528101df0 2024-09-16T01:25:35.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f052d56a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0528111fb0 con 0x7f05281027a0 2024-09-16T01:25:35.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f0526ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0528101df0 0x7f052819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f051ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05281027a0 0x7f052819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f0526ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0528101df0 0x7f052819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:43682/0 (socket says 172.21.15.63:43682) 2024-09-16T01:25:35.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f0526ffd640 1 -- 172.21.15.63:0/1647106235 learned_addr learned my addr 172.21.15.63:0/1647106235 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:35.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f05277fe640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0528106f20 0x7f052819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f051ffff640 1 -- 172.21.15.63:0/1647106235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0528101df0 msgr2=0x7f052819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:35.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f051ffff640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0528101df0 0x7f052819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f051ffff640 1 -- 172.21.15.63:0/1647106235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0528106f20 msgr2=0x7f052819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:35.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f051ffff640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0528106f20 0x7f052819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f051ffff640 1 -- 172.21.15.63:0/1647106235 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052819f490 con 0x7f05281027a0 2024-09-16T01:25:35.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.877+0000 7f051ffff640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05281027a0 0x7f052819aa20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f051000e9f0 tx=0x7f051000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:35.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.878+0000 7f0524ff9640 1 -- 172.21.15.63:0/1647106235 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051000ccc0 con 0x7f05281027a0 2024-09-16T01:25:35.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.878+0000 7f0524ff9640 1 -- 172.21.15.63:0/1647106235 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f05100108e0 con 0x7f05281027a0 2024-09-16T01:25:35.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.878+0000 7f052d56a640 1 -- 172.21.15.63:0/1647106235 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052819f780 con 0x7f05281027a0 2024-09-16T01:25:35.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.878+0000 7f0524ff9640 1 -- 172.21.15.63:0/1647106235 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510018880 con 0x7f05281027a0 2024-09-16T01:25:35.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.878+0000 7f052d56a640 1 -- 172.21.15.63:0/1647106235 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05281a7060 con 0x7f05281027a0 2024-09-16T01:25:35.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.880+0000 7f0524ff9640 1 -- 172.21.15.63:0/1647106235 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0510010a90 con 0x7f05281027a0 2024-09-16T01:25:35.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f052f943740 1 Processor -- start 2024-09-16T01:25:35.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f052f943740 1 -- start start 2024-09-16T01:25:35.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f0524ff9640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05140a3240 0x7f05140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f05277fe640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05140a3240 0x7f05140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f052f943740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f39b40 0x555871f38090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f0524ff9640 1 -- 172.21.15.63:0/1647106235 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f05100cfbc0 con 0x7f05281027a0 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f052f943740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f385d0 0x555871f38a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f052f943740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f45760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f052f943740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555871e9e2f0 con 0x555871f43370 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f052f943740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555871e45cf0 con 0x555871f385d0 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f052f943740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555871e9a2b0 con 0x555871f39b40 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.881+0000 7f0526ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f39b40 0x555871f38090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f05277fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f45760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f0526ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f39b40 0x555871f38090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:37286/0 (socket says 172.21.15.63:37286) 2024-09-16T01:25:35.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f0526ffd640 1 -- 172.21.15.63:0/696425430 learned_addr learned my addr 172.21.15.63:0/696425430 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f051ffff640 1 --2- 172.21.15.63:0/696425430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f385d0 0x555871f38a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f05277fe640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05140a3240 0x7f05140a5700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0520004af0 tx=0x7f0520009980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f05277fe640 1 -- 172.21.15.63:0/696425430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f39b40 msgr2=0x555871f38090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f05277fe640 1 --2- 172.21.15.63:0/696425430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f39b40 0x555871f38090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f05277fe640 1 -- 172.21.15.63:0/696425430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f385d0 msgr2=0x555871f38a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f05277fe640 1 --2- 172.21.15.63:0/696425430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f385d0 0x555871f38a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f05277fe640 1 -- 172.21.15.63:0/696425430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555871e2a3a0 con 0x555871f43370 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f0526ffd640 1 --2- 172.21.15.63:0/696425430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f39b40 0x555871f38090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f05277fe640 1 --2- 172.21.15.63:0/696425430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f45760 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0520031040 tx=0x7f0520047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855319f2104eaa41 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f051d7fa640 1 -- 172.21.15.63:0/696425430 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520042040 con 0x555871f43370 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f051d7fa640 1 -- 172.21.15.63:0/696425430 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f052004d070 con 0x555871f43370 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.882+0000 7f051d7fa640 1 -- 172.21.15.63:0/696425430 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05200305c0 con 0x555871f43370 2024-09-16T01:25:35.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.883+0000 7f052f943740 1 -- 172.21.15.63:0/696425430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 msgr2=0x555871f45760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:35.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.883+0000 7f052f943740 1 --2- 172.21.15.63:0/696425430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f45760 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0520031040 tx=0x7f0520047000 comp rx=0 tx=0).stop 2024-09-16T01:25:35.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.883+0000 7f052f943740 1 -- 172.21.15.63:0/696425430 shutdown_connections 2024-09-16T01:25:35.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.883+0000 7f052f943740 1 --2- 172.21.15.63:0/696425430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f45760 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.883+0000 7f052f943740 1 --2- 172.21.15.63:0/696425430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f385d0 0x555871f38a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.883+0000 7f052f943740 1 --2- 172.21.15.63:0/696425430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f39b40 0x555871f38090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.883+0000 7f052f943740 1 -- 172.21.15.63:0/696425430 >> 172.21.15.63:0/696425430 conn(0x555871f01310 msgr2=0x555871f34c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:35.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.883+0000 7f052f943740 1 -- 172.21.15.63:0/696425430 shutdown_connections 2024-09-16T01:25:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.883+0000 7f052f943740 1 -- 172.21.15.63:0/696425430 wait complete. 2024-09-16T01:25:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.883+0000 7f052f943740 1 -- start start 2024-09-16T01:25:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f052f943740 1 Processor -- start 2024-09-16T01:25:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f052f943740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 0x555871f42da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f052f943740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 0x555871f40050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f052f943740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f407e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f052f943740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555871f46010 con 0x555871f43370 2024-09-16T01:25:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f052f943740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555871e59060 con 0x555871f39b40 2024-09-16T01:25:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f052f943740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555871f46190 con 0x555871f385d0 2024-09-16T01:25:35.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f052f943740 10 client.0 _ll_register_callbacks cb 0x555871bac8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f05277fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f05277fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34290/0 (socket says 172.21.15.63:34290) 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f051ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 0x555871f40050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f0526ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 0x555871f42da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f05277fe640 1 -- 172.21.15.63:0/4002719119 learned_addr learned my addr 172.21.15.63:0/4002719119 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f05277fe640 1 -- 172.21.15.63:0/4002719119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 msgr2=0x555871f42da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f05277fe640 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 0x555871f42da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f05277fe640 1 -- 172.21.15.63:0/4002719119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 msgr2=0x555871f40050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f05277fe640 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 0x555871f40050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.884+0000 7f05277fe640 1 -- 172.21.15.63:0/4002719119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555871c0f3c0 con 0x555871f43370 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f05277fe640 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f407e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f05200043b0 tx=0x7f05200319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d76938031fcbfb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f050e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:25:35.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f050e7fc640 1 -- 172.21.15.63:0/4002719119 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0520042040 con 0x555871f43370 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f050e7fc640 1 -- 172.21.15.63:0/4002719119 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0520003b70 con 0x555871f43370 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f052f943740 1 -- 172.21.15.63:0/4002719119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f052004d070 con 0x555871f43370 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f050e7fc640 1 -- 172.21.15.63:0/4002719119 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0520003d70 con 0x555871f43370 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f052f943740 10 client.15528 fetch_fsmap learned FSMap version 27 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f052f943740 1 -- 172.21.15.63:0/4002719119 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555871f46010 con 0x555871f43370 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f050e7fc640 1 -- 172.21.15.63:0/4002719119 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f052004d070 con 0x555871f43370 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f050e7fc640 1 -- 172.21.15.63:0/4002719119 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f0520052620 con 0x555871f43370 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f052f943740 10 client.15528 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f052f943740 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f052f943740 20 client.15528 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f052f943740 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555871f52c70 0x555871f55060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f052f943740 4 client.15528 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:25:35.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.885+0000 7f052f943740 1 -- 172.21.15.63:0/4002719119 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555871eab860 con 0x555871f52c70 2024-09-16T01:25:35.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.886+0000 7f0526ffd640 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555871f52c70 0x555871f55060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.887+0000 7f0526ffd640 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555871f52c70 0x555871f55060 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9af091aae41706e7 server_cookie=23b4f8706d71c84c in_seq=0 out_seq=0 2024-09-16T01:25:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.887+0000 7f050e7fc640 10 client.15528 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f050e7fc640 1 -- 172.21.15.63:0/4002719119 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555871eab860 con 0x555871f52c70 2024-09-16T01:25:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f050e7fc640 10 client.15528 handle_command_reply: tid=0 2024-09-16T01:25:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 client.15528 shutdown 2024-09-16T01:25:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 -- 172.21.15.63:0/4002719119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 msgr2=0x555871f407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f407e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f05200043b0 tx=0x7f05200319a0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 -- 172.21.15.63:0/4002719119 shutdown_connections 2024-09-16T01:25:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555871f52c70 0x555871f55060 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871f407e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f050e7fc640 0 client.15528 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 0x555871f40050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 --2- 172.21.15.63:0/4002719119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 0x555871f42da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 -- 172.21.15.63:0/4002719119 >> 172.21.15.63:0/4002719119 conn(0x555871f01310 msgr2=0x555871f3a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 -- 172.21.15.63:0/4002719119 shutdown_connections 2024-09-16T01:25:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.888+0000 7f052f943740 1 -- 172.21.15.63:0/4002719119 wait complete. 2024-09-16T01:25:35.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.889+0000 7f052f943740 20 client.15528 trim_cache size 0 max 16384 2024-09-16T01:25:35.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f052f943740 1 Processor -- start 2024-09-16T01:25:35.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f052f943740 1 -- start start 2024-09-16T01:25:35.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f052f943740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f385d0 0x555871f41fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f052f943740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f39b40 0x555871f3b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f052f943740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f43370 0x555871f3b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f052f943740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f05281b1f60 con 0x555871f39b40 2024-09-16T01:25:35.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f052f943740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05281af800 con 0x555871f385d0 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f052f943740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f05281ad630 con 0x555871f43370 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f051ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f39b40 0x555871f3b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f051ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f39b40 0x555871f3b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34306/0 (socket says 172.21.15.63:34306) 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f051ffff640 1 -- 172.21.15.63:0/2794732169 learned_addr learned my addr 172.21.15.63:0/2794732169 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f0526ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f385d0 0x555871f41fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f05277fe640 1 --2- 172.21.15.63:0/2794732169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f43370 0x555871f3b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f051ffff640 1 -- 172.21.15.63:0/2794732169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f43370 msgr2=0x555871f3b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f051ffff640 1 --2- 172.21.15.63:0/2794732169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f43370 0x555871f3b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f051ffff640 1 -- 172.21.15.63:0/2794732169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f385d0 msgr2=0x555871f41fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f051ffff640 1 --2- 172.21.15.63:0/2794732169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f385d0 0x555871f41fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.902+0000 7f051ffff640 1 -- 172.21.15.63:0/2794732169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555871f4f790 con 0x555871f39b40 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.903+0000 7f05277fe640 1 --2- 172.21.15.63:0/2794732169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f43370 0x555871f3b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.903+0000 7f051ffff640 1 --2- 172.21.15.63:0/2794732169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f39b40 0x555871f3b010 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f05100cd680 tx=0x7f05100bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66a96f7c615a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:35.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.903+0000 7f051cff9640 1 -- 172.21.15.63:0/2794732169 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05100b5070 con 0x555871f39b40 2024-09-16T01:25:35.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.903+0000 7f051cff9640 1 -- 172.21.15.63:0/2794732169 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f051009a550 con 0x555871f39b40 2024-09-16T01:25:35.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.903+0000 7f051cff9640 1 -- 172.21.15.63:0/2794732169 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05100cdb40 con 0x555871f39b40 2024-09-16T01:25:35.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.904+0000 7f052f943740 1 -- 172.21.15.63:0/2794732169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f39b40 msgr2=0x555871f3b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:35.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.904+0000 7f052f943740 1 --2- 172.21.15.63:0/2794732169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f39b40 0x555871f3b010 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f05100cd680 tx=0x7f05100bc040 comp rx=0 tx=0).stop 2024-09-16T01:25:35.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.904+0000 7f052f943740 1 -- 172.21.15.63:0/2794732169 shutdown_connections 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.904+0000 7f052f943740 1 --2- 172.21.15.63:0/2794732169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f43370 0x555871f3b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.904+0000 7f052f943740 1 --2- 172.21.15.63:0/2794732169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f39b40 0x555871f3b010 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.904+0000 7f052f943740 1 --2- 172.21.15.63:0/2794732169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f385d0 0x555871f41fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.904+0000 7f052f943740 1 -- 172.21.15.63:0/2794732169 >> 172.21.15.63:0/2794732169 conn(0x555871f01310 msgr2=0x555871f418b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.904+0000 7f052f943740 1 -- 172.21.15.63:0/2794732169 shutdown_connections 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.904+0000 7f052f943740 1 -- 172.21.15.63:0/2794732169 wait complete. 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.904+0000 7f052f943740 1 -- start start 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f052f943740 1 Processor -- start 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f052f943740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 0x555871f46b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f052f943740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 0x555871f470a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f052f943740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871fb57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f052f943740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f05281adcc0 con 0x555871f43370 2024-09-16T01:25:35.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f052f943740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05281af130 con 0x555871f39b40 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f052f943740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f05281ae390 con 0x555871f385d0 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f052f943740 10 client.0 _ll_register_callbacks cb 0x7f0518009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f051ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 0x555871f470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f051ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 0x555871f470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:43712/0 (socket says 172.21.15.63:43712) 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f051ffff640 1 -- 172.21.15.63:0/2978018496 learned_addr learned my addr 172.21.15.63:0/2978018496 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f0526ffd640 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 0x555871f46b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f05277fe640 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871fb57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f051ffff640 1 -- 172.21.15.63:0/2978018496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 msgr2=0x555871f46b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f051ffff640 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 0x555871f46b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f051ffff640 1 -- 172.21.15.63:0/2978018496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 msgr2=0x555871fb57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f051ffff640 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871fb57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f051ffff640 1 -- 172.21.15.63:0/2978018496 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555871fb5e40 con 0x555871f39b40 2024-09-16T01:25:35.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.905+0000 7f0526ffd640 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 0x555871f46b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.906+0000 7f051ffff640 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 0x555871f470a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f051009c190 tx=0x7f051000ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f07d07abff150489 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.906+0000 7f050e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.906+0000 7f050e7fc640 1 -- 172.21.15.63:0/2978018496 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05100b5040 con 0x555871f39b40 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.906+0000 7f052f943740 1 -- 172.21.15.63:0/2978018496 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f051009a550 con 0x555871f39b40 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.906+0000 7f050e7fc640 1 -- 172.21.15.63:0/2978018496 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0510010430 con 0x555871f39b40 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.906+0000 7f050e7fc640 1 -- 172.21.15.63:0/2978018496 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0510010630 con 0x555871f39b40 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.906+0000 7f052f943740 10 client.25112 fetch_fsmap learned FSMap version 27 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.906+0000 7f052f943740 1 -- 172.21.15.63:0/2978018496 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555871fbd120 con 0x555871f39b40 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.906+0000 7f050e7fc640 1 -- 172.21.15.63:0/2978018496 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f051009a550 con 0x555871f39b40 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.906+0000 7f050e7fc640 1 -- 172.21.15.63:0/2978018496 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f0510097fa0 con 0x555871f39b40 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.907+0000 7f052f943740 10 client.25112 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.907+0000 7f052f943740 10 client.25112 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.907+0000 7f052f943740 20 client.25112 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:35.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.907+0000 7f052f943740 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555871fbd870 0x555871fbfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.907+0000 7f052f943740 4 client.25112 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:25:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.907+0000 7f052f943740 1 -- 172.21.15.63:0/2978018496 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555871ea5d70 con 0x555871fbd870 2024-09-16T01:25:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.907+0000 7f0526ffd640 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555871fbd870 0x555871fbfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.907+0000 7f0526ffd640 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555871fbd870 0x555871fbfc90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc408d6a73092e93 server_cookie=af147b0b96e5349a in_seq=0 out_seq=0 2024-09-16T01:25:35.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.907+0000 7f050e7fc640 10 client.25112 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f050e7fc640 1 -- 172.21.15.63:0/2978018496 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555871ea5d70 con 0x555871fbd870 2024-09-16T01:25:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f050e7fc640 10 client.25112 handle_command_reply: tid=0 2024-09-16T01:25:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 client.25112 shutdown 2024-09-16T01:25:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 -- 172.21.15.63:0/2978018496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 msgr2=0x555871f470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 0x555871f470a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f051009c190 tx=0x7f051000ced0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 -- 172.21.15.63:0/2978018496 shutdown_connections 2024-09-16T01:25:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555871fbd870 0x555871fbfc90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555871f43370 0x555871fb57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555871f39b40 0x555871f470a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f050e7fc640 0 client.25112 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 --2- 172.21.15.63:0/2978018496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555871f385d0 0x555871f46b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 -- 172.21.15.63:0/2978018496 >> 172.21.15.63:0/2978018496 conn(0x555871f01310 msgr2=0x555871f420d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 -- 172.21.15.63:0/2978018496 shutdown_connections 2024-09-16T01:25:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.908+0000 7f052f943740 1 -- 172.21.15.63:0/2978018496 wait complete. 2024-09-16T01:25:35.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052f943740 20 client.25112 trim_cache size 0 max 16384 2024-09-16T01:25:35.914 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:25:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052d56a640 1 -- 172.21.15.63:0/1647106235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05140a3240 msgr2=0x7f05140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052d56a640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05140a3240 0x7f05140a5700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0520004af0 tx=0x7f0520009980 comp rx=0 tx=0).stop 2024-09-16T01:25:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052d56a640 1 -- 172.21.15.63:0/1647106235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05281027a0 msgr2=0x7f052819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052d56a640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05281027a0 0x7f052819aa20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f051000e9f0 tx=0x7f051000eeb0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052d56a640 1 -- 172.21.15.63:0/1647106235 shutdown_connections 2024-09-16T01:25:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052d56a640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f05140a3240 0x7f05140a5700 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052d56a640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0528106f20 0x7f052819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052d56a640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05281027a0 0x7f052819aa20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052d56a640 1 --2- 172.21.15.63:0/1647106235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0528101df0 0x7f052819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.909+0000 7f052d56a640 1 -- 172.21.15.63:0/1647106235 >> 172.21.15.63:0/1647106235 conn(0x7f05280fd8f0 msgr2=0x7f05280febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.910+0000 7f052d56a640 1 -- 172.21.15.63:0/1647106235 shutdown_connections 2024-09-16T01:25:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:35.910+0000 7f052d56a640 1 -- 172.21.15.63:0/1647106235 wait complete. 2024-09-16T01:25:36.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:36 smithi063 ceph-mon[31070]: pgmap v403: 97 pgs: 97 active+clean; 1.7 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 111 MiB/s wr, 294 op/s 2024-09-16T01:25:36.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:36 smithi192 ceph-mon[34775]: pgmap v403: 97 pgs: 97 active+clean; 1.7 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 111 MiB/s wr, 294 op/s 2024-09-16T01:25:36.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:36 smithi162 ceph-mon[34539]: pgmap v403: 97 pgs: 97 active+clean; 1.7 GiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 42 MiB/s rd, 111 MiB/s wr, 294 op/s 2024-09-16T01:25:37.747 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-16T01:25:37.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-16T01:25:38.025 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:25:38.420 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:38 smithi063 ceph-mon[31070]: pgmap v404: 97 pgs: 97 active+clean; 1.0 GiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 37 MiB/s rd, 95 MiB/s wr, 283 op/s 2024-09-16T01:25:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.511+0000 7f8f22cb2640 1 -- 172.21.15.63:0/1819972019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f1c1037a0 msgr2=0x7f8f1c10bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.511+0000 7f8f22cb2640 1 --2- 172.21.15.63:0/1819972019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f1c1037a0 0x7f8f1c10bc00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009900 tx=0x7f8f0802a410 comp rx=0 tx=0).stop 2024-09-16T01:25:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.512+0000 7f8f22cb2640 1 -- 172.21.15.63:0/1819972019 shutdown_connections 2024-09-16T01:25:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.512+0000 7f8f22cb2640 1 --2- 172.21.15.63:0/1819972019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c10c2f0 0x7f8f1c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.512+0000 7f8f22cb2640 1 --2- 172.21.15.63:0/1819972019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f1c1037a0 0x7f8f1c10bc00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.512+0000 7f8f22cb2640 1 --2- 172.21.15.63:0/1819972019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1c102df0 0x7f8f1c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.512+0000 7f8f22cb2640 1 -- 172.21.15.63:0/1819972019 >> 172.21.15.63:0/1819972019 conn(0x7f8f1c0fc7d0 msgr2=0x7f8f1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.512+0000 7f8f22cb2640 1 -- 172.21.15.63:0/1819972019 shutdown_connections 2024-09-16T01:25:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.512+0000 7f8f22cb2640 1 -- 172.21.15.63:0/1819972019 wait complete. 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.512+0000 7f8f22cb2640 1 Processor -- start 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.512+0000 7f8f22cb2640 1 -- start start 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f22cb2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f1c102df0 0x7f8f1c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f22cb2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1c1037a0 0x7f8f1c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f22cb2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c10c2f0 0x7f8f1c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f22cb2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c111f80 con 0x7f8f1c102df0 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f22cb2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c111e00 con 0x7f8f1c10c2f0 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f22cb2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c112100 con 0x7f8f1c1037a0 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f2124f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c10c2f0 0x7f8f1c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f2124f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c10c2f0 0x7f8f1c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:57074/0 (socket says 172.21.15.63:57074) 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f2124f640 1 -- 172.21.15.63:0/3297727804 learned_addr learned my addr 172.21.15.63:0/3297727804 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f1c102df0 0x7f8f1c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1c1037a0 0x7f8f1c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f2124f640 1 -- 172.21.15.63:0/3297727804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1c1037a0 msgr2=0x7f8f1c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f2124f640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1c1037a0 0x7f8f1c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f2124f640 1 -- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f1c102df0 msgr2=0x7f8f1c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f2124f640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f1c102df0 0x7f8f1c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f2124f640 1 -- 172.21.15.63:0/3297727804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c19d4f0 con 0x7f8f1c10c2f0 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f1c102df0 0x7f8f1c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.513+0000 7f8f2124f640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c10c2f0 0x7f8f1c19ce10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400eb10 tx=0x7f8f1400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.514+0000 7f8f19ffb640 1 -- 172.21.15.63:0/3297727804 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14004b20 con 0x7f8f1c10c2f0 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.514+0000 7f8f22cb2640 1 -- 172.21.15.63:0/3297727804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1c19d7e0 con 0x7f8f1c10c2f0 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.514+0000 7f8f19ffb640 1 -- 172.21.15.63:0/3297727804 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f14004cc0 con 0x7f8f1c10c2f0 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.514+0000 7f8f19ffb640 1 -- 172.21.15.63:0/3297727804 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14010690 con 0x7f8f1c10c2f0 2024-09-16T01:25:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.514+0000 7f8f22cb2640 1 -- 172.21.15.63:0/3297727804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1c1a50c0 con 0x7f8f1c10c2f0 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.516+0000 7f8f19ffb640 1 -- 172.21.15.63:0/3297727804 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8f14005020 con 0x7f8f1c10c2f0 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f2508b740 1 Processor -- start 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f2508b740 1 -- start start 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f19ffb640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8f0c0a3240 0x7f8f0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115843f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8f0c0a3240 0x7f8f0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f19ffb640 1 -- 172.21.15.63:0/3297727804 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8f140cfe60 con 0x7f8f1c10c2f0 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 0x558115851130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f2508b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5581157a9280 con 0x558115843b60 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f2508b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558115750b10 con 0x55811584ed40 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f2508b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5581157a5240 con 0x558115844480 2024-09-16T01:25:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f20a4e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115843f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f20a4e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115843f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57200/0 (socket says 172.21.15.63:57200) 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f20a4e640 1 -- 172.21.15.63:0/2395011873 learned_addr learned my addr 172.21.15.63:0/2395011873 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/2395011873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f2124f640 1 --2- 172.21.15.63:0/2395011873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 0x558115851130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f1bfff640 1 -- 172.21.15.63:0/2395011873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 msgr2=0x558115851130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/2395011873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 0x558115851130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f1bfff640 1 -- 172.21.15.63:0/2395011873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 msgr2=0x558115843f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/2395011873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115843f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f1bfff640 1 -- 172.21.15.63:0/2395011873 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55811575d1f0 con 0x558115844480 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.517+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/2395011873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115843f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.518+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8f0c0a3240 0x7f8f0c0a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009230 tx=0x7f8f08032ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.518+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/2395011873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584e800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f0802a930 tx=0x7f8f08046000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e298ee56422ea16d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.518+0000 7f8f06ffd640 1 -- 172.21.15.63:0/2395011873 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08050070 con 0x558115844480 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.518+0000 7f8f06ffd640 1 -- 172.21.15.63:0/2395011873 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f080054f0 con 0x558115844480 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.518+0000 7f8f06ffd640 1 -- 172.21.15.63:0/2395011873 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08035040 con 0x558115844480 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 -- 172.21.15.63:0/2395011873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 msgr2=0x55811584e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 --2- 172.21.15.63:0/2395011873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584e800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f0802a930 tx=0x7f8f08046000 comp rx=0 tx=0).stop 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 -- 172.21.15.63:0/2395011873 shutdown_connections 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 --2- 172.21.15.63:0/2395011873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 0x558115851130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 --2- 172.21.15.63:0/2395011873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584e800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 --2- 172.21.15.63:0/2395011873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115843f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 -- 172.21.15.63:0/2395011873 >> 172.21.15.63:0/2395011873 conn(0x5581158400f0 msgr2=0x5581158404d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 -- 172.21.15.63:0/2395011873 shutdown_connections 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 -- 172.21.15.63:0/2395011873 wait complete. 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 -- start start 2024-09-16T01:25:38.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 Processor -- start 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115843b60 0x55811584bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55811584ed40 0x55811584c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x558115851910 con 0x55811584ed40 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558115763f10 con 0x558115843b60 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.519+0000 7f8f2508b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558115851a90 con 0x558115844480 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f2508b740 10 client.0 _ll_register_callbacks cb 0x55811572ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f20a4e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115843b60 0x55811584bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f2124f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55811584ed40 0x55811584c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f20a4e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115843b60 0x55811584bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:57098/0 (socket says 172.21.15.63:57098) 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:46548/0 (socket says 172.21.15.63:46548) 2024-09-16T01:25:38.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f20a4e640 1 -- 172.21.15.63:0/2323621555 learned_addr learned my addr 172.21.15.63:0/2323621555 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f1bfff640 1 -- 172.21.15.63:0/2323621555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115843b60 msgr2=0x55811584bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115843b60 0x55811584bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f1bfff640 1 -- 172.21.15.63:0/2323621555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55811584ed40 msgr2=0x55811584c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55811584ed40 0x55811584c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f1bfff640 1 -- 172.21.15.63:0/2323621555 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55811551a6a0 con 0x558115844480 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115843b60 0x55811584bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584c1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f08032fd0 tx=0x7f8f08031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c36b9198889dc0d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8efbfff640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8efbfff640 1 -- 172.21.15.63:0/2323621555 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f08059060 con 0x558115844480 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8efbfff640 1 -- 172.21.15.63:0/2323621555 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8f080037f0 con 0x558115844480 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.520+0000 7f8f2508b740 1 -- 172.21.15.63:0/2323621555 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f080054f0 con 0x558115844480 2024-09-16T01:25:38.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8efbfff640 1 -- 172.21.15.63:0/2323621555 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8f08050040 con 0x558115844480 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8f2508b740 10 client.25138 fetch_fsmap learned FSMap version 27 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8f2508b740 1 -- 172.21.15.63:0/2323621555 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558115851910 con 0x558115844480 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8efbfff640 1 -- 172.21.15.63:0/2323621555 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f080054f0 con 0x558115844480 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8efbfff640 1 -- 172.21.15.63:0/2323621555 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f8f0805e070 con 0x558115844480 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8f2508b740 10 client.25138 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8f2508b740 10 client.25138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8f2508b740 20 client.25138 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8f2508b740 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55811585e710 0x558115860b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8f2508b740 4 client.25138 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8f2508b740 1 -- 172.21.15.63:0/2323621555 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581157b67f0 con 0x55811585e710 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.521+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55811585e710 0x558115860b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.522+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55811585e710 0x558115860b00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6db3a986a5db1ed server_cookie=b769d21eab1f634a in_seq=0 out_seq=0 2024-09-16T01:25:38.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.522+0000 7f8efbfff640 10 client.25138 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8efbfff640 1 -- 172.21.15.63:0/2323621555 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5581157b67f0 con 0x55811585e710 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8efbfff640 10 client.25138 handle_command_reply: tid=0 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 client.25138 shutdown 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 -- 172.21.15.63:0/2323621555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 msgr2=0x55811584c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584c1e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f08032fd0 tx=0x7f8f08031400 comp rx=0 tx=0).stop 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 -- 172.21.15.63:0/2323621555 shutdown_connections 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55811585e710 0x558115860b00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55811584ed40 0x55811584c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x55811584c1e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8efbfff640 0 client.25138 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 --2- 172.21.15.63:0/2323621555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115843b60 0x55811584bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 -- 172.21.15.63:0/2323621555 >> 172.21.15.63:0/2323621555 conn(0x5581158400f0 msgr2=0x558115845e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:38.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 -- 172.21.15.63:0/2323621555 shutdown_connections 2024-09-16T01:25:38.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.524+0000 7f8f2508b740 1 -- 172.21.15.63:0/2323621555 wait complete. 2024-09-16T01:25:38.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.525+0000 7f8f2508b740 20 client.25138 trim_cache size 0 max 16384 2024-09-16T01:25:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f2508b740 1 Processor -- start 2024-09-16T01:25:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f2508b740 1 -- start start 2024-09-16T01:25:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115846610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115844480 0x558115866190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55811584ed40 0x5581158666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f2508b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1afe20 con 0x558115843b60 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f2508b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1ad6c0 con 0x558115844480 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f2508b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1ab4f0 con 0x55811584ed40 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f20a4e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115846610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f20a4e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115846610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57218/0 (socket says 172.21.15.63:57218) 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f20a4e640 1 -- 172.21.15.63:0/3656472811 learned_addr learned my addr 172.21.15.63:0/3656472811 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/3656472811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115844480 0x558115866190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f2124f640 1 --2- 172.21.15.63:0/3656472811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55811584ed40 0x5581158666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f20a4e640 1 -- 172.21.15.63:0/3656472811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55811584ed40 msgr2=0x5581158666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/3656472811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55811584ed40 0x5581158666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f20a4e640 1 -- 172.21.15.63:0/3656472811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115844480 msgr2=0x558115866190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/3656472811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115844480 0x558115866190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f20a4e640 1 -- 172.21.15.63:0/3656472811 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55811583fb90 con 0x558115843b60 2024-09-16T01:25:38.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.543+0000 7f8f2124f640 1 --2- 172.21.15.63:0/3656472811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55811584ed40 0x5581158666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:25:38.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.544+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/3656472811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115846610 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8f10004650 tx=0x7f8f10005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d62f38c413cc2ea server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:38.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.544+0000 7f8f067fc640 1 -- 172.21.15.63:0/3656472811 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1000fca0 con 0x558115843b60 2024-09-16T01:25:38.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.544+0000 7f8f067fc640 1 -- 172.21.15.63:0/3656472811 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f1000fe40 con 0x558115843b60 2024-09-16T01:25:38.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.544+0000 7f8f067fc640 1 -- 172.21.15.63:0/3656472811 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1001f3f0 con 0x558115843b60 2024-09-16T01:25:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 -- 172.21.15.63:0/3656472811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 msgr2=0x558115846610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 --2- 172.21.15.63:0/3656472811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115846610 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8f10004650 tx=0x7f8f10005f90 comp rx=0 tx=0).stop 2024-09-16T01:25:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 -- 172.21.15.63:0/3656472811 shutdown_connections 2024-09-16T01:25:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 --2- 172.21.15.63:0/3656472811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55811584ed40 0x5581158666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 --2- 172.21.15.63:0/3656472811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558115844480 0x558115866190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 --2- 172.21.15.63:0/3656472811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115846610 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 -- 172.21.15.63:0/3656472811 >> 172.21.15.63:0/3656472811 conn(0x5581158400f0 msgr2=0x55811584dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 -- 172.21.15.63:0/3656472811 shutdown_connections 2024-09-16T01:25:38.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 -- 172.21.15.63:0/3656472811 wait complete. 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 -- start start 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.545+0000 7f8f2508b740 1 Processor -- start 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115848e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x558115849370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2508b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 0x5581158498b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2508b740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1abb80 con 0x558115843b60 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2508b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1acff0 con 0x55811584ed40 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2508b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c1ac250 con 0x558115844480 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2508b740 10 client.0 _ll_register_callbacks cb 0x7f8f0804e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f20a4e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115848e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2124f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 0x5581158498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f20a4e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115848e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57226/0 (socket says 172.21.15.63:57226) 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2124f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 0x5581158498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:57116/0 (socket says 172.21.15.63:57116) 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f20a4e640 1 -- 172.21.15.63:0/303601126 learned_addr learned my addr 172.21.15.63:0/303601126 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x558115849370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2124f640 1 -- 172.21.15.63:0/303601126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 msgr2=0x558115849370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2124f640 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x558115849370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2124f640 1 -- 172.21.15.63:0/303601126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 msgr2=0x558115848e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2124f640 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115848e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2124f640 1 -- 172.21.15.63:0/303601126 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581158cc640 con 0x55811584ed40 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f1bfff640 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x558115849370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115848e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:38.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8f2124f640 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 0x5581158498b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f140cd920 tx=0x7f8f140cd7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d974415959160c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.546+0000 7f8efbfff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8efbfff640 1 -- 172.21.15.63:0/303601126 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140a07f0 con 0x55811584ed40 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8f2508b740 1 -- 172.21.15.63:0/303601126 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f1000fe40 con 0x55811584ed40 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8efbfff640 1 -- 172.21.15.63:0/303601126 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8f140a4c20 con 0x55811584ed40 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8efbfff640 1 -- 172.21.15.63:0/303601126 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8f140a50b0 con 0x55811584ed40 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8f2508b740 10 client.25130 fetch_fsmap learned FSMap version 27 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8f2508b740 1 -- 172.21.15.63:0/303601126 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5581158cd980 con 0x55811584ed40 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8efbfff640 1 -- 172.21.15.63:0/303601126 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8f1000fe40 con 0x55811584ed40 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8efbfff640 1 -- 172.21.15.63:0/303601126 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 27) ==== 8358+0+0 (secure 0 0 0) 0x7f8f14098190 con 0x55811584ed40 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8f2508b740 10 client.25130 fetch_fsmap finished waiting for FSMap version 27 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8f2508b740 10 client.25130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:25:38.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8f2508b740 20 client.25130 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8f2508b740 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5581158ce180 0x5581158d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8f2508b740 4 client.25130 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8f2508b740 1 -- 172.21.15.63:0/303601126 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5581157b0d00 con 0x5581158ce180 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.547+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5581158ce180 0x5581158d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.548+0000 7f8f20a4e640 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5581158ce180 0x5581158d05a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a786118a07be6f9 server_cookie=737e323a7630331f in_seq=0 out_seq=0 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.548+0000 7f8efbfff640 10 client.25130 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8efbfff640 1 -- 172.21.15.63:0/303601126 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5581157b0d00 con 0x5581158ce180 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8efbfff640 10 client.25130 handle_command_reply: tid=0 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8f2508b740 1 client.25130 shutdown 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8f2508b740 1 -- 172.21.15.63:0/303601126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 msgr2=0x5581158498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8f2508b740 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 0x5581158498b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f140cd920 tx=0x7f8f140cd7f0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8f2508b740 1 -- 172.21.15.63:0/303601126 shutdown_connections 2024-09-16T01:25:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8f2508b740 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55811584ed40 0x5581158498b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8f2508b740 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558115844480 0x558115849370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8f2508b740 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5581158ce180 0x5581158d05a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8f2508b740 1 --2- 172.21.15.63:0/303601126 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558115843b60 0x558115848e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8efbfff640 0 client.25130 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.549+0000 7f8f2508b740 1 -- 172.21.15.63:0/303601126 >> 172.21.15.63:0/303601126 conn(0x5581158400f0 msgr2=0x55811584d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.550+0000 7f8f2508b740 1 -- 172.21.15.63:0/303601126 shutdown_connections 2024-09-16T01:25:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.550+0000 7f8f2508b740 1 -- 172.21.15.63:0/303601126 wait complete. 2024-09-16T01:25:38.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.550+0000 7f8f2508b740 20 client.25130 trim_cache size 0 max 16384 2024-09-16T01:25:38.556 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:25:38.556 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-16T01:25:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "e07550c8-803e-48a1-8f52-7fcc3699000f", 2024-09-16T01:25:38.557 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-16T01:25:38.557 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:25:38.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.550+0000 7f8f22cb2640 1 -- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8f0c0a3240 msgr2=0x7f8f0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:38.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.550+0000 7f8f22cb2640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8f0c0a3240 0x7f8f0c0a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009230 tx=0x7f8f08032ec0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.550+0000 7f8f22cb2640 1 -- 172.21.15.63:0/3297727804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c10c2f0 msgr2=0x7f8f1c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.550+0000 7f8f22cb2640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c10c2f0 0x7f8f1c19ce10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400eb10 tx=0x7f8f1400c2d0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.551+0000 7f8f22cb2640 1 -- 172.21.15.63:0/3297727804 shutdown_connections 2024-09-16T01:25:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.551+0000 7f8f22cb2640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8f0c0a3240 0x7f8f0c0a5700 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.551+0000 7f8f22cb2640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c10c2f0 0x7f8f1c19ce10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.551+0000 7f8f22cb2640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1c1037a0 0x7f8f1c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.551+0000 7f8f22cb2640 1 --2- 172.21.15.63:0/3297727804 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8f1c102df0 0x7f8f1c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.551+0000 7f8f22cb2640 1 -- 172.21.15.63:0/3297727804 >> 172.21.15.63:0/3297727804 conn(0x7f8f1c0fc7d0 msgr2=0x7f8f1c0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.551+0000 7f8f22cb2640 1 -- 172.21.15.63:0/3297727804 shutdown_connections 2024-09-16T01:25:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:38.551+0000 7f8f22cb2640 1 -- 172.21.15.63:0/3297727804 wait complete. 2024-09-16T01:25:38.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:38 smithi192 ceph-mon[34775]: pgmap v404: 97 pgs: 97 active+clean; 1.0 GiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 37 MiB/s rd, 95 MiB/s wr, 283 op/s 2024-09-16T01:25:38.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:38 smithi162 ceph-mon[34539]: pgmap v404: 97 pgs: 97 active+clean; 1.0 GiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 37 MiB/s rd, 95 MiB/s wr, 283 op/s 2024-09-16T01:25:39.459 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: scrub queued for path: / 2024-09-16T01:25:39.460 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:39.460 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:25:39.460 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:25:39.460 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:25:39.460 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:39.460 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:25:39.460 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.461 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.461 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.461 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:39 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.494 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:25:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: scrub queued for path: / 2024-09-16T01:25:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:25:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:25:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:25:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:25:39.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.675 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:39 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: scrub queued for path: / 2024-09-16T01:25:39.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:39.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:25:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:25:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:25:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:25:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:39 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:39.846 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:25:40.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.338+0000 7fd8412f7640 1 -- 172.21.15.63:0/2419507232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd83c10c1a0 msgr2=0x7fd83c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:40.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.338+0000 7fd8412f7640 1 --2- 172.21.15.63:0/2419507232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd83c10c1a0 0x7fd83c10e610 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd834009ca0 tx=0x7fd83402a950 comp rx=0 tx=0).stop 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.338+0000 7fd8412f7640 1 -- 172.21.15.63:0/2419507232 shutdown_connections 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.338+0000 7fd8412f7640 1 --2- 172.21.15.63:0/2419507232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd83c10c1a0 0x7fd83c10e610 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.338+0000 7fd8412f7640 1 --2- 172.21.15.63:0/2419507232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd83c103720 0x7fd83c10bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.338+0000 7fd8412f7640 1 --2- 172.21.15.63:0/2419507232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd83c102e00 0x7fd83c1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.338+0000 7fd8412f7640 1 -- 172.21.15.63:0/2419507232 >> 172.21.15.63:0/2419507232 conn(0x7fd83c0fc7a0 msgr2=0x7fd83c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.338+0000 7fd8412f7640 1 -- 172.21.15.63:0/2419507232 shutdown_connections 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.338+0000 7fd8412f7640 1 -- 172.21.15.63:0/2419507232 wait complete. 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.338+0000 7fd8412f7640 1 Processor -- start 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd8412f7640 1 -- start start 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd8412f7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd83c102e00 0x7fd83c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd8412f7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd83c103720 0x7fd83c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd8412f7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd83c10c1a0 0x7fd83c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd8412f7640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c111e20 con 0x7fd83c103720 2024-09-16T01:25:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd8412f7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c111ca0 con 0x7fd83c102e00 2024-09-16T01:25:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd8412f7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c111fa0 con 0x7fd83c10c1a0 2024-09-16T01:25:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd83c102e00 0x7fd83c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd83c103720 0x7fd83c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd83c102e00 0x7fd83c198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:57134/0 (socket says 172.21.15.63:57134) 2024-09-16T01:25:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83a7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd83c103720 0x7fd83c198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57246/0 (socket says 172.21.15.63:57246) 2024-09-16T01:25:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83affd640 1 -- 172.21.15.63:0/1210605296 learned_addr learned my addr 172.21.15.63:0/1210605296 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83b7fe640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd83c10c1a0 0x7fd83c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83a7fc640 1 -- 172.21.15.63:0/1210605296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd83c10c1a0 msgr2=0x7fd83c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:40.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83a7fc640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd83c10c1a0 0x7fd83c19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83a7fc640 1 -- 172.21.15.63:0/1210605296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd83c102e00 msgr2=0x7fd83c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:40.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83a7fc640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd83c102e00 0x7fd83c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83a7fc640 1 -- 172.21.15.63:0/1210605296 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c19d300 con 0x7fd83c103720 2024-09-16T01:25:40.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.339+0000 7fd83affd640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd83c102e00 0x7fd83c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:25:40.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.340+0000 7fd83a7fc640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd83c103720 0x7fd83c198890 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd830005fd0 tx=0x7fd83000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:40.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.340+0000 7fd823fff640 1 -- 172.21.15.63:0/1210605296 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830009c30 con 0x7fd83c103720 2024-09-16T01:25:40.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.340+0000 7fd823fff640 1 -- 172.21.15.63:0/1210605296 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd830009dd0 con 0x7fd83c103720 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.340+0000 7fd8412f7640 1 -- 172.21.15.63:0/1210605296 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c19d5f0 con 0x7fd83c103720 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.340+0000 7fd823fff640 1 -- 172.21.15.63:0/1210605296 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830003e40 con 0x7fd83c103720 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.340+0000 7fd8412f7640 1 -- 172.21.15.63:0/1210605296 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c1a4ed0 con 0x7fd83c103720 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.342+0000 7fd8436d0740 1 Processor -- start 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.342+0000 7fd823fff640 1 -- 172.21.15.63:0/1210605296 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd830004000 con 0x7fd83c103720 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd8436d0740 1 -- start start 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4218740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c4227550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 0x5653c4229e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd8436d0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5653c417e2e0 con 0x5653c4218360 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd8436d0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5653c4125ce0 con 0x5653c4227a90 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd8436d0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5653c417a2a0 con 0x5653c4218c80 2024-09-16T01:25:40.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd83b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4218740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd83b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4218740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57258/0 (socket says 172.21.15.63:57258) 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd823fff640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd8240a3240 0x7fd8240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd83b7fe640 1 -- 172.21.15.63:0/93763960 learned_addr learned my addr 172.21.15.63:0/93763960 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd83affd640 1 --2- 172.21.15.63:0/93763960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c4227550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.343+0000 7fd83a7fc640 1 --2- 172.21.15.63:0/93763960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 0x5653c4229e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd823fff640 1 -- 172.21.15.63:0/1210605296 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd8300cf470 con 0x7fd83c103720 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd83affd640 1 -- 172.21.15.63:0/93763960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 msgr2=0x5653c4229e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd83affd640 1 --2- 172.21.15.63:0/93763960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 0x5653c4229e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd83affd640 1 -- 172.21.15.63:0/93763960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 msgr2=0x5653c4218740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd83affd640 1 --2- 172.21.15.63:0/93763960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4218740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd83b7fe640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd8240a3240 0x7fd8240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd83affd640 1 -- 172.21.15.63:0/93763960 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653c410a440 con 0x5653c4218c80 2024-09-16T01:25:40.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd83affd640 1 --2- 172.21.15.63:0/93763960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c4227550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0114f0 tx=0x7fd82c0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=158817335d366720 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd8217fa640 1 -- 172.21.15.63:0/93763960 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c01e070 con 0x5653c4218c80 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd8217fa640 1 -- 172.21.15.63:0/93763960 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd82c0035f0 con 0x5653c4218c80 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd8217fa640 1 -- 172.21.15.63:0/93763960 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00f820 con 0x5653c4218c80 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.344+0000 7fd83b7fe640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd8240a3240 0x7fd8240a5700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd834004ad0 tx=0x7fd83402a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.345+0000 7fd8436d0740 1 -- 172.21.15.63:0/93763960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 msgr2=0x5653c4227550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.345+0000 7fd8436d0740 1 --2- 172.21.15.63:0/93763960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c4227550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0114f0 tx=0x7fd82c0119b0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.345+0000 7fd8436d0740 1 -- 172.21.15.63:0/93763960 shutdown_connections 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.345+0000 7fd8436d0740 1 --2- 172.21.15.63:0/93763960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 0x5653c4229e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.345+0000 7fd8436d0740 1 --2- 172.21.15.63:0/93763960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c4227550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.345+0000 7fd8436d0740 1 --2- 172.21.15.63:0/93763960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4218740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.345+0000 7fd8436d0740 1 -- 172.21.15.63:0/93763960 >> 172.21.15.63:0/93763960 conn(0x5653c4214a30 msgr2=0x5653c4214e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.345+0000 7fd8436d0740 1 -- 172.21.15.63:0/93763960 shutdown_connections 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.345+0000 7fd8436d0740 1 -- 172.21.15.63:0/93763960 wait complete. 2024-09-16T01:25:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd8436d0740 1 -- start start 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd8436d0740 1 Processor -- start 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218360 0x5653c42273d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218c80 0x5653c4224680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c4224bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd8436d0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5653c422a660 con 0x5653c4227a90 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd8436d0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5653c4139050 con 0x5653c4218c80 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd8436d0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5653c422a7e0 con 0x5653c4218360 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd83b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c4224bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd83a7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218c80 0x5653c4224680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd83affd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218360 0x5653c42273d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd83b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c4224bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57266/0 (socket says 172.21.15.63:57266) 2024-09-16T01:25:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd83b7fe640 1 -- 172.21.15.63:0/3639708972 learned_addr learned my addr 172.21.15.63:0/3639708972 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.346+0000 7fd8436d0740 10 client.0 _ll_register_callbacks cb 0x5653c4179160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd83a7fc640 1 -- 172.21.15.63:0/3639708972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218360 msgr2=0x5653c42273d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd83a7fc640 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218360 0x5653c42273d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd83a7fc640 1 -- 172.21.15.63:0/3639708972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 msgr2=0x5653c4224bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd83a7fc640 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c4224bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd83a7fc640 1 -- 172.21.15.63:0/3639708972 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653c3eef3c0 con 0x5653c4218c80 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd83a7fc640 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218c80 0x5653c4224680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd83009b840 tx=0x7fd830005d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87b619d369dd0863 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd81eff5640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd81eff5640 1 -- 172.21.15.63:0/3639708972 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830020070 con 0x5653c4218c80 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd8436d0740 1 -- 172.21.15.63:0/3639708972 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd82c0035f0 con 0x5653c4218c80 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd81eff5640 1 -- 172.21.15.63:0/3639708972 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd8300981b0 con 0x5653c4218c80 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd81eff5640 1 -- 172.21.15.63:0/3639708972 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd83009bb40 con 0x5653c4218c80 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd8436d0740 10 client.25142 fetch_fsmap learned FSMap version 28 2024-09-16T01:25:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.347+0000 7fd8436d0740 1 -- 172.21.15.63:0/3639708972 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653c421b270 con 0x5653c4218c80 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd81eff5640 1 -- 172.21.15.63:0/3639708972 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd82c0035f0 con 0x5653c4218c80 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd81eff5640 1 -- 172.21.15.63:0/3639708972 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7fd8300860f0 con 0x5653c4218c80 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd8436d0740 10 client.25142 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd8436d0740 10 client.25142 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd8436d0740 20 client.25142 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5653c421c5c0 0x5653c421ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd8436d0740 4 client.25142 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd8436d0740 1 -- 172.21.15.63:0/3639708972 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653c418b850 con 0x5653c421c5c0 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd83affd640 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5653c421c5c0 0x5653c421ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd83affd640 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5653c421c5c0 0x5653c421ea00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=360354e051662519 server_cookie=d098f1be0fed8161 in_seq=0 out_seq=0 2024-09-16T01:25:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.348+0000 7fd81eff5640 10 client.25142 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:40.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd81eff5640 1 -- 172.21.15.63:0/3639708972 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653c418b850 con 0x5653c421c5c0 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd81eff5640 10 client.25142 handle_command_reply: tid=0 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 client.25142 shutdown 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 -- 172.21.15.63:0/3639708972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218c80 msgr2=0x5653c4224680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218c80 0x5653c4224680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd83009b840 tx=0x7fd830005d70 comp rx=0 tx=0).stop 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 -- 172.21.15.63:0/3639708972 shutdown_connections 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5653c421c5c0 0x5653c421ea00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c4224bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218c80 0x5653c4224680 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd81eff5640 0 client.25142 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3639708972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218360 0x5653c42273d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 -- 172.21.15.63:0/3639708972 >> 172.21.15.63:0/3639708972 conn(0x5653c4214a30 msgr2=0x5653c421a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 -- 172.21.15.63:0/3639708972 shutdown_connections 2024-09-16T01:25:40.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.349+0000 7fd8436d0740 1 -- 172.21.15.63:0/3639708972 wait complete. 2024-09-16T01:25:40.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.350+0000 7fd8436d0740 20 client.25142 trim_cache size 0 max 16384 2024-09-16T01:25:40.369 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T01:25:40.369 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T01:25:40.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd8436d0740 1 Processor -- start 2024-09-16T01:25:40.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd8436d0740 1 -- start start 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4233900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c42265f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 0x5653c423af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd8436d0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1adc70 con 0x5653c4218360 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd8436d0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1ab4b0 con 0x5653c4227a90 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd8436d0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1a92e0 con 0x5653c4218c80 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd83affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4233900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd83affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4233900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57278/0 (socket says 172.21.15.63:57278) 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd83affd640 1 -- 172.21.15.63:0/2041357670 learned_addr learned my addr 172.21.15.63:0/2041357670 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd83b7fe640 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 0x5653c423af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.369+0000 7fd83a7fc640 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c42265f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd83affd640 1 -- 172.21.15.63:0/2041357670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 msgr2=0x5653c42265f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd83affd640 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c42265f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd83affd640 1 -- 172.21.15.63:0/2041357670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 msgr2=0x5653c423af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd83affd640 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 0x5653c423af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd83affd640 1 -- 172.21.15.63:0/2041357670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653c422a1c0 con 0x5653c4218360 2024-09-16T01:25:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd83b7fe640 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 0x5653c423af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:25:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd83a7fc640 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c42265f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:25:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd83affd640 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4233900 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd82c014040 tx=0x7fd82c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfef633cfb18e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd820ff9640 1 -- 172.21.15.63:0/2041357670 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c01e040 con 0x5653c4218360 2024-09-16T01:25:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd820ff9640 1 -- 172.21.15.63:0/2041357670 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd82c02a070 con 0x5653c4218360 2024-09-16T01:25:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.370+0000 7fd820ff9640 1 -- 172.21.15.63:0/2041357670 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00f5c0 con 0x5653c4218360 2024-09-16T01:25:40.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 -- 172.21.15.63:0/2041357670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 msgr2=0x5653c4233900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:40.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4233900 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd82c014040 tx=0x7fd82c005040 comp rx=0 tx=0).stop 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 -- 172.21.15.63:0/2041357670 shutdown_connections 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4227a90 0x5653c423af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c42265f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 --2- 172.21.15.63:0/2041357670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4218360 0x5653c4233900 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 -- 172.21.15.63:0/2041357670 >> 172.21.15.63:0/2041357670 conn(0x5653c4214a30 msgr2=0x5653c4225ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 -- 172.21.15.63:0/2041357670 shutdown_connections 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 -- 172.21.15.63:0/2041357670 wait complete. 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 -- start start 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.371+0000 7fd8436d0740 1 Processor -- start 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218360 0x5653c4230120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c422b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd8436d0740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c422b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd8436d0740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1a9970 con 0x5653c4227a90 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd8436d0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1aade0 con 0x5653c4218360 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd8436d0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1aa040 con 0x5653c4218c80 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd8436d0740 10 client.0 _ll_register_callbacks cb 0x7fd83000df10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd83b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c422b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd83b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c422b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57290/0 (socket says 172.21.15.63:57290) 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd83b7fe640 1 -- 172.21.15.63:0/3622100399 learned_addr learned my addr 172.21.15.63:0/3622100399 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd83affd640 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218360 0x5653c4230120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd83a7fc640 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c422b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd83b7fe640 1 -- 172.21.15.63:0/3622100399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 msgr2=0x5653c422b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd83b7fe640 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c422b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd83b7fe640 1 -- 172.21.15.63:0/3622100399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218360 msgr2=0x5653c4230120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd83b7fe640 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218360 0x5653c4230120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.372+0000 7fd83b7fe640 1 -- 172.21.15.63:0/3622100399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653c422c190 con 0x5653c4227a90 2024-09-16T01:25:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.373+0000 7fd83b7fe640 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c422b990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd834005cc0 tx=0x7fd8340095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32be36ba80fdf8c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:25:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.373+0000 7fd81eff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:25:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.373+0000 7fd81eff5640 1 -- 172.21.15.63:0/3622100399 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834043050 con 0x5653c4227a90 2024-09-16T01:25:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.373+0000 7fd81eff5640 1 -- 172.21.15.63:0/3622100399 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fd834004310 con 0x5653c4227a90 2024-09-16T01:25:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.373+0000 7fd8436d0740 1 -- 172.21.15.63:0/3622100399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd82c02a070 con 0x5653c4227a90 2024-09-16T01:25:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.373+0000 7fd81eff5640 1 -- 172.21.15.63:0/3622100399 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd834034040 con 0x5653c4227a90 2024-09-16T01:25:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.373+0000 7fd8436d0740 10 client.15570 fetch_fsmap learned FSMap version 28 2024-09-16T01:25:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.373+0000 7fd8436d0740 1 -- 172.21.15.63:0/3622100399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653c429de70 con 0x5653c4227a90 2024-09-16T01:25:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.373+0000 7fd81eff5640 1 -- 172.21.15.63:0/3622100399 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd82c02a070 con 0x5653c4227a90 2024-09-16T01:25:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.374+0000 7fd81eff5640 1 -- 172.21.15.63:0/3622100399 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7fd834030440 con 0x5653c4227a90 2024-09-16T01:25:40.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.374+0000 7fd8436d0740 10 client.15570 fetch_fsmap finished waiting for FSMap version 28 2024-09-16T01:25:40.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.374+0000 7fd8436d0740 10 client.15570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:25:40.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.374+0000 7fd8436d0740 20 client.15570 populate_metadata read hostname 'smithi063' 2024-09-16T01:25:40.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.374+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5653c429e600 0x5653c42a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:25:40.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.374+0000 7fd8436d0740 4 client.15570 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:25:40.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.374+0000 7fd8436d0740 1 -- 172.21.15.63:0/3622100399 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5653c4224f50 con 0x5653c429e600 2024-09-16T01:25:40.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.374+0000 7fd83affd640 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5653c429e600 0x5653c42a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.374+0000 7fd81eff5640 10 client.15570 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.374+0000 7fd83affd640 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5653c429e600 0x5653c42a0a20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53482d51020ee870 server_cookie=e416fbf031945f79 in_seq=0 out_seq=0 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd81eff5640 1 -- 172.21.15.63:0/3622100399 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5653c4224f50 con 0x5653c429e600 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd81eff5640 10 client.15570 handle_command_reply: tid=0 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 client.15570 shutdown 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 -- 172.21.15.63:0/3622100399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 msgr2=0x5653c422b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c422b990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd834005cc0 tx=0x7fd8340095c0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 -- 172.21.15.63:0/3622100399 shutdown_connections 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5653c429e600 0x5653c42a0a20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd81eff5640 0 client.15570 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653c4227a90 0x5653c422b990 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5653c4218c80 0x5653c422b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 --2- 172.21.15.63:0/3622100399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653c4218360 0x5653c4230120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 -- 172.21.15.63:0/3622100399 >> 172.21.15.63:0/3622100399 conn(0x5653c4214a30 msgr2=0x5653c4226700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:40.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 -- 172.21.15.63:0/3622100399 shutdown_connections 2024-09-16T01:25:40.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 1 -- 172.21.15.63:0/3622100399 wait complete. 2024-09-16T01:25:40.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.375+0000 7fd8436d0740 20 client.15570 trim_cache size 0 max 16384 2024-09-16T01:25:40.385 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:25:40.385 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-16T01:25:40.385 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-16T01:25:40.385 INFO:teuthology.orchestra.run.smithi063.stdout: "e07550c8-803e-48a1-8f52-7fcc3699000f": { 2024-09-16T01:25:40.386 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-16T01:25:40.386 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "e07550c8-803e-48a1-8f52-7fcc3699000f", 2024-09-16T01:25:40.386 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-16T01:25:40.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:25:40.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:25:40.386 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:25:40.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 -- 172.21.15.63:0/1210605296 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd8240a3240 msgr2=0x7fd8240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd8240a3240 0x7fd8240a5700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd834004ad0 tx=0x7fd83402a950 comp rx=0 tx=0).stop 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 -- 172.21.15.63:0/1210605296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd83c103720 msgr2=0x7fd83c198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd83c103720 0x7fd83c198890 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd830005fd0 tx=0x7fd83000dde0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 -- 172.21.15.63:0/1210605296 shutdown_connections 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fd8240a3240 0x7fd8240a5700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd83c10c1a0 0x7fd83c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd83c103720 0x7fd83c198890 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 --2- 172.21.15.63:0/1210605296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd83c102e00 0x7fd83c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 -- 172.21.15.63:0/1210605296 >> 172.21.15.63:0/1210605296 conn(0x7fd83c0fc7a0 msgr2=0x7fd83c0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 -- 172.21.15.63:0/1210605296 shutdown_connections 2024-09-16T01:25:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:25:40.376+0000 7fd8412f7640 1 -- 172.21.15.63:0/1210605296 wait complete. 2024-09-16T01:25:40.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:40 smithi063 ceph-mon[31070]: pgmap v405: 97 pgs: 97 active+clean; 1.0 GiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 21 MiB/s wr, 151 op/s 2024-09-16T01:25:40.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:25:40.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:25:40.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:40 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:40.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:40.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:40 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:25:40.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:40 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:40.612 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:40 smithi063 ceph-mon[31070]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:25:40.613 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:40 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:40 smithi192 ceph-mon[34775]: pgmap v405: 97 pgs: 97 active+clean; 1.0 GiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 21 MiB/s wr, 151 op/s 2024-09-16T01:25:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:25:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:25:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:40 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:40 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:25:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:40 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:40 smithi192 ceph-mon[34775]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:25:40.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:40 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:40.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:40 smithi162 ceph-mon[34539]: pgmap v405: 97 pgs: 97 active+clean; 1.0 GiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 21 MiB/s wr, 151 op/s 2024-09-16T01:25:40.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:25:40.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:25:40.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:40 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:40.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:25:40.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:40 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:25:40.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:40 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:40.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:40 smithi162 ceph-mon[34539]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:25:40.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:40 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:25:41.230 INFO:tasks.cephfs.filesystem:scrub status for tag:e07550c8-803e-48a1-8f52-7fcc3699000f - {'path': '/', 'tag': 'e07550c8-803e-48a1-8f52-7fcc3699000f', 'options': 'recursive,force'} 2024-09-16T01:25:42.673 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:42 smithi192 ceph-mon[34775]: pgmap v406: 97 pgs: 97 active+clean; 529 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 21 MiB/s wr, 187 op/s 2024-09-16T01:25:42.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:42 smithi162 ceph-mon[34539]: pgmap v406: 97 pgs: 97 active+clean; 529 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 21 MiB/s wr, 187 op/s 2024-09-16T01:25:42.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:42 smithi063 ceph-mon[31070]: pgmap v406: 97 pgs: 97 active+clean; 529 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 21 MiB/s wr, 187 op/s 2024-09-16T01:25:44.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:44 smithi192 ceph-mon[34775]: pgmap v407: 97 pgs: 97 active+clean; 237 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 138 op/s 2024-09-16T01:25:44.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:44 smithi162 ceph-mon[34539]: pgmap v407: 97 pgs: 97 active+clean; 237 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 138 op/s 2024-09-16T01:25:44.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:44 smithi063 ceph-mon[31070]: pgmap v407: 97 pgs: 97 active+clean; 237 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.9 MiB/s wr, 138 op/s 2024-09-16T01:25:46.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:46 smithi192 ceph-mon[34775]: pgmap v408: 97 pgs: 97 active+clean; 186 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 152 op/s 2024-09-16T01:25:46.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:46 smithi162 ceph-mon[34539]: pgmap v408: 97 pgs: 97 active+clean; 186 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 152 op/s 2024-09-16T01:25:46.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:46 smithi063 ceph-mon[31070]: pgmap v408: 97 pgs: 97 active+clean; 186 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 152 op/s 2024-09-16T01:25:48.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:48 smithi192 ceph-mon[34775]: pgmap v409: 97 pgs: 97 active+clean; 144 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 943 KiB/s wr, 204 op/s 2024-09-16T01:25:48.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:48 smithi162 ceph-mon[34539]: pgmap v409: 97 pgs: 97 active+clean; 144 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 943 KiB/s wr, 204 op/s 2024-09-16T01:25:48.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:48 smithi063 ceph-mon[31070]: pgmap v409: 97 pgs: 97 active+clean; 144 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 943 KiB/s wr, 204 op/s 2024-09-16T01:25:50.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:50 smithi192 ceph-mon[34775]: pgmap v410: 97 pgs: 97 active+clean; 144 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 767 KiB/s wr, 163 op/s 2024-09-16T01:25:50.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:50 smithi162 ceph-mon[34539]: pgmap v410: 97 pgs: 97 active+clean; 144 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 767 KiB/s wr, 163 op/s 2024-09-16T01:25:50.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:50 smithi063 ceph-mon[31070]: pgmap v410: 97 pgs: 97 active+clean; 144 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 767 KiB/s wr, 163 op/s 2024-09-16T01:25:53.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:53 smithi063 ceph-mon[31070]: pgmap v411: 97 pgs: 97 active+clean; 146 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 245 op/s 2024-09-16T01:25:53.377 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:53 smithi192 ceph-mon[34775]: pgmap v411: 97 pgs: 97 active+clean; 146 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 245 op/s 2024-09-16T01:25:53.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:53 smithi162 ceph-mon[34539]: pgmap v411: 97 pgs: 97 active+clean; 146 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 245 op/s 2024-09-16T01:25:54.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:54 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:25:54.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:54 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:25:54.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:54 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:25:54.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:54 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:25:54.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:54 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:25:54.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:54 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:25:54.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:54 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:25:54.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:54 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:25:54.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:54 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:25:55.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:55 smithi063 ceph-mon[31070]: pgmap v412: 97 pgs: 97 active+clean; 146 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 961 KiB/s wr, 240 op/s 2024-09-16T01:25:55.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:55 smithi063 ceph-mon[31070]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:25:55.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:55 smithi192 ceph-mon[34775]: pgmap v412: 97 pgs: 97 active+clean; 146 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 961 KiB/s wr, 240 op/s 2024-09-16T01:25:55.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:55 smithi192 ceph-mon[34775]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:25:55.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:55 smithi162 ceph-mon[34539]: pgmap v412: 97 pgs: 97 active+clean; 146 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 961 KiB/s wr, 240 op/s 2024-09-16T01:25:55.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:55 smithi162 ceph-mon[34539]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-16T01:25:57.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:57 smithi063 ceph-mon[31070]: pgmap v413: 97 pgs: 97 active+clean; 147 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 942 KiB/s wr, 224 op/s 2024-09-16T01:25:57.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:57 smithi192 ceph-mon[34775]: pgmap v413: 97 pgs: 97 active+clean; 147 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 942 KiB/s wr, 224 op/s 2024-09-16T01:25:57.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:57 smithi162 ceph-mon[34539]: pgmap v413: 97 pgs: 97 active+clean; 147 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 942 KiB/s wr, 224 op/s 2024-09-16T01:25:59.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:25:59 smithi063 ceph-mon[31070]: pgmap v414: 97 pgs: 97 active+clean; 148 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 626 KiB/s wr, 208 op/s 2024-09-16T01:25:59.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:25:59 smithi192 ceph-mon[34775]: pgmap v414: 97 pgs: 97 active+clean; 148 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 626 KiB/s wr, 208 op/s 2024-09-16T01:25:59.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:25:59 smithi162 ceph-mon[34539]: pgmap v414: 97 pgs: 97 active+clean; 148 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 626 KiB/s wr, 208 op/s 2024-09-16T01:26:01.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:01 smithi063 ceph-mon[31070]: pgmap v415: 97 pgs: 97 active+clean; 148 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 613 KiB/s wr, 132 op/s 2024-09-16T01:26:01.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:01 smithi192 ceph-mon[34775]: pgmap v415: 97 pgs: 97 active+clean; 148 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 613 KiB/s wr, 132 op/s 2024-09-16T01:26:01.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:01 smithi162 ceph-mon[34539]: pgmap v415: 97 pgs: 97 active+clean; 148 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 613 KiB/s wr, 132 op/s 2024-09-16T01:26:03.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:03 smithi063 ceph-mon[31070]: pgmap v416: 97 pgs: 97 active+clean; 150 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 993 KiB/s wr, 226 op/s 2024-09-16T01:26:03.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:03 smithi192 ceph-mon[34775]: pgmap v416: 97 pgs: 97 active+clean; 150 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 993 KiB/s wr, 226 op/s 2024-09-16T01:26:03.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:03 smithi162 ceph-mon[34539]: pgmap v416: 97 pgs: 97 active+clean; 150 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 993 KiB/s wr, 226 op/s 2024-09-16T01:26:05.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:05 smithi063 ceph-mon[31070]: pgmap v417: 97 pgs: 97 active+clean; 148 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 886 KiB/s wr, 199 op/s 2024-09-16T01:26:05.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:05 smithi192 ceph-mon[34775]: pgmap v417: 97 pgs: 97 active+clean; 148 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 886 KiB/s wr, 199 op/s 2024-09-16T01:26:05.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:05 smithi162 ceph-mon[34539]: pgmap v417: 97 pgs: 97 active+clean; 148 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 886 KiB/s wr, 199 op/s 2024-09-16T01:26:07.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:07 smithi063 ceph-mon[31070]: pgmap v418: 97 pgs: 97 active+clean; 150 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 199 op/s 2024-09-16T01:26:07.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:07 smithi192 ceph-mon[34775]: pgmap v418: 97 pgs: 97 active+clean; 150 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 199 op/s 2024-09-16T01:26:07.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:07 smithi162 ceph-mon[34539]: pgmap v418: 97 pgs: 97 active+clean; 150 MiB data, 691 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 199 op/s 2024-09-16T01:26:09.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:09 smithi063 ceph-mon[31070]: pgmap v419: 97 pgs: 97 active+clean; 140 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 300 op/s 2024-09-16T01:26:09.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:09 smithi192 ceph-mon[34775]: pgmap v419: 97 pgs: 97 active+clean; 140 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 300 op/s 2024-09-16T01:26:09.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:09 smithi162 ceph-mon[34539]: pgmap v419: 97 pgs: 97 active+clean; 140 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 300 op/s 2024-09-16T01:26:11.232 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:26:11.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:11 smithi063 ceph-mon[31070]: pgmap v420: 97 pgs: 97 active+clean; 140 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 287 op/s 2024-09-16T01:26:11.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:11 smithi192 ceph-mon[34775]: pgmap v420: 97 pgs: 97 active+clean; 140 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 287 op/s 2024-09-16T01:26:11.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:11 smithi162 ceph-mon[34539]: pgmap v420: 97 pgs: 97 active+clean; 140 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 287 op/s 2024-09-16T01:26:11.518 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:26:12.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.368+0000 7faf3203b640 1 -- 172.21.15.63:0/2920193775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c102d30 msgr2=0x7faf2c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:12.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.368+0000 7faf3203b640 1 --2- 172.21.15.63:0/2920193775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c102d30 0x7faf2c103110 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009900 tx=0x7faf1c02a4a0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.369+0000 7faf3203b640 1 -- 172.21.15.63:0/2920193775 shutdown_connections 2024-09-16T01:26:12.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.369+0000 7faf3203b640 1 --2- 172.21.15.63:0/2920193775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf2c10c160 0x7faf2c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.369+0000 7faf3203b640 1 --2- 172.21.15.63:0/2920193775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf2c103650 0x7faf2c10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.369+0000 7faf3203b640 1 --2- 172.21.15.63:0/2920193775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c102d30 0x7faf2c103110 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.369+0000 7faf3203b640 1 -- 172.21.15.63:0/2920193775 >> 172.21.15.63:0/2920193775 conn(0x7faf2c0fc790 msgr2=0x7faf2c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:12.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.370+0000 7faf3203b640 1 -- 172.21.15.63:0/2920193775 shutdown_connections 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.371+0000 7faf3203b640 1 -- 172.21.15.63:0/2920193775 wait complete. 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.372+0000 7faf3203b640 1 Processor -- start 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.372+0000 7faf3203b640 1 -- start start 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.373+0000 7faf3203b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf2c102d30 0x7faf2c110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.373+0000 7faf3203b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c103650 0x7faf2c1107c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.373+0000 7faf3203b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf2c10c160 0x7faf2c110d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.373+0000 7faf3203b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c102520 con 0x7faf2c103650 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.373+0000 7faf3203b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1023a0 con 0x7faf2c102d30 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.373+0000 7faf3203b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1026a0 con 0x7faf2c10c160 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.373+0000 7faf2b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf2c102d30 0x7faf2c110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.373+0000 7faf2b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf2c102d30 0x7faf2c110280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:47500/0 (socket says 172.21.15.63:47500) 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.373+0000 7faf2b7fe640 1 -- 172.21.15.63:0/399352056 learned_addr learned my addr 172.21.15.63:0/399352056 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.374+0000 7faf2affd640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c103650 0x7faf2c1107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.375+0000 7faf2affd640 1 -- 172.21.15.63:0/399352056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf2c10c160 msgr2=0x7faf2c110d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.375+0000 7faf2affd640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf2c10c160 0x7faf2c110d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.375+0000 7faf2affd640 1 -- 172.21.15.63:0/399352056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf2c102d30 msgr2=0x7faf2c110280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.375+0000 7faf2affd640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf2c102d30 0x7faf2c110280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.375+0000 7faf2affd640 1 -- 172.21.15.63:0/399352056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c1aabb0 con 0x7faf2c103650 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.375+0000 7faf2affd640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c103650 0x7faf2c1107c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7faf2000d6b0 tx=0x7faf2000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.376+0000 7faf28ff9640 1 -- 172.21.15.63:0/399352056 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20017070 con 0x7faf2c103650 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.376+0000 7faf28ff9640 1 -- 172.21.15.63:0/399352056 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf200097c0 con 0x7faf2c103650 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.376+0000 7faf28ff9640 1 -- 172.21.15.63:0/399352056 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20004ba0 con 0x7faf2c103650 2024-09-16T01:26:12.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.376+0000 7faf3203b640 1 -- 172.21.15.63:0/399352056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c1aaea0 con 0x7faf2c103650 2024-09-16T01:26:12.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.376+0000 7faf3203b640 1 -- 172.21.15.63:0/399352056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2c1ab2a0 con 0x7faf2c103650 2024-09-16T01:26:12.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.380+0000 7faf34414740 1 Processor -- start 2024-09-16T01:26:12.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.381+0000 7faf34414740 1 -- start start 2024-09-16T01:26:12.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.381+0000 7faf34414740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 0x559e95fa1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.382+0000 7faf34414740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.382+0000 7faf28ff9640 1 -- 172.21.15.63:0/399352056 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faf20005220 con 0x7faf2c103650 2024-09-16T01:26:12.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.382+0000 7faf2bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 0x559e95fa1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.382+0000 7faf2bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 0x559e95fa1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:47512/0 (socket says 172.21.15.63:47512) 2024-09-16T01:26:12.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.382+0000 7faf2bfff640 1 -- 172.21.15.63:0/848297141 learned_addr learned my addr 172.21.15.63:0/848297141 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:12.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.382+0000 7faf34414740 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95faea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.382+0000 7faf34414740 1 -- 172.21.15.63:0/848297141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559e95f072e0 con 0x559e95fac680 2024-09-16T01:26:12.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.382+0000 7faf34414740 1 -- 172.21.15.63:0/848297141 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559e95eaece0 con 0x559e95fa14a0 2024-09-16T01:26:12.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.382+0000 7faf34414740 1 -- 172.21.15.63:0/848297141 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559e95f032a0 con 0x559e95fa1dc0 2024-09-16T01:26:12.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.382+0000 7faf2b7fe640 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.383+0000 7faf2bfff640 1 -- 172.21.15.63:0/848297141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 msgr2=0x559e95fac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:12.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.383+0000 7faf2bfff640 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.383+0000 7faf2bfff640 1 -- 172.21.15.63:0/848297141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 msgr2=0x559e95faea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:12.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.383+0000 7faf2affd640 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95faea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.383+0000 7faf2bfff640 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95faea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.383+0000 7faf2bfff640 1 -- 172.21.15.63:0/848297141 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e95e93440 con 0x559e95fa14a0 2024-09-16T01:26:12.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.383+0000 7faf2b7fe640 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:12.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.383+0000 7faf2affd640 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95faea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:26:12.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.383+0000 7faf2bfff640 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 0x559e95fa1880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faf24007bb0 tx=0x7faf2400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18fbc14a0caf18ab server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:12.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.384+0000 7faf28ff9640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7faf140a3440 0x7faf140a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.384+0000 7faf11ffb640 1 -- 172.21.15.63:0/848297141 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24014070 con 0x559e95fa14a0 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.384+0000 7faf28ff9640 1 -- 172.21.15.63:0/399352056 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7faf20004940 con 0x7faf2c103650 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.384+0000 7faf11ffb640 1 -- 172.21.15.63:0/848297141 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf2400fb00 con 0x559e95fa14a0 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.384+0000 7faf11ffb640 1 -- 172.21.15.63:0/848297141 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2400eac0 con 0x559e95fa14a0 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.384+0000 7faf2b7fe640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7faf140a3440 0x7faf140a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.385+0000 7faf34414740 1 -- 172.21.15.63:0/848297141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 msgr2=0x559e95fa1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.385+0000 7faf34414740 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 0x559e95fa1880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faf24007bb0 tx=0x7faf2400c6a0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.385+0000 7faf34414740 1 -- 172.21.15.63:0/848297141 shutdown_connections 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.385+0000 7faf34414740 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95faea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.385+0000 7faf34414740 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.385+0000 7faf34414740 1 --2- 172.21.15.63:0/848297141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 0x559e95fa1880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.385+0000 7faf34414740 1 -- 172.21.15.63:0/848297141 >> 172.21.15.63:0/848297141 conn(0x559e95f9da30 msgr2=0x559e95f9de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.386+0000 7faf2b7fe640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7faf140a3440 0x7faf140a5900 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x559e95f9e890 tx=0x7faf1c004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.386+0000 7faf34414740 1 -- 172.21.15.63:0/848297141 shutdown_connections 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.386+0000 7faf34414740 1 -- 172.21.15.63:0/848297141 wait complete. 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.387+0000 7faf34414740 1 -- start start 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.387+0000 7faf34414740 1 Processor -- start 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.388+0000 7faf34414740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 0x559e95fabfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.388+0000 7faf34414740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa1dc0 0x559e95fa92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.388+0000 7faf34414740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fac680 0x559e95fa9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.388+0000 7faf34414740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559e95faf250 con 0x559e95fa1dc0 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.388+0000 7faf34414740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559e95ec2050 con 0x559e95fa14a0 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.388+0000 7faf34414740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559e95faf3d0 con 0x559e95fac680 2024-09-16T01:26:12.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.388+0000 7faf34414740 10 client.0 _ll_register_callbacks cb 0x559e95f02160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:12.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.388+0000 7faf2affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa1dc0 0x559e95fa92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.388+0000 7faf2affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa1dc0 0x559e95fa92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57784/0 (socket says 172.21.15.63:57784) 2024-09-16T01:26:12.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.388+0000 7faf2affd640 1 -- 172.21.15.63:0/447429730 learned_addr learned my addr 172.21.15.63:0/447429730 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:12.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.389+0000 7faf2affd640 1 -- 172.21.15.63:0/447429730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fac680 msgr2=0x559e95fa9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:12.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.389+0000 7faf2bfff640 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fac680 0x559e95fa9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.389+0000 7faf2affd640 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fac680 0x559e95fa9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.389+0000 7faf2affd640 1 -- 172.21.15.63:0/447429730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 msgr2=0x559e95fabfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.389+0000 7faf2affd640 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 0x559e95fabfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.389+0000 7faf2affd640 1 -- 172.21.15.63:0/447429730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e95c783c0 con 0x559e95fa1dc0 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.389+0000 7faf2affd640 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa1dc0 0x559e95fa92e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faf20097e20 tx=0x7faf2009bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c4090e87507366 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.390+0000 7faf0affd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.390+0000 7faf0affd640 1 -- 172.21.15.63:0/447429730 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20020070 con 0x559e95fa1dc0 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.390+0000 7faf0affd640 1 -- 172.21.15.63:0/447429730 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7faf200cca40 con 0x559e95fa1dc0 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.390+0000 7faf34414740 1 -- 172.21.15.63:0/447429730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf2400fb00 con 0x559e95fa1dc0 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.391+0000 7faf0affd640 1 -- 172.21.15.63:0/447429730 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf200a40c0 con 0x559e95fa1dc0 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.391+0000 7faf34414740 10 client.15579 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.391+0000 7faf34414740 1 -- 172.21.15.63:0/447429730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e95fcbcd0 con 0x559e95fa1dc0 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.392+0000 7faf0affd640 1 -- 172.21.15.63:0/447429730 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf2400fb00 con 0x559e95fa1dc0 2024-09-16T01:26:12.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.392+0000 7faf0affd640 1 -- 172.21.15.63:0/447429730 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faf200a3c30 con 0x559e95fa1dc0 2024-09-16T01:26:12.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.393+0000 7faf34414740 10 client.15579 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:12.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.393+0000 7faf34414740 10 client.15579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:26:12.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.393+0000 7faf34414740 20 client.15579 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:12.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.393+0000 7faf34414740 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559e95fcd1e0 0x559e95fcf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.393+0000 7faf34414740 4 client.15579 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:26:12.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.393+0000 7faf34414740 1 -- 172.21.15.63:0/447429730 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e95f14850 con 0x559e95fcd1e0 2024-09-16T01:26:12.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.394+0000 7faf2b7fe640 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559e95fcd1e0 0x559e95fcf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.395+0000 7faf0affd640 10 client.15579 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:12.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.395+0000 7faf2b7fe640 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559e95fcd1e0 0x559e95fcf610 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f631a94f14022c81 server_cookie=219b8eefd11c8580 in_seq=0 out_seq=0 2024-09-16T01:26:12.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf0affd640 1 -- 172.21.15.63:0/447429730 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e95f14850 con 0x559e95fcd1e0 2024-09-16T01:26:12.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf0affd640 10 client.15579 handle_command_reply: tid=0 2024-09-16T01:26:12.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf34414740 1 client.15579 shutdown 2024-09-16T01:26:12.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf34414740 1 -- 172.21.15.63:0/447429730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa1dc0 msgr2=0x559e95fa92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:12.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf34414740 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa1dc0 0x559e95fa92e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faf20097e20 tx=0x7faf2009bb50 comp rx=0 tx=0).stop 2024-09-16T01:26:12.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf34414740 1 -- 172.21.15.63:0/447429730 shutdown_connections 2024-09-16T01:26:12.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf34414740 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fac680 0x559e95fa9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf34414740 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559e95fcd1e0 0x559e95fcf610 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf34414740 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa1dc0 0x559e95fa92e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf34414740 1 --2- 172.21.15.63:0/447429730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa14a0 0x559e95fabfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf34414740 1 -- 172.21.15.63:0/447429730 >> 172.21.15.63:0/447429730 conn(0x559e95f9da30 msgr2=0x559e95fa3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:12.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.396+0000 7faf0affd640 0 client.15579 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:12.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.397+0000 7faf34414740 1 -- 172.21.15.63:0/447429730 shutdown_connections 2024-09-16T01:26:12.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.397+0000 7faf34414740 1 -- 172.21.15.63:0/447429730 wait complete. 2024-09-16T01:26:12.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.397+0000 7faf34414740 20 client.15579 trim_cache size 0 max 16384 2024-09-16T01:26:12.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf34414740 1 Processor -- start 2024-09-16T01:26:12.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf34414740 1 -- start start 2024-09-16T01:26:12.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf34414740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa14a0 0x559e95fd4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf34414740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa1dc0 0x559e95fd5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf34414740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95fa6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf34414740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf18010ed0 con 0x559e95fac680 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf34414740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf1800e6e0 con 0x559e95fa1dc0 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf34414740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faf1800c510 con 0x559e95fa14a0 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf2bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95fa6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf2b7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa14a0 0x559e95fd4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf2bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95fa6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57792/0 (socket says 172.21.15.63:57792) 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf2bfff640 1 -- 172.21.15.63:0/1016656418 learned_addr learned my addr 172.21.15.63:0/1016656418 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.428+0000 7faf2affd640 1 --2- 172.21.15.63:0/1016656418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa1dc0 0x559e95fd5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf2affd640 1 -- 172.21.15.63:0/1016656418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa14a0 msgr2=0x559e95fd4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf2affd640 1 --2- 172.21.15.63:0/1016656418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa14a0 0x559e95fd4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf2affd640 1 -- 172.21.15.63:0/1016656418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 msgr2=0x559e95fa6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf2affd640 1 --2- 172.21.15.63:0/1016656418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95fa6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf2affd640 1 -- 172.21.15.63:0/1016656418 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e95fa9bf0 con 0x559e95fa1dc0 2024-09-16T01:26:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf2b7fe640 1 --2- 172.21.15.63:0/1016656418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa14a0 0x559e95fd4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf2bfff640 1 --2- 172.21.15.63:0/1016656418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95fa6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf2affd640 1 --2- 172.21.15.63:0/1016656418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa1dc0 0x559e95fd5460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf200978b0 tx=0x7faf2000dfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b4eb5c8ebd0a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf117fa640 1 -- 172.21.15.63:0/1016656418 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf200b8070 con 0x559e95fa1dc0 2024-09-16T01:26:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf117fa640 1 -- 172.21.15.63:0/1016656418 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf20099750 con 0x559e95fa1dc0 2024-09-16T01:26:12.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.429+0000 7faf117fa640 1 -- 172.21.15.63:0/1016656418 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20020070 con 0x559e95fa1dc0 2024-09-16T01:26:12.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 -- 172.21.15.63:0/1016656418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa1dc0 msgr2=0x559e95fd5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:12.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 --2- 172.21.15.63:0/1016656418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa1dc0 0x559e95fd5460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf200978b0 tx=0x7faf2000dfd0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 -- 172.21.15.63:0/1016656418 shutdown_connections 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 --2- 172.21.15.63:0/1016656418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fac680 0x559e95fa6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 --2- 172.21.15.63:0/1016656418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fa1dc0 0x559e95fd5460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 --2- 172.21.15.63:0/1016656418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa14a0 0x559e95fd4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 -- 172.21.15.63:0/1016656418 >> 172.21.15.63:0/1016656418 conn(0x559e95f9da30 msgr2=0x559e95fab360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 -- 172.21.15.63:0/1016656418 shutdown_connections 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 -- 172.21.15.63:0/1016656418 wait complete. 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 -- start start 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.430+0000 7faf34414740 1 Processor -- start 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf34414740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa14a0 0x559e95fb2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf34414740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fb3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf34414740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fac680 0x559e96036f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf34414740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf1800cba0 con 0x559e95fa14a0 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf34414740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf1800e010 con 0x559e95fac680 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf34414740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faf1800d270 con 0x559e95fa1dc0 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf34414740 10 client.0 _ll_register_callbacks cb 0x7faf20005b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2affd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fb3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2affd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fb3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:35274/0 (socket says 172.21.15.63:35274) 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2affd640 1 -- 172.21.15.63:0/321429080 learned_addr learned my addr 172.21.15.63:0/321429080 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2b7fe640 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa14a0 0x559e95fb2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2bfff640 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fac680 0x559e96036f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2affd640 1 -- 172.21.15.63:0/321429080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fac680 msgr2=0x559e96036f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:12.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2affd640 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fac680 0x559e96036f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2affd640 1 -- 172.21.15.63:0/321429080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa14a0 msgr2=0x559e95fb2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2affd640 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa14a0 0x559e95fb2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2affd640 1 -- 172.21.15.63:0/321429080 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e96037440 con 0x559e95fa1dc0 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf2affd640 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fb3010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf2009b150 tx=0x7faf2009b450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d05feb27d112d7cb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.431+0000 7faf0affd640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf0affd640 1 -- 172.21.15.63:0/321429080 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20020070 con 0x559e95fa1dc0 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf0affd640 1 -- 172.21.15.63:0/321429080 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7faf2009a8a0 con 0x559e95fa1dc0 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf34414740 1 -- 172.21.15.63:0/321429080 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf20099750 con 0x559e95fa1dc0 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf0affd640 1 -- 172.21.15.63:0/321429080 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf200b8050 con 0x559e95fa1dc0 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf34414740 10 client.25171 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:12.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf34414740 1 -- 172.21.15.63:0/321429080 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e96037440 con 0x559e95fa1dc0 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf0affd640 1 -- 172.21.15.63:0/321429080 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf20099750 con 0x559e95fa1dc0 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf0affd640 1 -- 172.21.15.63:0/321429080 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7faf200a0990 con 0x559e95fa1dc0 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf34414740 10 client.25171 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf34414740 10 client.25171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf34414740 20 client.25171 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf34414740 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559e960389a0 0x559e9603adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf34414740 4 client.25171 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.432+0000 7faf34414740 1 -- 172.21.15.63:0/321429080 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e95f0ed60 con 0x559e960389a0 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.433+0000 7faf2b7fe640 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559e960389a0 0x559e9603adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.433+0000 7faf2b7fe640 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559e960389a0 0x559e9603adc0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee572f2b825aabb0 server_cookie=f83624d1f481eb71 in_seq=0 out_seq=0 2024-09-16T01:26:12.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.433+0000 7faf0affd640 10 client.25171 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:12.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.433+0000 7faf0affd640 1 -- 172.21.15.63:0/321429080 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559e95f0ed60 con 0x559e960389a0 2024-09-16T01:26:12.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.433+0000 7faf0affd640 10 client.25171 handle_command_reply: tid=0 2024-09-16T01:26:12.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.433+0000 7faf34414740 1 client.25171 shutdown 2024-09-16T01:26:12.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.433+0000 7faf34414740 1 -- 172.21.15.63:0/321429080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 msgr2=0x559e95fb3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:12.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.433+0000 7faf34414740 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fb3010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf2009b150 tx=0x7faf2009b450 comp rx=0 tx=0).stop 2024-09-16T01:26:12.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf34414740 1 -- 172.21.15.63:0/321429080 shutdown_connections 2024-09-16T01:26:12.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf34414740 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559e95fac680 0x559e96036f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf34414740 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e95fa1dc0 0x559e95fb3010 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf34414740 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559e960389a0 0x559e9603adc0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf34414740 1 --2- 172.21.15.63:0/321429080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559e95fa14a0 0x559e95fb2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf34414740 1 -- 172.21.15.63:0/321429080 >> 172.21.15.63:0/321429080 conn(0x559e95f9da30 msgr2=0x559e95f9c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:12.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf0affd640 0 client.25171 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:12.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf34414740 1 -- 172.21.15.63:0/321429080 shutdown_connections 2024-09-16T01:26:12.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf34414740 1 -- 172.21.15.63:0/321429080 wait complete. 2024-09-16T01:26:12.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf34414740 20 client.25171 trim_cache size 0 max 16384 2024-09-16T01:26:12.443 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:26:12.443 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-16T01:26:12.443 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {} 2024-09-16T01:26:12.443 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:26:12.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf3203b640 1 -- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7faf140a3440 msgr2=0x7faf140a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:12.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf3203b640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7faf140a3440 0x7faf140a5900 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x559e95f9e890 tx=0x7faf1c004a60 comp rx=0 tx=0).stop 2024-09-16T01:26:12.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf3203b640 1 -- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c103650 msgr2=0x7faf2c1107c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:12.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf3203b640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c103650 0x7faf2c1107c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7faf2000d6b0 tx=0x7faf2000db70 comp rx=0 tx=0).stop 2024-09-16T01:26:12.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf3203b640 1 -- 172.21.15.63:0/399352056 shutdown_connections 2024-09-16T01:26:12.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf3203b640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7faf140a3440 0x7faf140a5900 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf3203b640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf2c10c160 0x7faf2c110d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf3203b640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf2c103650 0x7faf2c1107c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf3203b640 1 --2- 172.21.15.63:0/399352056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf2c102d30 0x7faf2c110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:12.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.434+0000 7faf3203b640 1 -- 172.21.15.63:0/399352056 >> 172.21.15.63:0/399352056 conn(0x7faf2c0fc790 msgr2=0x7faf2c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:12.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.435+0000 7faf3203b640 1 -- 172.21.15.63:0/399352056 shutdown_connections 2024-09-16T01:26:12.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:12.435+0000 7faf3203b640 1 -- 172.21.15.63:0/399352056 wait complete. 2024-09-16T01:26:13.250 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:13 smithi063 ceph-mon[31070]: pgmap v421: 97 pgs: 97 active+clean; 142 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 395 op/s 2024-09-16T01:26:13.280 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-16T01:26:13.280 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:26:13.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:13 smithi192 ceph-mon[34775]: pgmap v421: 97 pgs: 97 active+clean; 142 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 395 op/s 2024-09-16T01:26:13.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:13 smithi162 ceph-mon[34539]: pgmap v421: 97 pgs: 97 active+clean; 142 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 395 op/s 2024-09-16T01:26:13.581 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:26:14.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.114+0000 7ff3c4636640 1 -- 172.21.15.63:0/3110898235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3bc10e4d0 msgr2=0x7ff3bc1108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:14.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.114+0000 7ff3c4636640 1 --2- 172.21.15.63:0/3110898235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3bc10e4d0 0x7ff3bc1108e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009ca0 tx=0x7ff3b402a8c0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.115+0000 7ff3c4636640 1 -- 172.21.15.63:0/3110898235 shutdown_connections 2024-09-16T01:26:14.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.115+0000 7ff3c4636640 1 --2- 172.21.15.63:0/3110898235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3bc10e4d0 0x7ff3bc1108e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.115+0000 7ff3c4636640 1 --2- 172.21.15.63:0/3110898235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc101360 0x7ff3bc10df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.115+0000 7ff3c4636640 1 --2- 172.21.15.63:0/3110898235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3bc1009b0 0x7ff3bc100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.115+0000 7ff3c4636640 1 -- 172.21.15.63:0/3110898235 >> 172.21.15.63:0/3110898235 conn(0x7ff3bc0fc7d0 msgr2=0x7ff3bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:14.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.115+0000 7ff3c4636640 1 -- 172.21.15.63:0/3110898235 shutdown_connections 2024-09-16T01:26:14.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.115+0000 7ff3c4636640 1 -- 172.21.15.63:0/3110898235 wait complete. 2024-09-16T01:26:14.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.115+0000 7ff3c4636640 1 Processor -- start 2024-09-16T01:26:14.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.115+0000 7ff3c4636640 1 -- start start 2024-09-16T01:26:14.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c4636640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc1009b0 0x7ff3bc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:14.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c4636640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3bc101360 0x7ff3bc19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:14.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c4636640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3bc10e4d0 0x7ff3bc19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:14.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c4636640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc1140d0 con 0x7ff3bc101360 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c4636640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc113f50 con 0x7ff3bc1009b0 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c4636640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc114250 con 0x7ff3bc10e4d0 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c1bd1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3bc101360 0x7ff3bc19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c1bd1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3bc101360 0x7ff3bc19ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57820/0 (socket says 172.21.15.63:57820) 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c23d2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc1009b0 0x7ff3bc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c1bd1640 1 -- 172.21.15.63:0/3472657101 learned_addr learned my addr 172.21.15.63:0/3472657101 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c2bd3640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3bc10e4d0 0x7ff3bc19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c1bd1640 1 -- 172.21.15.63:0/3472657101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3bc10e4d0 msgr2=0x7ff3bc19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c1bd1640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3bc10e4d0 0x7ff3bc19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c1bd1640 1 -- 172.21.15.63:0/3472657101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc1009b0 msgr2=0x7ff3bc19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:14.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c1bd1640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc1009b0 0x7ff3bc19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c1bd1640 1 -- 172.21.15.63:0/3472657101 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3bc19f5e0 con 0x7ff3bc101360 2024-09-16T01:26:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.116+0000 7ff3c1bd1640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3bc101360 0x7ff3bc19ab70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00e9f0 tx=0x7ff3ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.117+0000 7ff3b37fe640 1 -- 172.21.15.63:0/3472657101 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00cd80 con 0x7ff3bc101360 2024-09-16T01:26:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.117+0000 7ff3c4636640 1 -- 172.21.15.63:0/3472657101 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3bc19f8d0 con 0x7ff3bc101360 2024-09-16T01:26:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.117+0000 7ff3b37fe640 1 -- 172.21.15.63:0/3472657101 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff3ac0108e0 con 0x7ff3bc101360 2024-09-16T01:26:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.117+0000 7ff3b37fe640 1 -- 172.21.15.63:0/3472657101 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac018920 con 0x7ff3bc101360 2024-09-16T01:26:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.117+0000 7ff3c4636640 1 -- 172.21.15.63:0/3472657101 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3bc1a71b0 con 0x7ff3bc101360 2024-09-16T01:26:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.118+0000 7ff3c4636640 1 -- 172.21.15.63:0/3472657101 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3bc06a7f0 con 0x7ff3bc101360 2024-09-16T01:26:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.119+0000 7ff3b37fe640 1 -- 172.21.15.63:0/3472657101 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff3ac010a90 con 0x7ff3bc101360 2024-09-16T01:26:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.120+0000 7ff3b37fe640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3a80a3240 0x7ff3a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.120+0000 7ff3c23d2640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3a80a3240 0x7ff3a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.120+0000 7ff3b37fe640 1 -- 172.21.15.63:0/3472657101 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff3ac0cfc50 con 0x7ff3bc101360 2024-09-16T01:26:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.120+0000 7ff3c23d2640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3a80a3240 0x7ff3a80a5700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8005fd0 tx=0x7ff3b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.124+0000 7ff3b37fe640 1 -- 172.21.15.63:0/3472657101 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3ac09c970 con 0x7ff3bc101360 2024-09-16T01:26:14.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.361+0000 7ff3c4636640 1 -- 172.21.15.63:0/3472657101 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3bc109660 con 0x7ff3bc101360 2024-09-16T01:26:14.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.362+0000 7ff3b37fe640 1 -- 172.21.15.63:0/3472657101 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11918 (secure 0 0 0) 0x7ff3ac09c270 con 0x7ff3bc101360 2024-09-16T01:26:14.363 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:26:14.363 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"btime":"2024-09-16T01:25:54:073139+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:25:53.917460+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24467,24460,24445]},"id":1}]} 2024-09-16T01:26:14.364 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 29 2024-09-16T01:26:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.364+0000 7ff3c4636640 1 -- 172.21.15.63:0/3472657101 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3a80a3240 msgr2=0x7ff3a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.364+0000 7ff3c4636640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3a80a3240 0x7ff3a80a5700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8005fd0 tx=0x7ff3b800b390 comp rx=0 tx=0).stop 2024-09-16T01:26:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.364+0000 7ff3c4636640 1 -- 172.21.15.63:0/3472657101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3bc101360 msgr2=0x7ff3bc19ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.364+0000 7ff3c4636640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3bc101360 0x7ff3bc19ab70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00e9f0 tx=0x7ff3ac00eeb0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.364+0000 7ff3c4636640 1 -- 172.21.15.63:0/3472657101 shutdown_connections 2024-09-16T01:26:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.364+0000 7ff3c4636640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff3a80a3240 0x7ff3a80a5700 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.364+0000 7ff3c4636640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3bc10e4d0 0x7ff3bc19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.364+0000 7ff3c4636640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3bc101360 0x7ff3bc19ab70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.364+0000 7ff3c4636640 1 --2- 172.21.15.63:0/3472657101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc1009b0 0x7ff3bc19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.364+0000 7ff3c4636640 1 -- 172.21.15.63:0/3472657101 >> 172.21.15.63:0/3472657101 conn(0x7ff3bc0fc7d0 msgr2=0x7ff3bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.365+0000 7ff3c4636640 1 -- 172.21.15.63:0/3472657101 shutdown_connections 2024-09-16T01:26:14.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:14.365+0000 7ff3c4636640 1 -- 172.21.15.63:0/3472657101 wait complete. 2024-09-16T01:26:15.325 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:15 smithi063 ceph-mon[31070]: pgmap v422: 97 pgs: 97 active+clean; 142 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 337 op/s 2024-09-16T01:26:15.326 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:15 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3472657101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:26:15.355 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-16T01:26:15.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:15 smithi192 ceph-mon[34775]: pgmap v422: 97 pgs: 97 active+clean; 142 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 337 op/s 2024-09-16T01:26:15.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:15 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3472657101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:26:15.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:15 smithi162 ceph-mon[34539]: pgmap v422: 97 pgs: 97 active+clean; 142 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 337 op/s 2024-09-16T01:26:15.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:15 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3472657101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:26:15.645 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:26:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.143+0000 7f606f363640 1 -- 172.21.15.63:0/4242851146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60681082a0 msgr2=0x7f606810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.143+0000 7f606f363640 1 --2- 172.21.15.63:0/4242851146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60681082a0 0x7f606810ec40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6060009cd0 tx=0x7f606002a8e0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.143+0000 7f606f363640 1 -- 172.21.15.63:0/4242851146 shutdown_connections 2024-09-16T01:26:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.143+0000 7f606f363640 1 --2- 172.21.15.63:0/4242851146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60681082a0 0x7f606810ec40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.143+0000 7f606f363640 1 --2- 172.21.15.63:0/4242851146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60681036e0 0x7f6068107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.143+0000 7f606f363640 1 --2- 172.21.15.63:0/4242851146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6068102d30 0x7f6068103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.143+0000 7f606f363640 1 -- 172.21.15.63:0/4242851146 >> 172.21.15.63:0/4242851146 conn(0x7f60680fc7d0 msgr2=0x7f60680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.143+0000 7f606f363640 1 -- 172.21.15.63:0/4242851146 shutdown_connections 2024-09-16T01:26:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.143+0000 7f606f363640 1 -- 172.21.15.63:0/4242851146 wait complete. 2024-09-16T01:26:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606f363640 1 Processor -- start 2024-09-16T01:26:16.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606f363640 1 -- start start 2024-09-16T01:26:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606f363640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6068102d30 0x7f6068198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606f363640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60681036e0 0x7f6068198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606f363640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60681082a0 0x7f606819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606f363640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6068111f50 con 0x7f60681082a0 2024-09-16T01:26:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606f363640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6068111dd0 con 0x7f6068102d30 2024-09-16T01:26:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606f363640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f60681120d0 con 0x7f60681036e0 2024-09-16T01:26:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606d900640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60681082a0 0x7f606819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606c8fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60681036e0 0x7f6068198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606d0ff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6068102d30 0x7f6068198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606c8fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60681036e0 0x7f6068198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:35296/0 (socket says 172.21.15.63:35296) 2024-09-16T01:26:16.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606c8fe640 1 -- 172.21.15.63:0/3314293882 learned_addr learned my addr 172.21.15.63:0/3314293882 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:16.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606d0ff640 1 -- 172.21.15.63:0/3314293882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60681036e0 msgr2=0x7f6068198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:16.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606d0ff640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60681036e0 0x7f6068198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606d0ff640 1 -- 172.21.15.63:0/3314293882 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60681082a0 msgr2=0x7f606819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:16.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606d0ff640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60681082a0 0x7f606819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.144+0000 7f606d0ff640 1 -- 172.21.15.63:0/3314293882 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606819d3b0 con 0x7f6068102d30 2024-09-16T01:26:16.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.145+0000 7f606d0ff640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6068102d30 0x7f6068198400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f606400c970 tx=0x7f606400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:16.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.145+0000 7f605e7fc640 1 -- 172.21.15.63:0/3314293882 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064007bb0 con 0x7f6068102d30 2024-09-16T01:26:16.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.145+0000 7f605e7fc640 1 -- 172.21.15.63:0/3314293882 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6064007d50 con 0x7f6068102d30 2024-09-16T01:26:16.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.145+0000 7f605e7fc640 1 -- 172.21.15.63:0/3314293882 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064018780 con 0x7f6068102d30 2024-09-16T01:26:16.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.145+0000 7f606f363640 1 -- 172.21.15.63:0/3314293882 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606819d6a0 con 0x7f6068102d30 2024-09-16T01:26:16.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.145+0000 7f606f363640 1 -- 172.21.15.63:0/3314293882 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60681a4f80 con 0x7f6068102d30 2024-09-16T01:26:16.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.147+0000 7f605e7fc640 1 -- 172.21.15.63:0/3314293882 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f606400f450 con 0x7f6068102d30 2024-09-16T01:26:16.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.148+0000 7f607173c740 1 Processor -- start 2024-09-16T01:26:16.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.148+0000 7f607173c740 1 -- start start 2024-09-16T01:26:16.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.148+0000 7f607173c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee86090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.148+0000 7f607173c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee86a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.148+0000 7f605e7fc640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60540a32c0 0x7f60540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.148+0000 7f607173c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 0x55ebeee93760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.148+0000 7f606d0ff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee86a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.148+0000 7f606d0ff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee86a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57840/0 (socket says 172.21.15.63:57840) 2024-09-16T01:26:16.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f607173c740 1 -- 172.21.15.63:0/159506924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ebeedec2f0 con 0x55ebeee865d0 2024-09-16T01:26:16.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606d0ff640 1 -- 172.21.15.63:0/159506924 learned_addr learned my addr 172.21.15.63:0/159506924 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:16.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f607173c740 1 -- 172.21.15.63:0/159506924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ebeed93cf0 con 0x55ebeee91370 2024-09-16T01:26:16.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f607173c740 1 -- 172.21.15.63:0/159506924 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ebeede82b0 con 0x55ebeee87b40 2024-09-16T01:26:16.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606d900640 1 --2- 172.21.15.63:0/159506924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee86090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606c8fe640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60540a32c0 0x7f60540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606d900640 1 --2- 172.21.15.63:0/159506924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 0x55ebeee93760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f605e7fc640 1 -- 172.21.15.63:0/3314293882 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f60640cf8f0 con 0x7f6068102d30 2024-09-16T01:26:16.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606d900640 1 -- 172.21.15.63:0/159506924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 msgr2=0x55ebeee93760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:16.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606d900640 1 --2- 172.21.15.63:0/159506924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 0x55ebeee93760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606d900640 1 -- 172.21.15.63:0/159506924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 msgr2=0x55ebeee86a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:16.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606d900640 1 --2- 172.21.15.63:0/159506924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee86a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606d900640 1 -- 172.21.15.63:0/159506924 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebeed783a0 con 0x55ebeee87b40 2024-09-16T01:26:16.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606c8fe640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60540a32c0 0x7f60540a5780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f60680fedf0 tx=0x7f6058005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:16.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f606d900640 1 --2- 172.21.15.63:0/159506924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee86090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6060009ca0 tx=0x7f6060004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=715ddef6ce3c94ee server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:16.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f60537fe640 1 -- 172.21.15.63:0/159506924 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060031990 con 0x55ebeee87b40 2024-09-16T01:26:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f60537fe640 1 -- 172.21.15.63:0/159506924 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6060036050 con 0x55ebeee87b40 2024-09-16T01:26:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.149+0000 7f60537fe640 1 -- 172.21.15.63:0/159506924 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60600043f0 con 0x55ebeee87b40 2024-09-16T01:26:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.150+0000 7f607173c740 1 -- 172.21.15.63:0/159506924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 msgr2=0x55ebeee86090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.150+0000 7f607173c740 1 --2- 172.21.15.63:0/159506924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee86090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6060009ca0 tx=0x7f6060004a60 comp rx=0 tx=0).stop 2024-09-16T01:26:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.150+0000 7f607173c740 1 -- 172.21.15.63:0/159506924 shutdown_connections 2024-09-16T01:26:16.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.150+0000 7f607173c740 1 --2- 172.21.15.63:0/159506924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 0x55ebeee93760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.150+0000 7f607173c740 1 --2- 172.21.15.63:0/159506924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee86a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.150+0000 7f607173c740 1 --2- 172.21.15.63:0/159506924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee86090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.150+0000 7f607173c740 1 -- 172.21.15.63:0/159506924 >> 172.21.15.63:0/159506924 conn(0x55ebeee4f310 msgr2=0x55ebeee82c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:16.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.150+0000 7f607173c740 1 -- 172.21.15.63:0/159506924 shutdown_connections 2024-09-16T01:26:16.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.150+0000 7f607173c740 1 -- 172.21.15.63:0/159506924 wait complete. 2024-09-16T01:26:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f607173c740 1 -- start start 2024-09-16T01:26:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f607173c740 1 Processor -- start 2024-09-16T01:26:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f607173c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee90db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f607173c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee8e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f607173c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 0x55ebeee8e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f607173c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ebeee94010 con 0x55ebeee865d0 2024-09-16T01:26:16.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f607173c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ebeeda7060 con 0x55ebeee91370 2024-09-16T01:26:16.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f607173c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ebeee94190 con 0x55ebeee87b40 2024-09-16T01:26:16.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f607173c740 10 client.0 _ll_register_callbacks cb 0x55ebeeafa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:16.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f606d900640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 0x55ebeee8e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f606c8fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee8e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f606d0ff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee90db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f606c8fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee8e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:35308/0 (socket says 172.21.15.63:35308) 2024-09-16T01:26:16.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f606d0ff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee90db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57850/0 (socket says 172.21.15.63:57850) 2024-09-16T01:26:16.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f606c8fe640 1 -- 172.21.15.63:0/408339806 learned_addr learned my addr 172.21.15.63:0/408339806 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:16.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.151+0000 7f606d900640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 0x55ebeee8e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:47586/0 (socket says 172.21.15.63:47586) 2024-09-16T01:26:16.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f606d0ff640 1 -- 172.21.15.63:0/408339806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 msgr2=0x55ebeee8e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:16.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f606d0ff640 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee8e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f606d0ff640 1 -- 172.21.15.63:0/408339806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 msgr2=0x55ebeee8e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:16.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f606d0ff640 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 0x55ebeee8e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f606d0ff640 1 -- 172.21.15.63:0/408339806 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebeeb5d3c0 con 0x55ebeee865d0 2024-09-16T01:26:16.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f606d900640 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 0x55ebeee8e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:16.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f606c8fe640 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee8e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:16.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f606d0ff640 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee90db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f606409be60 tx=0x7f606409bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f09f242f0118f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:16.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f6050ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:26:16.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f6050ff9640 1 -- 172.21.15.63:0/408339806 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606409c5d0 con 0x55ebeee865d0 2024-09-16T01:26:16.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f6050ff9640 1 -- 172.21.15.63:0/408339806 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f60640a46b0 con 0x55ebeee865d0 2024-09-16T01:26:16.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f607173c740 1 -- 172.21.15.63:0/408339806 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6060036050 con 0x55ebeee865d0 2024-09-16T01:26:16.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f6050ff9640 1 -- 172.21.15.63:0/408339806 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f606409bed0 con 0x55ebeee865d0 2024-09-16T01:26:16.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f607173c740 10 client.15603 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:16.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f607173c740 1 -- 172.21.15.63:0/408339806 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ebeee9fb60 con 0x55ebeee865d0 2024-09-16T01:26:16.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.152+0000 7f6050ff9640 1 -- 172.21.15.63:0/408339806 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6060036050 con 0x55ebeee865d0 2024-09-16T01:26:16.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.153+0000 7f6050ff9640 1 -- 172.21.15.63:0/408339806 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f60640bab10 con 0x55ebeee865d0 2024-09-16T01:26:16.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.153+0000 7f607173c740 10 client.15603 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:16.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.153+0000 7f607173c740 10 client.15603 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-16T01:26:16.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.153+0000 7f607173c740 20 client.15603 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:16.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.153+0000 7f607173c740 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ebeeea0fc0 0x55ebeeea3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.153+0000 7f607173c740 4 client.15603 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:26:16.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.153+0000 7f607173c740 1 -- 172.21.15.63:0/408339806 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebeedf9860 con 0x55ebeeea0fc0 2024-09-16T01:26:16.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.153+0000 7f606c8fe640 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ebeeea0fc0 0x55ebeeea3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.153+0000 7f6050ff9640 10 client.15603 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:26:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.153+0000 7f606c8fe640 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ebeeea0fc0 0x55ebeeea3440 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=67240f7944591604 server_cookie=911f5a537e4b370a in_seq=0 out_seq=0 2024-09-16T01:26:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f6050ff9640 1 -- 172.21.15.63:0/408339806 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ebeedf9860 con 0x55ebeeea0fc0 2024-09-16T01:26:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f6050ff9640 10 client.15603 handle_command_reply: tid=0 2024-09-16T01:26:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f607173c740 1 client.15603 shutdown 2024-09-16T01:26:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f607173c740 1 -- 172.21.15.63:0/408339806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 msgr2=0x55ebeee90db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f607173c740 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee90db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f606409be60 tx=0x7f606409bb40 comp rx=0 tx=0).stop 2024-09-16T01:26:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f607173c740 1 -- 172.21.15.63:0/408339806 shutdown_connections 2024-09-16T01:26:16.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f607173c740 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ebeeea0fc0 0x55ebeeea3440 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f607173c740 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee91370 0x55ebeee8e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f607173c740 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee8e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f607173c740 1 --2- 172.21.15.63:0/408339806 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee865d0 0x55ebeee90db0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f6050ff9640 0 client.15603 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:26:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f607173c740 1 -- 172.21.15.63:0/408339806 >> 172.21.15.63:0/408339806 conn(0x55ebeee4f310 msgr2=0x55ebeee889c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.154+0000 7f607173c740 1 -- 172.21.15.63:0/408339806 shutdown_connections 2024-09-16T01:26:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.155+0000 7f607173c740 1 -- 172.21.15.63:0/408339806 wait complete. 2024-09-16T01:26:16.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.155+0000 7f607173c740 20 client.15603 trim_cache size 0 max 16384 2024-09-16T01:26:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f607173c740 1 Processor -- start 2024-09-16T01:26:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f607173c740 1 -- start start 2024-09-16T01:26:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f607173c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 0x55ebeee89120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f607173c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee89660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f607173c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee91370 0x55ebeeea8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f607173c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f60681add20 con 0x55ebeee91370 2024-09-16T01:26:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f607173c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60681ab530 con 0x55ebeee865d0 2024-09-16T01:26:16.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f607173c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f60681a9360 con 0x55ebeee87b40 2024-09-16T01:26:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f606c8fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee89660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f606d900640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee91370 0x55ebeeea8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.169+0000 7f606d0ff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 0x55ebeee89120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f606c8fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee89660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:35324/0 (socket says 172.21.15.63:35324) 2024-09-16T01:26:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f606c8fe640 1 -- 172.21.15.63:0/3096815388 learned_addr learned my addr 172.21.15.63:0/3096815388 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f606d0ff640 1 -- 172.21.15.63:0/3096815388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 msgr2=0x55ebeee89660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:16.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f606d0ff640 1 --2- 172.21.15.63:0/3096815388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee89660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f606d0ff640 1 -- 172.21.15.63:0/3096815388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee91370 msgr2=0x55ebeeea8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f606d0ff640 1 --2- 172.21.15.63:0/3096815388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee91370 0x55ebeeea8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f606d0ff640 1 -- 172.21.15.63:0/3096815388 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebeee89ba0 con 0x55ebeee865d0 2024-09-16T01:26:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f606d900640 1 --2- 172.21.15.63:0/3096815388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee91370 0x55ebeeea8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f606d0ff640 1 --2- 172.21.15.63:0/3096815388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 0x55ebeee89120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6064098330 tx=0x7f60640076c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e0492b98467b690 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f6052ffd640 1 -- 172.21.15.63:0/3096815388 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064098170 con 0x55ebeee865d0 2024-09-16T01:26:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f6052ffd640 1 -- 172.21.15.63:0/3096815388 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f606409c5d0 con 0x55ebeee865d0 2024-09-16T01:26:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.170+0000 7f6052ffd640 1 -- 172.21.15.63:0/3096815388 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60640a4910 con 0x55ebeee865d0 2024-09-16T01:26:16.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.171+0000 7f607173c740 1 -- 172.21.15.63:0/3096815388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 msgr2=0x55ebeee89120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.171+0000 7f607173c740 1 --2- 172.21.15.63:0/3096815388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 0x55ebeee89120 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6064098330 tx=0x7f60640076c0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.171+0000 7f607173c740 1 -- 172.21.15.63:0/3096815388 shutdown_connections 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.171+0000 7f607173c740 1 --2- 172.21.15.63:0/3096815388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee91370 0x55ebeeea8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.171+0000 7f607173c740 1 --2- 172.21.15.63:0/3096815388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee87b40 0x55ebeee89660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.171+0000 7f607173c740 1 --2- 172.21.15.63:0/3096815388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 0x55ebeee89120 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.171+0000 7f607173c740 1 -- 172.21.15.63:0/3096815388 >> 172.21.15.63:0/3096815388 conn(0x55ebeee4f310 msgr2=0x55ebeee8d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.171+0000 7f607173c740 1 -- 172.21.15.63:0/3096815388 shutdown_connections 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.171+0000 7f607173c740 1 -- 172.21.15.63:0/3096815388 wait complete. 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f607173c740 1 -- start start 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f607173c740 1 Processor -- start 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f607173c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 0x55ebeee99a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f607173c740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee87b40 0x55ebeee94d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f607173c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee91370 0x55ebeee952a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f607173c740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f60681a99f0 con 0x55ebeee87b40 2024-09-16T01:26:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f607173c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60681aae60 con 0x55ebeee865d0 2024-09-16T01:26:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f607173c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f60681aa0c0 con 0x55ebeee91370 2024-09-16T01:26:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f607173c740 10 client.0 _ll_register_callbacks cb 0x7f60640cd2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f606d0ff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 0x55ebeee99a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f606c8fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee87b40 0x55ebeee94d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f606d900640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee91370 0x55ebeee952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f606c8fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee87b40 0x55ebeee94d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57864/0 (socket says 172.21.15.63:57864) 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f606d900640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee91370 0x55ebeee952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:35328/0 (socket says 172.21.15.63:35328) 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f606d0ff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 0x55ebeee99a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:47604/0 (socket says 172.21.15.63:47604) 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.172+0000 7f606c8fe640 1 -- 172.21.15.63:0/4211243289 learned_addr learned my addr 172.21.15.63:0/4211243289 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.173+0000 7f606d900640 1 -- 172.21.15.63:0/4211243289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 msgr2=0x55ebeee99a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.173+0000 7f606d900640 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 0x55ebeee99a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.173+0000 7f606d900640 1 -- 172.21.15.63:0/4211243289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee87b40 msgr2=0x55ebeee94d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.173+0000 7f606d900640 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee87b40 0x55ebeee94d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.173+0000 7f606d900640 1 -- 172.21.15.63:0/4211243289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebeee95990 con 0x55ebeee91370 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.173+0000 7f606d900640 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee91370 0x55ebeee952a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6060033040 tx=0x7f606002a8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b329f22a410e84c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.173+0000 7f6050ff9640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.173+0000 7f6050ff9640 1 -- 172.21.15.63:0/4211243289 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060003970 con 0x55ebeee91370 2024-09-16T01:26:16.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.173+0000 7f607173c740 1 -- 172.21.15.63:0/4211243289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f606409c5d0 con 0x55ebeee91370 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.173+0000 7f6050ff9640 1 -- 172.21.15.63:0/4211243289 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6060003b10 con 0x55ebeee91370 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f6050ff9640 1 -- 172.21.15.63:0/4211243289 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6060003d10 con 0x55ebeee91370 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f607173c740 10 client.25192 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f607173c740 1 -- 172.21.15.63:0/4211243289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ebeef0bba0 con 0x55ebeee91370 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f6050ff9640 1 -- 172.21.15.63:0/4211243289 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f606409c5d0 con 0x55ebeee91370 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f6050ff9640 1 -- 172.21.15.63:0/4211243289 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f6060030070 con 0x55ebeee91370 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f607173c740 10 client.25192 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f607173c740 10 client.25192 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f607173c740 20 client.25192 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f607173c740 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ebeef0be70 0x55ebeef0e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f607173c740 4 client.25192 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f607173c740 1 -- 172.21.15.63:0/4211243289 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ebeedf3d70 con 0x55ebeef0be70 2024-09-16T01:26:16.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.174+0000 7f606d0ff640 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ebeef0be70 0x55ebeef0e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f6050ff9640 10 client.25192 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f606d0ff640 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ebeef0be70 0x55ebeef0e260 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6773a0eb12c6774a server_cookie=361eca4ae66b957e in_seq=0 out_seq=0 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f6050ff9640 1 -- 172.21.15.63:0/4211243289 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ebeedf3d70 con 0x55ebeef0be70 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f6050ff9640 10 client.25192 handle_command_reply: tid=0 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 client.25192 shutdown 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 -- 172.21.15.63:0/4211243289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee91370 msgr2=0x55ebeee952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee91370 0x55ebeee952a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6060033040 tx=0x7f606002a8e0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 -- 172.21.15.63:0/4211243289 shutdown_connections 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x55ebeef0be70 0x55ebeef0e260 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ebeee91370 0x55ebeee952a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f6050ff9640 0 client.25192 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:26:16.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ebeee87b40 0x55ebeee94d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 --2- 172.21.15.63:0/4211243289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ebeee865d0 0x55ebeee99a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 -- 172.21.15.63:0/4211243289 >> 172.21.15.63:0/4211243289 conn(0x55ebeee4f310 msgr2=0x55ebeee814e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:16.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 -- 172.21.15.63:0/4211243289 shutdown_connections 2024-09-16T01:26:16.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.175+0000 7f607173c740 1 -- 172.21.15.63:0/4211243289 wait complete. 2024-09-16T01:26:16.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f607173c740 20 client.25192 trim_cache size 0 max 16384 2024-09-16T01:26:16.206 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:26:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 -- 172.21.15.63:0/3314293882 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60540a32c0 msgr2=0x7f60540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60540a32c0 0x7f60540a5780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f60680fedf0 tx=0x7f6058005f90 comp rx=0 tx=0).stop 2024-09-16T01:26:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 -- 172.21.15.63:0/3314293882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6068102d30 msgr2=0x7f6068198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6068102d30 0x7f6068198400 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f606400c970 tx=0x7f606400ce30 comp rx=0 tx=0).stop 2024-09-16T01:26:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 -- 172.21.15.63:0/3314293882 shutdown_connections 2024-09-16T01:26:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f60540a32c0 0x7f60540a5780 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60681082a0 0x7f606819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60681036e0 0x7f6068198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 --2- 172.21.15.63:0/3314293882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6068102d30 0x7f6068198400 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:16.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 -- 172.21.15.63:0/3314293882 >> 172.21.15.63:0/3314293882 conn(0x7f60680fc7d0 msgr2=0x7f6068105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:16.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 -- 172.21.15.63:0/3314293882 shutdown_connections 2024-09-16T01:26:16.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:16.176+0000 7f606f363640 1 -- 172.21.15.63:0/3314293882 wait complete. 2024-09-16T01:26:16.985 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-16T01:26:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:26:17.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:17 smithi063 ceph-mon[31070]: pgmap v423: 97 pgs: 97 active+clean; 143 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 310 op/s 2024-09-16T01:26:17.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:17 smithi192 ceph-mon[34775]: pgmap v423: 97 pgs: 97 active+clean; 143 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 310 op/s 2024-09-16T01:26:17.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:17 smithi162 ceph-mon[34539]: pgmap v423: 97 pgs: 97 active+clean; 143 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 310 op/s 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.741+0000 7f7951a16640 1 -- 172.21.15.63:0/2705145679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f794c109110 msgr2=0x7f794c110c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.741+0000 7f7951a16640 1 --2- 172.21.15.63:0/2705145679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f794c109110 0x7f794c110c90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7944009ca0 tx=0x7f794402a8c0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.741+0000 7f7951a16640 1 -- 172.21.15.63:0/2705145679 shutdown_connections 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.741+0000 7f7951a16640 1 --2- 172.21.15.63:0/2705145679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f794c109110 0x7f794c110c90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.741+0000 7f7951a16640 1 --2- 172.21.15.63:0/2705145679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c104990 0x7f794c1089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.741+0000 7f7951a16640 1 --2- 172.21.15.63:0/2705145679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c103fe0 0x7f794c1043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.741+0000 7f7951a16640 1 -- 172.21.15.63:0/2705145679 >> 172.21.15.63:0/2705145679 conn(0x7f794c0ffac0 msgr2=0x7f794c101ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.741+0000 7f7951a16640 1 -- 172.21.15.63:0/2705145679 shutdown_connections 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.741+0000 7f7951a16640 1 -- 172.21.15.63:0/2705145679 wait complete. 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f7951a16640 1 Processor -- start 2024-09-16T01:26:17.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f7951a16640 1 -- start start 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f7951a16640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c103fe0 0x7f794c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f7951a16640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c104990 0x7f794c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f7951a16640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f794c109110 0x7f794c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f7951a16640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f794c113fd0 con 0x7f794c109110 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f7951a16640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f794c113e50 con 0x7f794c104990 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f7951a16640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f794c114150 con 0x7f794c103fe0 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f794c109110 0x7f794c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f794affd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c103fe0 0x7f794c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f7943fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c104990 0x7f794c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f794c109110 0x7f794c19eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57884/0 (socket says 172.21.15.63:57884) 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f794b7fe640 1 -- 172.21.15.63:0/2358969909 learned_addr learned my addr 172.21.15.63:0/2358969909 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f794affd640 1 -- 172.21.15.63:0/2358969909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c104990 msgr2=0x7f794c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:17.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f794affd640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c104990 0x7f794c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f794affd640 1 -- 172.21.15.63:0/2358969909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f794c109110 msgr2=0x7f794c19eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f794affd640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f794c109110 0x7f794c19eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.742+0000 7f794affd640 1 -- 172.21.15.63:0/2358969909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794c19f480 con 0x7f794c103fe0 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.743+0000 7f794affd640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c103fe0 0x7f794c19a4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e9f0 tx=0x7f793c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.743+0000 7f7950a14640 1 -- 172.21.15.63:0/2358969909 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c00ccc0 con 0x7f794c103fe0 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.743+0000 7f7951a16640 1 -- 172.21.15.63:0/2358969909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794c19f770 con 0x7f794c103fe0 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.743+0000 7f7950a14640 1 -- 172.21.15.63:0/2358969909 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f793c0108e0 con 0x7f794c103fe0 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.743+0000 7f7950a14640 1 -- 172.21.15.63:0/2358969909 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c018880 con 0x7f794c103fe0 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.743+0000 7f7951a16640 1 -- 172.21.15.63:0/2358969909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f794c1a7050 con 0x7f794c103fe0 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.745+0000 7f7950a14640 1 -- 172.21.15.63:0/2358969909 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f793c010a90 con 0x7f794c103fe0 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.745+0000 7f7953def740 1 Processor -- start 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f7953def740 1 -- start start 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f7953def740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc62090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f7953def740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc62a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f7953def740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc6f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f7953def740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c86fbc82f0 con 0x55c86fc63b40 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f7953def740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c86fb6fcf0 con 0x55c86fc625d0 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f7953def740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c86fbc42b0 con 0x55c86fc6d370 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc62090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc62090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57900/0 (socket says 172.21.15.63:57900) 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f794b7fe640 1 -- 172.21.15.63:0/618697344 learned_addr learned my addr 172.21.15.63:0/618697344 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f794affd640 1 --2- 172.21.15.63:0/618697344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc62a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f7943fff640 1 --2- 172.21.15.63:0/618697344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc6f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f794b7fe640 1 -- 172.21.15.63:0/618697344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 msgr2=0x55c86fc6f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f794b7fe640 1 --2- 172.21.15.63:0/618697344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc6f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f794b7fe640 1 -- 172.21.15.63:0/618697344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 msgr2=0x55c86fc62a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f794b7fe640 1 --2- 172.21.15.63:0/618697344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc62a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.746+0000 7f794b7fe640 1 -- 172.21.15.63:0/618697344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c86fb543a0 con 0x55c86fc63b40 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.747+0000 7f7950a14640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79380a3240 0x7f79380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.747+0000 7f794b7fe640 1 --2- 172.21.15.63:0/618697344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc62090 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7944009a20 tx=0x7f7944005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c587a30d845038 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.747+0000 7f794affd640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79380a3240 0x7f79380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.747+0000 7f7941ffb640 1 -- 172.21.15.63:0/618697344 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944031e00 con 0x55c86fc63b40 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.747+0000 7f7941ffb640 1 -- 172.21.15.63:0/618697344 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7944036030 con 0x55c86fc63b40 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.747+0000 7f7950a14640 1 -- 172.21.15.63:0/2358969909 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f793c0cfc60 con 0x7f794c103fe0 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.747+0000 7f7941ffb640 1 -- 172.21.15.63:0/618697344 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944004440 con 0x55c86fc63b40 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 -- 172.21.15.63:0/618697344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 msgr2=0x55c86fc62090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 --2- 172.21.15.63:0/618697344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc62090 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7944009a20 tx=0x7f7944005ef0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f794affd640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79380a3240 0x7f79380a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f793c019000 tx=0x7f793c0d36e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:17.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 -- 172.21.15.63:0/618697344 shutdown_connections 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 --2- 172.21.15.63:0/618697344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc6f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 --2- 172.21.15.63:0/618697344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc62a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 --2- 172.21.15.63:0/618697344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc62090 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 -- 172.21.15.63:0/618697344 >> 172.21.15.63:0/618697344 conn(0x55c86fc2b310 msgr2=0x55c86fc5ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 -- 172.21.15.63:0/618697344 shutdown_connections 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 -- 172.21.15.63:0/618697344 wait complete. 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 -- start start 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.748+0000 7f7953def740 1 Processor -- start 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f7953def740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc625d0 0x55c86fc6cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f7953def740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc63b40 0x55c86fc69fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f7953def740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc6a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f7953def740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c86fc6fe90 con 0x55c86fc625d0 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f7953def740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c86fb83060 con 0x55c86fc63b40 2024-09-16T01:26:17.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f7953def740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c86fc70010 con 0x55c86fc6d370 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f7953def740 10 client.0 _ll_register_callbacks cb 0x55c86f8d68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc625d0 0x55c86fc6cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc625d0 0x55c86fc6cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57902/0 (socket says 172.21.15.63:57902) 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f7943fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc63b40 0x55c86fc69fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f794b7fe640 1 -- 172.21.15.63:0/3527612913 learned_addr learned my addr 172.21.15.63:0/3527612913 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f794b7fe640 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc6a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f794b7fe640 1 -- 172.21.15.63:0/3527612913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 msgr2=0x55c86fc6a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f794b7fe640 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc6a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f794b7fe640 1 -- 172.21.15.63:0/3527612913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc63b40 msgr2=0x55c86fc69fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f794b7fe640 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc63b40 0x55c86fc69fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f794b7fe640 1 -- 172.21.15.63:0/3527612913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c86f9393c0 con 0x55c86fc625d0 2024-09-16T01:26:17.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f7943fff640 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc63b40 0x55c86fc69fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f794b7fe640 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc625d0 0x55c86fc6cd10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7944009620 tx=0x7f79440040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f402318ba8a003 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.749+0000 7f792affd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f792affd640 1 -- 172.21.15.63:0/3527612913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944058060 con 0x55c86fc625d0 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f792affd640 1 -- 172.21.15.63:0/3527612913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f79440043c0 con 0x55c86fc625d0 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f7953def740 1 -- 172.21.15.63:0/3527612913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7944036030 con 0x55c86fc625d0 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f792affd640 1 -- 172.21.15.63:0/3527612913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f79440045c0 con 0x55c86fc625d0 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f7953def740 10 client.15621 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f7953def740 1 -- 172.21.15.63:0/3527612913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c86fc6fe90 con 0x55c86fc625d0 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f792affd640 1 -- 172.21.15.63:0/3527612913 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7944036030 con 0x55c86fc625d0 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f792affd640 1 -- 172.21.15.63:0/3527612913 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f794405d070 con 0x55c86fc625d0 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f7953def740 10 client.15621 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f7953def740 10 client.15621 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f7953def740 20 client.15621 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:17.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f7953def740 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c86fc7cb20 0x55c86fc7ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f7953def740 4 client.15621 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.750+0000 7f7953def740 1 -- 172.21.15.63:0/3527612913 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c86fbd5860 con 0x55c86fc7cb20 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.751+0000 7f7943fff640 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c86fc7cb20 0x55c86fc7ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.751+0000 7f7943fff640 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c86fc7cb20 0x55c86fc7ef40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=43708b7895e8461b server_cookie=69e9955d24f578c4 in_seq=0 out_seq=0 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.751+0000 7f792affd640 10 client.15621 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.751+0000 7f792affd640 1 -- 172.21.15.63:0/3527612913 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c86fbd5860 con 0x55c86fc7cb20 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.751+0000 7f792affd640 10 client.15621 handle_command_reply: tid=0 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 client.15621 shutdown 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 -- 172.21.15.63:0/3527612913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc625d0 msgr2=0x55c86fc6cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc625d0 0x55c86fc6cd10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7944009620 tx=0x7f79440040e0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 -- 172.21.15.63:0/3527612913 shutdown_connections 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c86fc7cb20 0x55c86fc7ef40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc6a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc63b40 0x55c86fc69fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 --2- 172.21.15.63:0/3527612913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc625d0 0x55c86fc6cd10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 -- 172.21.15.63:0/3527612913 >> 172.21.15.63:0/3527612913 conn(0x55c86fc2b310 msgr2=0x55c86fc64930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f792affd640 0 client.15621 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 -- 172.21.15.63:0/3527612913 shutdown_connections 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 1 -- 172.21.15.63:0/3527612913 wait complete. 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.752+0000 7f7953def740 20 client.15621 trim_cache size 0 max 16384 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7953def740 1 Processor -- start 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7953def740 1 -- start start 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7953def740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc68890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7953def740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc5e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7953def740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc5ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7953def740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f794c1b1f20 con 0x55c86fc63b40 2024-09-16T01:26:17.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7953def740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f794c1af730 con 0x55c86fc625d0 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7953def740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f794c1ad560 con 0x55c86fc6d370 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7943fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc5e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7943fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc5e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57916/0 (socket says 172.21.15.63:57916) 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7943fff640 1 -- 172.21.15.63:0/1325082379 learned_addr learned my addr 172.21.15.63:0/1325082379 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f794b7fe640 1 --2- 172.21.15.63:0/1325082379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc68890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f794b7fe640 1 --2- 172.21.15.63:0/1325082379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc5ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7943fff640 1 -- 172.21.15.63:0/1325082379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 msgr2=0x55c86fc5ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7943fff640 1 --2- 172.21.15.63:0/1325082379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc5ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7943fff640 1 -- 172.21.15.63:0/1325082379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 msgr2=0x55c86fc68890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7943fff640 1 --2- 172.21.15.63:0/1325082379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc68890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f7943fff640 1 -- 172.21.15.63:0/1325082379 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c86fc68f70 con 0x55c86fc63b40 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.766+0000 7f794b7fe640 1 --2- 172.21.15.63:0/1325082379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc68890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.767+0000 7f7943fff640 1 --2- 172.21.15.63:0/1325082379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc5e510 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7934012580 tx=0x7f7934005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405683c05e6e9e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.767+0000 7f79417fa640 1 -- 172.21.15.63:0/1325082379 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934004030 con 0x55c86fc63b40 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.767+0000 7f79417fa640 1 -- 172.21.15.63:0/1325082379 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f793400f790 con 0x55c86fc63b40 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.767+0000 7f79417fa640 1 -- 172.21.15.63:0/1325082379 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934003970 con 0x55c86fc63b40 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 -- 172.21.15.63:0/1325082379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 msgr2=0x55c86fc5e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 --2- 172.21.15.63:0/1325082379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc5e510 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7934012580 tx=0x7f7934005f90 comp rx=0 tx=0).stop 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 -- 172.21.15.63:0/1325082379 shutdown_connections 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 --2- 172.21.15.63:0/1325082379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc5ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 --2- 172.21.15.63:0/1325082379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc5e510 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 --2- 172.21.15.63:0/1325082379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc68890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 -- 172.21.15.63:0/1325082379 >> 172.21.15.63:0/1325082379 conn(0x55c86fc2b310 msgr2=0x55c86fc6c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:17.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 -- 172.21.15.63:0/1325082379 shutdown_connections 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 -- 172.21.15.63:0/1325082379 wait complete. 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 -- start start 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.768+0000 7f7953def740 1 Processor -- start 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f7953def740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc752a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f7953def740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc757e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f7953def740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc72270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f7953def740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f794c1adbf0 con 0x55c86fc63b40 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f7953def740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f794c1af060 con 0x55c86fc625d0 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f7953def740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f794c1ae2c0 con 0x55c86fc6d370 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f7953def740 10 client.0 _ll_register_callbacks cb 0x7f793c0d35b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f7943fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f794b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f7943fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc757e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57932/0 (socket says 172.21.15.63:57932) 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f7943fff640 1 -- 172.21.15.63:0/1304805891 learned_addr learned my addr 172.21.15.63:0/1304805891 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f794b7fe640 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc72270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f794b7fe640 1 -- 172.21.15.63:0/1304805891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 msgr2=0x55c86fc72270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f794b7fe640 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc72270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f794b7fe640 1 -- 172.21.15.63:0/1304805891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 msgr2=0x55c86fc757e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f794b7fe640 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc757e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f794b7fe640 1 -- 172.21.15.63:0/1304805891 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c86fc727b0 con 0x55c86fc625d0 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f794b7fe640 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc752a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7944031040 tx=0x7f7944003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70f862ffc2775a20 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f792affd640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.769+0000 7f792affd640 1 -- 172.21.15.63:0/1304805891 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944058070 con 0x55c86fc625d0 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f792affd640 1 -- 172.21.15.63:0/1304805891 <== mon.2 v2:172.21.15.162:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f794402f9e0 con 0x55c86fc625d0 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f7953def740 1 -- 172.21.15.63:0/1304805891 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f793400f790 con 0x55c86fc625d0 2024-09-16T01:26:17.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f792affd640 1 -- 172.21.15.63:0/1304805891 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7944063040 con 0x55c86fc625d0 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f7953def740 10 client.25205 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f7953def740 1 -- 172.21.15.63:0/1304805891 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c86fce7f30 con 0x55c86fc625d0 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f792affd640 1 -- 172.21.15.63:0/1304805891 <== mon.2 v2:172.21.15.162:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f793400f790 con 0x55c86fc625d0 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f792affd640 1 -- 172.21.15.63:0/1304805891 <== mon.2 v2:172.21.15.162:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f794405d040 con 0x55c86fc625d0 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f7953def740 10 client.25205 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f7953def740 10 client.25205 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f7953def740 20 client.25205 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.770+0000 7f7953def740 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c86fce8570 0x55c86fcea990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f7953def740 4 client.25205 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f7953def740 1 -- 172.21.15.63:0/1304805891 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c86fbcfd70 con 0x55c86fce8570 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f7943fff640 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c86fce8570 0x55c86fcea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f7943fff640 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c86fce8570 0x55c86fcea990 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d4afccc9709fb966 server_cookie=1ea772f38c3a77a1 in_seq=0 out_seq=0 2024-09-16T01:26:17.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f792affd640 10 client.25205 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f792affd640 1 -- 172.21.15.63:0/1304805891 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c86fbcfd70 con 0x55c86fce8570 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f792affd640 10 client.25205 handle_command_reply: tid=0 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f7953def740 1 client.25205 shutdown 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f7953def740 1 -- 172.21.15.63:0/1304805891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 msgr2=0x55c86fc752a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f7953def740 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc752a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7944031040 tx=0x7f7944003c80 comp rx=0 tx=0).stop 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f7953def740 1 -- 172.21.15.63:0/1304805891 shutdown_connections 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.771+0000 7f7953def740 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x55c86fce8570 0x55c86fcea990 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7953def740 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c86fc6d370 0x55c86fc72270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f792affd640 0 client.25205 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7953def740 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c86fc63b40 0x55c86fc757e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7953def740 1 --2- 172.21.15.63:0/1304805891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c86fc625d0 0x55c86fc752a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7953def740 1 -- 172.21.15.63:0/1304805891 >> 172.21.15.63:0/1304805891 conn(0x55c86fc2b310 msgr2=0x55c86fc64930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7953def740 1 -- 172.21.15.63:0/1304805891 shutdown_connections 2024-09-16T01:26:17.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7953def740 1 -- 172.21.15.63:0/1304805891 wait complete. 2024-09-16T01:26:17.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7953def740 20 client.25205 trim_cache size 0 max 16384 2024-09-16T01:26:17.790 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7951a16640 1 -- 172.21.15.63:0/2358969909 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79380a3240 msgr2=0x7f79380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7951a16640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79380a3240 0x7f79380a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f793c019000 tx=0x7f793c0d36e0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7951a16640 1 -- 172.21.15.63:0/2358969909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c103fe0 msgr2=0x7f794c19a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7951a16640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c103fe0 0x7f794c19a4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e9f0 tx=0x7f793c00eeb0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7951a16640 1 -- 172.21.15.63:0/2358969909 shutdown_connections 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7951a16640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f79380a3240 0x7f79380a5700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7951a16640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f794c109110 0x7f794c19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7951a16640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c104990 0x7f794c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7951a16640 1 --2- 172.21.15.63:0/2358969909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c103fe0 0x7f794c19a4d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.772+0000 7f7951a16640 1 -- 172.21.15.63:0/2358969909 >> 172.21.15.63:0/2358969909 conn(0x7f794c0ffac0 msgr2=0x7f794c100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:17.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.773+0000 7f7951a16640 1 -- 172.21.15.63:0/2358969909 shutdown_connections 2024-09-16T01:26:17.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:17.773+0000 7f7951a16640 1 -- 172.21.15.63:0/2358969909 wait complete. 2024-09-16T01:26:18.528 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-16T01:26:18.797 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:26:19.194 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:19 smithi063 ceph-mon[31070]: pgmap v424: 97 pgs: 97 active+clean; 144 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 375 op/s 2024-09-16T01:26:19.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.282+0000 7ff62f294640 1 -- 172.21.15.63:0/2618345767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff628103780 msgr2=0x7ff628107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:19.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.282+0000 7ff62f294640 1 --2- 172.21.15.63:0/2618345767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff628103780 0x7ff628107bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff618009930 tx=0x7ff61802a420 comp rx=0 tx=0).stop 2024-09-16T01:26:19.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.282+0000 7ff62f294640 1 -- 172.21.15.63:0/2618345767 shutdown_connections 2024-09-16T01:26:19.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.282+0000 7ff62f294640 1 --2- 172.21.15.63:0/2618345767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff628108300 0x7ff62810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.282+0000 7ff62f294640 1 --2- 172.21.15.63:0/2618345767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff628103780 0x7ff628107bc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.282+0000 7ff62f294640 1 --2- 172.21.15.63:0/2618345767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff628102dd0 0x7ff6281031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.282+0000 7ff62f294640 1 -- 172.21.15.63:0/2618345767 >> 172.21.15.63:0/2618345767 conn(0x7ff6280fc7d0 msgr2=0x7ff6280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:19.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.283+0000 7ff62f294640 1 -- 172.21.15.63:0/2618345767 shutdown_connections 2024-09-16T01:26:19.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.283+0000 7ff62f294640 1 -- 172.21.15.63:0/2618345767 wait complete. 2024-09-16T01:26:19.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.283+0000 7ff62f294640 1 Processor -- start 2024-09-16T01:26:19.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.283+0000 7ff62f294640 1 -- start start 2024-09-16T01:26:19.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62f294640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff628102dd0 0x7ff628198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62f294640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff628103780 0x7ff628198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62f294640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff628108300 0x7ff62819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62f294640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff628111f20 con 0x7ff628108300 2024-09-16T01:26:19.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62f294640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff628111da0 con 0x7ff628103780 2024-09-16T01:26:19.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62f294640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281120a0 con 0x7ff628102dd0 2024-09-16T01:26:19.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d831640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff628108300 0x7ff62819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d831640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff628108300 0x7ff62819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48816/0 (socket says 172.21.15.63:48816) 2024-09-16T01:26:19.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d831640 1 -- 172.21.15.63:0/769667730 learned_addr learned my addr 172.21.15.63:0/769667730 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:19.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62c82f640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff628103780 0x7ff628198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d030640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff628102dd0 0x7ff628198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d831640 1 -- 172.21.15.63:0/769667730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff628102dd0 msgr2=0x7ff628198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d831640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff628102dd0 0x7ff628198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d831640 1 -- 172.21.15.63:0/769667730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff628103780 msgr2=0x7ff628198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d831640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff628103780 0x7ff628198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d831640 1 -- 172.21.15.63:0/769667730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62819d4b0 con 0x7ff628108300 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d030640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff628102dd0 0x7ff628198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.284+0000 7ff62d831640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff628108300 0x7ff62819cdd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff62000eb10 tx=0x7ff62000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.285+0000 7ff61e7fc640 1 -- 172.21.15.63:0/769667730 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620004b20 con 0x7ff628108300 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.285+0000 7ff62f294640 1 -- 172.21.15.63:0/769667730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62819d7a0 con 0x7ff628108300 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.285+0000 7ff62f294640 1 -- 172.21.15.63:0/769667730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6281a5080 con 0x7ff628108300 2024-09-16T01:26:19.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.285+0000 7ff61e7fc640 1 -- 172.21.15.63:0/769667730 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff620004cc0 con 0x7ff628108300 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.285+0000 7ff61e7fc640 1 -- 172.21.15.63:0/769667730 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620010690 con 0x7ff628108300 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.287+0000 7ff61e7fc640 1 -- 172.21.15.63:0/769667730 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff620005020 con 0x7ff628108300 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.287+0000 7ff63166d740 1 Processor -- start 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.287+0000 7ff63166d740 1 -- start start 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff63166d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c52090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff63166d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c52a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff63166d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c61780 0x559f23c63b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff63166d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559f23bb82f0 con 0x559f23c61780 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff63166d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559f23b5fcf0 con 0x559f23c525d0 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff63166d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559f23bb42b0 con 0x559f23c53b40 2024-09-16T01:26:19.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62c82f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62d030640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c52a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62c82f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c61780 0x559f23c63b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62d030640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c52a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:54808/0 (socket says 172.21.15.63:54808) 2024-09-16T01:26:19.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62d030640 1 -- 172.21.15.63:0/1095400919 learned_addr learned my addr 172.21.15.63:0/1095400919 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:19.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff61e7fc640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff6140a32c0 0x7ff6140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62d030640 1 -- 172.21.15.63:0/1095400919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 msgr2=0x559f23c52090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:19.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62d030640 1 --2- 172.21.15.63:0/1095400919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c52090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62d030640 1 -- 172.21.15.63:0/1095400919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c61780 msgr2=0x559f23c63b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:19.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62d030640 1 --2- 172.21.15.63:0/1095400919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c61780 0x559f23c63b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62d030640 1 -- 172.21.15.63:0/1095400919 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f23b443a0 con 0x559f23c525d0 2024-09-16T01:26:19.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff61e7fc640 1 -- 172.21.15.63:0/769667730 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff6200cfe50 con 0x7ff628108300 2024-09-16T01:26:19.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62d831640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff6140a32c0 0x7ff6140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.288+0000 7ff62d030640 1 --2- 172.21.15.63:0/1095400919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c52a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff624009c60 tx=0x7ff624010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3593f61433e9ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff6137fe640 1 -- 172.21.15.63:0/1095400919 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624005020 con 0x559f23c525d0 2024-09-16T01:26:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff6137fe640 1 -- 172.21.15.63:0/1095400919 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6240047a0 con 0x559f23c525d0 2024-09-16T01:26:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff6137fe640 1 -- 172.21.15.63:0/1095400919 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624012650 con 0x559f23c525d0 2024-09-16T01:26:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff63166d740 1 -- 172.21.15.63:0/1095400919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 msgr2=0x559f23c52a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff62d831640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff6140a32c0 0x7ff6140a5780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff6200049d0 tx=0x7ff62000efd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff63166d740 1 --2- 172.21.15.63:0/1095400919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c52a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff624009c60 tx=0x7ff624010740 comp rx=0 tx=0).stop 2024-09-16T01:26:19.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff63166d740 1 -- 172.21.15.63:0/1095400919 shutdown_connections 2024-09-16T01:26:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff63166d740 1 --2- 172.21.15.63:0/1095400919 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c61780 0x559f23c63b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff63166d740 1 --2- 172.21.15.63:0/1095400919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c52a10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff63166d740 1 --2- 172.21.15.63:0/1095400919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c52090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff63166d740 1 -- 172.21.15.63:0/1095400919 >> 172.21.15.63:0/1095400919 conn(0x559f23c1b310 msgr2=0x559f23c4ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.289+0000 7ff63166d740 1 -- 172.21.15.63:0/1095400919 shutdown_connections 2024-09-16T01:26:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.290+0000 7ff63166d740 1 -- 172.21.15.63:0/1095400919 wait complete. 2024-09-16T01:26:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.290+0000 7ff63166d740 1 -- start start 2024-09-16T01:26:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.290+0000 7ff63166d740 1 Processor -- start 2024-09-16T01:26:19.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.290+0000 7ff63166d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c61180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.290+0000 7ff63166d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c5e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.290+0000 7ff63166d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c61780 0x559f23c5ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.290+0000 7ff63166d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559f23c64480 con 0x559f23c525d0 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.290+0000 7ff63166d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559f23b73060 con 0x559f23c61780 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.290+0000 7ff63166d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559f23c64600 con 0x559f23c53b40 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.290+0000 7ff63166d740 10 client.0 _ll_register_callbacks cb 0x559f238c68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62c82f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c61180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62c82f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c61180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48842/0 (socket says 172.21.15.63:48842) 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62c82f640 1 -- 172.21.15.63:0/877991984 learned_addr learned my addr 172.21.15.63:0/877991984 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62d030640 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c5e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62c82f640 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c61780 0x559f23c5ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62c82f640 1 -- 172.21.15.63:0/877991984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 msgr2=0x559f23c5e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62c82f640 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c5e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62c82f640 1 -- 172.21.15.63:0/877991984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c61780 msgr2=0x559f23c5ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62c82f640 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c61780 0x559f23c5ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62c82f640 1 -- 172.21.15.63:0/877991984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f239293c0 con 0x559f23c525d0 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62d030640 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c5e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff62c82f640 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c61180 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff618009930 tx=0x7ff618041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a4a353c92ca53e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff610ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff610ff9640 1 -- 172.21.15.63:0/877991984 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618035070 con 0x559f23c525d0 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff63166d740 1 -- 172.21.15.63:0/877991984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6240047a0 con 0x559f23c525d0 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.291+0000 7ff610ff9640 1 -- 172.21.15.63:0/877991984 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff6180318e0 con 0x559f23c525d0 2024-09-16T01:26:19.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff610ff9640 1 -- 172.21.15.63:0/877991984 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff618005020 con 0x559f23c525d0 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff63166d740 10 client.15639 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff63166d740 1 -- 172.21.15.63:0/877991984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559f23c6ff70 con 0x559f23c525d0 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff610ff9640 1 -- 172.21.15.63:0/877991984 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6240047a0 con 0x559f23c525d0 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff610ff9640 1 -- 172.21.15.63:0/877991984 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff6180035f0 con 0x559f23c525d0 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff63166d740 10 client.15639 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff63166d740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff63166d740 20 client.15639 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff63166d740 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559f23c71380 0x559f23c73770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff63166d740 4 client.15639 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff63166d740 1 -- 172.21.15.63:0/877991984 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f23bc5860 con 0x559f23c71380 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.292+0000 7ff62d030640 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559f23c71380 0x559f23c73770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.293+0000 7ff62d030640 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559f23c71380 0x559f23c73770 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe64a8580b41ca2a server_cookie=683f4ce186a550dc in_seq=0 out_seq=0 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.293+0000 7ff610ff9640 10 client.15639 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff610ff9640 1 -- 172.21.15.63:0/877991984 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f23bc5860 con 0x559f23c71380 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff610ff9640 10 client.15639 handle_command_reply: tid=0 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 client.15639 shutdown 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 -- 172.21.15.63:0/877991984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 msgr2=0x559f23c61180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c61180 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff618009930 tx=0x7ff618041040 comp rx=0 tx=0).stop 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 -- 172.21.15.63:0/877991984 shutdown_connections 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c61780 0x559f23c5ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c5e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559f23c71380 0x559f23c73770 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 --2- 172.21.15.63:0/877991984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c61180 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 -- 172.21.15.63:0/877991984 >> 172.21.15.63:0/877991984 conn(0x559f23c1b310 msgr2=0x559f23c54960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff610ff9640 0 client.15639 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 -- 172.21.15.63:0/877991984 shutdown_connections 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 1 -- 172.21.15.63:0/877991984 wait complete. 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.294+0000 7ff63166d740 20 client.15639 trim_cache size 0 max 16384 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff63166d740 1 Processor -- start 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff63166d740 1 -- start start 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff63166d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c6d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff63166d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c5dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff63166d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c61780 0x559f23c4e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff63166d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281adda0 con 0x559f23c61780 2024-09-16T01:26:19.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff63166d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281ab5b0 con 0x559f23c525d0 2024-09-16T01:26:19.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff63166d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281a93e0 con 0x559f23c53b40 2024-09-16T01:26:19.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff62c82f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c61780 0x559f23c4e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff62c82f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c6d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff62d030640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c5dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff62c82f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c6d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:54824/0 (socket says 172.21.15.63:54824) 2024-09-16T01:26:19.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff62c82f640 1 -- 172.21.15.63:0/2849642429 learned_addr learned my addr 172.21.15.63:0/2849642429 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:19.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff62d030640 1 -- 172.21.15.63:0/2849642429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 msgr2=0x559f23c6d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:19.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff62d030640 1 --2- 172.21.15.63:0/2849642429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c6d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff62d030640 1 -- 172.21.15.63:0/2849642429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c61780 msgr2=0x559f23c4e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff62d030640 1 --2- 172.21.15.63:0/2849642429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c61780 0x559f23c4e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.308+0000 7ff62d030640 1 -- 172.21.15.63:0/2849642429 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f23c5c9a0 con 0x559f23c53b40 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.309+0000 7ff62d030640 1 --2- 172.21.15.63:0/2849642429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c5dcf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff624009c30 tx=0x7ff62401e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7eb39c8689306e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.309+0000 7ff612ffd640 1 -- 172.21.15.63:0/2849642429 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624004660 con 0x559f23c53b40 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.309+0000 7ff612ffd640 1 -- 172.21.15.63:0/2849642429 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6240035f0 con 0x559f23c53b40 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.309+0000 7ff612ffd640 1 -- 172.21.15.63:0/2849642429 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624005000 con 0x559f23c53b40 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 -- 172.21.15.63:0/2849642429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 msgr2=0x559f23c5dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 --2- 172.21.15.63:0/2849642429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c5dcf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff624009c30 tx=0x7ff62401e040 comp rx=0 tx=0).stop 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 -- 172.21.15.63:0/2849642429 shutdown_connections 2024-09-16T01:26:19.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 --2- 172.21.15.63:0/2849642429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c61780 0x559f23c4e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 --2- 172.21.15.63:0/2849642429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c5dcf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 --2- 172.21.15.63:0/2849642429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c525d0 0x559f23c6d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 -- 172.21.15.63:0/2849642429 >> 172.21.15.63:0/2849642429 conn(0x559f23c1b310 msgr2=0x559f23c59720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 -- 172.21.15.63:0/2849642429 shutdown_connections 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 -- 172.21.15.63:0/2849642429 wait complete. 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 -- start start 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.310+0000 7ff63166d740 1 Processor -- start 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff63166d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c69890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff63166d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c69dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff63166d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c61780 0x559f23c5aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff63166d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281a9a70 con 0x559f23c525d0 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff63166d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281aaee0 con 0x559f23c61780 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff63166d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff6281aa140 con 0x559f23c53b40 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff63166d740 10 client.0 _ll_register_callbacks cb 0x7ff618004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62c82f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c69890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62c82f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c69890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48856/0 (socket says 172.21.15.63:48856) 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62d030640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c69dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62c82f640 1 -- 172.21.15.63:0/2419586120 learned_addr learned my addr 172.21.15.63:0/2419586120 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62c82f640 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c61780 0x559f23c5aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62d030640 1 -- 172.21.15.63:0/2419586120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c61780 msgr2=0x559f23c5aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62d030640 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c61780 0x559f23c5aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62d030640 1 -- 172.21.15.63:0/2419586120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 msgr2=0x559f23c69890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:19.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62d030640 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c69890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62d030640 1 -- 172.21.15.63:0/2419586120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f23c5b010 con 0x559f23c53b40 2024-09-16T01:26:19.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.311+0000 7ff62c82f640 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c69890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:19.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff62d030640 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c69dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x559f23c5ef30 tx=0x7ff624010d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc8cbf6bc6a70bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:19.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff610ff9640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:26:19.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff610ff9640 1 -- 172.21.15.63:0/2419586120 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff624038070 con 0x559f23c53b40 2024-09-16T01:26:19.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff63166d740 1 -- 172.21.15.63:0/2419586120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6240035f0 con 0x559f23c53b40 2024-09-16T01:26:19.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff610ff9640 1 -- 172.21.15.63:0/2419586120 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff624004020 con 0x559f23c53b40 2024-09-16T01:26:19.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff610ff9640 1 -- 172.21.15.63:0/2419586120 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff624043050 con 0x559f23c53b40 2024-09-16T01:26:19.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff63166d740 10 client.25225 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff63166d740 1 -- 172.21.15.63:0/2419586120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559f23cdb7b0 con 0x559f23c53b40 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff610ff9640 1 -- 172.21.15.63:0/2419586120 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6240035f0 con 0x559f23c53b40 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff610ff9640 1 -- 172.21.15.63:0/2419586120 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff62400f040 con 0x559f23c53b40 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff63166d740 10 client.25225 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.312+0000 7ff63166d740 10 client.25225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 20 client.25225 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559f23cdbdc0 0x559f23cde1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 4 client.25225 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 1 -- 172.21.15.63:0/2419586120 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f23bbfd70 con 0x559f23cdbdc0 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff62c82f640 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559f23cdbdc0 0x559f23cde1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff62c82f640 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559f23cdbdc0 0x559f23cde1e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a00ed370da7e6163 server_cookie=6b126e31e1b92687 in_seq=0 out_seq=0 2024-09-16T01:26:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff610ff9640 10 client.25225 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff610ff9640 1 -- 172.21.15.63:0/2419586120 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f23bbfd70 con 0x559f23cdbdc0 2024-09-16T01:26:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff610ff9640 10 client.25225 handle_command_reply: tid=0 2024-09-16T01:26:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 1 client.25225 shutdown 2024-09-16T01:26:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 1 -- 172.21.15.63:0/2419586120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 msgr2=0x559f23c69dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c69dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x559f23c5ef30 tx=0x7ff624010d10 comp rx=0 tx=0).stop 2024-09-16T01:26:19.381 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:26:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 1 -- 172.21.15.63:0/2419586120 shutdown_connections 2024-09-16T01:26:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559f23c61780 0x559f23c5aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f23c53b40 0x559f23c69dd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.313+0000 7ff63166d740 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x559f23cdbdc0 0x559f23cde1e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff63166d740 1 --2- 172.21.15.63:0/2419586120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559f23c525d0 0x559f23c69890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff610ff9640 0 client.25225 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff63166d740 1 -- 172.21.15.63:0/2419586120 >> 172.21.15.63:0/2419586120 conn(0x559f23c1b310 msgr2=0x559f23c59720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff63166d740 1 -- 172.21.15.63:0/2419586120 shutdown_connections 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff63166d740 1 -- 172.21.15.63:0/2419586120 wait complete. 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff63166d740 20 client.25225 trim_cache size 0 max 16384 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff62f294640 1 -- 172.21.15.63:0/769667730 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff6140a32c0 msgr2=0x7ff6140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff62f294640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff6140a32c0 0x7ff6140a5780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff6200049d0 tx=0x7ff62000efd0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff62f294640 1 -- 172.21.15.63:0/769667730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff628108300 msgr2=0x7ff62819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff62f294640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff628108300 0x7ff62819cdd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff62000eb10 tx=0x7ff62000c2d0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff62f294640 1 -- 172.21.15.63:0/769667730 shutdown_connections 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff62f294640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff6140a32c0 0x7ff6140a5780 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff62f294640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff628108300 0x7ff62819cdd0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff62f294640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff628103780 0x7ff628198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff62f294640 1 --2- 172.21.15.63:0/769667730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff628102dd0 0x7ff628198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:19.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.314+0000 7ff62f294640 1 -- 172.21.15.63:0/769667730 >> 172.21.15.63:0/769667730 conn(0x7ff6280fc7d0 msgr2=0x7ff628105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:19.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.315+0000 7ff62f294640 1 -- 172.21.15.63:0/769667730 shutdown_connections 2024-09-16T01:26:19.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:19.315+0000 7ff62f294640 1 -- 172.21.15.63:0/769667730 wait complete. 2024-09-16T01:26:19.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:19 smithi192 ceph-mon[34775]: pgmap v424: 97 pgs: 97 active+clean; 144 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 375 op/s 2024-09-16T01:26:19.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:19 smithi162 ceph-mon[34539]: pgmap v424: 97 pgs: 97 active+clean; 144 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 375 op/s 2024-09-16T01:26:21.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:21 smithi063 ceph-mon[31070]: pgmap v425: 97 pgs: 97 active+clean; 144 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 268 op/s 2024-09-16T01:26:21.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:21 smithi192 ceph-mon[34775]: pgmap v425: 97 pgs: 97 active+clean; 144 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 268 op/s 2024-09-16T01:26:21.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:21 smithi162 ceph-mon[34539]: pgmap v425: 97 pgs: 97 active+clean; 144 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 268 op/s 2024-09-16T01:26:22.037 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-16T01:26:22.037 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-16T01:26:22.318 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:26:22.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.850+0000 7f0e00f67640 1 -- 172.21.15.63:0/3902120775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc100e20 msgr2=0x7f0dfc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:22.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.850+0000 7f0e00f67640 1 --2- 172.21.15.63:0/3902120775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc100e20 0x7f0dfc101200 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009900 tx=0x7f0dec02a480 comp rx=0 tx=0).stop 2024-09-16T01:26:22.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.850+0000 7f0e00f67640 1 -- 172.21.15.63:0/3902120775 shutdown_connections 2024-09-16T01:26:22.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.850+0000 7f0e00f67640 1 --2- 172.21.15.63:0/3902120775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.850+0000 7f0e00f67640 1 --2- 172.21.15.63:0/3902120775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102570 0x7f0dfc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.850+0000 7f0e00f67640 1 --2- 172.21.15.63:0/3902120775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc100e20 0x7f0dfc101200 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.850+0000 7f0e00f67640 1 -- 172.21.15.63:0/3902120775 >> 172.21.15.63:0/3902120775 conn(0x7f0dfc0fc7d0 msgr2=0x7f0dfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:22.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.850+0000 7f0e00f67640 1 -- 172.21.15.63:0/3902120775 shutdown_connections 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.850+0000 7f0e00f67640 1 -- 172.21.15.63:0/3902120775 wait complete. 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0e00f67640 1 Processor -- start 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0e00f67640 1 -- start start 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0e00f67640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 0x7f0dfc1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0e00f67640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102570 0x7f0dfc197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0e00f67640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0e00f67640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc110e30 con 0x7f0dfc102ef0 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0e00f67640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc110cb0 con 0x7f0dfc102570 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0e00f67640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc110fb0 con 0x7f0dfc100e20 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 0x7f0dfc1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc19bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48874/0 (socket says 172.21.15.63:48874) 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0df9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102570 0x7f0dfc197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 0x7f0dfc1972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:46138/0 (socket says 172.21.15.63:46138) 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.851+0000 7f0dfad9d640 1 -- 172.21.15.63:0/222754032 learned_addr learned my addr 172.21.15.63:0/222754032 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0dfad9d640 1 -- 172.21.15.63:0/222754032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 msgr2=0x7f0dfc1972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0dfad9d640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 0x7f0dfc1972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0dfad9d640 1 -- 172.21.15.63:0/222754032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102570 msgr2=0x7f0dfc197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0dfad9d640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102570 0x7f0dfc197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0dfad9d640 1 -- 172.21.15.63:0/222754032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dfc19c280 con 0x7f0dfc102ef0 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0dfad9d640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc19bba0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0df400eb10 tx=0x7f0df400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0deb7fe640 1 -- 172.21.15.63:0/222754032 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4004b20 con 0x7f0dfc102ef0 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0e00f67640 1 -- 172.21.15.63:0/222754032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dfc19c570 con 0x7f0dfc102ef0 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0deb7fe640 1 -- 172.21.15.63:0/222754032 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0df4004cc0 con 0x7f0dfc102ef0 2024-09-16T01:26:22.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0deb7fe640 1 -- 172.21.15.63:0/222754032 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4010690 con 0x7f0dfc102ef0 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.852+0000 7f0e00f67640 1 -- 172.21.15.63:0/222754032 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dfc1a3e50 con 0x7f0dfc102ef0 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.855+0000 7f0deb7fe640 1 -- 172.21.15.63:0/222754032 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0df4005020 con 0x7f0dfc102ef0 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.855+0000 7f0e03340740 1 Processor -- start 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.855+0000 7f0e03340740 1 -- start start 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0deb7fe640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de40a3240 0x7f0de40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0e03340740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 0x5578a2cbbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0e03340740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cc8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0e03340740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2ccb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0e03340740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5578a2c21280 con 0x5578a2cc8f50 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0e03340740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5578a2bc8b10 con 0x5578a2cbc360 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0e03340740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5578a2c1d240 con 0x5578a2cbba40 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2ccb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2ccb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48884/0 (socket says 172.21.15.63:48884) 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0dfad9d640 1 -- 172.21.15.63:0/1463624849 learned_addr learned my addr 172.21.15.63:0/1463624849 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/1463624849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cc8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0deb7fe640 1 -- 172.21.15.63:0/222754032 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0df40cfff0 con 0x7f0dfc102ef0 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de40a3240 0x7f0de40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0dfa59c640 1 --2- 172.21.15.63:0/1463624849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 0x5578a2cbbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0df9d9b640 1 -- 172.21.15.63:0/1463624849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 msgr2=0x5578a2cbbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/1463624849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 0x5578a2cbbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0df9d9b640 1 -- 172.21.15.63:0/1463624849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 msgr2=0x5578a2ccb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/1463624849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2ccb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0df9d9b640 1 -- 172.21.15.63:0/1463624849 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a2bd51f0 con 0x5578a2cbc360 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.856+0000 7f0dfad9d640 1 --2- 172.21.15.63:0/1463624849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2ccb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.857+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/1463624849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cc8a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0ffec0 tx=0x7f0df0010e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1e9cdb9f30a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.857+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de40a3240 0x7f0de40a5700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0df000f790 tx=0x7f0df0018000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.857+0000 7f0de8ff9640 1 -- 172.21.15.63:0/1463624849 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df0019040 con 0x5578a2cbc360 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.857+0000 7f0de8ff9640 1 -- 172.21.15.63:0/1463624849 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0df0010430 con 0x5578a2cbc360 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.857+0000 7f0de8ff9640 1 -- 172.21.15.63:0/1463624849 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df001e900 con 0x5578a2cbc360 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 -- 172.21.15.63:0/1463624849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 msgr2=0x5578a2cc8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 --2- 172.21.15.63:0/1463624849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cc8a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0ffec0 tx=0x7f0df0010e60 comp rx=0 tx=0).stop 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 -- 172.21.15.63:0/1463624849 shutdown_connections 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 --2- 172.21.15.63:0/1463624849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2ccb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 --2- 172.21.15.63:0/1463624849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cc8a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 --2- 172.21.15.63:0/1463624849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 0x5578a2cbbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 -- 172.21.15.63:0/1463624849 >> 172.21.15.63:0/1463624849 conn(0x5578a2cb80f0 msgr2=0x5578a2cb84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 -- 172.21.15.63:0/1463624849 shutdown_connections 2024-09-16T01:26:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 -- 172.21.15.63:0/1463624849 wait complete. 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 -- start start 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.858+0000 7f0e03340740 1 Processor -- start 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0e03340740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cc4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0e03340740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cc4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0e03340740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cc8f50 0x5578a2cd2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0e03340740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5578a2cbe9e0 con 0x5578a2cbba40 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0e03340740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5578a2bdbf10 con 0x5578a2cbc360 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0e03340740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5578a2cbeb60 con 0x5578a2cc8f50 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cc4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0e03340740 10 client.0 _ll_register_callbacks cb 0x5578a2ba4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cc4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48898/0 (socket says 172.21.15.63:48898) 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cc8f50 0x5578a2cd2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0df9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cc4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0dfa59c640 1 -- 172.21.15.63:0/97170702 learned_addr learned my addr 172.21.15.63:0/97170702 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0dfa59c640 1 -- 172.21.15.63:0/97170702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cc8f50 msgr2=0x5578a2cd2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0dfa59c640 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cc8f50 0x5578a2cd2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0dfa59c640 1 -- 172.21.15.63:0/97170702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 msgr2=0x5578a2cc4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0dfa59c640 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cc4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0dfa59c640 1 -- 172.21.15.63:0/97170702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a29926a0 con 0x5578a2cbba40 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0dfa59c640 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cc4570 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009900 tx=0x7f0dec031da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6416ea5ba88e3fdc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.859+0000 7f0de1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0de1ffb640 1 -- 172.21.15.63:0/97170702 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec035040 con 0x5578a2cbba40 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0e03340740 1 -- 172.21.15.63:0/97170702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0df0010430 con 0x5578a2cbba40 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0de1ffb640 1 -- 172.21.15.63:0/97170702 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0dec031640 con 0x5578a2cbba40 2024-09-16T01:26:22.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0de1ffb640 1 -- 172.21.15.63:0/97170702 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0dec031840 con 0x5578a2cbba40 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0e03340740 10 client.15657 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0e03340740 1 -- 172.21.15.63:0/97170702 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5578a2cd5640 con 0x5578a2cbba40 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0de1ffb640 1 -- 172.21.15.63:0/97170702 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0df0010430 con 0x5578a2cbba40 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0de1ffb640 1 -- 172.21.15.63:0/97170702 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0dec0047a0 con 0x5578a2cbba40 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0e03340740 10 client.15657 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0e03340740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0e03340740 20 client.15657 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0e03340740 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5578a2cd6b50 0x5578a2cd8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0e03340740 4 client.15657 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.860+0000 7f0e03340740 1 -- 172.21.15.63:0/97170702 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578a2c2e7f0 con 0x5578a2cd6b50 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.861+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5578a2cd6b50 0x5578a2cd8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.861+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5578a2cd6b50 0x5578a2cd8f90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd51107854dfcf6d server_cookie=ed19a8112a6f0d41 in_seq=0 out_seq=0 2024-09-16T01:26:22.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.861+0000 7f0de1ffb640 10 client.15657 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0de1ffb640 1 -- 172.21.15.63:0/97170702 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5578a2c2e7f0 con 0x5578a2cd6b50 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0de1ffb640 10 client.15657 handle_command_reply: tid=0 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 client.15657 shutdown 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 -- 172.21.15.63:0/97170702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 msgr2=0x5578a2cc4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cc4570 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009900 tx=0x7f0dec031da0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 -- 172.21.15.63:0/97170702 shutdown_connections 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cc8f50 0x5578a2cd2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cc4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5578a2cd6b50 0x5578a2cd8f90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0de1ffb640 0 client.15657 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 --2- 172.21.15.63:0/97170702 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cc4570 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 -- 172.21.15.63:0/97170702 >> 172.21.15.63:0/97170702 conn(0x5578a2cb80f0 msgr2=0x5578a2cb7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:22.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 -- 172.21.15.63:0/97170702 shutdown_connections 2024-09-16T01:26:22.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 1 -- 172.21.15.63:0/97170702 wait complete. 2024-09-16T01:26:22.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.863+0000 7f0e03340740 20 client.15657 trim_cache size 0 max 16384 2024-09-16T01:26:22.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.883+0000 7f0e03340740 1 Processor -- start 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.883+0000 7f0e03340740 1 -- start start 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0e03340740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 0x5578a2cb7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0e03340740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cde860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0e03340740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2cdeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0e03340740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1adb70 con 0x5578a2cc8f50 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0e03340740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1ab380 con 0x5578a2cbc360 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0e03340740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1a91b0 con 0x5578a2cbba40 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2cdeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 0x5578a2cb7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2cdeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48902/0 (socket says 172.21.15.63:48902) 2024-09-16T01:26:22.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0df9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cde860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfad9d640 1 -- 172.21.15.63:0/3944975225 learned_addr learned my addr 172.21.15.63:0/3944975225 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 0x5578a2cb7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:46156/0 (socket says 172.21.15.63:46156) 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfa59c640 1 -- 172.21.15.63:0/3944975225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 msgr2=0x5578a2cde860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfa59c640 1 --2- 172.21.15.63:0/3944975225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cde860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfa59c640 1 -- 172.21.15.63:0/3944975225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 msgr2=0x5578a2cdeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfa59c640 1 --2- 172.21.15.63:0/3944975225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2cdeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfa59c640 1 -- 172.21.15.63:0/3944975225 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578a2cc3340 con 0x5578a2cbba40 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/3944975225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cde860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0dfa59c640 1 --2- 172.21.15.63:0/3944975225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 0x5578a2cb7160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0dec004bf0 tx=0x7f0dec02a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=500ecf6cb86dd394 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.884+0000 7f0de3fff640 1 -- 172.21.15.63:0/3944975225 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec056070 con 0x5578a2cbba40 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0de3fff640 1 -- 172.21.15.63:0/3944975225 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0dec031640 con 0x5578a2cbba40 2024-09-16T01:26:22.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0de3fff640 1 -- 172.21.15.63:0/3944975225 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec035070 con 0x5578a2cbba40 2024-09-16T01:26:22.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0e03340740 1 -- 172.21.15.63:0/3944975225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 msgr2=0x5578a2cb7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:22.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0e03340740 1 --2- 172.21.15.63:0/3944975225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 0x5578a2cb7160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0dec004bf0 tx=0x7f0dec02a480 comp rx=0 tx=0).stop 2024-09-16T01:26:22.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0e03340740 1 -- 172.21.15.63:0/3944975225 shutdown_connections 2024-09-16T01:26:22.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0e03340740 1 --2- 172.21.15.63:0/3944975225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cc8f50 0x5578a2cdeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0e03340740 1 --2- 172.21.15.63:0/3944975225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cbc360 0x5578a2cde860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0e03340740 1 --2- 172.21.15.63:0/3944975225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbba40 0x5578a2cb7160 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0e03340740 1 -- 172.21.15.63:0/3944975225 >> 172.21.15.63:0/3944975225 conn(0x5578a2cb80f0 msgr2=0x5578a2cb6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0e03340740 1 -- 172.21.15.63:0/3944975225 shutdown_connections 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.885+0000 7f0e03340740 1 -- 172.21.15.63:0/3944975225 wait complete. 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0e03340740 1 -- start start 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0e03340740 1 Processor -- start 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0e03340740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0e03340740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbc360 0x5578a2cce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0e03340740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cc8f50 0x5578a2d40830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0e03340740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1a9840 con 0x5578a2cbba40 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0e03340740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1aacb0 con 0x5578a2cc8f50 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0e03340740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1a9f10 con 0x5578a2cbc360 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0e03340740 10 client.0 _ll_register_callbacks cb 0x7f0dec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:22.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0df9d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbc360 0x5578a2cce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48918/0 (socket says 172.21.15.63:48918) 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0df9d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbc360 0x5578a2cce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:46168/0 (socket says 172.21.15.63:46168) 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0dfa59c640 1 -- 172.21.15.63:0/3491572532 learned_addr learned my addr 172.21.15.63:0/3491572532 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.886+0000 7f0dfad9d640 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cc8f50 0x5578a2d40830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0dfa59c640 1 -- 172.21.15.63:0/3491572532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbc360 msgr2=0x5578a2cce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0dfa59c640 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbc360 0x5578a2cce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0dfa59c640 1 -- 172.21.15.63:0/3491572532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cc8f50 msgr2=0x5578a2d40830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0dfa59c640 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cc8f50 0x5578a2d40830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0dfa59c640 1 -- 172.21.15.63:0/3491572532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578a2d40d70 con 0x5578a2cbba40 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0dfa59c640 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cce380 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0dec048040 tx=0x7f0dec03ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72e6639f1bca7fa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:22.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0de1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0de1ffb640 1 -- 172.21.15.63:0/3491572532 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec061060 con 0x5578a2cbba40 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0de1ffb640 1 -- 172.21.15.63:0/3491572532 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0dec004de0 con 0x5578a2cbba40 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0e03340740 1 -- 172.21.15.63:0/3491572532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dec031640 con 0x5578a2cbba40 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0de1ffb640 1 -- 172.21.15.63:0/3491572532 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0dec056070 con 0x5578a2cbba40 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0e03340740 10 client.15663 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0e03340740 1 -- 172.21.15.63:0/3491572532 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5578a2d41fb0 con 0x5578a2cbba40 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.887+0000 7f0de1ffb640 1 -- 172.21.15.63:0/3491572532 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0dec031640 con 0x5578a2cbba40 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.888+0000 7f0de1ffb640 1 -- 172.21.15.63:0/3491572532 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0dec066070 con 0x5578a2cbba40 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.888+0000 7f0e03340740 10 client.15663 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.888+0000 7f0e03340740 10 client.15663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.888+0000 7f0e03340740 20 client.15663 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:22.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.888+0000 7f0e03340740 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5578a2d425b0 0x5578a2d449d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:22.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.888+0000 7f0e03340740 4 client.15663 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-16T01:26:22.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.888+0000 7f0e03340740 1 -- 172.21.15.63:0/3491572532 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5578a2c28d00 con 0x5578a2d425b0 2024-09-16T01:26:22.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.888+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5578a2d425b0 0x5578a2d449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:22.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.888+0000 7f0df9d9b640 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5578a2d425b0 0x5578a2d449d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39d76620f187272b server_cookie=42eb91fd63cdf55f in_seq=0 out_seq=0 2024-09-16T01:26:22.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.888+0000 7f0de1ffb640 10 client.15663 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0de1ffb640 1 -- 172.21.15.63:0/3491572532 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5578a2c28d00 con 0x5578a2d425b0 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0de1ffb640 10 client.15663 handle_command_reply: tid=0 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 client.15663 shutdown 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 -- 172.21.15.63:0/3491572532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 msgr2=0x5578a2cce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cce380 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0dec048040 tx=0x7f0dec03ddf0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 -- 172.21.15.63:0/3491572532 shutdown_connections 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5578a2cc8f50 0x5578a2d40830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578a2cbc360 0x5578a2cce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x5578a2d425b0 0x5578a2d449d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 --2- 172.21.15.63:0/3491572532 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5578a2cbba40 0x5578a2cce380 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 -- 172.21.15.63:0/3491572532 >> 172.21.15.63:0/3491572532 conn(0x5578a2cb80f0 msgr2=0x5578a2cb7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:22.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0de1ffb640 0 client.15663 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:22.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 -- 172.21.15.63:0/3491572532 shutdown_connections 2024-09-16T01:26:22.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 1 -- 172.21.15.63:0/3491572532 wait complete. 2024-09-16T01:26:22.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.890+0000 7f0e03340740 20 client.15663 trim_cache size 0 max 16384 2024-09-16T01:26:22.896 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:26:22.896 INFO:teuthology.orchestra.run.smithi063.stdout: "return_code": 0, 2024-09-16T01:26:22.896 INFO:teuthology.orchestra.run.smithi063.stdout: "scrub_tag": "491aed7c-d121-43fa-8827-93077ca44da4", 2024-09-16T01:26:22.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": "asynchronous" 2024-09-16T01:26:22.896 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:26:22.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 -- 172.21.15.63:0/222754032 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de40a3240 msgr2=0x7f0de40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:22.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de40a3240 0x7f0de40a5700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0df000f790 tx=0x7f0df0018000 comp rx=0 tx=0).stop 2024-09-16T01:26:22.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 -- 172.21.15.63:0/222754032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102ef0 msgr2=0x7f0dfc19bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:22.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc19bba0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0df400eb10 tx=0x7f0df400c2d0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 -- 172.21.15.63:0/222754032 shutdown_connections 2024-09-16T01:26:22.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0de40a3240 0x7f0de40a5700 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dfc102ef0 0x7f0dfc19bba0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc102570 0x7f0dfc197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 --2- 172.21.15.63:0/222754032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0dfc100e20 0x7f0dfc1972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:22.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 -- 172.21.15.63:0/222754032 >> 172.21.15.63:0/222754032 conn(0x7f0dfc0fc7d0 msgr2=0x7f0dfc0fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:22.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 -- 172.21.15.63:0/222754032 shutdown_connections 2024-09-16T01:26:22.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:22.891+0000 7f0e00f67640 1 -- 172.21.15.63:0/222754032 wait complete. 2024-09-16T01:26:23.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:23 smithi063 ceph-mon[31070]: pgmap v426: 97 pgs: 97 active+clean; 143 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 339 op/s 2024-09-16T01:26:23.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:23 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:26:23.359 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:23 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:23 smithi192 ceph-mon[34775]: pgmap v426: 97 pgs: 97 active+clean; 143 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 339 op/s 2024-09-16T01:26:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:23 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:26:23.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:23 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:23 smithi162 ceph-mon[34539]: pgmap v426: 97 pgs: 97 active+clean; 143 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 339 op/s 2024-09-16T01:26:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:23 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:26:23.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:23 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:23.707 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:26:23.976 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub queued for path: / 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:26:24.360 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:26:24.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:26:24.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:26:24.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: active paths [/] 2024-09-16T01:26:24.361 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:24 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub queued for path: / 2024-09-16T01:26:24.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:26:24.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:26:24.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:26:24.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: active paths [/] 2024-09-16T01:26:24.425 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:24 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub queued for path: / 2024-09-16T01:26:24.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:26:24.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:26:24.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: active paths [/] 2024-09-16T01:26:24.435 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:24 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:24.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 -- 172.21.15.63:0/1885057501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1058101e10 msgr2=0x7f10581021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:24.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 --2- 172.21.15.63:0/1885057501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1058101e10 0x7f10581021f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1048009900 tx=0x7f104802a410 comp rx=0 tx=0).stop 2024-09-16T01:26:24.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 -- 172.21.15.63:0/1885057501 shutdown_connections 2024-09-16T01:26:24.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 --2- 172.21.15.63:0/1885057501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058106f40 0x7f105810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 --2- 172.21.15.63:0/1885057501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10581027c0 0x7f1058106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 --2- 172.21.15.63:0/1885057501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1058101e10 0x7f10581021f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 -- 172.21.15.63:0/1885057501 >> 172.21.15.63:0/1885057501 conn(0x7f10580fd8d0 msgr2=0x7f10580ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 -- 172.21.15.63:0/1885057501 shutdown_connections 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 -- 172.21.15.63:0/1885057501 wait complete. 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 Processor -- start 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.499+0000 7f105e8fc640 1 -- start start 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f105e8fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058101e10 0x7f10580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f105e8fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10581027c0 0x7f1058074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f105e8fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1058106f40 0x7f1058074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f105e8fc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1058111e50 con 0x7f1058106f40 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f105e8fc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1058111cd0 con 0x7f1058101e10 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f105e8fc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1058111fd0 con 0x7f10581027c0 2024-09-16T01:26:24.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f1057fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058101e10 0x7f10580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f105ce99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1058106f40 0x7f1058074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f1057fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058101e10 0x7f10580744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:54926/0 (socket says 172.21.15.63:54926) 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f1057fff640 1 -- 172.21.15.63:0/3958276118 learned_addr learned my addr 172.21.15.63:0/3958276118 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f10577fe640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10581027c0 0x7f1058074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f1057fff640 1 -- 172.21.15.63:0/3958276118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10581027c0 msgr2=0x7f1058074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f1057fff640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10581027c0 0x7f1058074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f1057fff640 1 -- 172.21.15.63:0/3958276118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1058106f40 msgr2=0x7f1058074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f1057fff640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1058106f40 0x7f1058074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f1057fff640 1 -- 172.21.15.63:0/3958276118 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10581a68b0 con 0x7f1058101e10 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.500+0000 7f10577fe640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10581027c0 0x7f1058074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.501+0000 7f1057fff640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058101e10 0x7f10580744f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1048005940 tx=0x7f10480040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.501+0000 7f10557fa640 1 -- 172.21.15.63:0/3958276118 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104803f030 con 0x7f1058101e10 2024-09-16T01:26:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.501+0000 7f105e8fc640 1 -- 172.21.15.63:0/3958276118 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10581a6b40 con 0x7f1058101e10 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.501+0000 7f10557fa640 1 -- 172.21.15.63:0/3958276118 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f10480044c0 con 0x7f1058101e10 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.501+0000 7f10557fa640 1 -- 172.21.15.63:0/3958276118 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048035070 con 0x7f1058101e10 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.501+0000 7f105e8fc640 1 -- 172.21.15.63:0/3958276118 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10581a7070 con 0x7f1058101e10 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.503+0000 7f1060cd5740 1 Processor -- start 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f1060cd5740 1 -- start start 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f10557fa640 1 -- 172.21.15.63:0/3958276118 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1048042030 con 0x7f1058101e10 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 0x557bbcda2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda2dc0 0x557bbcdad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcdad680 0x557bbcdafa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f1060cd5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557bbcd082e0 con 0x557bbcda2dc0 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f1060cd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557bbccafce0 con 0x557bbcda24a0 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f1060cd5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557bbcd042a0 con 0x557bbcdad680 2024-09-16T01:26:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f105ce99640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 0x557bbcda2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f105ce99640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 0x557bbcda2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.63:54942/0 (socket says 172.21.15.63:54942) 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f1057fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda2dc0 0x557bbcdad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f105ce99640 1 -- 172.21.15.63:0/1419584678 learned_addr learned my addr 172.21.15.63:0/1419584678 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f10577fe640 1 --2- 172.21.15.63:0/1419584678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcdad680 0x557bbcdafa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f105ce99640 1 -- 172.21.15.63:0/1419584678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcdad680 msgr2=0x557bbcdafa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f105ce99640 1 --2- 172.21.15.63:0/1419584678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcdad680 0x557bbcdafa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f105ce99640 1 -- 172.21.15.63:0/1419584678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda2dc0 msgr2=0x557bbcdad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f105ce99640 1 --2- 172.21.15.63:0/1419584678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda2dc0 0x557bbcdad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f105ce99640 1 -- 172.21.15.63:0/1419584678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bbcc94440 con 0x557bbcda24a0 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.504+0000 7f1057fff640 1 --2- 172.21.15.63:0/1419584678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda2dc0 0x557bbcdad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.505+0000 7f105ce99640 1 --2- 172.21.15.63:0/1419584678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 0x557bbcda2880 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1050009f50 tx=0x7f10500118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a266f429a4677f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.505+0000 7f10557fa640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f10400a3240 0x7f10400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.505+0000 7f103e7fc640 1 -- 172.21.15.63:0/1419584678 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050004d20 con 0x557bbcda24a0 2024-09-16T01:26:24.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.505+0000 7f1057fff640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f10400a3240 0x7f10400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.505+0000 7f10557fa640 1 -- 172.21.15.63:0/3958276118 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f10480efc20 con 0x7f1058101e10 2024-09-16T01:26:24.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.505+0000 7f103e7fc640 1 -- 172.21.15.63:0/1419584678 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1050004050 con 0x557bbcda24a0 2024-09-16T01:26:24.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.505+0000 7f103e7fc640 1 -- 172.21.15.63:0/1419584678 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050005280 con 0x557bbcda24a0 2024-09-16T01:26:24.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1060cd5740 1 -- 172.21.15.63:0/1419584678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 msgr2=0x557bbcda2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:24.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1057fff640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f10400a3240 0x7f10400a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f10480b8750 tx=0x7f10480f36a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:24.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1060cd5740 1 --2- 172.21.15.63:0/1419584678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 0x557bbcda2880 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1050009f50 tx=0x7f10500118d0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1060cd5740 1 -- 172.21.15.63:0/1419584678 shutdown_connections 2024-09-16T01:26:24.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1060cd5740 1 --2- 172.21.15.63:0/1419584678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcdad680 0x557bbcdafa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1060cd5740 1 --2- 172.21.15.63:0/1419584678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda2dc0 0x557bbcdad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1060cd5740 1 --2- 172.21.15.63:0/1419584678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 0x557bbcda2880 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1060cd5740 1 -- 172.21.15.63:0/1419584678 >> 172.21.15.63:0/1419584678 conn(0x557bbcd9ea30 msgr2=0x557bbcd9ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1060cd5740 1 -- 172.21.15.63:0/1419584678 shutdown_connections 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1060cd5740 1 -- 172.21.15.63:0/1419584678 wait complete. 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.506+0000 7f1060cd5740 1 -- start start 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f1060cd5740 1 Processor -- start 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 0x557bbcdacf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 0x557bbcdaa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcdad680 0x557bbcdaa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f1060cd5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557bbcdb0250 con 0x557bbcdad680 2024-09-16T01:26:24.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f1060cd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557bbccc3050 con 0x557bbcda24a0 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f1060cd5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557bbcdb03d0 con 0x557bbcda2dc0 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f1060cd5740 10 client.0 _ll_register_callbacks cb 0x557bbcd03160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f10577fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 0x557bbcdaa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f105ce99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcdad680 0x557bbcdaa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f10577fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 0x557bbcdaa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.63:46212/0 (socket says 172.21.15.63:46212) 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f10577fe640 1 -- 172.21.15.63:0/3156136464 learned_addr learned my addr 172.21.15.63:0/3156136464 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.507+0000 7f105ce99640 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 0x557bbcdacf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f10577fe640 1 -- 172.21.15.63:0/3156136464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 msgr2=0x557bbcdacf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f10577fe640 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 0x557bbcdacf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f10577fe640 1 -- 172.21.15.63:0/3156136464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcdad680 msgr2=0x557bbcdaa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f10577fe640 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcdad680 0x557bbcdaa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f10577fe640 1 -- 172.21.15.63:0/3156136464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bbca793c0 con 0x557bbcda2dc0 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f105ce99640 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcdad680 0x557bbcdaa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f10577fe640 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 0x557bbcdaa220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f104c0129f0 tx=0x7f104c012eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69ef2b9f0276adde server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f10377fe640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f10377fe640 1 -- 172.21.15.63:0/3156136464 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c00fa40 con 0x557bbcda2dc0 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f10377fe640 1 -- 172.21.15.63:0/3156136464 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f104c00fbe0 con 0x557bbcda2dc0 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f1060cd5740 1 -- 172.21.15.63:0/3156136464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1050004050 con 0x557bbcda2dc0 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f10377fe640 1 -- 172.21.15.63:0/3156136464 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f104c00fe20 con 0x557bbcda2dc0 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f1060cd5740 10 client.25255 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.508+0000 7f1060cd5740 1 -- 172.21.15.63:0/3156136464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557bbcdbbc50 con 0x557bbcda2dc0 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f10377fe640 1 -- 172.21.15.63:0/3156136464 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1050004050 con 0x557bbcda2dc0 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f10377fe640 1 -- 172.21.15.63:0/3156136464 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f104c003c60 con 0x557bbcda2dc0 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f1060cd5740 10 client.25255 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f1060cd5740 10 client.25255 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f1060cd5740 20 client.25255 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557bbcdbd1b0 0x557bbcdbf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f1060cd5740 4 client.25255 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f1060cd5740 1 -- 172.21.15.63:0/3156136464 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bbcd15850 con 0x557bbcdbd1b0 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f105ce99640 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557bbcdbd1b0 0x557bbcdbf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f105ce99640 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557bbcdbd1b0 0x557bbcdbf5a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eb38c25009e354f server_cookie=af9fc9ca087573ba in_seq=0 out_seq=0 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.509+0000 7f10377fe640 10 client.25255 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f10377fe640 1 -- 172.21.15.63:0/3156136464 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557bbcd15850 con 0x557bbcdbd1b0 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f10377fe640 10 client.25255 handle_command_reply: tid=0 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 client.25255 shutdown 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 -- 172.21.15.63:0/3156136464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 msgr2=0x557bbcdaa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 0x557bbcdaa220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f104c0129f0 tx=0x7f104c012eb0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 -- 172.21.15.63:0/3156136464 shutdown_connections 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557bbcdbd1b0 0x557bbcdbf5a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcdad680 0x557bbcdaa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 0x557bbcdaa220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3156136464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda24a0 0x557bbcdacf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f10377fe640 0 client.25255 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 -- 172.21.15.63:0/3156136464 >> 172.21.15.63:0/3156136464 conn(0x557bbcd9ea30 msgr2=0x557bbcd9db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 -- 172.21.15.63:0/3156136464 shutdown_connections 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 1 -- 172.21.15.63:0/3156136464 wait complete. 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.511+0000 7f1060cd5740 20 client.25255 trim_cache size 0 max 16384 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f1060cd5740 1 Processor -- start 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f1060cd5740 1 -- start start 2024-09-16T01:26:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 0x557bbcda5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcdad680 0x557bbcdac190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f1060cd5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f10581b20a0 con 0x557bbcda24a0 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f1060cd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10581af8b0 con 0x557bbcdad680 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f1060cd5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f10581ad6e0 con 0x557bbcda2dc0 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f105ce99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f105ce99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48970/0 (socket says 172.21.15.63:48970) 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f105ce99640 1 -- 172.21.15.63:0/3661350158 learned_addr learned my addr 172.21.15.63:0/3661350158 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f10577fe640 1 --2- 172.21.15.63:0/3661350158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 0x557bbcda5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.530+0000 7f105ce99640 1 --2- 172.21.15.63:0/3661350158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcdad680 0x557bbcdac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.531+0000 7f105ce99640 1 -- 172.21.15.63:0/3661350158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 msgr2=0x557bbcda5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:24.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.531+0000 7f105ce99640 1 --2- 172.21.15.63:0/3661350158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 0x557bbcda5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.531+0000 7f105ce99640 1 -- 172.21.15.63:0/3661350158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcdad680 msgr2=0x557bbcdac190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.531+0000 7f105ce99640 1 --2- 172.21.15.63:0/3661350158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcdad680 0x557bbcdac190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.531+0000 7f105ce99640 1 -- 172.21.15.63:0/3661350158 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bbcd9fae0 con 0x557bbcda24a0 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.531+0000 7f105ce99640 1 --2- 172.21.15.63:0/3661350158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb94e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1050011dd0 tx=0x7f10500047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2193ceee59717c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.531+0000 7f103dffb640 1 -- 172.21.15.63:0/3661350158 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050004280 con 0x557bbcda24a0 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.531+0000 7f103dffb640 1 -- 172.21.15.63:0/3661350158 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1050004420 con 0x557bbcda24a0 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.531+0000 7f103dffb640 1 -- 172.21.15.63:0/3661350158 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10500053d0 con 0x557bbcda24a0 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 -- 172.21.15.63:0/3661350158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 msgr2=0x557bbcdb94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3661350158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb94e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1050011dd0 tx=0x7f10500047b0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 -- 172.21.15.63:0/3661350158 shutdown_connections 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3661350158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcdad680 0x557bbcdac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3661350158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcda2dc0 0x557bbcda5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3661350158 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb94e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 -- 172.21.15.63:0/3661350158 >> 172.21.15.63:0/3661350158 conn(0x557bbcd9ea30 msgr2=0x557bbcdaba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 -- 172.21.15.63:0/3661350158 shutdown_connections 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 -- 172.21.15.63:0/3661350158 wait complete. 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 -- start start 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.532+0000 7f1060cd5740 1 Processor -- start 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda2dc0 0x557bbcdb5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f1060cd5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcdad680 0x557bbcdb0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f1060cd5740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f10581add70 con 0x557bbcda24a0 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f1060cd5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10581af1e0 con 0x557bbcda2dc0 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f1060cd5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f10581ae440 con 0x557bbcdad680 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f1060cd5740 10 client.0 _ll_register_callbacks cb 0x7f104c009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f105ce99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f105ce99640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48976/0 (socket says 172.21.15.63:48976) 2024-09-16T01:26:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f105ce99640 1 -- 172.21.15.63:0/3157543959 learned_addr learned my addr 172.21.15.63:0/3157543959 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f10577fe640 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda2dc0 0x557bbcdb5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f105ce99640 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcdad680 0x557bbcdb0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f105ce99640 1 -- 172.21.15.63:0/3157543959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcdad680 msgr2=0x557bbcdb0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f105ce99640 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcdad680 0x557bbcdb0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f105ce99640 1 -- 172.21.15.63:0/3157543959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda2dc0 msgr2=0x557bbcdb5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f105ce99640 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda2dc0 0x557bbcdb5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f105ce99640 1 -- 172.21.15.63:0/3157543959 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bbcdb15d0 con 0x557bbcda24a0 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f10577fe640 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda2dc0 0x557bbcdb5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f105ce99640 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb59a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1050009270 tx=0x7f10500096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26db09dfd15ee442 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.533+0000 7f10377fe640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f10377fe640 1 -- 172.21.15.63:0/3157543959 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10500045d0 con 0x557bbcda24a0 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f10377fe640 1 -- 172.21.15.63:0/3157543959 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f1050004d40 con 0x557bbcda24a0 2024-09-16T01:26:24.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f1060cd5740 1 -- 172.21.15.63:0/3157543959 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1050004420 con 0x557bbcda24a0 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f10377fe640 1 -- 172.21.15.63:0/3157543959 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1050004f40 con 0x557bbcda24a0 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f1060cd5740 10 client.15681 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f1060cd5740 1 -- 172.21.15.63:0/3157543959 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557bbce27a40 con 0x557bbcda24a0 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f10377fe640 1 -- 172.21.15.63:0/3157543959 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1050004420 con 0x557bbcda24a0 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f10377fe640 1 -- 172.21.15.63:0/3157543959 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1050041050 con 0x557bbcda24a0 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f1060cd5740 10 client.15681 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f1060cd5740 10 client.15681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f1060cd5740 20 client.15681 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557bbcdbd1b0 0x557bbce29e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f1060cd5740 4 client.15681 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f1060cd5740 1 -- 172.21.15.63:0/3157543959 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557bbcd0fd60 con 0x557bbcdbd1b0 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.534+0000 7f10577fe640 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557bbcdbd1b0 0x557bbce29e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:24.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f10577fe640 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557bbcdbd1b0 0x557bbce29e70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55a995b90aa450f1 server_cookie=c0fe528e6dc5dd7f in_seq=0 out_seq=0 2024-09-16T01:26:24.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f10377fe640 10 client.15681 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:24.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f10377fe640 1 -- 172.21.15.63:0/3157543959 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557bbcd0fd60 con 0x557bbcdbd1b0 2024-09-16T01:26:24.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f10377fe640 10 client.15681 handle_command_reply: tid=0 2024-09-16T01:26:24.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f1060cd5740 1 client.15681 shutdown 2024-09-16T01:26:24.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f1060cd5740 1 -- 172.21.15.63:0/3157543959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 msgr2=0x557bbcdb59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:24.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb59a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1050009270 tx=0x7f10500096c0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f1060cd5740 1 -- 172.21.15.63:0/3157543959 shutdown_connections 2024-09-16T01:26:24.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557bbcdad680 0x557bbcdb0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557bbcda2dc0 0x557bbcdb5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.535+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x557bbcdbd1b0 0x557bbce29e70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.724 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:26:24.724 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-16T01:26:24.724 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": { 2024-09-16T01:26:24.724 INFO:teuthology.orchestra.run.smithi063.stdout: "491aed7c-d121-43fa-8827-93077ca44da4": { 2024-09-16T01:26:24.724 INFO:teuthology.orchestra.run.smithi063.stdout: "path": "/", 2024-09-16T01:26:24.724 INFO:teuthology.orchestra.run.smithi063.stdout: "tag": "491aed7c-d121-43fa-8827-93077ca44da4", 2024-09-16T01:26:24.724 INFO:teuthology.orchestra.run.smithi063.stdout: "options": "recursive,force" 2024-09-16T01:26:24.724 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:26:24.724 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:26:24.724 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f1060cd5740 1 --2- 172.21.15.63:0/3157543959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557bbcda24a0 0x557bbcdb59a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f10377fe640 0 client.15681 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f1060cd5740 1 -- 172.21.15.63:0/3157543959 >> 172.21.15.63:0/3157543959 conn(0x557bbcd9ea30 msgr2=0x557bbcd9d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f1060cd5740 1 -- 172.21.15.63:0/3157543959 shutdown_connections 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f1060cd5740 1 -- 172.21.15.63:0/3157543959 wait complete. 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f1060cd5740 20 client.15681 trim_cache size 0 max 16384 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 -- 172.21.15.63:0/3958276118 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f10400a3240 msgr2=0x7f10400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f10400a3240 0x7f10400a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f10480b8750 tx=0x7f10480f36a0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 -- 172.21.15.63:0/3958276118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058101e10 msgr2=0x7f10580744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058101e10 0x7f10580744f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1048005940 tx=0x7f10480040c0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 -- 172.21.15.63:0/3958276118 shutdown_connections 2024-09-16T01:26:24.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f10400a3240 0x7f10400a5700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1058106f40 0x7f1058074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10581027c0 0x7f1058074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 --2- 172.21.15.63:0/3958276118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058101e10 0x7f10580744f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:24.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 -- 172.21.15.63:0/3958276118 >> 172.21.15.63:0/3958276118 conn(0x7f10580fd8d0 msgr2=0x7f10580fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:24.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.536+0000 7f105e8fc640 1 -- 172.21.15.63:0/3958276118 shutdown_connections 2024-09-16T01:26:24.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:24.537+0000 7f105e8fc640 1 -- 172.21.15.63:0/3958276118 wait complete. 2024-09-16T01:26:25.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:25 smithi192 ceph-mon[34775]: pgmap v427: 97 pgs: 97 active+clean; 142 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 287 op/s 2024-09-16T01:26:25.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:25 smithi192 ceph-mon[34775]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:25.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:25 smithi162 ceph-mon[34539]: pgmap v427: 97 pgs: 97 active+clean; 142 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 287 op/s 2024-09-16T01:26:25.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:25 smithi162 ceph-mon[34539]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:25.553 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:25 smithi063 ceph-mon[31070]: pgmap v427: 97 pgs: 97 active+clean; 142 MiB data, 646 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 287 op/s 2024-09-16T01:26:25.553 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:25 smithi063 ceph-mon[31070]: scrub summary: idle+waiting paths [/] 2024-09-16T01:26:25.583 INFO:tasks.cephfs.filesystem:scrub status for tag:491aed7c-d121-43fa-8827-93077ca44da4 - {'path': '/', 'tag': '491aed7c-d121-43fa-8827-93077ca44da4', 'options': 'recursive,force'} 2024-09-16T01:26:27.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:27 smithi192 ceph-mon[34775]: pgmap v428: 97 pgs: 97 active+clean; 141 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 1021 KiB/s wr, 267 op/s 2024-09-16T01:26:27.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:27 smithi162 ceph-mon[34539]: pgmap v428: 97 pgs: 97 active+clean; 141 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 1021 KiB/s wr, 267 op/s 2024-09-16T01:26:27.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:27 smithi063 ceph-mon[31070]: pgmap v428: 97 pgs: 97 active+clean; 141 MiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 1021 KiB/s wr, 267 op/s 2024-09-16T01:26:29.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:29 smithi192 ceph-mon[34775]: pgmap v429: 97 pgs: 97 active+clean; 141 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 338 op/s 2024-09-16T01:26:29.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:29 smithi162 ceph-mon[34539]: pgmap v429: 97 pgs: 97 active+clean; 141 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 338 op/s 2024-09-16T01:26:29.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:29 smithi063 ceph-mon[31070]: pgmap v429: 97 pgs: 97 active+clean; 141 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 338 op/s 2024-09-16T01:26:29.650 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-16T01:26:29.651 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T01:26:29.970 DEBUG:teuthology.parallel:result is None 2024-09-16T01:26:29.970 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T01:26:30.006 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T01:26:30.006 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-16T01:26:30.016 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-16T01:26:31.423 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:31 smithi192 ceph-mon[34775]: pgmap v430: 97 pgs: 97 active+clean; 141 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 895 KiB/s wr, 242 op/s 2024-09-16T01:26:31.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:31 smithi162 ceph-mon[34539]: pgmap v430: 97 pgs: 97 active+clean; 141 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 895 KiB/s wr, 242 op/s 2024-09-16T01:26:31.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:31 smithi063 ceph-mon[31070]: pgmap v430: 97 pgs: 97 active+clean; 141 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 895 KiB/s wr, 242 op/s 2024-09-16T01:26:33.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:33 smithi192 ceph-mon[34775]: pgmap v431: 97 pgs: 97 active+clean; 139 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-09-16T01:26:33.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:33 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:26:33.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:33 smithi162 ceph-mon[34539]: pgmap v431: 97 pgs: 97 active+clean; 139 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-09-16T01:26:33.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:33 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:26:33.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:33 smithi063 ceph-mon[31070]: pgmap v431: 97 pgs: 97 active+clean; 139 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-09-16T01:26:33.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:33 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:26:34.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:34 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:26:34.701 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:34 smithi192 ceph-mon[34775]: scrub summary: idle 2024-09-16T01:26:34.702 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:34 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:26:34.702 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:34 smithi063 ceph-mon[31070]: scrub summary: idle 2024-09-16T01:26:34.702 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:34 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:26:34.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:34 smithi162 ceph-mon[34539]: scrub summary: idle 2024-09-16T01:26:35.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:35 smithi192 ceph-mon[34775]: pgmap v432: 97 pgs: 97 active+clean; 137 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 962 KiB/s wr, 275 op/s 2024-09-16T01:26:35.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:35 smithi162 ceph-mon[34539]: pgmap v432: 97 pgs: 97 active+clean; 137 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 962 KiB/s wr, 275 op/s 2024-09-16T01:26:35.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:35 smithi063 ceph-mon[31070]: pgmap v432: 97 pgs: 97 active+clean; 137 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 962 KiB/s wr, 275 op/s 2024-09-16T01:26:37.413 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:37 smithi063 ceph-mon[31070]: pgmap v433: 97 pgs: 97 active+clean; 136 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 682 KiB/s wr, 226 op/s 2024-09-16T01:26:37.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:37 smithi192 ceph-mon[34775]: pgmap v433: 97 pgs: 97 active+clean; 136 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 682 KiB/s wr, 226 op/s 2024-09-16T01:26:37.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:37 smithi162 ceph-mon[34539]: pgmap v433: 97 pgs: 97 active+clean; 136 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 682 KiB/s wr, 226 op/s 2024-09-16T01:26:39.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:39 smithi192 ceph-mon[34775]: pgmap v434: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 682 KiB/s wr, 214 op/s 2024-09-16T01:26:39.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:39 smithi162 ceph-mon[34539]: pgmap v434: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 682 KiB/s wr, 214 op/s 2024-09-16T01:26:39.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:39 smithi063 ceph-mon[31070]: pgmap v434: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 682 KiB/s wr, 214 op/s 2024-09-16T01:26:40.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:26:40.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:26:40.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:26:41.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:41 smithi192 ceph-mon[34775]: pgmap v435: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 311 KiB/s wr, 115 op/s 2024-09-16T01:26:41.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:26:41.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:26:41.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:26:41.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:41 smithi162 ceph-mon[34539]: pgmap v435: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 311 KiB/s wr, 115 op/s 2024-09-16T01:26:41.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:26:41.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:26:41.434 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:26:41.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:41 smithi063 ceph-mon[31070]: pgmap v435: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 311 KiB/s wr, 115 op/s 2024-09-16T01:26:41.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:26:41.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:26:41.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:26:43.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:43 smithi192 ceph-mon[34775]: pgmap v436: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 312 KiB/s wr, 118 op/s 2024-09-16T01:26:43.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:43 smithi162 ceph-mon[34539]: pgmap v436: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 312 KiB/s wr, 118 op/s 2024-09-16T01:26:43.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:43 smithi063 ceph-mon[31070]: pgmap v436: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 312 KiB/s wr, 118 op/s 2024-09-16T01:26:45.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:45 smithi192 ceph-mon[34775]: pgmap v437: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.8 KiB/s wr, 38 op/s 2024-09-16T01:26:45.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:45 smithi162 ceph-mon[34539]: pgmap v437: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.8 KiB/s wr, 38 op/s 2024-09-16T01:26:45.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:45 smithi063 ceph-mon[31070]: pgmap v437: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.8 KiB/s wr, 38 op/s 2024-09-16T01:26:46.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:46 smithi192 ceph-mon[34775]: pgmap v438: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-16T01:26:46.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:46 smithi162 ceph-mon[34539]: pgmap v438: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-16T01:26:46.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:46 smithi063 ceph-mon[31070]: pgmap v438: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-16T01:26:48.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:48 smithi063 ceph-mon[31070]: pgmap v439: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-16T01:26:48.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:48 smithi192 ceph-mon[34775]: pgmap v439: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-16T01:26:48.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:48 smithi162 ceph-mon[34539]: pgmap v439: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-16T01:26:50.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:50 smithi063 ceph-mon[31070]: pgmap v440: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-16T01:26:50.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:50 smithi192 ceph-mon[34775]: pgmap v440: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-16T01:26:50.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:50 smithi162 ceph-mon[34539]: pgmap v440: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-16T01:26:52.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:52 smithi063 ceph-mon[31070]: pgmap v441: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-16T01:26:52.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:52 smithi192 ceph-mon[34775]: pgmap v441: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-16T01:26:52.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:52 smithi162 ceph-mon[34539]: pgmap v441: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-16T01:26:54.614 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:54 smithi063 ceph-mon[31070]: pgmap v442: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:26:54.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:54 smithi192 ceph-mon[34775]: pgmap v442: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:26:54.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:54 smithi162 ceph-mon[34539]: pgmap v442: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:26:55.584 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-16T01:26:55.856 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:26:56.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.362+0000 7f54d2d94640 1 -- 172.21.15.63:0/4214663127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54cc102570 msgr2=0x7f54cc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:56.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.362+0000 7f54d2d94640 1 --2- 172.21.15.63:0/4214663127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54cc102570 0x7f54cc1029b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009900 tx=0x7f54bc02a480 comp rx=0 tx=0).stop 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.362+0000 7f54d2d94640 1 -- 172.21.15.63:0/4214663127 shutdown_connections 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.362+0000 7f54d2d94640 1 --2- 172.21.15.63:0/4214663127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc102ef0 0x7f54cc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.362+0000 7f54d2d94640 1 --2- 172.21.15.63:0/4214663127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54cc102570 0x7f54cc1029b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.362+0000 7f54d2d94640 1 --2- 172.21.15.63:0/4214663127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc100e20 0x7f54cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.362+0000 7f54d2d94640 1 -- 172.21.15.63:0/4214663127 >> 172.21.15.63:0/4214663127 conn(0x7f54cc0fc7d0 msgr2=0x7f54cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.362+0000 7f54d2d94640 1 -- 172.21.15.63:0/4214663127 shutdown_connections 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.362+0000 7f54d2d94640 1 -- 172.21.15.63:0/4214663127 wait complete. 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.362+0000 7f54d2d94640 1 Processor -- start 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54d2d94640 1 -- start start 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54d2d94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc100e20 0x7f54cc1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54d2d94640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54cc102570 0x7f54cc197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54d2d94640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc102ef0 0x7f54cc19bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54d2d94640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc110e30 con 0x7f54cc102570 2024-09-16T01:26:56.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54d2d94640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc110cb0 con 0x7f54cc102ef0 2024-09-16T01:26:56.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54d2d94640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc110fb0 con 0x7f54cc100e20 2024-09-16T01:26:56.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54cc102570 0x7f54cc197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54cc102570 0x7f54cc197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37060/0 (socket says 172.21.15.63:37060) 2024-09-16T01:26:56.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54c3fff640 1 -- 172.21.15.63:0/1143721058 learned_addr learned my addr 172.21.15.63:0/1143721058 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:56.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54d1331640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc102ef0 0x7f54cc19bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54d0b30640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc100e20 0x7f54cc1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54c3fff640 1 -- 172.21.15.63:0/1143721058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc100e20 msgr2=0x7f54cc1972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:56.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54c3fff640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc100e20 0x7f54cc1972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54c3fff640 1 -- 172.21.15.63:0/1143721058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc102ef0 msgr2=0x7f54cc19bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54c3fff640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc102ef0 0x7f54cc19bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54c3fff640 1 -- 172.21.15.63:0/1143721058 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc19c2a0 con 0x7f54cc102570 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.363+0000 7f54d1331640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc102ef0 0x7f54cc19bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.364+0000 7f54c3fff640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54cc102570 0x7f54cc197830 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f54bc006010 tx=0x7f54bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.364+0000 7f54c1ffb640 1 -- 172.21.15.63:0/1143721058 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc046070 con 0x7f54cc102570 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.364+0000 7f54c1ffb640 1 -- 172.21.15.63:0/1143721058 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54bc003aa0 con 0x7f54cc102570 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.364+0000 7f54d2d94640 1 -- 172.21.15.63:0/1143721058 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc19c530 con 0x7f54cc102570 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.364+0000 7f54c1ffb640 1 -- 172.21.15.63:0/1143721058 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc035050 con 0x7f54cc102570 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.364+0000 7f54d2d94640 1 -- 172.21.15.63:0/1143721058 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc069f70 con 0x7f54cc102570 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.366+0000 7f54c1ffb640 1 -- 172.21.15.63:0/1143721058 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f54bc049070 con 0x7f54cc102570 2024-09-16T01:26:56.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.366+0000 7f54d516d740 1 Processor -- start 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d516d740 1 -- start start 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d516d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c554a0 0x555a92c55880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d516d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c55dc0 0x555a92c60140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d516d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c62a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d516d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555a92bbb2e0 con 0x555a92c554a0 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d516d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555a92b62ce0 con 0x555a92c60680 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d516d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555a92bb72a0 con 0x555a92c55dc0 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54c1ffb640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54b40a32c0 0x7f54b40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d1331640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c554a0 0x555a92c55880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d1331640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c554a0 0x555a92c55880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37074/0 (socket says 172.21.15.63:37074) 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d1331640 1 -- 172.21.15.63:0/2462426927 learned_addr learned my addr 172.21.15.63:0/2462426927 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54c1ffb640 1 -- 172.21.15.63:0/1143721058 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f54bc0f13e0 con 0x7f54cc102570 2024-09-16T01:26:56.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d1331640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54b40a32c0 0x7f54b40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54c3fff640 1 --2- 172.21.15.63:0/2462426927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c62a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d1331640 1 -- 172.21.15.63:0/2462426927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c55dc0 msgr2=0x555a92c60140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d1331640 1 --2- 172.21.15.63:0/2462426927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c55dc0 0x555a92c60140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d1331640 1 -- 172.21.15.63:0/2462426927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 msgr2=0x555a92c62a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d1331640 1 --2- 172.21.15.63:0/2462426927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c62a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.367+0000 7f54d1331640 1 -- 172.21.15.63:0/2462426927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a92b47440 con 0x555a92c554a0 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.368+0000 7f54d1331640 1 --2- 172.21.15.63:0/2462426927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c554a0 0x555a92c55880 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f54c4013b20 tx=0x7f54c4011380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3649c0afeeec7ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.368+0000 7f54d1331640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54b40a32c0 0x7f54b40a5780 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f54c4011880 tx=0x7f54c401d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.368+0000 7f54b2ffd640 1 -- 172.21.15.63:0/2462426927 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c401cbe0 con 0x555a92c554a0 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.368+0000 7f54b2ffd640 1 -- 172.21.15.63:0/2462426927 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54c4021030 con 0x555a92c554a0 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.368+0000 7f54b2ffd640 1 -- 172.21.15.63:0/2462426927 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4024370 con 0x555a92c554a0 2024-09-16T01:26:56.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 -- 172.21.15.63:0/2462426927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c554a0 msgr2=0x555a92c55880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 --2- 172.21.15.63:0/2462426927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c554a0 0x555a92c55880 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f54c4013b20 tx=0x7f54c4011380 comp rx=0 tx=0).stop 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 -- 172.21.15.63:0/2462426927 shutdown_connections 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 --2- 172.21.15.63:0/2462426927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c62a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 --2- 172.21.15.63:0/2462426927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c55dc0 0x555a92c60140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 --2- 172.21.15.63:0/2462426927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c554a0 0x555a92c55880 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 -- 172.21.15.63:0/2462426927 >> 172.21.15.63:0/2462426927 conn(0x555a92c51a30 msgr2=0x555a92c51e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 -- 172.21.15.63:0/2462426927 shutdown_connections 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 -- 172.21.15.63:0/2462426927 wait complete. 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 -- start start 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.369+0000 7f54d516d740 1 Processor -- start 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d516d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c5ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d516d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c5d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d516d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c5d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d516d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555a92c63250 con 0x555a92c55dc0 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d516d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555a92b76050 con 0x555a92c60680 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d516d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555a92c633d0 con 0x555a92c554a0 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d516d740 10 client.0 _ll_register_callbacks cb 0x555a92bb6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c5d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c5d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37078/0 (socket says 172.21.15.63:37078) 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54c3fff640 1 -- 172.21.15.63:0/3237007 learned_addr learned my addr 172.21.15.63:0/3237007 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d0b30640 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c5ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d1331640 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c5d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54c3fff640 1 -- 172.21.15.63:0/3237007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 msgr2=0x555a92c5ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54c3fff640 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c5ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54c3fff640 1 -- 172.21.15.63:0/3237007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 msgr2=0x555a92c5d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:56.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54c3fff640 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c5d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54c3fff640 1 -- 172.21.15.63:0/3237007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9292c3c0 con 0x555a92c55dc0 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d0b30640 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c5ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54c3fff640 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c5d240 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0b9e60 tx=0x7f54bc0bd420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407e70b5d83abdb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54abfff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54abfff640 1 -- 172.21.15.63:0/3237007 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0d6060 con 0x555a92c55dc0 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54abfff640 1 -- 172.21.15.63:0/3237007 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f54bc003c50 con 0x555a92c55dc0 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.370+0000 7f54d516d740 1 -- 172.21.15.63:0/3237007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54c4021030 con 0x555a92c55dc0 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54abfff640 1 -- 172.21.15.63:0/3237007 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f54bc0c1db0 con 0x555a92c55dc0 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54d516d740 10 client.15693 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54d516d740 1 -- 172.21.15.63:0/3237007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555a92c6ebd0 con 0x555a92c55dc0 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54abfff640 1 -- 172.21.15.63:0/3237007 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54c4021030 con 0x555a92c55dc0 2024-09-16T01:26:56.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54abfff640 1 -- 172.21.15.63:0/3237007 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f54bc0c61e0 con 0x555a92c55dc0 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54d516d740 10 client.15693 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54d516d740 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54d516d740 20 client.15693 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54d516d740 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555a92c70080 0x555a92c72540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54d516d740 4 client.15693 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54d516d740 1 -- 172.21.15.63:0/3237007 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a92bc8850 con 0x555a92c70080 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.371+0000 7f54d0b30640 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555a92c70080 0x555a92c72540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.372+0000 7f54d0b30640 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555a92c70080 0x555a92c72540 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd33ba5e29550a15 server_cookie=aff770bbfc398c08 in_seq=0 out_seq=0 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.372+0000 7f54abfff640 10 client.15693 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.372+0000 7f54abfff640 1 -- 172.21.15.63:0/3237007 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a92bc8850 con 0x555a92c70080 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.372+0000 7f54abfff640 10 client.15693 handle_command_reply: tid=0 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.372+0000 7f54d516d740 1 client.15693 shutdown 2024-09-16T01:26:56.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 1 -- 172.21.15.63:0/3237007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 msgr2=0x555a92c5d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c5d240 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0b9e60 tx=0x7f54bc0bd420 comp rx=0 tx=0).stop 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 1 -- 172.21.15.63:0/3237007 shutdown_connections 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c5d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555a92c70080 0x555a92c72540 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c5d240 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 1 --2- 172.21.15.63:0/3237007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c5ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54abfff640 0 client.15693 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 1 -- 172.21.15.63:0/3237007 >> 172.21.15.63:0/3237007 conn(0x555a92c51a30 msgr2=0x555a92c50b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 1 -- 172.21.15.63:0/3237007 shutdown_connections 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 1 -- 172.21.15.63:0/3237007 wait complete. 2024-09-16T01:26:56.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.373+0000 7f54d516d740 20 client.15693 trim_cache size 0 max 16384 2024-09-16T01:26:56.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54d516d740 1 Processor -- start 2024-09-16T01:26:56.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54d516d740 1 -- start start 2024-09-16T01:26:56.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54d516d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c6c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54d516d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c77e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54d516d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c78350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54d516d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc1adb00 con 0x555a92c55dc0 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54d516d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc1ab310 con 0x555a92c60680 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54d516d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc1a9140 con 0x555a92c554a0 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c77e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c77e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37092/0 (socket says 172.21.15.63:37092) 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54c3fff640 1 -- 172.21.15.63:0/297873316 learned_addr learned my addr 172.21.15.63:0/297873316 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54d0b30640 1 --2- 172.21.15.63:0/297873316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c6c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54d1331640 1 --2- 172.21.15.63:0/297873316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c78350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54c3fff640 1 -- 172.21.15.63:0/297873316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 msgr2=0x555a92c6c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54c3fff640 1 --2- 172.21.15.63:0/297873316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c6c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54c3fff640 1 -- 172.21.15.63:0/297873316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 msgr2=0x555a92c78350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54c3fff640 1 --2- 172.21.15.63:0/297873316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c78350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.391+0000 7f54c3fff640 1 -- 172.21.15.63:0/297873316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a92c52ae0 con 0x555a92c55dc0 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.392+0000 7f54c3fff640 1 --2- 172.21.15.63:0/297873316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c77e10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f54bc032a80 tx=0x7f54bc005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53306f2ad4e47f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.392+0000 7f54b27fc640 1 -- 172.21.15.63:0/297873316 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0a8070 con 0x555a92c55dc0 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.392+0000 7f54b27fc640 1 -- 172.21.15.63:0/297873316 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54bc0c61e0 con 0x555a92c55dc0 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.392+0000 7f54b27fc640 1 -- 172.21.15.63:0/297873316 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc038a00 con 0x555a92c55dc0 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 -- 172.21.15.63:0/297873316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 msgr2=0x555a92c77e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 --2- 172.21.15.63:0/297873316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c77e10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f54bc032a80 tx=0x7f54bc005c00 comp rx=0 tx=0).stop 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 -- 172.21.15.63:0/297873316 shutdown_connections 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 --2- 172.21.15.63:0/297873316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92c78350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 --2- 172.21.15.63:0/297873316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c77e10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 --2- 172.21.15.63:0/297873316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c6c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 -- 172.21.15.63:0/297873316 >> 172.21.15.63:0/297873316 conn(0x555a92c51a30 msgr2=0x555a92c57710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 -- 172.21.15.63:0/297873316 shutdown_connections 2024-09-16T01:26:56.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 -- 172.21.15.63:0/297873316 wait complete. 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 -- start start 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.393+0000 7f54d516d740 1 Processor -- start 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54d516d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54d516d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c68e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54d516d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92cd6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54d516d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc1a97d0 con 0x555a92c55dc0 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54d516d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc1aac40 con 0x555a92c60680 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54d516d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc1a9ea0 con 0x555a92c554a0 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54d516d740 10 client.0 _ll_register_callbacks cb 0x7f54bc0b9ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c68e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54c3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c68e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37106/0 (socket says 172.21.15.63:37106) 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54c3fff640 1 -- 172.21.15.63:0/758984556 learned_addr learned my addr 172.21.15.63:0/758984556 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:56.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54d0b30640 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54d1331640 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92cd6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54c3fff640 1 -- 172.21.15.63:0/758984556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 msgr2=0x555a92c688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54c3fff640 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54c3fff640 1 -- 172.21.15.63:0/758984556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 msgr2=0x555a92cd6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54c3fff640 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92cd6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54c3fff640 1 -- 172.21.15.63:0/758984556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a92c552d0 con 0x555a92c55dc0 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54c3fff640 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c68e00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0bd700 tx=0x7f54bc0bd420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c839eec1866415 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54abfff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54abfff640 1 -- 172.21.15.63:0/758984556 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc038c00 con 0x555a92c55dc0 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54abfff640 1 -- 172.21.15.63:0/758984556 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f54bc0035f0 con 0x555a92c55dc0 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.394+0000 7f54d516d740 1 -- 172.21.15.63:0/758984556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54bc0c61e0 con 0x555a92c55dc0 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54abfff640 1 -- 172.21.15.63:0/758984556 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f54bc0c6390 con 0x555a92c55dc0 2024-09-16T01:26:56.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54d516d740 10 client.15699 fetch_fsmap learned FSMap version 29 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54d516d740 1 -- 172.21.15.63:0/758984556 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555a92c552d0 con 0x555a92c55dc0 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54abfff640 1 -- 172.21.15.63:0/758984556 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54bc0c61e0 con 0x555a92c55dc0 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54abfff640 1 -- 172.21.15.63:0/758984556 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f54bc0b9750 con 0x555a92c55dc0 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54d516d740 10 client.15699 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54d516d740 10 client.15699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54d516d740 20 client.15699 populate_metadata read hostname 'smithi063' 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54d516d740 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555a92c67620 0x555a92c67a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54d516d740 4 client.15699 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54d516d740 1 -- 172.21.15.63:0/758984556 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555a92c5db10 con 0x555a92c67620 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.395+0000 7f54d0b30640 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555a92c67620 0x555a92c67a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54abfff640 10 client.15699 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d0b30640 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555a92c67620 0x555a92c67a30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2addf088f63e51df server_cookie=46b5a8b065d663a6 in_seq=0 out_seq=0 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54abfff640 1 -- 172.21.15.63:0/758984556 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555a92c5db10 con 0x555a92c67620 2024-09-16T01:26:56.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54abfff640 10 client.15699 handle_command_reply: tid=0 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 client.15699 shutdown 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 -- 172.21.15.63:0/758984556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 msgr2=0x555a92c68e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c68e00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0bd700 tx=0x7f54bc0bd420 comp rx=0 tx=0).stop 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 -- 172.21.15.63:0/758984556 shutdown_connections 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a92c60680 0x555a92cd6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x555a92c67620 0x555a92c67a30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555a92c55dc0 0x555a92c68e00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 --2- 172.21.15.63:0/758984556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a92c554a0 0x555a92c688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 -- 172.21.15.63:0/758984556 >> 172.21.15.63:0/758984556 conn(0x555a92c51a30 msgr2=0x555a92c50370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54abfff640 0 client.15699 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 -- 172.21.15.63:0/758984556 shutdown_connections 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 1 -- 172.21.15.63:0/758984556 wait complete. 2024-09-16T01:26:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.396+0000 7f54d516d740 20 client.15699 trim_cache size 0 max 16384 2024-09-16T01:26:56.408 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:26:56.408 INFO:teuthology.orchestra.run.smithi063.stdout: "status": "no active scrubs running", 2024-09-16T01:26:56.408 INFO:teuthology.orchestra.run.smithi063.stdout: "scrubs": {} 2024-09-16T01:26:56.408 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:26:56.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 -- 172.21.15.63:0/1143721058 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54b40a32c0 msgr2=0x7f54b40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:56.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54b40a32c0 0x7f54b40a5780 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f54c4011880 tx=0x7f54c401d000 comp rx=0 tx=0).stop 2024-09-16T01:26:56.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 -- 172.21.15.63:0/1143721058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54cc102570 msgr2=0x7f54cc197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:56.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54cc102570 0x7f54cc197830 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f54bc006010 tx=0x7f54bc004270 comp rx=0 tx=0).stop 2024-09-16T01:26:56.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 -- 172.21.15.63:0/1143721058 shutdown_connections 2024-09-16T01:26:56.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54b40a32c0 0x7f54b40a5780 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54cc102ef0 0x7f54cc19bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54cc102570 0x7f54cc197830 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 --2- 172.21.15.63:0/1143721058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54cc100e20 0x7f54cc1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:56.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 -- 172.21.15.63:0/1143721058 >> 172.21.15.63:0/1143721058 conn(0x7f54cc0fc7d0 msgr2=0x7f54cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:56.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 -- 172.21.15.63:0/1143721058 shutdown_connections 2024-09-16T01:26:56.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:56.397+0000 7f54d2d94640 1 -- 172.21.15.63:0/1143721058 wait complete. 2024-09-16T01:26:56.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:56 smithi063 ceph-mon[31070]: pgmap v443: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:26:56.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:56 smithi192 ceph-mon[34775]: pgmap v443: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:26:56.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:56 smithi162 ceph-mon[34539]: pgmap v443: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:26:57.371 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-16T01:26:57.371 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:26:57.634 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:26:58.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.144+0000 7f16c5c6b640 1 -- 172.21.15.63:0/3514625231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16c01002f0 msgr2=0x7f16c01006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:58.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.144+0000 7f16c5c6b640 1 --2- 172.21.15.63:0/3514625231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16c01002f0 0x7f16c01006d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009930 tx=0x7f16b002a420 comp rx=0 tx=0).stop 2024-09-16T01:26:58.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.144+0000 7f16c5c6b640 1 -- 172.21.15.63:0/3514625231 shutdown_connections 2024-09-16T01:26:58.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.144+0000 7f16c5c6b640 1 --2- 172.21.15.63:0/3514625231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0106f50 0x7f16c010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:58.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.144+0000 7f16c5c6b640 1 --2- 172.21.15.63:0/3514625231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c0100ca0 0x7f16c0106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:58.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.144+0000 7f16c5c6b640 1 --2- 172.21.15.63:0/3514625231 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16c01002f0 0x7f16c01006d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:58.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.144+0000 7f16c5c6b640 1 -- 172.21.15.63:0/3514625231 >> 172.21.15.63:0/3514625231 conn(0x7f16c0077210 msgr2=0x7f16c00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.144+0000 7f16c5c6b640 1 -- 172.21.15.63:0/3514625231 shutdown_connections 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.144+0000 7f16c5c6b640 1 -- 172.21.15.63:0/3514625231 wait complete. 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.145+0000 7f16c5c6b640 1 Processor -- start 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.145+0000 7f16c5c6b640 1 -- start start 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.145+0000 7f16c5c6b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c01002f0 0x7f16c01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.145+0000 7f16c5c6b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0100ca0 0x7f16c01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.145+0000 7f16c5c6b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16c0106f50 0x7f16c019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.145+0000 7f16c5c6b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0111e50 con 0x7f16c0106f50 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.145+0000 7f16c5c6b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0111cd0 con 0x7f16c0100ca0 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.145+0000 7f16c5c6b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16c0111fd0 con 0x7f16c01002f0 2024-09-16T01:26:58.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.145+0000 7f16bffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16c0106f50 0x7f16c019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16c0106f50 0x7f16c019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37124/0 (socket says 172.21.15.63:37124) 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bf7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c01002f0 0x7f16c01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bffff640 1 -- 172.21.15.63:0/1862874492 learned_addr learned my addr 172.21.15.63:0/1862874492 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16beffd640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0100ca0 0x7f16c01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bffff640 1 -- 172.21.15.63:0/1862874492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c01002f0 msgr2=0x7f16c01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bffff640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c01002f0 0x7f16c01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bffff640 1 -- 172.21.15.63:0/1862874492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0100ca0 msgr2=0x7f16c01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bffff640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0100ca0 0x7f16c01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bffff640 1 -- 172.21.15.63:0/1862874492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c019d460 con 0x7f16c0106f50 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16beffd640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0100ca0 0x7f16c01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bffff640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16c0106f50 0x7f16c019cd80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f16b800cce0 tx=0x7f16b800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:58.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bcff9640 1 -- 172.21.15.63:0/1862874492 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b800f450 con 0x7f16c0106f50 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16c5c6b640 1 -- 172.21.15.63:0/1862874492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c019d750 con 0x7f16c0106f50 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bcff9640 1 -- 172.21.15.63:0/1862874492 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f16b800faa0 con 0x7f16c0106f50 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16bcff9640 1 -- 172.21.15.63:0/1862874492 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8018b70 con 0x7f16c0106f50 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.146+0000 7f16c5c6b640 1 -- 172.21.15.63:0/1862874492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c01a5030 con 0x7f16c0106f50 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.147+0000 7f16c5c6b640 1 -- 172.21.15.63:0/1862874492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c01006d0 con 0x7f16c0106f50 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.148+0000 7f16bcff9640 1 -- 172.21.15.63:0/1862874492 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f16b8018d10 con 0x7f16c0106f50 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.149+0000 7f16bcff9640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f16a80a3240 0x7f16a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.149+0000 7f16bf7fe640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f16a80a3240 0x7f16a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.149+0000 7f16bcff9640 1 -- 172.21.15.63:0/1862874492 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f16b80cfce0 con 0x7f16c0106f50 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.150+0000 7f16bf7fe640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f16a80a3240 0x7f16a80a5700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009900 tx=0x7f16b0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.153+0000 7f16bcff9640 1 -- 172.21.15.63:0/1862874492 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f16b8014030 con 0x7f16c0106f50 2024-09-16T01:26:58.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.367+0000 7f16c5c6b640 1 -- 172.21.15.63:0/1862874492 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16c0109bb0 con 0x7f16c0106f50 2024-09-16T01:26:58.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.368+0000 7f16bcff9640 1 -- 172.21.15.63:0/1862874492 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11918 (secure 0 0 0) 0x7f16b809ca00 con 0x7f16c0106f50 2024-09-16T01:26:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:26:58.370 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"btime":"2024-09-16T01:25:54:073139+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:25:53.917460+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24467,24460,24445]},"id":1}]} 2024-09-16T01:26:58.370 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 29 2024-09-16T01:26:58.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 -- 172.21.15.63:0/1862874492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f16a80a3240 msgr2=0x7f16a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:58.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f16a80a3240 0x7f16a80a5700 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009900 tx=0x7f16b0000bc0 comp rx=0 tx=0).stop 2024-09-16T01:26:58.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 -- 172.21.15.63:0/1862874492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16c0106f50 msgr2=0x7f16c019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:58.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16c0106f50 0x7f16c019cd80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f16b800cce0 tx=0x7f16b800a620 comp rx=0 tx=0).stop 2024-09-16T01:26:58.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 -- 172.21.15.63:0/1862874492 shutdown_connections 2024-09-16T01:26:58.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f16a80a3240 0x7f16a80a5700 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:58.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16c0106f50 0x7f16c019cd80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:58.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0100ca0 0x7f16c01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:58.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 --2- 172.21.15.63:0/1862874492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c01002f0 0x7f16c01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:58.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 -- 172.21.15.63:0/1862874492 >> 172.21.15.63:0/1862874492 conn(0x7f16c0077210 msgr2=0x7f16c0105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:58.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 -- 172.21.15.63:0/1862874492 shutdown_connections 2024-09-16T01:26:58.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:58.370+0000 7f16c5c6b640 1 -- 172.21.15.63:0/1862874492 wait complete. 2024-09-16T01:26:58.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:58 smithi063 ceph-mon[31070]: pgmap v444: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:26:58.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:58 smithi192 ceph-mon[34775]: pgmap v444: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:26:58.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:58 smithi162 ceph-mon[34539]: pgmap v444: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:26:59.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-16T01:26:59.480 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:26:59.601 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:26:59 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1862874492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:26:59.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:26:59 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1862874492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:26:59.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:26:59 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1862874492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:26:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.971+0000 7fa3c3a41640 1 -- 172.21.15.63:0/1940881418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3bc103740 msgr2=0x7fa3bc107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.971+0000 7fa3c3a41640 1 --2- 172.21.15.63:0/1940881418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3bc103740 0x7fa3bc107b80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009cd0 tx=0x7fa3b002a8e0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.971+0000 7fa3c3a41640 1 -- 172.21.15.63:0/1940881418 shutdown_connections 2024-09-16T01:26:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.971+0000 7fa3c3a41640 1 --2- 172.21.15.63:0/1940881418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc108290 0x7fa3bc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.971+0000 7fa3c3a41640 1 --2- 172.21.15.63:0/1940881418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3bc103740 0x7fa3bc107b80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.971+0000 7fa3c3a41640 1 --2- 172.21.15.63:0/1940881418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc102d90 0x7fa3bc103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.971+0000 7fa3c3a41640 1 -- 172.21.15.63:0/1940881418 >> 172.21.15.63:0/1940881418 conn(0x7fa3bc0fc7d0 msgr2=0x7fa3bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.971+0000 7fa3c3a41640 1 -- 172.21.15.63:0/1940881418 shutdown_connections 2024-09-16T01:26:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.971+0000 7fa3c3a41640 1 -- 172.21.15.63:0/1940881418 wait complete. 2024-09-16T01:26:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.971+0000 7fa3c3a41640 1 Processor -- start 2024-09-16T01:26:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c3a41640 1 -- start start 2024-09-16T01:26:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c3a41640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc102d90 0x7fa3bc1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c3a41640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc103740 0x7fa3bc100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c3a41640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3bc108290 0x7fa3bc101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c3a41640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc111f40 con 0x7fa3bc108290 2024-09-16T01:26:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c3a41640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc111dc0 con 0x7fa3bc102d90 2024-09-16T01:26:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c3a41640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc1120c0 con 0x7fa3bc103740 2024-09-16T01:26:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c1fde640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3bc108290 0x7fa3bc101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c1fde640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3bc108290 0x7fa3bc101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38618/0 (socket says 172.21.15.63:38618) 2024-09-16T01:26:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c1fde640 1 -- 172.21.15.63:0/3466407844 learned_addr learned my addr 172.21.15.63:0/3466407844 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc103740 0x7fa3bc100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc102d90 0x7fa3bc1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c1fde640 1 -- 172.21.15.63:0/3466407844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc103740 msgr2=0x7fa3bc100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c1fde640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc103740 0x7fa3bc100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c1fde640 1 -- 172.21.15.63:0/3466407844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc102d90 msgr2=0x7fa3bc1009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c1fde640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc102d90 0x7fa3bc1009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c1fde640 1 -- 172.21.15.63:0/3466407844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc1a69c0 con 0x7fa3bc108290 2024-09-16T01:26:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.972+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc102d90 0x7fa3bc1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:26:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.973+0000 7fa3c1fde640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3bc108290 0x7fa3bc101470 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c970 tx=0x7fa3b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.973+0000 7fa3ba7fc640 1 -- 172.21.15.63:0/3466407844 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4007bb0 con 0x7fa3bc108290 2024-09-16T01:26:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.973+0000 7fa3c3a41640 1 -- 172.21.15.63:0/3466407844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3bc1a6cb0 con 0x7fa3bc108290 2024-09-16T01:26:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.973+0000 7fa3ba7fc640 1 -- 172.21.15.63:0/3466407844 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa3b4007d50 con 0x7fa3bc108290 2024-09-16T01:26:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.973+0000 7fa3ba7fc640 1 -- 172.21.15.63:0/3466407844 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4004e10 con 0x7fa3bc108290 2024-09-16T01:26:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.973+0000 7fa3c3a41640 1 -- 172.21.15.63:0/3466407844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3bc1a71c0 con 0x7fa3bc108290 2024-09-16T01:26:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.975+0000 7fa3ba7fc640 1 -- 172.21.15.63:0/3466407844 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa3b4005020 con 0x7fa3bc108290 2024-09-16T01:26:59.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.975+0000 7fa3c5e1a740 1 Processor -- start 2024-09-16T01:26:59.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c5e1a740 1 -- start start 2024-09-16T01:26:59.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e34b40 0x563cb8e33090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:59.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e335d0 0x563cb8e33a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:59.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e3e370 0x563cb8e40760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:59.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563cb8d992f0 con 0x563cb8e3e370 2024-09-16T01:26:59.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563cb8d40cf0 con 0x563cb8e34b40 2024-09-16T01:26:59.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563cb8d952b0 con 0x563cb8e335d0 2024-09-16T01:26:59.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3ba7fc640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3a40a3240 0x7fa3a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:59.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c0fdc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e3e370 0x563cb8e40760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:59.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c0fdc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e3e370 0x563cb8e40760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38624/0 (socket says 172.21.15.63:38624) 2024-09-16T01:26:59.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/2793104886 learned_addr learned my addr 172.21.15.63:0/2793104886 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:59.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/2793104886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e335d0 0x563cb8e33a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:59.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c1fde640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3a40a3240 0x7fa3a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:59.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/2793104886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e34b40 0x563cb8e33090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:59.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/2793104886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e335d0 msgr2=0x563cb8e33a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:59.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/2793104886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e335d0 0x563cb8e33a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/2793104886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e34b40 msgr2=0x563cb8e33090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:59.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/2793104886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e34b40 0x563cb8e33090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/2793104886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb8d253a0 con 0x563cb8e3e370 2024-09-16T01:26:59.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.976+0000 7fa3ba7fc640 1 -- 172.21.15.63:0/3466407844 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa3b40cf5c0 con 0x7fa3bc108290 2024-09-16T01:26:59.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.977+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/2793104886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e3e370 0x563cb8e40760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0697d0 tx=0x7fa3b0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7dc3f695a212160 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:59.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.977+0000 7fa3c1fde640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3a40a3240 0x7fa3a40a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40978c0 tx=0x7fa3b4096610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:59.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.977+0000 7fa3a37fe640 1 -- 172.21.15.63:0/2793104886 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b003f030 con 0x563cb8e3e370 2024-09-16T01:26:59.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.977+0000 7fa3a37fe640 1 -- 172.21.15.63:0/2793104886 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa3b0036070 con 0x563cb8e3e370 2024-09-16T01:26:59.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.977+0000 7fa3a37fe640 1 -- 172.21.15.63:0/2793104886 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0004380 con 0x563cb8e3e370 2024-09-16T01:26:59.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/2793104886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e3e370 msgr2=0x563cb8e40760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:26:59.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/2793104886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e3e370 0x563cb8e40760 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0697d0 tx=0x7fa3b0005ef0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/2793104886 shutdown_connections 2024-09-16T01:26:59.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/2793104886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e3e370 0x563cb8e40760 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/2793104886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e335d0 0x563cb8e33a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/2793104886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e34b40 0x563cb8e33090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/2793104886 >> 172.21.15.63:0/2793104886 conn(0x563cb8dfc310 msgr2=0x563cb8e2fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/2793104886 shutdown_connections 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/2793104886 wait complete. 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 -- start start 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.978+0000 7fa3c5e1a740 1 Processor -- start 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e3dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 0x563cb8e3afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e3e370 0x563cb8e3b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x563cb8e41010 con 0x563cb8e335d0 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563cb8d54060 con 0x563cb8e3e370 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563cb8e41190 con 0x563cb8e34b40 2024-09-16T01:26:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c5e1a740 10 client.0 _ll_register_callbacks cb 0x563cb8aa78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c0fdc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e3dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c0fdc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e3dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38630/0 (socket says 172.21.15.63:38630) 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/4244440707 learned_addr learned my addr 172.21.15.63:0/4244440707 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 0x563cb8e3afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/4244440707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 msgr2=0x563cb8e3afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 0x563cb8e3afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/4244440707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e3e370 msgr2=0x563cb8e3b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e3e370 0x563cb8e3b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/4244440707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cb8b0a3c0 con 0x563cb8e335d0 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 0x563cb8e3afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e3dd30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0002230 tx=0x7fa3b0031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db50551e00ca661f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:26:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.979+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4244440707 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b003f070 con 0x563cb8e335d0 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4244440707 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa3b0004120 con 0x563cb8e335d0 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4244440707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3b0036070 con 0x563cb8e335d0 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4244440707 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa3b0004320 con 0x563cb8e335d0 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3c5e1a740 10 client.15717 fetch_fsmap learned FSMap version 29 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4244440707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563cb8e4caa0 con 0x563cb8e335d0 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4244440707 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa3b0036070 con 0x563cb8e335d0 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4244440707 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa3b0030070 con 0x563cb8e335d0 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3c5e1a740 10 client.15717 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3c5e1a740 10 client.15717 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3c5e1a740 20 client.15717 populate_metadata read hostname 'smithi063' 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x563cb8e4ddf0 0x563cb8e501e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3c5e1a740 4 client.15717 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.980+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4244440707 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cb8da6860 con 0x563cb8e4ddf0 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.981+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x563cb8e4ddf0 0x563cb8e501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.981+0000 7fa3a0ff9640 10 client.15717 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.981+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x563cb8e4ddf0 0x563cb8e501e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7e875ea55891d65f server_cookie=553d4b3d013954aa in_seq=0 out_seq=0 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4244440707 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563cb8da6860 con 0x563cb8e4ddf0 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3a0ff9640 10 client.15717 handle_command_reply: tid=0 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 client.15717 shutdown 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4244440707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 msgr2=0x563cb8e3dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e3dd30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0002230 tx=0x7fa3b0031850 comp rx=0 tx=0).stop 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4244440707 shutdown_connections 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x563cb8e4ddf0 0x563cb8e501e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e3e370 0x563cb8e3b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 0x563cb8e3afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3a0ff9640 0 client.15717 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:27:00.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4244440707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e3dd30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4244440707 >> 172.21.15.63:0/4244440707 conn(0x563cb8dfc310 msgr2=0x563cb8e35960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:00.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4244440707 shutdown_connections 2024-09-16T01:27:00.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4244440707 wait complete. 2024-09-16T01:27:00.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.982+0000 7fa3c5e1a740 20 client.15717 trim_cache size 0 max 16384 2024-09-16T01:27:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.995+0000 7fa3c5e1a740 1 Processor -- start 2024-09-16T01:27:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.995+0000 7fa3c5e1a740 1 -- start start 2024-09-16T01:27:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.995+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e4a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.995+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 0x563cb8e3a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.995+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e3e370 0x563cb8e2f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.995+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc1b20e0 con 0x563cb8e335d0 2024-09-16T01:27:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.995+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc1af8f0 con 0x563cb8e3e370 2024-09-16T01:27:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.995+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc1ad720 con 0x563cb8e34b40 2024-09-16T01:27:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3c0fdc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e4a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3c0fdc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e4a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38642/0 (socket says 172.21.15.63:38642) 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/4044110628 learned_addr learned my addr 172.21.15.63:0/4044110628 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/4044110628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 0x563cb8e3a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/4044110628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 msgr2=0x563cb8e3a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/4044110628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 0x563cb8e3a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/4044110628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e3e370 msgr2=0x563cb8e2f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/4044110628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e3e370 0x563cb8e2f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3c0fdc640 1 -- 172.21.15.63:0/4044110628 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb8e34760 con 0x563cb8e335d0 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/4044110628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e4a2e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0030360 tx=0x7fa3b0009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4219a295399c8878 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3a2ffd640 1 -- 172.21.15.63:0/4044110628 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b003f040 con 0x563cb8e335d0 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3a2ffd640 1 -- 172.21.15.63:0/4044110628 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa3b0060020 con 0x563cb8e335d0 2024-09-16T01:27:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.996+0000 7fa3a2ffd640 1 -- 172.21.15.63:0/4044110628 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0031c80 con 0x563cb8e335d0 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4044110628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 msgr2=0x563cb8e4a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4044110628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e4a2e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0030360 tx=0x7fa3b0009540 comp rx=0 tx=0).stop 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4044110628 shutdown_connections 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4044110628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e3e370 0x563cb8e2f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4044110628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e34b40 0x563cb8e3a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4044110628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e335d0 0x563cb8e4a2e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4044110628 >> 172.21.15.63:0/4044110628 conn(0x563cb8dfc310 msgr2=0x563cb8e362f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4044110628 shutdown_connections 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4044110628 wait complete. 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 -- start start 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.997+0000 7fa3c5e1a740 1 Processor -- start 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e335d0 0x563cb8e46450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e34b40 0x563cb8e46990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c5e1a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e3e370 0x563cb8e37270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc1addb0 con 0x563cb8e34b40 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc1af220 con 0x563cb8e335d0 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c5e1a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc1ae480 con 0x563cb8e3e370 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c5e1a740 10 client.0 _ll_register_callbacks cb 0x7fa3ac009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c17dd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e34b40 0x563cb8e46990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c17dd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e34b40 0x563cb8e46990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38650/0 (socket says 172.21.15.63:38650) 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c17dd640 1 -- 172.21.15.63:0/4284303539 learned_addr learned my addr 172.21.15.63:0/4284303539 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e3e370 0x563cb8e37270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e335d0 0x563cb8e46450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c17dd640 1 -- 172.21.15.63:0/4284303539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e3e370 msgr2=0x563cb8e37270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e3e370 0x563cb8e37270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c17dd640 1 -- 172.21.15.63:0/4284303539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e335d0 msgr2=0x563cb8e46450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e335d0 0x563cb8e46450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c17dd640 1 -- 172.21.15.63:0/4284303539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cb8e46fd0 con 0x563cb8e34b40 2024-09-16T01:27:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3c17dd640 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e34b40 0x563cb8e46990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac005fd0 tx=0x7fa3ac0138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed12e51b32f3138 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.998+0000 7fa3a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:27:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4284303539 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac01a550 con 0x563cb8e34b40 2024-09-16T01:27:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4284303539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3b0060020 con 0x563cb8e34b40 2024-09-16T01:27:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4284303539 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa3ac01a6f0 con 0x563cb8e34b40 2024-09-16T01:27:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4284303539 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa3ac01a8f0 con 0x563cb8e34b40 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3c5e1a740 10 client.15723 fetch_fsmap learned FSMap version 29 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4284303539 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563cb8eb7d40 con 0x563cb8e34b40 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4284303539 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa3b0060020 con 0x563cb8e34b40 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4284303539 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa3ac00f040 con 0x563cb8e34b40 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3c5e1a740 10 client.15723 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3c5e1a740 10 client.15723 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3c5e1a740 20 client.15723 populate_metadata read hostname 'smithi063' 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x563cb8eb8530 0x563cb8eba950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3c5e1a740 4 client.15723 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:26:59.999+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4284303539 --> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563cb8da0d70 con 0x563cb8eb8530 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x563cb8eb8530 0x563cb8eba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c0fdc640 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x563cb8eb8530 0x563cb8eba950 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ccdb59d2f662529d server_cookie=19f46592909fb01f in_seq=0 out_seq=0 2024-09-16T01:27:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3a0ff9640 10 client.15723 ms_handle_connect on v2:172.21.15.192:6836/3521040095 2024-09-16T01:27:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3a0ff9640 1 -- 172.21.15.63:0/4284303539 <== mds.2 v2:172.21.15.192:6836/3521040095 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563cb8da0d70 con 0x563cb8eb8530 2024-09-16T01:27:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3a0ff9640 10 client.15723 handle_command_reply: tid=0 2024-09-16T01:27:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 client.15723 shutdown 2024-09-16T01:27:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4284303539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e34b40 msgr2=0x563cb8e46990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e34b40 0x563cb8e46990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac005fd0 tx=0x7fa3ac0138f0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4284303539 shutdown_connections 2024-09-16T01:27:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.192:6836/3521040095,v1:172.21.15.192:6837/3521040095] conn(0x563cb8eb8530 0x563cb8eba950 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563cb8e3e370 0x563cb8e37270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x563cb8e34b40 0x563cb8e46990 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3a0ff9640 0 client.15723 ms_handle_reset on v2:172.21.15.192:6836/3521040095 2024-09-16T01:27:00.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 --2- 172.21.15.63:0/4284303539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563cb8e335d0 0x563cb8e46450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4284303539 >> 172.21.15.63:0/4284303539 conn(0x563cb8dfc310 msgr2=0x563cb8e2f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:00.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4284303539 shutdown_connections 2024-09-16T01:27:00.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.000+0000 7fa3c5e1a740 1 -- 172.21.15.63:0/4284303539 wait complete. 2024-09-16T01:27:00.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c5e1a740 20 client.15723 trim_cache size 0 max 16384 2024-09-16T01:27:00.014 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:27:00.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 -- 172.21.15.63:0/3466407844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3a40a3240 msgr2=0x7fa3a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:00.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3a40a3240 0x7fa3a40a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40978c0 tx=0x7fa3b4096610 comp rx=0 tx=0).stop 2024-09-16T01:27:00.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 -- 172.21.15.63:0/3466407844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3bc108290 msgr2=0x7fa3bc101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3bc108290 0x7fa3bc101470 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c970 tx=0x7fa3b400ce30 comp rx=0 tx=0).stop 2024-09-16T01:27:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 -- 172.21.15.63:0/3466407844 shutdown_connections 2024-09-16T01:27:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fa3a40a3240 0x7fa3a40a5700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3bc108290 0x7fa3bc101470 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc103740 0x7fa3bc100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 --2- 172.21.15.63:0/3466407844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc102d90 0x7fa3bc1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 -- 172.21.15.63:0/3466407844 >> 172.21.15.63:0/3466407844 conn(0x7fa3bc0fc7d0 msgr2=0x7fa3bc105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 -- 172.21.15.63:0/3466407844 shutdown_connections 2024-09-16T01:27:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:00.001+0000 7fa3c3a41640 1 -- 172.21.15.63:0/3466407844 wait complete. 2024-09-16T01:27:00.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:00 smithi063 ceph-mon[31070]: pgmap v445: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:00.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:00 smithi192 ceph-mon[34775]: pgmap v445: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:00.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:00 smithi162 ceph-mon[34539]: pgmap v445: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:00.887 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-16T01:27:01.144 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:01.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.629+0000 7ff21d12e640 1 -- 172.21.15.63:0/2268565977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff218100cc0 msgr2=0x7ff218106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:01.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.629+0000 7ff21d12e640 1 --2- 172.21.15.63:0/2268565977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff218100cc0 0x7ff218106800 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009900 tx=0x7ff20c02a410 comp rx=0 tx=0).stop 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.629+0000 7ff21d12e640 1 -- 172.21.15.63:0/2268565977 shutdown_connections 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.629+0000 7ff21d12e640 1 --2- 172.21.15.63:0/2268565977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff218106f30 0x7ff21810eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.629+0000 7ff21d12e640 1 --2- 172.21.15.63:0/2268565977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff218100cc0 0x7ff218106800 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.629+0000 7ff21d12e640 1 --2- 172.21.15.63:0/2268565977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff218100310 0x7ff2181006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.629+0000 7ff21d12e640 1 -- 172.21.15.63:0/2268565977 >> 172.21.15.63:0/2268565977 conn(0x7ff218077210 msgr2=0x7ff2180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.629+0000 7ff21d12e640 1 -- 172.21.15.63:0/2268565977 shutdown_connections 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.629+0000 7ff21d12e640 1 -- 172.21.15.63:0/2268565977 wait complete. 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.629+0000 7ff21d12e640 1 Processor -- start 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21d12e640 1 -- start start 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21d12e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff218100310 0x7ff218101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21d12e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff218100cc0 0x7ff2181017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21d12e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff218106f30 0x7ff218101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21d12e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff218111e40 con 0x7ff218100cc0 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21d12e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff218111cc0 con 0x7ff218106f30 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21d12e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff218111fc0 con 0x7ff218100310 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff218100cc0 0x7ff2181017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff218100cc0 0x7ff2181017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38668/0 (socket says 172.21.15.63:38668) 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21659c640 1 -- 172.21.15.63:0/3516924318 learned_addr learned my addr 172.21.15.63:0/3516924318 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21759e640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff218106f30 0x7ff218101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff216d9d640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff218100310 0x7ff218101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21659c640 1 -- 172.21.15.63:0/3516924318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff218100310 msgr2=0x7ff218101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21659c640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff218100310 0x7ff218101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21659c640 1 -- 172.21.15.63:0/3516924318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff218106f30 msgr2=0x7ff218101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:01.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21659c640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff218106f30 0x7ff218101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff21659c640 1 -- 172.21.15.63:0/3516924318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2181a6880 con 0x7ff218100cc0 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.630+0000 7ff216d9d640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff218100310 0x7ff218101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.631+0000 7ff21659c640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff218100cc0 0x7ff2181017d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff20c005940 tx=0x7ff20c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.631+0000 7ff1fffff640 1 -- 172.21.15.63:0/3516924318 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c03f030 con 0x7ff218100cc0 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.631+0000 7ff1fffff640 1 -- 172.21.15.63:0/3516924318 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff20c003aa0 con 0x7ff218100cc0 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.631+0000 7ff21d12e640 1 -- 172.21.15.63:0/3516924318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2181a6b10 con 0x7ff218100cc0 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.631+0000 7ff1fffff640 1 -- 172.21.15.63:0/3516924318 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c035070 con 0x7ff218100cc0 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.631+0000 7ff21d12e640 1 -- 172.21.15.63:0/3516924318 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2181a6ff0 con 0x7ff218100cc0 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.633+0000 7ff21f507740 1 Processor -- start 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.633+0000 7ff1fffff640 1 -- 172.21.15.63:0/3516924318 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff20c042030 con 0x7ff218100cc0 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.633+0000 7ff21f507740 1 -- start start 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21f507740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84cbb40 0x5564b84ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21f507740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84ca5d0 0x5564b84caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21f507740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84d5370 0x5564b84d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21f507740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5564b84302f0 con 0x5564b84d5370 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21f507740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5564b83d7cf0 con 0x5564b84ca5d0 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21f507740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5564b842c2b0 con 0x5564b84cbb40 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84d5370 0x5564b84d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84d5370 0x5564b84d7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38682/0 (socket says 172.21.15.63:38682) 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21659c640 1 -- 172.21.15.63:0/3272261203 learned_addr learned my addr 172.21.15.63:0/3272261203 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff216d9d640 1 --2- 172.21.15.63:0/3272261203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84ca5d0 0x5564b84caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21759e640 1 --2- 172.21.15.63:0/3272261203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84cbb40 0x5564b84ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff1fffff640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff2000a3240 0x7ff2000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21659c640 1 -- 172.21.15.63:0/3272261203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84cbb40 msgr2=0x5564b84ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21659c640 1 --2- 172.21.15.63:0/3272261203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84cbb40 0x5564b84ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21659c640 1 -- 172.21.15.63:0/3272261203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84ca5d0 msgr2=0x5564b84caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21659c640 1 --2- 172.21.15.63:0/3272261203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84ca5d0 0x5564b84caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21659c640 1 -- 172.21.15.63:0/3272261203 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b83bc3a0 con 0x5564b84d5370 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff216d9d640 1 --2- 172.21.15.63:0/3272261203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84ca5d0 0x5564b84caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff21759e640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff2000a3240 0x7ff2000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.634+0000 7ff1fffff640 1 -- 172.21.15.63:0/3516924318 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff20c0f0100 con 0x7ff218100cc0 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.635+0000 7ff21659c640 1 --2- 172.21.15.63:0/3272261203 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84d5370 0x5564b84d7760 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff20c09ed80 tx=0x7ff20c087160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661a1d4d608c903b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.635+0000 7ff1fd7fa640 1 -- 172.21.15.63:0/3272261203 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0bc080 con 0x5564b84d5370 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.635+0000 7ff1fd7fa640 1 -- 172.21.15.63:0/3272261203 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff20c03b460 con 0x5564b84d5370 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.635+0000 7ff1fd7fa640 1 -- 172.21.15.63:0/3272261203 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c08faa0 con 0x5564b84d5370 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.635+0000 7ff21f507740 1 -- 172.21.15.63:0/3272261203 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84d5370 msgr2=0x5564b84d7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.635+0000 7ff21759e640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff2000a3240 0x7ff2000a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff21000a2c0 tx=0x7ff210004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.635+0000 7ff21f507740 1 --2- 172.21.15.63:0/3272261203 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84d5370 0x5564b84d7760 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff20c09ed80 tx=0x7ff20c087160 comp rx=0 tx=0).stop 2024-09-16T01:27:01.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.635+0000 7ff21f507740 1 -- 172.21.15.63:0/3272261203 shutdown_connections 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 --2- 172.21.15.63:0/3272261203 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84d5370 0x5564b84d7760 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 --2- 172.21.15.63:0/3272261203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84ca5d0 0x5564b84caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 --2- 172.21.15.63:0/3272261203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84cbb40 0x5564b84ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 -- 172.21.15.63:0/3272261203 >> 172.21.15.63:0/3272261203 conn(0x5564b8493310 msgr2=0x5564b84c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 -- 172.21.15.63:0/3272261203 shutdown_connections 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 -- 172.21.15.63:0/3272261203 wait complete. 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 -- start start 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 Processor -- start 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84d4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 0x5564b84d1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84d5370 0x5564b84d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5564b84d7e30 con 0x5564b84ca5d0 2024-09-16T01:27:01.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5564b83eb060 con 0x5564b84cbb40 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5564b84d7fb0 con 0x5564b84d5370 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff216d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84d4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff216d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84d4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38692/0 (socket says 172.21.15.63:38692) 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff21f507740 10 client.0 _ll_register_callbacks cb 0x5564b813e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.636+0000 7ff216d9d640 1 -- 172.21.15.63:0/665472496 learned_addr learned my addr 172.21.15.63:0/665472496 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff21659c640 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 0x5564b84d1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff21759e640 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84d5370 0x5564b84d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff216d9d640 1 -- 172.21.15.63:0/665472496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84d5370 msgr2=0x5564b84d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff216d9d640 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84d5370 0x5564b84d2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff216d9d640 1 -- 172.21.15.63:0/665472496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 msgr2=0x5564b84d1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff216d9d640 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 0x5564b84d1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff216d9d640 1 -- 172.21.15.63:0/665472496 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b81a13c0 con 0x5564b84ca5d0 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff21659c640 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 0x5564b84d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff216d9d640 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84d4c70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff20800bf80 tx=0x7ff208011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafaef3cf4f93236 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff1faff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff1faff5640 1 -- 172.21.15.63:0/665472496 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208012710 con 0x5564b84ca5d0 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff1faff5640 1 -- 172.21.15.63:0/665472496 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff2080128b0 con 0x5564b84ca5d0 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff21f507740 1 -- 172.21.15.63:0/665472496 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564b843d860 con 0x5564b84ca5d0 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff1faff5640 1 -- 172.21.15.63:0/665472496 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff208012ab0 con 0x5564b84ca5d0 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff21f507740 10 client.15735 fetch_fsmap learned FSMap version 29 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff21f507740 1 -- 172.21.15.63:0/665472496 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564b84e3770 con 0x5564b84ca5d0 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.637+0000 7ff1faff5640 1 -- 172.21.15.63:0/665472496 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5564b843d860 con 0x5564b84ca5d0 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.638+0000 7ff1faff5640 1 -- 172.21.15.63:0/665472496 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff208025400 con 0x5564b84ca5d0 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.638+0000 7ff21f507740 10 client.15735 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:27:01.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.638+0000 7ff21f507740 10 client.15735 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.638+0000 7ff21f507740 20 client.15735 populate_metadata read hostname 'smithi063' 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.638+0000 7ff21f507740 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5564b84e4bd0 0x5564b84e7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.638+0000 7ff21f507740 4 client.15735 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.638+0000 7ff21f507740 1 -- 172.21.15.63:0/665472496 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564b8437d70 con 0x5564b84e4bd0 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.638+0000 7ff21659c640 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5564b84e4bd0 0x5564b84e7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.638+0000 7ff1faff5640 10 client.15735 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.638+0000 7ff21659c640 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5564b84e4bd0 0x5564b84e7070 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=68cedb92a6292399 server_cookie=f11dca3bf11cf2ce in_seq=0 out_seq=0 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff1faff5640 1 -- 172.21.15.63:0/665472496 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564b8437d70 con 0x5564b84e4bd0 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff1faff5640 10 client.15735 handle_command_reply: tid=0 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff21f507740 1 client.15735 shutdown 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff21f507740 1 -- 172.21.15.63:0/665472496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 msgr2=0x5564b84d4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff21f507740 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84d4c70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff20800bf80 tx=0x7ff208011870 comp rx=0 tx=0).stop 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff21f507740 1 -- 172.21.15.63:0/665472496 shutdown_connections 2024-09-16T01:27:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff21f507740 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5564b84e4bd0 0x5564b84e7070 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff21f507740 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84d5370 0x5564b84d2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff21f507740 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 0x5564b84d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff1faff5640 0 client.15735 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff21f507740 1 --2- 172.21.15.63:0/665472496 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84d4c70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.639+0000 7ff21f507740 1 -- 172.21.15.63:0/665472496 >> 172.21.15.63:0/665472496 conn(0x5564b8493310 msgr2=0x5564b84cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.640+0000 7ff21f507740 1 -- 172.21.15.63:0/665472496 shutdown_connections 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.640+0000 7ff21f507740 1 -- 172.21.15.63:0/665472496 wait complete. 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.640+0000 7ff21f507740 20 client.15735 trim_cache size 0 max 16384 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.652+0000 7ff21f507740 1 Processor -- start 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.653+0000 7ff21f507740 1 -- start start 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.653+0000 7ff21f507740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.653+0000 7ff21f507740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 0x5564b84cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.653+0000 7ff21f507740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84d5370 0x5564b84cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.653+0000 7ff21f507740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff2181b2100 con 0x5564b84ca5d0 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.653+0000 7ff21f507740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2181af910 con 0x5564b84cbb40 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.653+0000 7ff21f507740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2181ad740 con 0x5564b84d5370 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.653+0000 7ff216d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.653+0000 7ff216d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84e0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38706/0 (socket says 172.21.15.63:38706) 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.653+0000 7ff216d9d640 1 -- 172.21.15.63:0/1995321066 learned_addr learned my addr 172.21.15.63:0/1995321066 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.654+0000 7ff21759e640 1 --2- 172.21.15.63:0/1995321066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84d5370 0x5564b84cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.654+0000 7ff21659c640 1 --2- 172.21.15.63:0/1995321066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 0x5564b84cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.654+0000 7ff216d9d640 1 -- 172.21.15.63:0/1995321066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84d5370 msgr2=0x5564b84cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.654+0000 7ff216d9d640 1 --2- 172.21.15.63:0/1995321066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84d5370 0x5564b84cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.654+0000 7ff216d9d640 1 -- 172.21.15.63:0/1995321066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 msgr2=0x5564b84cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.654+0000 7ff216d9d640 1 --2- 172.21.15.63:0/1995321066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 0x5564b84cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.654+0000 7ff216d9d640 1 -- 172.21.15.63:0/1995321066 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b84d7e20 con 0x5564b84ca5d0 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.654+0000 7ff21659c640 1 --2- 172.21.15.63:0/1995321066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 0x5564b84cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.654+0000 7ff216d9d640 1 --2- 172.21.15.63:0/1995321066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84e0f40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b420 tx=0x7ff20800baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4ce20705e4504c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.654+0000 7ff1fcff9640 1 -- 172.21.15.63:0/1995321066 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208012e50 con 0x5564b84ca5d0 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff1fcff9640 1 -- 172.21.15.63:0/1995321066 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff208025400 con 0x5564b84ca5d0 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff1fcff9640 1 -- 172.21.15.63:0/1995321066 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208004290 con 0x5564b84ca5d0 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff21f507740 1 -- 172.21.15.63:0/1995321066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 msgr2=0x5564b84e0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff21f507740 1 --2- 172.21.15.63:0/1995321066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84e0f40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b420 tx=0x7ff20800baf0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff21f507740 1 -- 172.21.15.63:0/1995321066 shutdown_connections 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff21f507740 1 --2- 172.21.15.63:0/1995321066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84d5370 0x5564b84cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff21f507740 1 --2- 172.21.15.63:0/1995321066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84cbb40 0x5564b84cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff21f507740 1 --2- 172.21.15.63:0/1995321066 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84ca5d0 0x5564b84e0f40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff21f507740 1 -- 172.21.15.63:0/1995321066 >> 172.21.15.63:0/1995321066 conn(0x5564b8493310 msgr2=0x5564b84d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff21f507740 1 -- 172.21.15.63:0/1995321066 shutdown_connections 2024-09-16T01:27:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.655+0000 7ff21f507740 1 -- 172.21.15.63:0/1995321066 wait complete. 2024-09-16T01:27:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21f507740 1 -- start start 2024-09-16T01:27:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21f507740 1 Processor -- start 2024-09-16T01:27:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21f507740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84ca5d0 0x5564b84dd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21f507740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84cbb40 0x5564b84dd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21f507740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84d5370 0x5564b84ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21f507740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff2181addd0 con 0x5564b84cbb40 2024-09-16T01:27:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21f507740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2181af240 con 0x5564b84d5370 2024-09-16T01:27:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21f507740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2181ae4a0 con 0x5564b84ca5d0 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21f507740 10 client.0 _ll_register_callbacks cb 0x7ff20800b4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84cbb40 0x5564b84dd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84cbb40 0x5564b84dd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38708/0 (socket says 172.21.15.63:38708) 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21659c640 1 -- 172.21.15.63:0/1622321251 learned_addr learned my addr 172.21.15.63:0/1622321251 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21759e640 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84d5370 0x5564b84ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff216d9d640 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84ca5d0 0x5564b84dd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21659c640 1 -- 172.21.15.63:0/1622321251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84ca5d0 msgr2=0x5564b84dd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21659c640 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84ca5d0 0x5564b84dd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21659c640 1 -- 172.21.15.63:0/1622321251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84d5370 msgr2=0x5564b84ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.656+0000 7ff21659c640 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84d5370 0x5564b84ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff21659c640 1 -- 172.21.15.63:0/1622321251 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b84ceb50 con 0x5564b84cbb40 2024-09-16T01:27:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff216d9d640 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84ca5d0 0x5564b84dd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff21759e640 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84d5370 0x5564b84ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff21659c640 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84cbb40 0x5564b84dd5f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0bc420 tx=0x7ff20c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d210fc7e6a212008 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff1faff5640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff1faff5640 1 -- 172.21.15.63:0/1622321251 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c049070 con 0x5564b84cbb40 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff1faff5640 1 -- 172.21.15.63:0/1622321251 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff20c0baa20 con 0x5564b84cbb40 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff21f507740 1 -- 172.21.15.63:0/1622321251 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff208025400 con 0x5564b84cbb40 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff1faff5640 1 -- 172.21.15.63:0/1622321251 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff20c0bce20 con 0x5564b84cbb40 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff21f507740 10 client.15741 fetch_fsmap learned FSMap version 29 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff21f507740 1 -- 172.21.15.63:0/1622321251 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564b854f250 con 0x5564b84cbb40 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff1faff5640 1 -- 172.21.15.63:0/1622321251 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff208025400 con 0x5564b84cbb40 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff1faff5640 1 -- 172.21.15.63:0/1622321251 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7ff20c0b8d90 con 0x5564b84cbb40 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff21f507740 10 client.15741 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:27:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff21f507740 10 client.15741 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.657+0000 7ff21f507740 20 client.15741 populate_metadata read hostname 'smithi063' 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.658+0000 7ff21f507740 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5564b854f800 0x5564b8551c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.658+0000 7ff21f507740 4 client.15741 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.658+0000 7ff21f507740 1 -- 172.21.15.63:0/1622321251 --> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5564b83b4170 con 0x5564b854f800 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.658+0000 7ff216d9d640 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5564b854f800 0x5564b8551c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.658+0000 7ff1faff5640 10 client.15741 ms_handle_connect on v2:172.21.15.192:6838/82939697 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.658+0000 7ff216d9d640 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5564b854f800 0x5564b8551c20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f36c1b20af4c3f5 server_cookie=1274967efeb7140 in_seq=0 out_seq=0 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.658+0000 7ff1faff5640 1 -- 172.21.15.63:0/1622321251 <== mds.1 v2:172.21.15.192:6838/82939697 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5564b83b4170 con 0x5564b854f800 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff1faff5640 10 client.15741 handle_command_reply: tid=0 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 client.15741 shutdown 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 -- 172.21.15.63:0/1622321251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84cbb40 msgr2=0x5564b84dd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84cbb40 0x5564b84dd5f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0bc420 tx=0x7ff20c005c90 comp rx=0 tx=0).stop 2024-09-16T01:27:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 -- 172.21.15.63:0/1622321251 shutdown_connections 2024-09-16T01:27:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.192:6838/82939697,v1:172.21.15.192:6839/82939697] conn(0x5564b854f800 0x5564b8551c20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5564b84d5370 0x5564b84ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5564b84cbb40 0x5564b84dd5f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 --2- 172.21.15.63:0/1622321251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5564b84ca5d0 0x5564b84dd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 -- 172.21.15.63:0/1622321251 >> 172.21.15.63:0/1622321251 conn(0x5564b8493310 msgr2=0x5564b84d3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff1faff5640 0 client.15741 ms_handle_reset on v2:172.21.15.192:6838/82939697 2024-09-16T01:27:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 -- 172.21.15.63:0/1622321251 shutdown_connections 2024-09-16T01:27:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 1 -- 172.21.15.63:0/1622321251 wait complete. 2024-09-16T01:27:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21f507740 20 client.15741 trim_cache size 0 max 16384 2024-09-16T01:27:01.676 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:27:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21d12e640 1 -- 172.21.15.63:0/3516924318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff2000a3240 msgr2=0x7ff2000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21d12e640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff2000a3240 0x7ff2000a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff21000a2c0 tx=0x7ff210004a40 comp rx=0 tx=0).stop 2024-09-16T01:27:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21d12e640 1 -- 172.21.15.63:0/3516924318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff218100cc0 msgr2=0x7ff2181017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.659+0000 7ff21d12e640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff218100cc0 0x7ff2181017d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff20c005940 tx=0x7ff20c004270 comp rx=0 tx=0).stop 2024-09-16T01:27:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.660+0000 7ff21d12e640 1 -- 172.21.15.63:0/3516924318 shutdown_connections 2024-09-16T01:27:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.660+0000 7ff21d12e640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff2000a3240 0x7ff2000a5700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.660+0000 7ff21d12e640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff218106f30 0x7ff218101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.660+0000 7ff21d12e640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff218100cc0 0x7ff2181017d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.660+0000 7ff21d12e640 1 --2- 172.21.15.63:0/3516924318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff218100310 0x7ff218101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.660+0000 7ff21d12e640 1 -- 172.21.15.63:0/3516924318 >> 172.21.15.63:0/3516924318 conn(0x7ff218077210 msgr2=0x7ff218105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.660+0000 7ff21d12e640 1 -- 172.21.15.63:0/3516924318 shutdown_connections 2024-09-16T01:27:01.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:01.660+0000 7ff21d12e640 1 -- 172.21.15.63:0/3516924318 wait complete. 2024-09-16T01:27:02.481 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-16T01:27:02.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:02 smithi063 ceph-mon[31070]: pgmap v446: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:02.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:02 smithi192 ceph-mon[34775]: pgmap v446: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:02.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:02 smithi162 ceph-mon[34539]: pgmap v446: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:02.740 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:03.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.212+0000 7fcb00a1f640 1 -- 172.21.15.63:0/1777648975 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcafc105e80 msgr2=0x7fcafc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.212+0000 7fcb00a1f640 1 --2- 172.21.15.63:0/1777648975 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcafc105e80 0x7fcafc10da40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009ca0 tx=0x7fcaf402a8c0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.212+0000 7fcb00a1f640 1 -- 172.21.15.63:0/1777648975 shutdown_connections 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.212+0000 7fcb00a1f640 1 --2- 172.21.15.63:0/1777648975 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcafc105e80 0x7fcafc10da40 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.212+0000 7fcb00a1f640 1 --2- 172.21.15.63:0/1777648975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcafc101e30 0x7fcafc105750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.212+0000 7fcb00a1f640 1 --2- 172.21.15.63:0/1777648975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc101480 0x7fcafc101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.212+0000 7fcb00a1f640 1 -- 172.21.15.63:0/1777648975 >> 172.21.15.63:0/1777648975 conn(0x7fcafc077210 msgr2=0x7fcafc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.212+0000 7fcb00a1f640 1 -- 172.21.15.63:0/1777648975 shutdown_connections 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.213+0000 7fcb00a1f640 1 -- 172.21.15.63:0/1777648975 wait complete. 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.213+0000 7fcb00a1f640 1 Processor -- start 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.213+0000 7fcb00a1f640 1 -- start start 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.213+0000 7fcb00a1f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcafc101480 0x7fcafc1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.213+0000 7fcb00a1f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc101e30 0x7fcafc198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.213+0000 7fcb00a1f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcafc105e80 0x7fcafc19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.213+0000 7fcb00a1f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc110dd0 con 0x7fcafc101480 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.213+0000 7fcb00a1f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc110c50 con 0x7fcafc101e30 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.213+0000 7fcb00a1f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc110f50 con 0x7fcafc105e80 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcafa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcafc101480 0x7fcafc1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcafa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcafc101480 0x7fcafc1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38730/0 (socket says 172.21.15.63:38730) 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcafa59c640 1 -- 172.21.15.63:0/2085021165 learned_addr learned my addr 172.21.15.63:0/2085021165 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcafad9d640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcafc105e80 0x7fcafc19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc101e30 0x7fcafc198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcafa59c640 1 -- 172.21.15.63:0/2085021165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcafc105e80 msgr2=0x7fcafc19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcafa59c640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcafc105e80 0x7fcafc19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcafa59c640 1 -- 172.21.15.63:0/2085021165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc101e30 msgr2=0x7fcafc198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcafa59c640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc101e30 0x7fcafc198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcafa59c640 1 -- 172.21.15.63:0/2085021165 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc19d390 con 0x7fcafc101480 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcafa59c640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcafc101480 0x7fcafc1983e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00c890 tx=0x7fcaec00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcaeb7fe640 1 -- 172.21.15.63:0/2085021165 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec004220 con 0x7fcafc101480 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcaeb7fe640 1 -- 172.21.15.63:0/2085021165 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcaec0043c0 con 0x7fcafc101480 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcb00a1f640 1 -- 172.21.15.63:0/2085021165 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc19d680 con 0x7fcafc101480 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcaeb7fe640 1 -- 172.21.15.63:0/2085021165 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec004a00 con 0x7fcafc101480 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.214+0000 7fcb00a1f640 1 -- 172.21.15.63:0/2085021165 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc1a4f60 con 0x7fcafc101480 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.216+0000 7fcaeb7fe640 1 -- 172.21.15.63:0/2085021165 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcaec004ba0 con 0x7fcafc101480 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.217+0000 7fcb02df8740 1 Processor -- start 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.217+0000 7fcb02df8740 1 -- start start 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.217+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1938b40 0x55a3e1937090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.217+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e19375d0 0x55a3e1937a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.217+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1942370 0x55a3e1944760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.217+0000 7fcb02df8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a3e189d2f0 con 0x55a3e1942370 2024-09-16T01:27:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.217+0000 7fcb02df8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3e1844cf0 con 0x55a3e1938b40 2024-09-16T01:27:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.217+0000 7fcb02df8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a3e18992b0 con 0x55a3e19375d0 2024-09-16T01:27:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.217+0000 7fcaeb7fe640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcae40a32c0 0x7fcae40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.217+0000 7fcaf9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1942370 0x55a3e1944760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcaf9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1942370 0x55a3e1944760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38744/0 (socket says 172.21.15.63:38744) 2024-09-16T01:27:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcaf9d9b640 1 -- 172.21.15.63:0/57266128 learned_addr learned my addr 172.21.15.63:0/57266128 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcafad9d640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcae40a32c0 0x7fcae40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcaeb7fe640 1 -- 172.21.15.63:0/2085021165 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcaec0cf550 con 0x7fcafc101480 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcafa59c640 1 --2- 172.21.15.63:0/57266128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e19375d0 0x55a3e1937a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcafad9d640 1 --2- 172.21.15.63:0/57266128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1938b40 0x55a3e1937090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcaf9d9b640 1 -- 172.21.15.63:0/57266128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e19375d0 msgr2=0x55a3e1937a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/57266128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e19375d0 0x55a3e1937a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcaf9d9b640 1 -- 172.21.15.63:0/57266128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1938b40 msgr2=0x55a3e1937090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/57266128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1938b40 0x55a3e1937090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcaf9d9b640 1 -- 172.21.15.63:0/57266128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e18293a0 con 0x55a3e1942370 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/57266128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1942370 0x55a3e1944760 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000cb30 tx=0x7fcaf000e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadf4aa847c3a1ad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcafad9d640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcae40a32c0 0x7fcae40a5780 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009430 tx=0x7fcaf4031e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcae8ff9640 1 -- 172.21.15.63:0/57266128 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0010430 con 0x55a3e1942370 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcae8ff9640 1 -- 172.21.15.63:0/57266128 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcaf0010a80 con 0x55a3e1942370 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.218+0000 7fcae8ff9640 1 -- 172.21.15.63:0/57266128 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf001aae0 con 0x55a3e1942370 2024-09-16T01:27:03.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.219+0000 7fcb02df8740 1 -- 172.21.15.63:0/57266128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1942370 msgr2=0x55a3e1944760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.219+0000 7fcb02df8740 1 --2- 172.21.15.63:0/57266128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1942370 0x55a3e1944760 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000cb30 tx=0x7fcaf000e350 comp rx=0 tx=0).stop 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.219+0000 7fcb02df8740 1 -- 172.21.15.63:0/57266128 shutdown_connections 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.219+0000 7fcb02df8740 1 --2- 172.21.15.63:0/57266128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1942370 0x55a3e1944760 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.219+0000 7fcb02df8740 1 --2- 172.21.15.63:0/57266128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e19375d0 0x55a3e1937a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.219+0000 7fcb02df8740 1 --2- 172.21.15.63:0/57266128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1938b40 0x55a3e1937090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.219+0000 7fcb02df8740 1 -- 172.21.15.63:0/57266128 >> 172.21.15.63:0/57266128 conn(0x55a3e1900310 msgr2=0x55a3e1933c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.219+0000 7fcb02df8740 1 -- 172.21.15.63:0/57266128 shutdown_connections 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.219+0000 7fcb02df8740 1 -- 172.21.15.63:0/57266128 wait complete. 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcb02df8740 1 -- start start 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcb02df8740 1 Processor -- start 2024-09-16T01:27:03.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e1941d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 0x55a3e193f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 0x55a3e193f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcb02df8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a3e1945070 con 0x55a3e19375d0 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcb02df8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3e1858060 con 0x55a3e1942370 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcb02df8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a3e19451f0 con 0x55a3e1938b40 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcb02df8740 10 client.0 _ll_register_callbacks cb 0x55a3e15ab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcafa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e1941d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcafa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e1941d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38752/0 (socket says 172.21.15.63:38752) 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcafa59c640 1 -- 172.21.15.63:0/3311954071 learned_addr learned my addr 172.21.15.63:0/3311954071 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 0x55a3e193f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcafad9d640 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 0x55a3e193f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcafa59c640 1 -- 172.21.15.63:0/3311954071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 msgr2=0x55a3e193f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:03.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcafa59c640 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 0x55a3e193f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcafa59c640 1 -- 172.21.15.63:0/3311954071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 msgr2=0x55a3e193f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcafa59c640 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 0x55a3e193f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcafa59c640 1 -- 172.21.15.63:0/3311954071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e160e3c0 con 0x55a3e19375d0 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcafad9d640 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 0x55a3e193f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.220+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 0x55a3e193f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcafa59c640 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e1941d60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0cd050 tx=0x7fcaec09c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0a482611e6061a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcae1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcae1ffb640 1 -- 172.21.15.63:0/3311954071 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec01d040 con 0x55a3e19375d0 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcae1ffb640 1 -- 172.21.15.63:0/3311954071 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcaec0050b0 con 0x55a3e19375d0 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcb02df8740 1 -- 172.21.15.63:0/3311954071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaf0010a80 con 0x55a3e19375d0 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcae1ffb640 1 -- 172.21.15.63:0/3311954071 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcaec0a47e0 con 0x55a3e19375d0 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcb02df8740 10 client.15753 fetch_fsmap learned FSMap version 29 2024-09-16T01:27:03.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcb02df8740 1 -- 172.21.15.63:0/3311954071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a3e1950b10 con 0x55a3e19375d0 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcae1ffb640 1 -- 172.21.15.63:0/3311954071 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcaf0010a80 con 0x55a3e19375d0 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcae1ffb640 1 -- 172.21.15.63:0/3311954071 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcaec0978c0 con 0x55a3e19375d0 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcb02df8740 10 client.15753 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcb02df8740 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcb02df8740 20 client.15753 populate_metadata read hostname 'smithi063' 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcb02df8740 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3e1951fd0 0x55a3e1954440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcb02df8740 4 client.15753 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.221+0000 7fcb02df8740 1 -- 172.21.15.63:0/3311954071 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3e18aa860 con 0x55a3e1951fd0 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.222+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3e1951fd0 0x55a3e1954440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.222+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3e1951fd0 0x55a3e1954440 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd64ab7d62de2df3 server_cookie=fa5b230081453295 in_seq=0 out_seq=0 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.222+0000 7fcae1ffb640 10 client.15753 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:27:03.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcae1ffb640 1 -- 172.21.15.63:0/3311954071 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3e18aa860 con 0x55a3e1951fd0 2024-09-16T01:27:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcae1ffb640 10 client.15753 handle_command_reply: tid=0 2024-09-16T01:27:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 client.15753 shutdown 2024-09-16T01:27:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 -- 172.21.15.63:0/3311954071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 msgr2=0x55a3e1941d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e1941d60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0cd050 tx=0x7fcaec09c270 comp rx=0 tx=0).stop 2024-09-16T01:27:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 -- 172.21.15.63:0/3311954071 shutdown_connections 2024-09-16T01:27:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 0x55a3e193f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 0x55a3e193f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3e1951fd0 0x55a3e1954440 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 --2- 172.21.15.63:0/3311954071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e1941d60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcae1ffb640 0 client.15753 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 -- 172.21.15.63:0/3311954071 >> 172.21.15.63:0/3311954071 conn(0x55a3e1900310 msgr2=0x55a3e1939990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 -- 172.21.15.63:0/3311954071 shutdown_connections 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.223+0000 7fcb02df8740 1 -- 172.21.15.63:0/3311954071 wait complete. 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.224+0000 7fcb02df8740 20 client.15753 trim_cache size 0 max 16384 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.236+0000 7fcb02df8740 1 Processor -- start 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.236+0000 7fcb02df8740 1 -- start start 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.236+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e19375d0 0x55a3e194e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.236+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1938b40 0x55a3e1943760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.236+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1942370 0x55a3e1943ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.236+0000 7fcb02df8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1afec0 con 0x55a3e1938b40 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcb02df8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1ad6d0 con 0x55a3e19375d0 2024-09-16T01:27:03.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcb02df8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1ab500 con 0x55a3e1942370 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcaf9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1938b40 0x55a3e1943760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcaf9d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1938b40 0x55a3e1943760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38768/0 (socket says 172.21.15.63:38768) 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcaf9d9b640 1 -- 172.21.15.63:0/1291600625 learned_addr learned my addr 172.21.15.63:0/1291600625 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcafa59c640 1 --2- 172.21.15.63:0/1291600625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e19375d0 0x55a3e194e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcafad9d640 1 --2- 172.21.15.63:0/1291600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1942370 0x55a3e1943ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcaf9d9b640 1 -- 172.21.15.63:0/1291600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1942370 msgr2=0x55a3e1943ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/1291600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1942370 0x55a3e1943ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcaf9d9b640 1 -- 172.21.15.63:0/1291600625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e19375d0 msgr2=0x55a3e194e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/1291600625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e19375d0 0x55a3e194e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcaf9d9b640 1 -- 172.21.15.63:0/1291600625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e1933ed0 con 0x55a3e1938b40 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcafad9d640 1 --2- 172.21.15.63:0/1291600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1942370 0x55a3e1943ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:27:03.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/1291600625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1938b40 0x55a3e1943760 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000e850 tx=0x7fcaf00051d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bb243a09a5e7a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcae3fff640 1 -- 172.21.15.63:0/1291600625 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf001a930 con 0x55a3e1938b40 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcae3fff640 1 -- 172.21.15.63:0/1291600625 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcaf0004660 con 0x55a3e1938b40 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.237+0000 7fcae3fff640 1 -- 172.21.15.63:0/1291600625 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0010650 con 0x55a3e1938b40 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 -- 172.21.15.63:0/1291600625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1938b40 msgr2=0x55a3e1943760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 --2- 172.21.15.63:0/1291600625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1938b40 0x55a3e1943760 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000e850 tx=0x7fcaf00051d0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 -- 172.21.15.63:0/1291600625 shutdown_connections 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 --2- 172.21.15.63:0/1291600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1942370 0x55a3e1943ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 --2- 172.21.15.63:0/1291600625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e1938b40 0x55a3e1943760 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 --2- 172.21.15.63:0/1291600625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e19375d0 0x55a3e194e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 -- 172.21.15.63:0/1291600625 >> 172.21.15.63:0/1291600625 conn(0x55a3e1900310 msgr2=0x55a3e193e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 -- 172.21.15.63:0/1291600625 shutdown_connections 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 -- 172.21.15.63:0/1291600625 wait complete. 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 -- start start 2024-09-16T01:27:03.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.238+0000 7fcb02df8740 1 Processor -- start 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e194aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 0x55a3e1959470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcb02df8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 0x55a3e19599b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcb02df8740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1abb90 con 0x55a3e19375d0 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcb02df8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1ad000 con 0x55a3e1942370 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcb02df8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc1ac260 con 0x55a3e1938b40 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcb02df8740 10 client.0 _ll_register_callbacks cb 0x7fcaec005380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcafa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e194aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcafa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e194aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38778/0 (socket says 172.21.15.63:38778) 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcafa59c640 1 -- 172.21.15.63:0/478415209 learned_addr learned my addr 172.21.15.63:0/478415209 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 0x55a3e1959470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcafad9d640 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 0x55a3e19599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcafa59c640 1 -- 172.21.15.63:0/478415209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 msgr2=0x55a3e1959470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcafa59c640 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 0x55a3e1959470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcafa59c640 1 -- 172.21.15.63:0/478415209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 msgr2=0x55a3e19599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcafa59c640 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 0x55a3e19599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcafa59c640 1 -- 172.21.15.63:0/478415209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e195a020 con 0x55a3e19375d0 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcafa59c640 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e194aa80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0058c0 tx=0x7fcaec09ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308600fc993e338f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcae1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcae1ffb640 1 -- 172.21.15.63:0/478415209 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec01d040 con 0x55a3e19375d0 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcae1ffb640 1 -- 172.21.15.63:0/478415209 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcaec0cf0f0 con 0x55a3e19375d0 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcb02df8740 1 -- 172.21.15.63:0/478415209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcaf0004660 con 0x55a3e19375d0 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcae1ffb640 1 -- 172.21.15.63:0/478415209 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcaec097e10 con 0x55a3e19375d0 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcb02df8740 10 client.15759 fetch_fsmap learned FSMap version 29 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.239+0000 7fcb02df8740 1 -- 172.21.15.63:0/478415209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a3e1949310 con 0x55a3e19375d0 2024-09-16T01:27:03.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.240+0000 7fcae1ffb640 1 -- 172.21.15.63:0/478415209 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcaf0004660 con 0x55a3e19375d0 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.240+0000 7fcae1ffb640 1 -- 172.21.15.63:0/478415209 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fcaec09ac30 con 0x55a3e19375d0 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.240+0000 7fcb02df8740 10 client.15759 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.240+0000 7fcb02df8740 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.240+0000 7fcb02df8740 20 client.15759 populate_metadata read hostname 'smithi063' 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.240+0000 7fcb02df8740 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3e19bd1a0 0x55a3e19bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.240+0000 7fcb02df8740 4 client.15759 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.240+0000 7fcb02df8740 1 -- 172.21.15.63:0/478415209 --> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a3e18a4d70 con 0x55a3e19bd1a0 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.240+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3e19bd1a0 0x55a3e19bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcaf9d9b640 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3e19bd1a0 0x55a3e19bf5c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d84cb191c513237 server_cookie=b93e52b57059942b in_seq=0 out_seq=0 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcae1ffb640 10 client.15759 ms_handle_connect on v2:172.21.15.162:6838/2919019351 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcae1ffb640 1 -- 172.21.15.63:0/478415209 <== mds.0 v2:172.21.15.162:6838/2919019351 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a3e18a4d70 con 0x55a3e19bd1a0 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcae1ffb640 10 client.15759 handle_command_reply: tid=0 2024-09-16T01:27:03.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 client.15759 shutdown 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 -- 172.21.15.63:0/478415209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 msgr2=0x55a3e194aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e194aa80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcaec0058c0 tx=0x7fcaec09ba60 comp rx=0 tx=0).stop 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 -- 172.21.15.63:0/478415209 shutdown_connections 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e1942370 0x55a3e19599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a3e1938b40 0x55a3e1959470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.162:6838/2919019351,v1:172.21.15.162:6839/2919019351] conn(0x55a3e19bd1a0 0x55a3e19bf5c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcae1ffb640 0 client.15759 ms_handle_reset on v2:172.21.15.162:6838/2919019351 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 --2- 172.21.15.63:0/478415209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a3e19375d0 0x55a3e194aa80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 -- 172.21.15.63:0/478415209 >> 172.21.15.63:0/478415209 conn(0x55a3e1900310 msgr2=0x55a3e1940870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 -- 172.21.15.63:0/478415209 shutdown_connections 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 1 -- 172.21.15.63:0/478415209 wait complete. 2024-09-16T01:27:03.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.241+0000 7fcb02df8740 20 client.15759 trim_cache size 0 max 16384 2024-09-16T01:27:03.266 INFO:teuthology.orchestra.run.smithi063.stdout:[] 2024-09-16T01:27:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 -- 172.21.15.63:0/2085021165 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcae40a32c0 msgr2=0x7fcae40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcae40a32c0 0x7fcae40a5780 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009430 tx=0x7fcaf4031e60 comp rx=0 tx=0).stop 2024-09-16T01:27:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 -- 172.21.15.63:0/2085021165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcafc101480 msgr2=0x7fcafc1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcafc101480 0x7fcafc1983e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00c890 tx=0x7fcaec00cd50 comp rx=0 tx=0).stop 2024-09-16T01:27:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 -- 172.21.15.63:0/2085021165 shutdown_connections 2024-09-16T01:27:03.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcae40a32c0 0x7fcae40a5780 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcafc105e80 0x7fcafc19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcafc101e30 0x7fcafc198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 --2- 172.21.15.63:0/2085021165 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcafc101480 0x7fcafc1983e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:03.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 -- 172.21.15.63:0/2085021165 >> 172.21.15.63:0/2085021165 conn(0x7fcafc077210 msgr2=0x7fcafc104720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:03.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 -- 172.21.15.63:0/2085021165 shutdown_connections 2024-09-16T01:27:03.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:03.242+0000 7fcb00a1f640 1 -- 172.21.15.63:0/2085021165 wait complete. 2024-09-16T01:27:03.954 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-16T01:27:03.955 INFO:tasks.fwd_scrub:done joining 2024-09-16T01:27:03.955 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-16T01:27:03.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:27:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.074+0000 7f8eb0a53640 1 -- 172.21.15.63:0/2072902059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8eac101c20 msgr2=0x7f8eac1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.074+0000 7f8eb0a53640 1 --2- 172.21.15.63:0/2072902059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8eac101c20 0x7f8eac1020a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009900 tx=0x7f8ea002a410 comp rx=0 tx=0).stop 2024-09-16T01:27:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.074+0000 7f8eb0a53640 1 -- 172.21.15.63:0/2072902059 shutdown_connections 2024-09-16T01:27:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.074+0000 7f8eb0a53640 1 --2- 172.21.15.63:0/2072902059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eac1025e0 0x7f8eac108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.074+0000 7f8eb0a53640 1 --2- 172.21.15.63:0/2072902059 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8eac101c20 0x7f8eac1020a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.074+0000 7f8eb0a53640 1 --2- 172.21.15.63:0/2072902059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac100a30 0x7f8eac100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.074+0000 7f8eb0a53640 1 -- 172.21.15.63:0/2072902059 >> 172.21.15.63:0/2072902059 conn(0x7f8eac0fc1b0 msgr2=0x7f8eac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.074+0000 7f8eb0a53640 1 -- 172.21.15.63:0/2072902059 shutdown_connections 2024-09-16T01:27:04.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.074+0000 7f8eb0a53640 1 -- 172.21.15.63:0/2072902059 wait complete. 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.075+0000 7f8eb0a53640 1 Processor -- start 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eb0a53640 1 -- start start 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eb0a53640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eac100a30 0x7f8eac1049c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eb0a53640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac101c20 0x7f8eac103000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eb0a53640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8eac1025e0 0x7f8eac103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eb0a53640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac10c540 con 0x7f8eac1025e0 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eb0a53640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac10c3c0 con 0x7f8eac100a30 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eb0a53640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac10c6c0 con 0x7f8eac101c20 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eaad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8eac1025e0 0x7f8eac103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eaad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8eac1025e0 0x7f8eac103540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38804/0 (socket says 172.21.15.63:38804) 2024-09-16T01:27:04.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eaad9d640 1 -- 172.21.15.63:0/3989561262 learned_addr learned my addr 172.21.15.63:0/3989561262 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8ea9d9b640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac101c20 0x7f8eac103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eaa59c640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eac100a30 0x7f8eac1049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eaad9d640 1 -- 172.21.15.63:0/3989561262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac101c20 msgr2=0x7f8eac103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eaad9d640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac101c20 0x7f8eac103000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eaad9d640 1 -- 172.21.15.63:0/3989561262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eac100a30 msgr2=0x7f8eac1049c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eaad9d640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eac100a30 0x7f8eac1049c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eaad9d640 1 -- 172.21.15.63:0/3989561262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac103dd0 con 0x7f8eac1025e0 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.076+0000 7f8eaad9d640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8eac1025e0 0x7f8eac103540 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400eaa0 tx=0x7f8ea400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.077+0000 7f8e9b7fe640 1 -- 172.21.15.63:0/3989561262 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400cdb0 con 0x7f8eac1025e0 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.077+0000 7f8e9b7fe640 1 -- 172.21.15.63:0/3989561262 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ea4005020 con 0x7f8eac1025e0 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.077+0000 7f8eb0a53640 1 -- 172.21.15.63:0/3989561262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eac1a1f20 con 0x7f8eac1025e0 2024-09-16T01:27:04.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.077+0000 7f8e9b7fe640 1 -- 172.21.15.63:0/3989561262 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40116d0 con 0x7f8eac1025e0 2024-09-16T01:27:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.077+0000 7f8eb0a53640 1 -- 172.21.15.63:0/3989561262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eac1a2330 con 0x7f8eac1025e0 2024-09-16T01:27:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.078+0000 7f8eb0a53640 1 -- 172.21.15.63:0/3989561262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eac1a2620 con 0x7f8eac1025e0 2024-09-16T01:27:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.079+0000 7f8e9b7fe640 1 -- 172.21.15.63:0/3989561262 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8ea40051d0 con 0x7f8eac1025e0 2024-09-16T01:27:04.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.079+0000 7f8e9b7fe640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8e940a3250 0x7f8e940a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.080+0000 7f8eaa59c640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8e940a3250 0x7f8e940a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:04.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.080+0000 7f8e9b7fe640 1 -- 172.21.15.63:0/3989561262 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8ea40cfeb0 con 0x7f8eac1025e0 2024-09-16T01:27:04.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.080+0000 7f8eaa59c640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8e940a3250 0x7f8e940a5710 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c005db0 tx=0x7f8e9c005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:04.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.083+0000 7f8e9b7fe640 1 -- 172.21.15.63:0/3989561262 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ea4016030 con 0x7f8eac1025e0 2024-09-16T01:27:04.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.263+0000 7f8eb0a53640 1 -- 172.21.15.63:0/3989561262 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8eac1a29b0 con 0x7f8eac1025e0 2024-09-16T01:27:04.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.265+0000 7f8e9b7fe640 1 -- 172.21.15.63:0/3989561262 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22710 (secure 0 0 0) 0x7f8ea409cbd0 con 0x7f8eac1025e0 2024-09-16T01:27:04.267 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:27:04.267 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:39.083854+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:27:04.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 -- 172.21.15.63:0/3989561262 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8e940a3250 msgr2=0x7f8e940a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8e940a3250 0x7f8e940a5710 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c005db0 tx=0x7f8e9c005d40 comp rx=0 tx=0).stop 2024-09-16T01:27:04.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 -- 172.21.15.63:0/3989561262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8eac1025e0 msgr2=0x7f8eac103540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8eac1025e0 0x7f8eac103540 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400eaa0 tx=0x7f8ea400ef60 comp rx=0 tx=0).stop 2024-09-16T01:27:04.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 -- 172.21.15.63:0/3989561262 shutdown_connections 2024-09-16T01:27:04.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f8e940a3250 0x7f8e940a5710 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8eac1025e0 0x7f8eac103540 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eac101c20 0x7f8eac103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 --2- 172.21.15.63:0/3989561262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eac100a30 0x7f8eac1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 -- 172.21.15.63:0/3989561262 >> 172.21.15.63:0/3989561262 conn(0x7f8eac0fc1b0 msgr2=0x7f8eac06a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 -- 172.21.15.63:0/3989561262 shutdown_connections 2024-09-16T01:27:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.267+0000 7f8eb0a53640 1 -- 172.21.15.63:0/3989561262 wait complete. 2024-09-16T01:27:04.281 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:16:51.610676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T01:21:24.729872+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T01:21:27.006661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:27:04.282 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:27:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 -- 172.21.15.63:0/3827851363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e70100a30 msgr2=0x7f0e70100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 --2- 172.21.15.63:0/3827851363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e70100a30 0x7f0e70100e30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009900 tx=0x7f0e6002a410 comp rx=0 tx=0).stop 2024-09-16T01:27:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 -- 172.21.15.63:0/3827851363 shutdown_connections 2024-09-16T01:27:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 --2- 172.21.15.63:0/3827851363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e701025e0 0x7f0e70108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 --2- 172.21.15.63:0/3827851363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e70101c20 0x7f0e701020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 --2- 172.21.15.63:0/3827851363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e70100a30 0x7f0e70100e30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 -- 172.21.15.63:0/3827851363 >> 172.21.15.63:0/3827851363 conn(0x7f0e700fc1b0 msgr2=0x7f0e700fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 -- 172.21.15.63:0/3827851363 shutdown_connections 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 -- 172.21.15.63:0/3827851363 wait complete. 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 Processor -- start 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.388+0000 7f0e768f1640 1 -- start start 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e768f1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e70100a30 0x7f0e70197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e768f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e70101c20 0x7f0e70198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e768f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e701025e0 0x7f0e7019f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e768f1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7010c540 con 0x7f0e70100a30 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e768f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7010c3c0 con 0x7f0e70101c20 2024-09-16T01:27:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e768f1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7010c6c0 con 0x7f0e701025e0 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e70100a30 0x7f0e70197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e70100a30 0x7f0e70197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38822/0 (socket says 172.21.15.63:38822) 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e6ffff640 1 -- 172.21.15.63:0/2501979170 learned_addr learned my addr 172.21.15.63:0/2501979170 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e6ffff640 1 -- 172.21.15.63:0/2501979170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e701025e0 msgr2=0x7f0e7019f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e6ffff640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e701025e0 0x7f0e7019f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e6ffff640 1 -- 172.21.15.63:0/2501979170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e70101c20 msgr2=0x7f0e70198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e6ffff640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e70101c20 0x7f0e70198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e6ffff640 1 -- 172.21.15.63:0/2501979170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7019fa50 con 0x7f0e70100a30 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.389+0000 7f0e6ffff640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e70100a30 0x7f0e70197e30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0e60004270 tx=0x7f0e60031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.390+0000 7f0e6d7fa640 1 -- 172.21.15.63:0/2501979170 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6003f030 con 0x7f0e70100a30 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.390+0000 7f0e6d7fa640 1 -- 172.21.15.63:0/2501979170 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e60003cb0 con 0x7f0e70100a30 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.390+0000 7f0e768f1640 1 -- 172.21.15.63:0/2501979170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7019fce0 con 0x7f0e70100a30 2024-09-16T01:27:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.390+0000 7f0e6d7fa640 1 -- 172.21.15.63:0/2501979170 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e60035070 con 0x7f0e70100a30 2024-09-16T01:27:04.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.390+0000 7f0e768f1640 1 -- 172.21.15.63:0/2501979170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e701a01d0 con 0x7f0e70100a30 2024-09-16T01:27:04.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.391+0000 7f0e768f1640 1 -- 172.21.15.63:0/2501979170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e701a03a0 con 0x7f0e70100a30 2024-09-16T01:27:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.392+0000 7f0e6d7fa640 1 -- 172.21.15.63:0/2501979170 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0e60042030 con 0x7f0e70100a30 2024-09-16T01:27:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.393+0000 7f0e6d7fa640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0e580a3250 0x7f0e580a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.393+0000 7f0e6f7fe640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0e580a3250 0x7f0e580a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.393+0000 7f0e6d7fa640 1 -- 172.21.15.63:0/2501979170 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f0e600f0390 con 0x7f0e70100a30 2024-09-16T01:27:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.393+0000 7f0e6f7fe640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0e580a3250 0x7f0e580a5710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e70199340 tx=0x7f0e64005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:04.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.396+0000 7f0e6d7fa640 1 -- 172.21.15.63:0/2501979170 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e600bd0b0 con 0x7f0e70100a30 2024-09-16T01:27:04.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.572+0000 7f0e768f1640 1 -- 172.21.15.63:0/2501979170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e701a0730 con 0x7f0e70100a30 2024-09-16T01:27:04.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.572+0000 7f0e6d7fa640 1 -- 172.21.15.63:0/2501979170 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f0e600bc9b0 con 0x7f0e70100a30 2024-09-16T01:27:04.574 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-09-16T01:27:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 -- 172.21.15.63:0/2501979170 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0e580a3250 msgr2=0x7f0e580a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0e580a3250 0x7f0e580a5710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e70199340 tx=0x7f0e64005bf0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 -- 172.21.15.63:0/2501979170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e70100a30 msgr2=0x7f0e70197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e70100a30 0x7f0e70197e30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0e60004270 tx=0x7f0e60031a30 comp rx=0 tx=0).stop 2024-09-16T01:27:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 -- 172.21.15.63:0/2501979170 shutdown_connections 2024-09-16T01:27:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f0e580a3250 0x7f0e580a5710 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e701025e0 0x7f0e7019f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e70101c20 0x7f0e70198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 --2- 172.21.15.63:0/2501979170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e70100a30 0x7f0e70197e30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 -- 172.21.15.63:0/2501979170 >> 172.21.15.63:0/2501979170 conn(0x7f0e700fc1b0 msgr2=0x7f0e7006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 -- 172.21.15.63:0/2501979170 shutdown_connections 2024-09-16T01:27:04.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.575+0000 7f0e768f1640 1 -- 172.21.15.63:0/2501979170 wait complete. 2024-09-16T01:27:04.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:04 smithi063 ceph-mon[31070]: pgmap v447: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:04.586 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:04 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3989561262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:27:04.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T01:27:04.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:04 smithi192 ceph-mon[34775]: pgmap v447: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:04.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:04 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3989561262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:27:04.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:04 smithi162 ceph-mon[34539]: pgmap v447: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:04.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:04 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3989561262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:27:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.692+0000 7f404d6d0640 1 -- 172.21.15.63:0/2573962679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4048100a30 msgr2=0x7f4048100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.692+0000 7f404d6d0640 1 --2- 172.21.15.63:0/2573962679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4048100a30 0x7f4048100e30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4038009900 tx=0x7f403802a410 comp rx=0 tx=0).stop 2024-09-16T01:27:04.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.692+0000 7f404d6d0640 1 -- 172.21.15.63:0/2573962679 shutdown_connections 2024-09-16T01:27:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.692+0000 7f404d6d0640 1 --2- 172.21.15.63:0/2573962679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40481025e0 0x7f4048108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.692+0000 7f404d6d0640 1 --2- 172.21.15.63:0/2573962679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4048101c20 0x7f40481020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.692+0000 7f404d6d0640 1 --2- 172.21.15.63:0/2573962679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4048100a30 0x7f4048100e30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.692+0000 7f404d6d0640 1 -- 172.21.15.63:0/2573962679 >> 172.21.15.63:0/2573962679 conn(0x7f40480fc1b0 msgr2=0x7f40480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.692+0000 7f404d6d0640 1 -- 172.21.15.63:0/2573962679 shutdown_connections 2024-09-16T01:27:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.692+0000 7f404d6d0640 1 -- 172.21.15.63:0/2573962679 wait complete. 2024-09-16T01:27:04.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.692+0000 7f404d6d0640 1 Processor -- start 2024-09-16T01:27:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f404d6d0640 1 -- start start 2024-09-16T01:27:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f404d6d0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4048100a30 0x7f4048197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f404d6d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4048101c20 0x7f40481983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f404d6d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40481025e0 0x7f404819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f404d6d0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f404810c5c0 con 0x7f4048100a30 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f404d6d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f404810c440 con 0x7f40481025e0 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f404d6d0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f404810c740 con 0x7f4048101c20 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f4046ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4048100a30 0x7f4048197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f4046ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4048100a30 0x7f4048197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38834/0 (socket says 172.21.15.63:38834) 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f4046ffd640 1 -- 172.21.15.63:0/2923508212 learned_addr learned my addr 172.21.15.63:0/2923508212 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f4046ffd640 1 -- 172.21.15.63:0/2923508212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4048101c20 msgr2=0x7f40481983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f4046ffd640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4048101c20 0x7f40481983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f4046ffd640 1 -- 172.21.15.63:0/2923508212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40481025e0 msgr2=0x7f404819f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f4046ffd640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40481025e0 0x7f404819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f4046ffd640 1 -- 172.21.15.63:0/2923508212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404819fac0 con 0x7f4048100a30 2024-09-16T01:27:04.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f4046ffd640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4048100a30 0x7f4048197ea0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4038004270 tx=0x7f4038031a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.693+0000 7f402ffff640 1 -- 172.21.15.63:0/2923508212 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403803f030 con 0x7f4048100a30 2024-09-16T01:27:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.694+0000 7f402ffff640 1 -- 172.21.15.63:0/2923508212 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4038003cb0 con 0x7f4048100a30 2024-09-16T01:27:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.694+0000 7f404d6d0640 1 -- 172.21.15.63:0/2923508212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404819fd50 con 0x7f4048100a30 2024-09-16T01:27:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.694+0000 7f402ffff640 1 -- 172.21.15.63:0/2923508212 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4038035070 con 0x7f4048100a30 2024-09-16T01:27:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.694+0000 7f404d6d0640 1 -- 172.21.15.63:0/2923508212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40481a0260 con 0x7f4048100a30 2024-09-16T01:27:04.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.694+0000 7f404d6d0640 1 -- 172.21.15.63:0/2923508212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40481a0490 con 0x7f4048100a30 2024-09-16T01:27:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.696+0000 7f402ffff640 1 -- 172.21.15.63:0/2923508212 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4038042030 con 0x7f4048100a30 2024-09-16T01:27:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.696+0000 7f402ffff640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f40300a3250 0x7f40300a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.697+0000 7f40467fc640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f40300a3250 0x7f40300a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.697+0000 7f402ffff640 1 -- 172.21.15.63:0/2923508212 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f40380f0390 con 0x7f4048100a30 2024-09-16T01:27:04.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.697+0000 7f40467fc640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f40300a3250 0x7f40300a5710 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f40481993b0 tx=0x7f403c006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:04.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.699+0000 7f402ffff640 1 -- 172.21.15.63:0/2923508212 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40380bd0b0 con 0x7f4048100a30 2024-09-16T01:27:04.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.876+0000 7f404d6d0640 1 -- 172.21.15.63:0/2923508212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f40481a0660 con 0x7f4048100a30 2024-09-16T01:27:04.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.876+0000 7f402ffff640 1 -- 172.21.15.63:0/2923508212 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f40380bc9b0 con 0x7f4048100a30 2024-09-16T01:27:04.878 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-09-16T01:27:04.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 -- 172.21.15.63:0/2923508212 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f40300a3250 msgr2=0x7f40300a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f40300a3250 0x7f40300a5710 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f40481993b0 tx=0x7f403c006c90 comp rx=0 tx=0).stop 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 -- 172.21.15.63:0/2923508212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4048100a30 msgr2=0x7f4048197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4048100a30 0x7f4048197ea0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4038004270 tx=0x7f4038031a30 comp rx=0 tx=0).stop 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 -- 172.21.15.63:0/2923508212 shutdown_connections 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f40300a3250 0x7f40300a5710 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40481025e0 0x7f404819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4048101c20 0x7f40481983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 --2- 172.21.15.63:0/2923508212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4048100a30 0x7f4048197ea0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 -- 172.21.15.63:0/2923508212 >> 172.21.15.63:0/2923508212 conn(0x7f40480fc1b0 msgr2=0x7f404806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 -- 172.21.15.63:0/2923508212 shutdown_connections 2024-09-16T01:27:04.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.878+0000 7f404d6d0640 1 -- 172.21.15.63:0/2923508212 wait complete. 2024-09-16T01:27:04.890 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T01:27:04.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.996+0000 7f23a2a65640 1 -- 172.21.15.63:0/2127856979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c101bf0 msgr2=0x7f239c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:04.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.996+0000 7f23a2a65640 1 --2- 172.21.15.63:0/2127856979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c101bf0 0x7f239c102070 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2384009900 tx=0x7f238402a410 comp rx=0 tx=0).stop 2024-09-16T01:27:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.996+0000 7f23a2a65640 1 -- 172.21.15.63:0/2127856979 shutdown_connections 2024-09-16T01:27:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.996+0000 7f23a2a65640 1 --2- 172.21.15.63:0/2127856979 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c1025b0 0x7f239c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.996+0000 7f23a2a65640 1 --2- 172.21.15.63:0/2127856979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c101bf0 0x7f239c102070 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.996+0000 7f23a2a65640 1 --2- 172.21.15.63:0/2127856979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f239c100a00 0x7f239c100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.996+0000 7f23a2a65640 1 -- 172.21.15.63:0/2127856979 >> 172.21.15.63:0/2127856979 conn(0x7f239c0fc140 msgr2=0x7f239c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.996+0000 7f23a2a65640 1 -- 172.21.15.63:0/2127856979 shutdown_connections 2024-09-16T01:27:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.996+0000 7f23a2a65640 1 -- 172.21.15.63:0/2127856979 wait complete. 2024-09-16T01:27:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a2a65640 1 Processor -- start 2024-09-16T01:27:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a2a65640 1 -- start start 2024-09-16T01:27:05.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a2a65640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c100a00 0x7f239c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:05.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a2a65640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f239c101bf0 0x7f239c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:05.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a2a65640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c1025b0 0x7f239c19f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:05.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a2a65640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f239c10c510 con 0x7f239c1025b0 2024-09-16T01:27:05.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a2a65640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f239c10c390 con 0x7f239c100a00 2024-09-16T01:27:05.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a2a65640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f239c10c690 con 0x7f239c101bf0 2024-09-16T01:27:05.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a1002640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c1025b0 0x7f239c19f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:05.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a1002640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c1025b0 0x7f239c19f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38856/0 (socket says 172.21.15.63:38856) 2024-09-16T01:27:05.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a1002640 1 -- 172.21.15.63:0/4060003611 learned_addr learned my addr 172.21.15.63:0/4060003611 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:05.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a0801640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c100a00 0x7f239c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f239bfff640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f239c101bf0 0x7f239c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a1002640 1 -- 172.21.15.63:0/4060003611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f239c101bf0 msgr2=0x7f239c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a1002640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f239c101bf0 0x7f239c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a1002640 1 -- 172.21.15.63:0/4060003611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c100a00 msgr2=0x7f239c197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a1002640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c100a00 0x7f239c197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.997+0000 7f23a1002640 1 -- 172.21.15.63:0/4060003611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239c19f9f0 con 0x7f239c1025b0 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.998+0000 7f23a1002640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c1025b0 0x7f239c19f380 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f239400eaa0 tx=0x7f239400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.998+0000 7f2399ffb640 1 -- 172.21.15.63:0/4060003611 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239400cdb0 con 0x7f239c1025b0 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.998+0000 7f23a2a65640 1 -- 172.21.15.63:0/4060003611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239c19fce0 con 0x7f239c1025b0 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.998+0000 7f2399ffb640 1 -- 172.21.15.63:0/4060003611 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2394005020 con 0x7f239c1025b0 2024-09-16T01:27:05.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.998+0000 7f2399ffb640 1 -- 172.21.15.63:0/4060003611 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239401f060 con 0x7f239c1025b0 2024-09-16T01:27:05.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.998+0000 7f23a2a65640 1 -- 172.21.15.63:0/4060003611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f239c1a0180 con 0x7f239c1025b0 2024-09-16T01:27:05.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:04.999+0000 7f23a2a65640 1 -- 172.21.15.63:0/4060003611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f239c1a0410 con 0x7f239c1025b0 2024-09-16T01:27:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.000+0000 7f2399ffb640 1 -- 172.21.15.63:0/4060003611 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f23940051d0 con 0x7f239c1025b0 2024-09-16T01:27:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.001+0000 7f2399ffb640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f23880a3250 0x7f23880a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.001+0000 7f23a0801640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f23880a3250 0x7f23880a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.001+0000 7f2399ffb640 1 -- 172.21.15.63:0/4060003611 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f23940cfae0 con 0x7f239c1025b0 2024-09-16T01:27:05.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.001+0000 7f23a0801640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f23880a3250 0x7f23880a5710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f239c101a50 tx=0x7f238c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:05.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.005+0000 7f2399ffb640 1 -- 172.21.15.63:0/4060003611 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2394016030 con 0x7f239c1025b0 2024-09-16T01:27:05.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.182+0000 7f23a2a65640 1 -- 172.21.15.63:0/4060003611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f239c1a0cc0 con 0x7f239c1025b0 2024-09-16T01:27:05.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.182+0000 7f2399ffb640 1 -- 172.21.15.63:0/4060003611 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f239409c800 con 0x7f239c1025b0 2024-09-16T01:27:05.184 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-09-16T01:27:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.184+0000 7f23a2a65640 1 -- 172.21.15.63:0/4060003611 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f23880a3250 msgr2=0x7f23880a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.184+0000 7f23a2a65640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f23880a3250 0x7f23880a5710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f239c101a50 tx=0x7f238c00b390 comp rx=0 tx=0).stop 2024-09-16T01:27:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.184+0000 7f23a2a65640 1 -- 172.21.15.63:0/4060003611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c1025b0 msgr2=0x7f239c19f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.184+0000 7f23a2a65640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c1025b0 0x7f239c19f380 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f239400eaa0 tx=0x7f239400ef60 comp rx=0 tx=0).stop 2024-09-16T01:27:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.185+0000 7f23a2a65640 1 -- 172.21.15.63:0/4060003611 shutdown_connections 2024-09-16T01:27:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.185+0000 7f23a2a65640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f23880a3250 0x7f23880a5710 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.185+0000 7f23a2a65640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c1025b0 0x7f239c19f380 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.185+0000 7f23a2a65640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f239c101bf0 0x7f239c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.185+0000 7f23a2a65640 1 --2- 172.21.15.63:0/4060003611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f239c100a00 0x7f239c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.185+0000 7f23a2a65640 1 -- 172.21.15.63:0/4060003611 >> 172.21.15.63:0/4060003611 conn(0x7f239c0fc140 msgr2=0x7f239c0693b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.185+0000 7f23a2a65640 1 -- 172.21.15.63:0/4060003611 shutdown_connections 2024-09-16T01:27:05.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.185+0000 7f23a2a65640 1 -- 172.21.15.63:0/4060003611 wait complete. 2024-09-16T01:27:05.197 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-16T01:27:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.299+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2104250374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f24104ee0 msgr2=0x7f6f241072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.299+0000 7f6f29bcf640 1 --2- 172.21.15.63:0/2104250374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f24104ee0 0x7f6f241072d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009900 tx=0x7f6f0c02a410 comp rx=0 tx=0).stop 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.299+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2104250374 shutdown_connections 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.299+0000 7f6f29bcf640 1 --2- 172.21.15.63:0/2104250374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f24107810 0x7f6f24109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.299+0000 7f6f29bcf640 1 --2- 172.21.15.63:0/2104250374 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f24104ee0 0x7f6f241072d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.299+0000 7f6f29bcf640 1 --2- 172.21.15.63:0/2104250374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f241025b0 0x7f6f241049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.299+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2104250374 >> 172.21.15.63:0/2104250374 conn(0x7f6f240fc1b0 msgr2=0x7f6f240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.299+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2104250374 shutdown_connections 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.299+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2104250374 wait complete. 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f29bcf640 1 Processor -- start 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f29bcf640 1 -- start start 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f29bcf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f241025b0 0x7f6f24197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f29bcf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f24104ee0 0x7f6f24198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f29bcf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f24107810 0x7f6f2419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f29bcf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2410d670 con 0x7f6f24104ee0 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f29bcf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2410d4f0 con 0x7f6f241025b0 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f29bcf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2410d7f0 con 0x7f6f24107810 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f1affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f24104ee0 0x7f6f24198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f1affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f24104ee0 0x7f6f24198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38876/0 (socket says 172.21.15.63:38876) 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.300+0000 7f6f1affd640 1 -- 172.21.15.63:0/2152680530 learned_addr learned my addr 172.21.15.63:0/2152680530 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f237fe640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f241025b0 0x7f6f24197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f23fff640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f24107810 0x7f6f2419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f1affd640 1 -- 172.21.15.63:0/2152680530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f24107810 msgr2=0x7f6f2419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f1affd640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f24107810 0x7f6f2419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f1affd640 1 -- 172.21.15.63:0/2152680530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f241025b0 msgr2=0x7f6f24197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:05.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f1affd640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f241025b0 0x7f6f24197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f1affd640 1 -- 172.21.15.63:0/2152680530 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2419fa60 con 0x7f6f24104ee0 2024-09-16T01:27:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f237fe640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f241025b0 0x7f6f24197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:27:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f1affd640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f24104ee0 0x7f6f24198380 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0314e0 tx=0x7f6f0c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f217fa640 1 -- 172.21.15.63:0/2152680530 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c03f030 con 0x7f6f24104ee0 2024-09-16T01:27:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f217fa640 1 -- 172.21.15.63:0/2152680530 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6f0c003cb0 con 0x7f6f24104ee0 2024-09-16T01:27:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f217fa640 1 -- 172.21.15.63:0/2152680530 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c035070 con 0x7f6f24104ee0 2024-09-16T01:27:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2152680530 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2419fcf0 con 0x7f6f24104ee0 2024-09-16T01:27:05.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.301+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2152680530 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f241a0190 con 0x7f6f24104ee0 2024-09-16T01:27:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.302+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2152680530 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f240fdca0 con 0x7f6f24104ee0 2024-09-16T01:27:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.303+0000 7f6f217fa640 1 -- 172.21.15.63:0/2152680530 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6f0c042030 con 0x7f6f24104ee0 2024-09-16T01:27:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.304+0000 7f6f217fa640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6f100a3250 0x7f6f100a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.304+0000 7f6f217fa640 1 -- 172.21.15.63:0/2152680530 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f6f0c0effd0 con 0x7f6f24104ee0 2024-09-16T01:27:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.304+0000 7f6f237fe640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6f100a3250 0x7f6f100a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:05.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.305+0000 7f6f237fe640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6f100a3250 0x7f6f100a5710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400baa0 tx=0x7f6f14005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:05.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.308+0000 7f6f217fa640 1 -- 172.21.15.63:0/2152680530 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f0c0bccf0 con 0x7f6f24104ee0 2024-09-16T01:27:05.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.536+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2152680530 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f6f24062e90 con 0x7f6f24104ee0 2024-09-16T01:27:05.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.544+0000 7f6f217fa640 1 -- 172.21.15.63:0/2152680530 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742339 (secure 0 0 0) 0x7f6f0c0bc5f0 con 0x7f6f24104ee0 2024-09-16T01:27:05.555 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:27:05.555 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:27:05.555 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 18, 2024-09-16T01:27:05.555 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.555 INFO:teuthology.orchestra.run.smithi063.stdout: "active_gid": 14150, 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: "active_name": "x", 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: "active_addrs": { 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3860332424 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2024-09-16T01:27:05.556 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3860332424 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: "active_addr": "172.21.15.63:6801/3860332424", 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: "active_change": "2024-09-16T01:14:37.096415+0000", 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: "active_mgr_features": 4540701547738038271, 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: "available": true, 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: "standbys": [ 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 24112, 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "z", 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_features": 4540701547738038271, 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: "available_modules": [ 2024-09-16T01:27:05.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "alerts", 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.558 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.559 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.560 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.561 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.562 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.563 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_destination": { 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_destination", 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email address to send alerts to", 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.565 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_from_name": { 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_from_name", 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "Ceph", 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email From: name", 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_host": { 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_host", 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP server", 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.567 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_password": { 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_password", 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.568 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Password to authenticate with", 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_port": { 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_port", 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "465", 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.569 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP port", 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_sender": { 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_sender", 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.570 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP envelope sender", 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_ssl": { 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_ssl", 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.571 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_user": { 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_user", 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.572 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "User to authenticate as", 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.573 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "balancer", 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "active": { 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "active", 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.574 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_time": { 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_time", 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0000", 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_weekday": { 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_weekday", 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-16T01:27:05.576 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_max_iterations": { 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_max_iterations", 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.577 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "25", 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "250", 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_metrics": { 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_metrics", 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.578 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_step": { 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_step", 2024-09-16T01:27:05.579 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.5", 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0.001", 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "0.999", 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "aggressiveness of optimization", 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "end_time": { 2024-09-16T01:27:05.580 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_time", 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2359", 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.581 INFO:teuthology.orchestra.run.smithi063.stdout: "end_weekday": { 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_weekday", 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.582 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.583 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.586 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "min_score": { 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_score", 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.588 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "upmap", 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-compat", 2024-09-16T01:27:05.589 INFO:teuthology.orchestra.run.smithi063.stdout: "none", 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "read", 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap", 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap-read" 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Balancer mode", 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ids": { 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_ids", 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.590 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:05.591 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_deviation": { 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_deviation", 2024-09-16T01:27:05.592 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_optimizations": { 2024-09-16T01:27:05.593 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_optimizations", 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm", 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_down_multiplier": { 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_down_multiplier", 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.595 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_refresh_rate": { 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_refresh_rate", 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "20", 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.596 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_starting_port": { 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_starting_port", 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4721", 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.597 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_ptrace": { 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_ptrace", 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.598 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_interval": { 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_interval", 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:05.599 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_memory_target_ratio": { 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.7", 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm_log_destination": { 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm_log_destination", 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "file", 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "file,syslog", 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "syslog" 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "cgroups_split": { 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cgroups_split", 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "config_checks_enabled": { 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_checks_enabled", 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.604 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "config_dashboard": { 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_dashboard", 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T01:27:05.605 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_alertmanager": { 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_alertmanager", 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.606 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_base": { 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_base", 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.607 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Container image name, without the tag", 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_elasticsearch": { 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_elasticsearch", 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.608 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "elasticsearch container image", 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_grafana": { 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_grafana", 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_haproxy": { 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_haproxy", 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.610 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "HAproxy container image", 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_agent": { 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_agent", 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.611 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger agent container image", 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_collector": { 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_collector", 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.612 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger collector container image", 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_query": { 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_query", 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger query container image", 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_keepalived": { 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_keepalived", 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.614 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Keepalived container image", 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_loki": { 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_loki", 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.615 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Loki container image", 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_node_exporter": { 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_node_exporter", 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.616 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_nvmeof": { 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_nvmeof", 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.617 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Nvme-of container image", 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_prometheus": { 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_prometheus", 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_promtail": { 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_promtail", 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.619 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T01:27:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Promtail container image", 2024-09-16T01:27:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_samba": { 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_samba", 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Samba/SMB container image", 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.621 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_snmp_gateway": { 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_snmp_gateway", 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SNMP Gateway container image", 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.622 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "container_init": { 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_init", 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T01:27:05.623 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "daemon_cache_timeout": { 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "daemon_cache_timeout", 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.624 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "default_cephadm_command_timeout": { 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "900", 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.625 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "default_registry": { 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_registry", 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io", 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.626 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "device_cache_timeout": { 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_cache_timeout", 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1800", 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.627 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache device inventory", 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "device_enhanced_scan": { 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_enhanced_scan", 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.628 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "facts_cache_timeout": { 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "facts_cache_timeout", 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.629 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache host facts data", 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "grafana_dashboards_path": { 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "grafana_dashboards_path", 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.630 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "host_check_interval": { 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "host_check_interval", 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.631 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to perform a host check", 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "hw_monitoring": { 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hw_monitoring", 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.632 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "inventory_list_all": { 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "inventory_list_all", 2024-09-16T01:27:05.633 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.634 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.635 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "log_refresh_metadata": { 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_refresh_metadata", 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.636 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.637 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.638 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.639 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.640 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.641 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "*", 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.642 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "max_count_per_host": { 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_count_per_host", 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.643 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of daemons per service per host", 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd_draining_count": { 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_osd_draining_count", 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:05.644 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "migration_current": { 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "migration_current", 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.645 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "internal - do not modify", 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.646 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "root", 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm-package", 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "root" 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "oob_default_addr": { 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "oob_default_addr", 2024-09-16T01:27:05.647 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "169.254.1.1", 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "prometheus_alerts_path": { 2024-09-16T01:27:05.648 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus_alerts_path", 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.649 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_insecure": { 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_insecure", 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_password": { 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_password", 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_url": { 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_url", 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_username": { 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_username", 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.653 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "secure_monitoring_stack": { 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secure_monitoring_stack", 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.654 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "service_discovery_port": { 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "service_discovery_port", 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8765", 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "cephadm service discovery port", 2024-09-16T01:27:05.655 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_config_file": { 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_config_file", 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.656 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "use_agent": { 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_agent", 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.657 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "use_repo_digest": { 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_repo_digest", 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T01:27:05.658 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_failed_host_check": { 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_failed_host_check", 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T01:27:05.659 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_daemons": { 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_daemons", 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T01:27:05.660 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_hosts": { 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_hosts", 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T01:27:05.661 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crash", 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.662 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.665 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.667 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "retain_interval": { 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retain_interval", 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "31536000", 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.668 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_recent_interval": { 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_recent_interval", 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1209600", 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T01:27:05.669 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dashboard", 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T01:27:05.670 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T01:27:05.671 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T01:27:05.672 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.673 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_ENABLED": { 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.674 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.676 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.677 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.678 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.679 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.680 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.681 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.682 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.683 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.684 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.685 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.686 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_URL": { 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_URL", 2024-09-16T01:27:05.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T01:27:05.688 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T01:27:05.689 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.689 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.689 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.692 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-16T01:27:05.692 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.693 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T01:27:05.694 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.695 INFO:teuthology.orchestra.run.smithi063.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.697 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.698 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.699 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.700 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.701 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.702 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.703 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.704 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.705 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.706 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.707 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.708 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T01:27:05.709 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T01:27:05.710 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8", 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T01:27:05.711 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "45", 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.712 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.714 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.715 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.716 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.717 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.718 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.719 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "cross_origin_url": { 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cross_origin_url", 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.720 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "crt_file": { 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crt_file", 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.721 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "debug": { 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "debug", 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.722 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable/disable debug options", 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "jwt_token_ttl": { 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "jwt_token_ttl", 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.723 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "28800", 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.724 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.726 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.727 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.728 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.729 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.730 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "motd": { 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "motd", 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "The message of the day", 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.731 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect_resolve_ip_addr": { 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.732 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.733 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8080", 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.734 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.735 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl_server_port": { 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl_server_port", 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8443", 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.736 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.737 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "redirect", 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect" 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.738 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "url_prefix": { 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url_prefix", 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.740 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "devicehealth", 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_monitoring": { 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_monitoring", 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.741 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "monitor device health metrics", 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.742 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.743 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.744 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.745 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.746 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.747 INFO:teuthology.orchestra.run.smithi063.stdout: "mark_out_threshold": { 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mark_out_threshold", 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2419200", 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": { 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_name", 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "device_health_metrics", 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "retention_period": { 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retention_period", 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15552000", 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain device health metrics", 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.750 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_frequency": { 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_frequency", 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.751 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "self_heal": { 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "self_heal", 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.752 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.753 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_threshold": { 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_threshold", 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7257600", 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.754 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "diskprediction_local", 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.755 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.756 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.757 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.758 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.760 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "predict_interval": { 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predict_interval", 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.761 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "predictor_model": { 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predictor_model", 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "prophetstor", 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.762 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.763 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "influx", 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": false, 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "influxdb python module not found", 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: "batch_size": { 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "batch_size", 2024-09-16T01:27:05.764 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5000", 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.765 INFO:teuthology.orchestra.run.smithi063.stdout: "database": { 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "database", 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "ceph", 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.766 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": { 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hostname", 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server hostname", 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.767 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "30", 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "5", 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.768 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.769 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "password": { 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "password", 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.774 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "password of InfluxDB server user", 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "port": { 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "port", 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.775 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8086", 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server port", 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.776 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "false", 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "threads": { 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threads", 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.777 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "32", 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "username": { 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "username", 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.778 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "username of InfluxDB server user", 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "verify_ssl": { 2024-09-16T01:27:05.779 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "verify_ssl", 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "true", 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.780 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "insights", 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.781 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.782 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.783 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.784 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.785 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.786 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "iostat", 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.787 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.788 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.789 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.790 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.791 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "k8sevents", 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_event_retention_days": { 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ceph_event_retention_days", 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7", 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.793 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "config_check_secs": { 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_check_secs", 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:05.794 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "10", 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.795 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.796 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.797 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.798 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.800 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "localpool", 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: "failure_domain": { 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "failure_domain", 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.801 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "host", 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "failure domain for any created local pool", 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.802 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.803 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.804 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.805 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.806 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": { 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_size", 2024-09-16T01:27:05.807 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default min_size for any created local pool", 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rep": { 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "num_rep", 2024-09-16T01:27:05.808 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3", 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default replica count for any created local pool", 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.809 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": { 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_num", 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "128", 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "prefix": { 2024-09-16T01:27:05.810 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prefix", 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name prefix for any created local pool", 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.811 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": { 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "subtree", 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "rack", 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.812 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mds_autoscaler", 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.813 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.814 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.815 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.816 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.818 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirroring", 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.819 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.820 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.821 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.822 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.823 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "nfs", 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.825 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.826 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.828 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.829 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.830 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "fail_fs": { 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "fail_fs", 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.831 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.832 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.833 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.834 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.835 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.836 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator": { 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.837 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm", 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "rook", 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "test_orchestrator" 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Orchestrator backend", 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.838 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_perf_query", 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.839 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.840 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.841 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.842 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.844 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_support", 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.845 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.846 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.847 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.848 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.849 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_autoscaler", 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.851 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.852 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.853 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.854 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.855 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:05.856 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.857 INFO:teuthology.orchestra.run.smithi063.stdout: "threshold": { 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threshold", 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1.0", 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "scaling threshold", 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.858 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "progress", 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_pg_recovery_event": { 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_pg_recovery_event", 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.859 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.860 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.861 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.862 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.863 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.864 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.865 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.866 INFO:teuthology.orchestra.run.smithi063.stdout: "max_completed_events": { 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_completed_events", 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "50", 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "number of past completed events to remember", 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long the module is going to sleep", 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.868 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus", 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: "cache": { 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cache", 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.869 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "exclude_perf_counters": { 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "exclude_perf_counters", 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.870 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.871 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.872 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.873 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.874 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.875 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.876 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools": { 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools", 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.877 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "300", 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.878 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_interval": { 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_interval", 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15.0", 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.879 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-16T01:27:05.880 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "9283", 2024-09-16T01:27:05.881 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: "stale_cache_strategy": { 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stale_cache_strategy", 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.882 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "log", 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-16T01:27:05.883 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "default", 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "default", 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "error" 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.884 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.885 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_support", 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.886 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.887 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.888 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.889 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.891 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_snap_create": { 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_snap_create", 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.892 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "mirror_snapshot_schedule": { 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.893 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "trash_purge_schedule": { 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "trash_purge_schedule", 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.894 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "restful", 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_auth": { 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_auth", 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.895 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.896 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.897 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.897 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.897 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.897 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.897 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.897 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.897 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.897 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.897 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.898 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.899 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.900 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.901 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.902 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.903 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rgw", 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.906 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.907 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.909 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.910 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.911 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.912 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rook", 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.913 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.915 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.916 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.917 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.918 INFO:teuthology.orchestra.run.smithi063.stdout: "storage_class": { 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "storage_class", 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "local", 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.919 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "selftest", 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.921 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.922 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.923 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.924 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.925 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "roption1": { 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption1", 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.926 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "roption2": { 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption2", 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "xyz", 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.927 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption1": { 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption1", 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.928 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption2": { 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption2", 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.929 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption3": { 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption3", 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.930 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption4": { 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption4", 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.931 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption5": { 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption5", 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption6": { 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption6", 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.933 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption7": { 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption7", 2024-09-16T01:27:05.934 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "42", 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "testkey": { 2024-09-16T01:27:05.935 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testkey", 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.936 INFO:teuthology.orchestra.run.smithi063.stdout: "testlkey": { 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testlkey", 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "testnewline": { 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testnewline", 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.938 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snap_schedule", 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_m_granularity": { 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_m_granularity", 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.939 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "dump_on_update": { 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dump_on_update", 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.940 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "dump database to debug log on update", 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.941 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.942 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.943 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.944 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.945 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.946 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stats", 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.947 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.948 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.949 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.950 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.951 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.952 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "status", 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.953 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.954 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.955 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.956 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.957 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.958 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telegraf", 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: "address": { 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "address", 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.959 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:05.960 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15", 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.961 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.962 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.963 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.964 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.965 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.966 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telemetry", 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_basic": { 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_basic", 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.967 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_crash": { 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_crash", 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.968 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_device": { 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_device", 2024-09-16T01:27:05.969 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_ident": { 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_ident", 2024-09-16T01:27:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_perf": { 2024-09-16T01:27:05.971 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_perf", 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.972 INFO:teuthology.orchestra.run.smithi063.stdout: "contact": { 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "contact", 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "description": { 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "description", 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.974 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "device_url": { 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_url", 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.975 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.976 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "24", 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "8", 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.977 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "last_opt_revision": { 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "last_opt_revision", 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1", 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.978 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard": { 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard", 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.979 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard_description": { 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard_description", 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.980 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.981 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.981 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.981 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.981 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.981 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.981 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.981 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.981 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.981 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.985 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.985 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.985 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.985 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.985 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.985 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.985 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.985 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.985 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.986 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.987 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.988 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.989 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "organization": { 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "organization", 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.990 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "proxy": { 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "proxy", 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.991 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "url": { 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url", 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.992 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "test_orchestrator", 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:05.994 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.996 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:05.997 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:05.998 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:05.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "volumes", 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.000 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.001 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.002 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.003 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.004 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_clones": { 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_clones", 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4", 2024-09-16T01:27:06.005 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "periodic_async_work": { 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "periodic_async_work", 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.006 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Periodically check for async work", 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_delay": { 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_delay", 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.007 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_no_wait": { 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.008 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.009 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix", 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "discovery_interval": { 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "discovery_interval", 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "100", 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.010 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "identifier": { 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "identifier", 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.011 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.012 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.013 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.014 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.015 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.016 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.017 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_host": { 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_host", 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.018 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_port": { 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_port", 2024-09-16T01:27:06.019 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10051", 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_sender": { 2024-09-16T01:27:06.020 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_sender", 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.021 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: "gid": 24128, 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "y", 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_features": 4540701547738038271, 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: "available_modules": [ 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "alerts", 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.022 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.023 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.024 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.025 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.026 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.028 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_destination": { 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_destination", 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.029 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email address to send alerts to", 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_from_name": { 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_from_name", 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "Ceph", 2024-09-16T01:27:06.030 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email From: name", 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_host": { 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_host", 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.031 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP server", 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_password": { 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_password", 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.032 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Password to authenticate with", 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_port": { 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_port", 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.033 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "465", 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP port", 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_sender": { 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_sender", 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.034 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP envelope sender", 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_ssl": { 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_ssl", 2024-09-16T01:27:06.035 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_user": { 2024-09-16T01:27:06.036 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_user", 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "User to authenticate as", 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.037 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "balancer", 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "active": { 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "active", 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.038 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_time": { 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_time", 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0000", 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.039 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_weekday": { 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_weekday", 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.040 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_max_iterations": { 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_max_iterations", 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.041 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "25", 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "250", 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_metrics": { 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_metrics", 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.042 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_step": { 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_step", 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.043 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.5", 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0.001", 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "0.999", 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "aggressiveness of optimization", 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "end_time": { 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_time", 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.044 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2359", 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "end_weekday": { 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_weekday", 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.045 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.046 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.047 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.050 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.051 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "min_score": { 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_score", 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T01:27:06.052 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "upmap", 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.053 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-compat", 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "none", 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "read", 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap", 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap-read" 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Balancer mode", 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ids": { 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_ids", 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.054 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:06.055 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_deviation": { 2024-09-16T01:27:06.056 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_deviation", 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.057 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_optimizations": { 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_optimizations", 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.058 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm", 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_down_multiplier": { 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_down_multiplier", 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.059 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_refresh_rate": { 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_refresh_rate", 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "20", 2024-09-16T01:27:06.060 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_starting_port": { 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_starting_port", 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4721", 2024-09-16T01:27:06.061 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_ptrace": { 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_ptrace", 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.062 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_interval": { 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_interval", 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.063 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_memory_target_ratio": { 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T01:27:06.064 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.7", 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm_log_destination": { 2024-09-16T01:27:06.065 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm_log_destination", 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "file", 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "file,syslog", 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "syslog" 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T01:27:06.066 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "cgroups_split": { 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cgroups_split", 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T01:27:06.067 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "config_checks_enabled": { 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_checks_enabled", 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.068 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "config_dashboard": { 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_dashboard", 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.069 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_alertmanager": { 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_alertmanager", 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-16T01:27:06.070 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_base": { 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_base", 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.071 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Container image name, without the tag", 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_elasticsearch": { 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_elasticsearch", 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.072 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "elasticsearch container image", 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_grafana": { 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_grafana", 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.073 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_haproxy": { 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_haproxy", 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.074 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "HAproxy container image", 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_agent": { 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_agent", 2024-09-16T01:27:06.075 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger agent container image", 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_collector": { 2024-09-16T01:27:06.076 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_collector", 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger collector container image", 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_query": { 2024-09-16T01:27:06.077 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_query", 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger query container image", 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.078 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_keepalived": { 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_keepalived", 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Keepalived container image", 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_loki": { 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_loki", 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Loki container image", 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_node_exporter": { 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_node_exporter", 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_nvmeof": { 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_nvmeof", 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Nvme-of container image", 2024-09-16T01:27:06.082 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_prometheus": { 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_prometheus", 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.083 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_promtail": { 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_promtail", 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.084 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Promtail container image", 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_samba": { 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_samba", 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T01:27:06.085 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Samba/SMB container image", 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_snmp_gateway": { 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_snmp_gateway", 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T01:27:06.086 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SNMP Gateway container image", 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "container_init": { 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_init", 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.087 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "daemon_cache_timeout": { 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "daemon_cache_timeout", 2024-09-16T01:27:06.088 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "default_cephadm_command_timeout": { 2024-09-16T01:27:06.089 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "900", 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.090 INFO:teuthology.orchestra.run.smithi063.stdout: "default_registry": { 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_registry", 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io", 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "device_cache_timeout": { 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_cache_timeout", 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1800", 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache device inventory", 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "device_enhanced_scan": { 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_enhanced_scan", 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.093 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "facts_cache_timeout": { 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "facts_cache_timeout", 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache host facts data", 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.094 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "grafana_dashboards_path": { 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "grafana_dashboards_path", 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.095 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "host_check_interval": { 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "host_check_interval", 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to perform a host check", 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.096 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "hw_monitoring": { 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hw_monitoring", 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.097 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "inventory_list_all": { 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "inventory_list_all", 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.098 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.099 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "log_refresh_metadata": { 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_refresh_metadata", 2024-09-16T01:27:06.100 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.101 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.103 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.104 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.105 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.106 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "*", 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "max_count_per_host": { 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_count_per_host", 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.107 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of daemons per service per host", 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd_draining_count": { 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_osd_draining_count", 2024-09-16T01:27:06.108 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "migration_current": { 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "migration_current", 2024-09-16T01:27:06.109 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "internal - do not modify", 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-16T01:27:06.110 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "root", 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm-package", 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "root" 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.111 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "oob_default_addr": { 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "oob_default_addr", 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "169.254.1.1", 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.112 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "prometheus_alerts_path": { 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus_alerts_path", 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.113 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_insecure": { 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_insecure", 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T01:27:06.114 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_password": { 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_password", 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.115 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_url": { 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_url", 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.116 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_username": { 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_username", 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.117 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "secure_monitoring_stack": { 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secure_monitoring_stack", 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.118 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "service_discovery_port": { 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "service_discovery_port", 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.119 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8765", 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "cephadm service discovery port", 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_config_file": { 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_config_file", 2024-09-16T01:27:06.120 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "use_agent": { 2024-09-16T01:27:06.121 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_agent", 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.122 INFO:teuthology.orchestra.run.smithi063.stdout: "use_repo_digest": { 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_repo_digest", 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.123 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_failed_host_check": { 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_failed_host_check", 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_daemons": { 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_daemons", 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.125 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_hosts": { 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_hosts", 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.126 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crash", 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.127 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.128 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.129 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.130 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.131 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.132 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "retain_interval": { 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retain_interval", 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "31536000", 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T01:27:06.133 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_recent_interval": { 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_recent_interval", 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1209600", 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.134 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dashboard", 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T01:27:06.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T01:27:06.136 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.137 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_ENABLED": { 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.140 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.141 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.142 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.143 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.144 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.145 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.146 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.147 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T01:27:06.148 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T01:27:06.149 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T01:27:06.150 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T01:27:06.151 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_URL": { 2024-09-16T01:27:06.152 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_URL", 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T01:27:06.153 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T01:27:06.154 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.157 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.158 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.159 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.160 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.161 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.162 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.163 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.164 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.165 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.166 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.167 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.168 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.169 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8", 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.171 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "45", 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.172 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.174 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.175 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.176 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.177 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T01:27:06.178 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T01:27:06.179 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "cross_origin_url": { 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cross_origin_url", 2024-09-16T01:27:06.180 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "crt_file": { 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crt_file", 2024-09-16T01:27:06.181 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "debug": { 2024-09-16T01:27:06.182 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "debug", 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable/disable debug options", 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "jwt_token_ttl": { 2024-09-16T01:27:06.183 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "jwt_token_ttl", 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "28800", 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.184 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.185 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.186 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.187 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.188 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.189 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "motd": { 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "motd", 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "The message of the day", 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.191 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect_resolve_ip_addr": { 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.192 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.193 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8080", 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl_server_port": { 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl_server_port", 2024-09-16T01:27:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8443", 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-16T01:27:06.196 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "redirect", 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect" 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "url_prefix": { 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url_prefix", 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.199 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "devicehealth", 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_monitoring": { 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_monitoring", 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.200 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "monitor device health metrics", 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.201 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.202 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.204 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.205 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "mark_out_threshold": { 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mark_out_threshold", 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.206 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2419200", 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": { 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_name", 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.207 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "device_health_metrics", 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "retention_period": { 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retention_period", 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.208 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15552000", 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain device health metrics", 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_frequency": { 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_frequency", 2024-09-16T01:27:06.209 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "self_heal": { 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "self_heal", 2024-09-16T01:27:06.210 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:06.211 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.212 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_threshold": { 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_threshold", 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7257600", 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.213 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "diskprediction_local", 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.214 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.215 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.216 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.217 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.218 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.219 INFO:teuthology.orchestra.run.smithi063.stdout: "predict_interval": { 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predict_interval", 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "predictor_model": { 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predictor_model", 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "prophetstor", 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.221 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.222 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "influx", 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": false, 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "influxdb python module not found", 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: "batch_size": { 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "batch_size", 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.223 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5000", 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "database": { 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "database", 2024-09-16T01:27:06.224 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "ceph", 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": { 2024-09-16T01:27:06.225 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hostname", 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server hostname", 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.226 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "30", 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "5", 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.228 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.229 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.230 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.231 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.232 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "password": { 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "password", 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.233 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "password of InfluxDB server user", 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "port": { 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "port", 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8086", 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.234 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server port", 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "false", 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.235 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "threads": { 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threads", 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "32", 2024-09-16T01:27:06.236 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "username": { 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "username", 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.237 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "username of InfluxDB server user", 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "verify_ssl": { 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "verify_ssl", 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "true", 2024-09-16T01:27:06.238 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "insights", 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.239 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.240 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.241 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.243 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.244 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "iostat", 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.245 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.246 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.247 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.248 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.249 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.250 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "k8sevents", 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_event_retention_days": { 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ceph_event_retention_days", 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7", 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.251 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "config_check_secs": { 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_check_secs", 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.252 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.253 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "10", 2024-09-16T01:27:06.253 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.253 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.253 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-16T01:27:06.253 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.253 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.253 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.253 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.253 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.254 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.255 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.256 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.258 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "localpool", 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: "failure_domain": { 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "failure_domain", 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.259 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "host", 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "failure domain for any created local pool", 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.260 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.261 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.262 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.263 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.264 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.265 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": { 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_size", 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default min_size for any created local pool", 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.266 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rep": { 2024-09-16T01:27:06.267 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "num_rep", 2024-09-16T01:27:06.267 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.267 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.267 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.267 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3", 2024-09-16T01:27:06.267 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.267 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.267 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.267 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default replica count for any created local pool", 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": { 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_num", 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "128", 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.268 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "prefix": { 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prefix", 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.269 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name prefix for any created local pool", 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": { 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "subtree", 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "rack", 2024-09-16T01:27:06.270 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mds_autoscaler", 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.271 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.273 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.274 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.275 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.276 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirroring", 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.277 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.278 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.279 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.280 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.281 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.282 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "nfs", 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.283 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.284 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.285 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.286 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.287 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.288 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "fail_fs": { 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "fail_fs", 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.289 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.290 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.291 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.292 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.293 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.294 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator": { 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.295 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm", 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: "rook", 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: "test_orchestrator" 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Orchestrator backend", 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.296 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_perf_query", 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.297 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.299 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.300 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.301 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.301 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.301 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.301 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.301 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.304 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.305 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_support", 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.306 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.307 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.308 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.309 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.311 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_autoscaler", 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.312 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.313 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.314 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.315 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.316 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "threshold": { 2024-09-16T01:27:06.318 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threshold", 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1.0", 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "scaling threshold", 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "progress", 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_pg_recovery_event": { 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_pg_recovery_event", 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.320 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.321 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.322 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.323 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.325 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.326 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "max_completed_events": { 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_completed_events", 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.327 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "50", 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "number of past completed events to remember", 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long the module is going to sleep", 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus", 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "cache": { 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cache", 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.330 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "exclude_perf_counters": { 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "exclude_perf_counters", 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.331 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.332 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.334 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.335 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.336 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.337 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools": { 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools", 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.338 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "300", 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_interval": { 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_interval", 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15.0", 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.341 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "9283", 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.342 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "stale_cache_strategy": { 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stale_cache_strategy", 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "log", 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.343 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "default", 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "default", 2024-09-16T01:27:06.344 INFO:teuthology.orchestra.run.smithi063.stdout: "error" 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-16T01:27:06.345 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_support", 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.346 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.347 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.348 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.349 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.350 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.351 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_snap_create": { 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_snap_create", 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.352 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "mirror_snapshot_schedule": { 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.353 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "trash_purge_schedule": { 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "trash_purge_schedule", 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.354 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "restful", 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_auth": { 2024-09-16T01:27:06.355 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_auth", 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.356 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.358 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.359 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.360 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.361 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.362 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.363 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.364 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rgw", 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.366 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.367 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.368 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.369 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.370 INFO:teuthology.orchestra.run.smithi063.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rook", 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.372 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.373 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.374 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.375 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.376 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "storage_class": { 2024-09-16T01:27:06.377 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "storage_class", 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "local", 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.378 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "selftest", 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.379 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.380 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.381 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.382 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.383 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "roption1": { 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption1", 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.384 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "roption2": { 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption2", 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.385 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "xyz", 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption1": { 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption1", 2024-09-16T01:27:06.386 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption2": { 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption2", 2024-09-16T01:27:06.387 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption3": { 2024-09-16T01:27:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption3", 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption4": { 2024-09-16T01:27:06.389 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption4", 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption5": { 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption5", 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.391 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption6": { 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption6", 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.392 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption7": { 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption7", 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "42", 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.393 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "testkey": { 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testkey", 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.394 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "testlkey": { 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testlkey", 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.395 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "testnewline": { 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testnewline", 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snap_schedule", 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_m_granularity": { 2024-09-16T01:27:06.397 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_m_granularity", 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.398 INFO:teuthology.orchestra.run.smithi063.stdout: "dump_on_update": { 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dump_on_update", 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "dump database to debug log on update", 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.399 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.400 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.401 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.402 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.403 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.404 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stats", 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.405 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.406 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.407 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.408 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.409 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.410 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "status", 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.411 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.412 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.413 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.414 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.415 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.416 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telegraf", 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "address": { 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "address", 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.417 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15", 2024-09-16T01:27:06.418 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.419 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.421 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.424 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telemetry", 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_basic": { 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_basic", 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T01:27:06.425 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_crash": { 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_crash", 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.426 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_device": { 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_device", 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.427 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_ident": { 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_ident", 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.428 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_perf": { 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_perf", 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.429 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "contact": { 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "contact", 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.430 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "description": { 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "description", 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.431 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "device_url": { 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_url", 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.432 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.433 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.434 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "24", 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "8", 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "last_opt_revision": { 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "last_opt_revision", 2024-09-16T01:27:06.435 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1", 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard": { 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard", 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.437 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard_description": { 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard_description", 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.438 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.439 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.441 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.442 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "organization": { 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "organization", 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.444 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "proxy": { 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "proxy", 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.445 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "url": { 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url", 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.446 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "test_orchestrator", 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.447 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.448 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.450 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.451 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.452 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "volumes", 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.453 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.454 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.455 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_clones": { 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_clones", 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4", 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "periodic_async_work": { 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "periodic_async_work", 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Periodically check for async work", 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_delay": { 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_delay", 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_no_wait": { 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T01:27:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix", 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "discovery_interval": { 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "discovery_interval", 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "100", 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "identifier": { 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "identifier", 2024-09-16T01:27:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_host": { 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_host", 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_port": { 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_port", 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10051", 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_sender": { 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_sender", 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "modules": [ 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm", 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "dashboard", 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "iostat", 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "nfs", 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "restful" 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "available_modules": [ 2024-09-16T01:27:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "alerts", 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How frequently to reexamine health status", 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_destination": { 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_destination", 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email address to send alerts to", 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_from_name": { 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_from_name", 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "Ceph", 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Email From: name", 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_host": { 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_host", 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP server", 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_password": { 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_password", 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Password to authenticate with", 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_port": { 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_port", 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "465", 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP port", 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_sender": { 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_sender", 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SMTP envelope sender", 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_ssl": { 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_ssl", 2024-09-16T01:27:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "smtp_user": { 2024-09-16T01:27:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "smtp_user", 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "User to authenticate as", 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "balancer", 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "active": { 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "active", 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically balance PGs across cluster", 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_time": { 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_time", 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0000", 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "beginning time of day to automatically balance", 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "begin_weekday": { 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "begin_weekday", 2024-09-16T01:27:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_max_iterations": { 2024-09-16T01:27:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_max_iterations", 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "25", 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "250", 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_metrics": { 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_metrics", 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "pgs,objects,bytes", 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_compat_step": { 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crush_compat_step", 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.5", 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0.001", 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "0.999", 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "aggressiveness of optimization", 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "end_time": { 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_time", 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2359", 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ending time of day to automatically balance", 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "end_weekday": { 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "end_weekday", 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "0", 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "6", 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-16T01:27:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "min_score": { 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_score", 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "upmap", 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-compat", 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "none", 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "read", 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap", 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap-read" 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Balancer mode", 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_ids": { 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_ids", 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-16T01:27:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-16T01:27:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_deviation": { 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_deviation", 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "upmap_max_optimizations": { 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "upmap_max_optimizations", 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm", 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_down_multiplier": { 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_down_multiplier", 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_refresh_rate": { 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_refresh_rate", 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "20", 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "agent_starting_port": { 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "agent_starting_port", 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4721", 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_ptrace": { 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_ptrace", 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-16T01:27:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_interval": { 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_interval", 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "autotune_memory_target_ratio": { 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "autotune_memory_target_ratio", 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0.7", 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm_log_destination": { 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cephadm_log_destination", 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "file", 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "file,syslog", 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "syslog" 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "cgroups_split": { 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cgroups_split", 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "config_checks_enabled": { 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_checks_enabled", 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "config_dashboard": { 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_dashboard", 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_alertmanager": { 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_alertmanager", 2024-09-16T01:27:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_base": { 2024-09-16T01:27:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_base", 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Container image name, without the tag", 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_elasticsearch": { 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_elasticsearch", 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "elasticsearch container image", 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_grafana": { 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_grafana", 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_haproxy": { 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_haproxy", 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "HAproxy container image", 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_agent": { 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_agent", 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger agent container image", 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_collector": { 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_collector", 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger collector container image", 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_jaeger_query": { 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_jaeger_query", 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Jaeger query container image", 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_keepalived": { 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_keepalived", 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Keepalived container image", 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_loki": { 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_loki", 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Loki container image", 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_node_exporter": { 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_node_exporter", 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_nvmeof": { 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_nvmeof", 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Nvme-of container image", 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_prometheus": { 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_prometheus", 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-16T01:27:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Prometheus container image", 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_promtail": { 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_promtail", 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Promtail container image", 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_samba": { 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_samba", 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Samba/SMB container image", 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image_snmp_gateway": { 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_image_snmp_gateway", 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "SNMP Gateway container image", 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "container_init": { 2024-09-16T01:27:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "container_init", 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Run podman/docker with `--init`", 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "daemon_cache_timeout": { 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "daemon_cache_timeout", 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "default_cephadm_command_timeout": { 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_cephadm_command_timeout", 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "900", 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "default_registry": { 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "default_registry", 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "docker.io", 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "device_cache_timeout": { 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_cache_timeout", 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1800", 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache device inventory", 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "device_enhanced_scan": { 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_enhanced_scan", 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "facts_cache_timeout": { 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "facts_cache_timeout", 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "seconds to cache host facts data", 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "grafana_dashboards_path": { 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "grafana_dashboards_path", 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "host_check_interval": { 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "host_check_interval", 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to perform a host check", 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "hw_monitoring": { 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hw_monitoring", 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "inventory_list_all": { 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "inventory_list_all", 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.552 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "log_refresh_metadata": { 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_refresh_metadata", 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.553 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.554 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.555 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.557 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "*", 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.559 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "max_count_per_host": { 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_count_per_host", 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.560 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of daemons per service per host", 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd_draining_count": { 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_osd_draining_count", 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.561 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "migration_current": { 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "migration_current", 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.562 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "internal - do not modify", 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "mode": { 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mode", 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.563 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "root", 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm-package", 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "root" 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "mode for remote execution of cephadm", 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "oob_default_addr": { 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "oob_default_addr", 2024-09-16T01:27:06.564 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "169.254.1.1", 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "prometheus_alerts_path": { 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus_alerts_path", 2024-09-16T01:27:06.565 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_insecure": { 2024-09-16T01:27:06.566 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_insecure", 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_password": { 2024-09-16T01:27:06.567 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_password", 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_url": { 2024-09-16T01:27:06.568 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_url", 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.569 INFO:teuthology.orchestra.run.smithi063.stdout: "registry_username": { 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "registry_username", 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.570 INFO:teuthology.orchestra.run.smithi063.stdout: "secure_monitoring_stack": { 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secure_monitoring_stack", 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "service_discovery_port": { 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "service_discovery_port", 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8765", 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "cephadm service discovery port", 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.572 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "ssh_config_file": { 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssh_config_file", 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.573 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "use_agent": { 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_agent", 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.574 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "use_repo_digest": { 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "use_repo_digest", 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.575 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_failed_host_check": { 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_failed_host_check", 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if the host check fails", 2024-09-16T01:27:06.576 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_daemons": { 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_daemons", 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-16T01:27:06.577 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_on_stray_hosts": { 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_on_stray_hosts", 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.578 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crash", 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.579 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.580 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.581 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.582 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.583 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.584 INFO:teuthology.orchestra.run.smithi063.stdout: "retain_interval": { 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retain_interval", 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "31536000", 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.585 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_recent_interval": { 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_recent_interval", 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1209600", 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.586 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dashboard", 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.587 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_HOST": { 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.588 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.589 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_ENABLED": { 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_ENABLED", 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.590 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-16T01:27:06.591 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "ENABLE_BROWSABLE_API": { 2024-09-16T01:27:06.592 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.593 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.594 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.596 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.597 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.598 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.599 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.600 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.601 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_PASSWORD": { 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-16T01:27:06.602 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.603 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_URL": { 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_URL", 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.604 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_API_USERNAME": { 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.605 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.606 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.607 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-16T01:27:06.608 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-16T01:27:06.609 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_HOST": { 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-16T01:27:06.610 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.612 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.613 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.614 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.617 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.618 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.619 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_ENABLED": { 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.620 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.621 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.622 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.623 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8", 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.624 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "45", 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ACCESS_KEY": { 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.625 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.626 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "admin", 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SECRET_KEY": { 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-16T01:27:06.627 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "RGW_API_SSL_VERIFY": { 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-16T01:27:06.628 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-16T01:27:06.629 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.631 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "cross_origin_url": { 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cross_origin_url", 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.632 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "crt_file": { 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "crt_file", 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.633 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "debug": { 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "debug", 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.634 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Enable/disable debug options", 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "jwt_token_ttl": { 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "jwt_token_ttl", 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.635 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "28800", 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.636 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.637 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.638 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.639 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.640 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.641 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "motd": { 2024-09-16T01:27:06.642 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "motd", 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "The message of the day", 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect_resolve_ip_addr": { 2024-09-16T01:27:06.643 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "redirect_resolve_ip_addr", 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.644 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.645 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8080", 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl_server_port": { 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl_server_port", 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8443", 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.648 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "redirect", 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: "redirect" 2024-09-16T01:27:06.649 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-16T01:27:06.650 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "url_prefix": { 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url_prefix", 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.651 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "devicehealth", 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.652 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_monitoring": { 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_monitoring", 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "monitor device health metrics", 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.653 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.654 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.655 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.656 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.657 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.658 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "mark_out_threshold": { 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mark_out_threshold", 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "2419200", 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.659 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": { 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pool_name", 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "device_health_metrics", 2024-09-16T01:27:06.660 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "retention_period": { 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "retention_period", 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.661 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15552000", 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long to retain device health metrics", 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_frequency": { 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_frequency", 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.662 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "self_heal": { 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "self_heal", 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.663 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how frequently to wake up and check device health", 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "warn_threshold": { 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "warn_threshold", 2024-09-16T01:27:06.665 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7257600", 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "diskprediction_local", 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.667 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.668 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.670 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.671 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "predict_interval": { 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predict_interval", 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.672 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "86400", 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "predictor_model": { 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "predictor_model", 2024-09-16T01:27:06.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "prophetstor", 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:06.674 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "600", 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "influx", 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": false, 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "influxdb python module not found", 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "batch_size": { 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "batch_size", 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5000", 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.676 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "database": { 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "database", 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "ceph", 2024-09-16T01:27:06.677 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": { 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "hostname", 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.678 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server hostname", 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.679 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "30", 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "5", 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.680 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.681 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.683 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.684 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "password": { 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "password", 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.685 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "password of InfluxDB server user", 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "port": { 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "port", 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.686 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "8086", 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "InfluxDB server port", 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "ssl": { 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ssl", 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.687 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "false", 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "threads": { 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threads", 2024-09-16T01:27:06.688 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "32", 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "username": { 2024-09-16T01:27:06.689 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "username", 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "username of InfluxDB server user", 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "verify_ssl": { 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "verify_ssl", 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "true", 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.691 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "insights", 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.692 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.693 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.694 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.695 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.696 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.697 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "iostat", 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.698 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.700 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.701 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.702 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "k8sevents", 2024-09-16T01:27:06.703 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_event_retention_days": { 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "ceph_event_retention_days", 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "7", 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.704 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "config_check_secs": { 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "config_check_secs", 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "10", 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-16T01:27:06.705 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.706 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.707 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.708 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.709 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.709 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.709 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.709 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.709 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.709 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.709 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.712 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.712 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.712 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.713 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "localpool", 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "failure_domain": { 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "failure_domain", 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "host", 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.715 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "failure domain for any created local pool", 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.716 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.719 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.720 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": { 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "min_size", 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.721 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default min_size for any created local pool", 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "num_rep": { 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "num_rep", 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.722 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3", 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default replica count for any created local pool", 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": { 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_num", 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.723 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "128", 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "default pg_num for any created local pool", 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "prefix": { 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prefix", 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.724 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "name prefix for any created local pool", 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "subtree": { 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "subtree", 2024-09-16T01:27:06.725 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "rack", 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mds_autoscaler", 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.727 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.730 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.731 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.732 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirroring", 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.733 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.734 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.735 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.736 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.737 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "nfs", 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.738 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.739 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.740 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.741 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.742 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.743 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: "fail_fs": { 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "fail_fs", 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.744 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.745 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.746 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.747 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.748 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.749 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.750 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator": { 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "orchestrator", 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm", 2024-09-16T01:27:06.751 INFO:teuthology.orchestra.run.smithi063.stdout: "rook", 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: "test_orchestrator" 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Orchestrator backend", 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_perf_query", 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.752 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.753 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.754 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.755 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.756 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.757 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "osd_support", 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.758 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.759 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.760 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.761 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "pg_autoscaler", 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.764 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.765 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.766 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.767 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.768 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.769 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.770 INFO:teuthology.orchestra.run.smithi063.stdout: "threshold": { 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "threshold", 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "3.0", 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1.0", 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "scaling threshold", 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "progress", 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_pg_recovery_event": { 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_pg_recovery_event", 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.773 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.774 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.775 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.776 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.777 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.778 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "max_completed_events": { 2024-09-16T01:27:06.779 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_completed_events", 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "50", 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "number of past completed events to remember", 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "sleep_interval": { 2024-09-16T01:27:06.780 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "sleep_interval", 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "how long the module is going to sleep", 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.781 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "prometheus", 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "cache": { 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "cache", 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.782 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "exclude_perf_counters": { 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "exclude_perf_counters", 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.783 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.784 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.785 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.786 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.787 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.788 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.789 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools": { 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools", 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "300", 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.791 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "scrape_interval": { 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "scrape_interval", 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15.0", 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.792 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "::", 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-16T01:27:06.793 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "9283", 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-16T01:27:06.794 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "stale_cache_strategy": { 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stale_cache_strategy", 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "log", 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.795 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_behaviour": { 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_behaviour", 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "default", 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.796 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "default", 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "error" 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "standby_error_status_code": { 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "standby_error_status_code", 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.797 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "500", 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "400", 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "599", 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_support", 2024-09-16T01:27:06.798 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.799 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.800 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.801 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.802 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.803 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_snap_create": { 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_snap_create", 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10", 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.804 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "mirror_snapshot_schedule": { 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mirror_snapshot_schedule", 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.805 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "trash_purge_schedule": { 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "trash_purge_schedule", 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.806 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "restful", 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.807 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_auth": { 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enable_auth", 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "key_file": { 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "key_file", 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.809 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.810 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.811 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.812 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.813 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.814 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "server_addr": { 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_addr", 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.815 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "server_port": { 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "server_port", 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.816 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rgw", 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.817 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.818 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.819 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.820 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.821 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.822 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "secondary_zone_period_retry_limit": { 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "5", 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.823 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rook", 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.824 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.825 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.826 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.828 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.829 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "storage_class": { 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "storage_class", 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "local", 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-16T01:27:06.830 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "selftest", 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.831 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.832 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.833 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.834 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.835 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "roption1": { 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption1", 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.837 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "roption2": { 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "roption2", 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "xyz", 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.838 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption1": { 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption1", 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.839 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption2": { 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption2", 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.840 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption3": { 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption3", 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "float", 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.841 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption4": { 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption4", 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.842 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption5": { 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption5", 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.843 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption6": { 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption6", 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.844 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "rwoption7": { 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rwoption7", 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.845 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "1", 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "42", 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "testkey": { 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testkey", 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.846 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "testlkey": { 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testlkey", 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.847 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "testnewline": { 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "testnewline", 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.848 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snap_schedule", 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_m_granularity": { 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "allow_m_granularity", 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.850 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "allow minute scheduled snapshots", 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "dump_on_update": { 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "dump_on_update", 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.851 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "dump database to debug log on update", 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.852 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.853 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.854 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.855 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.856 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "stats", 2024-09-16T01:27:06.857 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.858 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.859 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.860 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.861 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.862 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "status", 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.863 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.864 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.865 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.866 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.867 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.868 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telegraf", 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.869 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "address": { 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "address", 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.870 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "15", 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.872 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.874 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.875 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.876 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "telemetry", 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_basic": { 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_basic", 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.878 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_crash": { 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_crash", 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.879 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_device": { 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_device", 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.880 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_ident": { 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_ident", 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.881 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "channel_perf": { 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "channel_perf", 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.882 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "contact": { 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "contact", 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.883 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "description": { 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "description", 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.884 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "device_url": { 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "device_url", 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.885 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "enabled": { 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "enabled", 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.886 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.887 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "24", 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "8", 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "last_opt_revision": { 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "last_opt_revision", 2024-09-16T01:27:06.888 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "1", 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard": { 2024-09-16T01:27:06.889 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard", 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "leaderboard_description": { 2024-09-16T01:27:06.890 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "leaderboard_description", 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.891 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.892 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.893 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.894 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.895 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.896 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "organization": { 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "organization", 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.897 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "proxy": { 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "proxy", 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.898 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "url": { 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "url", 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.899 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "test_orchestrator", 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.900 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.901 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.902 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.903 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.905 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "volumes", 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.906 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.907 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.908 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.909 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.910 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "max_concurrent_clones": { 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "max_concurrent_clones", 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "4", 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "periodic_async_work": { 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "periodic_async_work", 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Periodically check for async work", 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_delay": { 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_delay", 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "0", 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.914 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "snapshot_clone_no_wait": { 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "snapshot_clone_no_wait", 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "True", 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-16T01:27:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix", 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "can_run": true, 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "error_string": "", 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "module_options": { 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "discovery_interval": { 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "discovery_interval", 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "uint", 2024-09-16T01:27:06.916 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "100", 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "identifier": { 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "identifier", 2024-09-16T01:27:06.917 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "interval": { 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "interval", 2024-09-16T01:27:06.918 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "secs", 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "60", 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "log_level": { 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_level", 2024-09-16T01:27:06.919 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.920 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster": { 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster", 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.921 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_cluster_level": { 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_cluster_level", 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "info", 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.922 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [ 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "", 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "critical", 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "debug", 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "error", 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "info", 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "warning" 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.923 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": { 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "log_to_file", 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "bool", 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "False", 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.924 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_host": { 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_host", 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "", 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_port": { 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_port", 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "int", 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "10051", 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.926 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "zabbix_sender": { 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "zabbix_sender", 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "str", 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "level": "advanced", 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 0, 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "min": "", 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "max": "", 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "enum_allowed": [], 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "desc": "", 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "long_desc": "", 2024-09-16T01:27:06.927 INFO:teuthology.orchestra.run.smithi063.stdout: "tags": [], 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "see_also": [] 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "services": { 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "dashboard": "https://172.21.15.63:8443/" 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "always_on_modules": { 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "octopus": [ 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "balancer", 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2024-09-16T01:27:06.928 INFO:teuthology.orchestra.run.smithi063.stdout: "devicehealth", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscaler", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "progress", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_support", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "status", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "telemetry", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "volumes" 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "pacific": [ 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "balancer", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "devicehealth", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator", 2024-09-16T01:27:06.929 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscaler", 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "progress", 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_support", 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "status", 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "telemetry", 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "volumes" 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "quincy": [ 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "balancer", 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "devicehealth", 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator", 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscaler", 2024-09-16T01:27:06.930 INFO:teuthology.orchestra.run.smithi063.stdout: "progress", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_support", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "status", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "telemetry", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "volumes" 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "reef": [ 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "balancer", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "devicehealth", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscaler", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "progress", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_support", 2024-09-16T01:27:06.931 INFO:teuthology.orchestra.run.smithi063.stdout: "status", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "telemetry", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "volumes" 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "squid": [ 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "balancer", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "crash", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "devicehealth", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "orchestrator", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscaler", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "progress", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_support", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "status", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "telemetry", 2024-09-16T01:27:06.932 INFO:teuthology.orchestra.run.smithi063.stdout: "volumes" 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "last_failure_osd_epoch": 3, 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "active_clients": [ 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "devicehealth", 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 1012006669 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-16T01:27:06.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "libcephsqlite", 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 228564475 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "rbd_support", 2024-09-16T01:27:06.934 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3983534819 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "volumes", 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:0", 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 108118133 2024-09-16T01:27:06.935 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-16T01:27:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:06.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-16T01:27:06.936 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:27:06.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2152680530 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6f100a3250 msgr2=0x7f6f100a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6f100a3250 0x7f6f100a5710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400baa0 tx=0x7f6f14005d90 comp rx=0 tx=0).stop 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2152680530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f24104ee0 msgr2=0x7f6f24198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f24104ee0 0x7f6f24198380 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0314e0 tx=0x7f6f0c0042e0 comp rx=0 tx=0).stop 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2152680530 shutdown_connections 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f6f100a3250 0x7f6f100a5710 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f24107810 0x7f6f2419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f24104ee0 0x7f6f24198380 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 --2- 172.21.15.63:0/2152680530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f241025b0 0x7f6f24197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2152680530 >> 172.21.15.63:0/2152680530 conn(0x7f6f240fc1b0 msgr2=0x7f6f241043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2152680530 shutdown_connections 2024-09-16T01:27:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:05.550+0000 7f6f29bcf640 1 -- 172.21.15.63:0/2152680530 wait complete. 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:05 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2501979170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:05 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2923508212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:05 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/4060003611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:06 smithi162 ceph-mon[34539]: pgmap v448: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:06 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2152680530' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:05 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2501979170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:05 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2923508212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:05 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/4060003611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:06 smithi192 ceph-mon[34775]: pgmap v448: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:06 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2152680530' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-16T01:27:06.939 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:05 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2501979170' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T01:27:06.940 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:05 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2923508212' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-16T01:27:06.940 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:05 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/4060003611' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-16T01:27:07.006 DEBUG:tasks.check_counter:Getting stats from a 2024-09-16T01:27:07.007 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-16T01:27:07.007 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:06 smithi063 ceph-mon[31070]: pgmap v448: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:07.007 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:06 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2152680530' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-16T01:27:07.279 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:07.797 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:27:07.797 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:07.797 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 101, 2024-09-16T01:27:07.797 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 98, 2024-09-16T01:27:07.798 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 445632, 2024-09-16T01:27:07.798 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 59232, 2024-09-16T01:27:07.798 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 4, 2024-09-16T01:27:07.798 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 0, 2024-09-16T01:27:07.798 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.015888829, 2024-09-16T01:27:07.798 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.005957150, 2024-09-16T01:27:07.798 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.012759997, 2024-09-16T01:27:07.799 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:07.799 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:07.799 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 97, 2024-09-16T01:27:07.799 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004862301, 2024-09-16T01:27:07.799 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000050126 2024-09-16T01:27:07.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.799 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:07.799 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:07.799 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:07.799 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:07.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.800 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 445632, 2024-09-16T01:27:07.800 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 59232 2024-09-16T01:27:07.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.800 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:07.800 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 5, 2024-09-16T01:27:07.800 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 76, 2024-09-16T01:27:07.800 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3152, 2024-09-16T01:27:07.800 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 91952, 2024-09-16T01:27:07.800 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 3, 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.008112989, 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.004138549, 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.003345972, 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 75, 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.007303507, 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000097380 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.801 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 91952 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 0, 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 2, 2024-09-16T01:27:07.802 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 0, 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 0, 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 2, 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.000191787, 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.000000000, 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.000114831, 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:07.803 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:07.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.804 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:07.804 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:07.804 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:07.804 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:07.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.804 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:27:07.804 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:27:07.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 0, 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:07.805 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:07.806 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:07.806 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:07.806 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:07.806 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:07.806 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:07.806 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:07.807 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2024-09-16T01:27:07.808 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 148801, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 27, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 0, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 0, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 928, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 2, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:07.810 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 102, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 431377, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 102, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 102, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 431377, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:07.811 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:07.812 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:07.812 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:07.812 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:27:08.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:08 smithi063 ceph-mon[31070]: pgmap v449: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:08.673 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-16T01:27:08.673 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-16T01:27:08.673 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-16T01:27:08.673 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-16T01:27:08.673 DEBUG:tasks.check_counter:Getting stats from d 2024-09-16T01:27:08.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-16T01:27:08.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:08 smithi192 ceph-mon[34775]: pgmap v449: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:08.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:08 smithi162 ceph-mon[34539]: pgmap v449: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:08.931 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:09.473 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 107, 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 104, 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 447888, 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 62768, 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 4, 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 0, 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.015534554, 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.005744702, 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.012381867, 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:09.474 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 103, 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004050250, 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000039322 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 447888, 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 62768 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:09.475 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 5, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 80, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3152, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 92656, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 3, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.008064904, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.004186345, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.003211666, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 79, 2024-09-16T01:27:09.476 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.006959890, 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000088099 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 92656 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 0, 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 2, 2024-09-16T01:27:09.477 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 0, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 0, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 2, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.000208961, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.000000000, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.000143278, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:09.478 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 0, 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:09.479 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:09.480 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:09.481 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 148801, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 27, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2024-09-16T01:27:09.482 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 928, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 2, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2024-09-16T01:27:09.483 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 108, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 432794, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 108, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 108, 2024-09-16T01:27:09.484 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 432794, 2024-09-16T01:27:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-16T01:27:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:09.485 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:09.485 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:27:10.293 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-16T01:27:10.294 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-16T01:27:10.294 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-16T01:27:10.294 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-16T01:27:10.294 DEBUG:tasks.check_counter:Getting stats from g 2024-09-16T01:27:10.294 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-16T01:27:10.556 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:10.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:10 smithi063 ceph-mon[31070]: pgmap v450: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:10.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:10 smithi192 ceph-mon[34775]: pgmap v450: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:10.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:10 smithi162 ceph-mon[34539]: pgmap v450: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:11.054 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 102, 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 99, 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 445904, 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 59856, 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 4, 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 0, 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.015789442, 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.005965369, 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.012344391, 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:11.055 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 98, 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004636270, 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000047308 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 445904, 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 59856 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.056 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 5, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 77, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3152, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 92128, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 3, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.008126146, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.004241778, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.003211495, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 76, 2024-09-16T01:27:11.057 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.007142482, 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000093980 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 92128 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:11.058 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 0, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 2, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 0, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 0, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 2, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.000228743, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.000000000, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.000158736, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:11.059 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:27:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:27:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2024-09-16T01:27:11.060 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 0, 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:11.061 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:11.062 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:11.063 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 148840, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 28, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2024-09-16T01:27:11.064 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 928, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 2, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:11.065 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 103, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 431507, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 103, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-16T01:27:11.066 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-16T01:27:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 103, 2024-09-16T01:27:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 431507, 2024-09-16T01:27:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-16T01:27:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:11.067 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:11.067 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:27:11.937 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-16T01:27:11.938 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-16T01:27:11.938 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-16T01:27:11.938 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-16T01:27:11.938 DEBUG:tasks.check_counter:Getting stats from j 2024-09-16T01:27:11.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-16T01:27:12.202 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:12.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:12 smithi063 ceph-mon[31070]: pgmap v451: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:12.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:12 smithi192 ceph-mon[34775]: pgmap v451: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:12.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:12 smithi162 ceph-mon[34539]: pgmap v451: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:12.719 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-16T01:27:12.719 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:12.719 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 109, 2024-09-16T01:27:12.719 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 106, 2024-09-16T01:27:12.719 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 448432, 2024-09-16T01:27:12.719 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 64048, 2024-09-16T01:27:12.719 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 4, 2024-09-16T01:27:12.719 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 0, 2024-09-16T01:27:12.719 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.017644607, 2024-09-16T01:27:12.719 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.006358453, 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.014407786, 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 105, 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.004917770, 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000046835 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:12.720 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 448432, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 64048 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 5, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 81, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 3152, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 92832, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 3, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 2, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.008609157, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.004538629, 2024-09-16T01:27:12.721 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.003209968, 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 80, 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.007877210, 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000098465 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.722 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 92832 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_messages": 0, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages": 2, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_bytes": 0, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_bytes": 0, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_created_connections": 2, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_active_connections": 1, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_total_time": 0.000355071, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_send_time": 0.000000000, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_recv_time": 0.000298691, 2024-09-16T01:27:12.723 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:27:12.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "cct": { 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "total_workers": 0, 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "unhealthy_workers": 0 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool": { 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:12.725 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:12.726 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:12.727 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:12.727 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:12.727 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:12.727 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:12.727 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:12.727 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:12.727 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:12.727 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:12.727 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:12.727 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:12.728 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:12.728 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:12.728 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_items": 0, 2024-09-16T01:27:12.728 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:12.728 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:12.728 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:12.728 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:12.728 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_bytes": 148863, 2024-09-16T01:27:12.728 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_anon_items": 28, 2024-09-16T01:27:12.728 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:12.729 INFO:teuthology.orchestra.run.smithi063.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:12.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bytes": 0, 2024-09-16T01:27:12.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_items": 0, 2024-09-16T01:27:12.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:12.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:12.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:12.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:12.729 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_bytes": 0, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_items": 0, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "pgmap_items": 0, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_bytes": 928, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_co_items": 2, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_1_items": 0, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:12.730 INFO:teuthology.orchestra.run.smithi063.stdout: "unittest_2_items": 0 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "val": 0, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "max": 104857600, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "get_started": 0, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "get": 110, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "get_sum": 433054, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "get_or_fail_success": 110, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "take": 0, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "take_sum": 0, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "put": 110, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "put_sum": 433054, 2024-09-16T01:27:12.731 INFO:teuthology.orchestra.run.smithi063.stdout: "wait": { 2024-09-16T01:27:12.732 INFO:teuthology.orchestra.run.smithi063.stdout: "avgcount": 0, 2024-09-16T01:27:12.732 INFO:teuthology.orchestra.run.smithi063.stdout: "sum": 0.000000000, 2024-09-16T01:27:12.732 INFO:teuthology.orchestra.run.smithi063.stdout: "avgtime": 0.000000000 2024-09-16T01:27:12.732 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:12.732 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-16T01:27:12.732 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-16T01:27:13.536 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-16T01:27:13.536 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-16T01:27:13.536 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-16T01:27:13.537 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-16T01:27:13.537 DEBUG:tasks.check_counter:Getting stats from b 2024-09-16T01:27:13.537 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-16T01:27:13.799 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:27:14.447 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-16T01:27:14.447 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:14.447 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 29538, 2024-09-16T01:27:14.447 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 33031, 2024-09-16T01:27:14.447 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 8882055, 2024-09-16T01:27:14.447 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 55668823, 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 48, 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 7, 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 1.573277412, 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.647685233, 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.845804439, 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.176340133, 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 33030, 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.846131149, 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000025617 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.448 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 48546, 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.006627093, 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000136 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 508176, 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 72752 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 53966, 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 111322, 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 19511641, 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 72912058, 2024-09-16T01:27:14.449 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 12, 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 5, 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 3.378512931, 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 1.471712585, 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 2.075568574, 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.172038215, 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 111320, 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2.238091843, 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000020105 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:14.450 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 141122, 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.022388797, 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000158 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 56352, 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 244544 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 30705, 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 34209, 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 15063292, 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 39096632, 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 10, 2024-09-16T01:27:14.451 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 6, 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 1.563869251, 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.683209479, 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.834268615, 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.140702420, 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 34208, 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.853723712, 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000024956 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:14.452 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 53408, 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.007129655, 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000133 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 448 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-16T01:27:14.453 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 9144, 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 19.990804918, 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002186221 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 11498, 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.498428485, 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000130320 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:14.454 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 30617, 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 29989, 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 29989, 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 58.723143833, 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001958156 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 628, 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-16T01:27:14.455 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 76, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 7, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 1, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 83, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 13, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 31, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 39, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 45, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 13854, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 2, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 2, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 4, 2024-09-16T01:27:14.456 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 43245, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 37978, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 607, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 726, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 10, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 38, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 11593, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 29, 2024-09-16T01:27:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 6716, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 5024, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 4, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 234, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 5024, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 774, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 5, 2024-09-16T01:27:14.458 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 769, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 4250, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 6153, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 20357, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 193, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 17275, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 10886, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 138, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 28398 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.459 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 1981, 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 2181, 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 1445, 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 1472, 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 3984, 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 4, 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 7302, 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 7237, 2024-09-16T01:27:14.460 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 62, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 5, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 38, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 8, 2024-09-16T01:27:14.461 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 3, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 40041, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 40041, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 54, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-16T01:27:14.462 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 54, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 5, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 90816992, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 0, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3367, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 45.168804982, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.013415148 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.463 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 0 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 32, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 19092, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 19060, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 31, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 3004, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 2973, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 83, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 28242, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 28159, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 2, 2024-09-16T01:27:14.464 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 18473, 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 18471, 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 127308, 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 231712 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 40725, 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 164, 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 30617, 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 53, 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 705, 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-16T01:27:14.465 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 9556, 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 14.404082271, 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001507333 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 5172, 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2.204564670, 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000426249 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.466 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 221, 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.012675662, 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.004582242 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2744, 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 5.394684609, 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001965992 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-16T01:27:14.467 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.468 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.468 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.468 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-16T01:27:14.468 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.468 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.468 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.468 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.468 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.469 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.470 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.470 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.470 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-16T01:27:14.470 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1336, 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 4.047752087, 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.003029754 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 449, 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.199591142, 2024-09-16T01:27:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002671695 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 649, 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.619290601, 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002495054 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.472 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1140, 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2.328390362, 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002042447 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 484, 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2.423977494, 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.005008217 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.473 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.474 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-16T01:27:14.474 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.474 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.474 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.474 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.474 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-16T01:27:14.474 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1155, 2024-09-16T01:27:14.474 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 11.623558720, 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.010063687 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-16T01:27:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 226, 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2.091951664, 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.009256423 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.476 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.477 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-16T01:27:14.477 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.477 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.477 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.477 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.478 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-16T01:27:14.478 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 7, 2024-09-16T01:27:14.478 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.019551855, 2024-09-16T01:27:14.478 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002793122 2024-09-16T01:27:14.478 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.478 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-16T01:27:14.478 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 449, 2024-09-16T01:27:14.478 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.634941434, 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.003641294 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 6401, 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 8.718131262, 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001361995 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.479 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 2, 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 15990, 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 15990, 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 237, 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-16T01:27:14.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:14.482 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:14.483 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 298684, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 118, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:14.484 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7592, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 156, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 178724, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 1834, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-16T01:27:14.485 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 17259, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 89766176, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 37, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 17259, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 17259, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 50.949958142, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002952080 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 17259, 2024-09-16T01:27:14.486 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 17556 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 17259, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 5216, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 12043, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 0, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 11, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 187, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 3549, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 91, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-16T01:27:14.487 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 7, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 7952, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 5029, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 22, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-16T01:27:14.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 236, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-16T01:27:14.489 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 2, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 12, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 12, 2024-09-16T01:27:14.490 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-16T01:27:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-16T01:27:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 369, 2024-09-16T01:27:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 0, 2024-09-16T01:27:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 103 2024-09-16T01:27:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-16T01:27:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 1, 2024-09-16T01:27:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:27:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-16T01:27:14.491 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 18, 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 10, 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 7416, 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 7237, 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-16T01:27:14.492 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 114205, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 33160962, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 114205, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 114205, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 33160962, 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:14.493 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:14.494 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 17259, 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 90497137, 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 17259, 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 90497137, 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-16T01:27:14.495 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 17259, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 17259, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 17259, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 17259, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.496 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 7237, 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 730961, 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 7237, 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-16T01:27:14.497 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 182, 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 730961, 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x5604c7ae4960": { 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 40041, 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 86622688, 2024-09-16T01:27:14.498 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 40041, 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 3367, 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 86622688, 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:14.499 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-16T01:27:14.500 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:14 smithi162 ceph-mon[34539]: pgmap v452: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:14.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:14 smithi192 ceph-mon[34775]: pgmap v452: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:14.860 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:14 smithi063 ceph-mon[31070]: pgmap v452: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:15.381 INFO:tasks.check_counter:Daemon mds.b mds.exported=38 2024-09-16T01:27:15.381 INFO:tasks.check_counter:Daemon mds.b mds.imported=29 2024-09-16T01:27:15.381 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1981 2024-09-16T01:27:15.381 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=2181 2024-09-16T01:27:15.381 DEBUG:tasks.check_counter:Getting stats from e 2024-09-16T01:27:15.381 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-16T01:27:15.629 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:27:16.175 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-16T01:27:16.175 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:16.175 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 345, 2024-09-16T01:27:16.175 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 347, 2024-09-16T01:27:16.175 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 8478213, 2024-09-16T01:27:16.175 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 109774, 2024-09-16T01:27:16.175 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 7, 2024-09-16T01:27:16.175 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-16T01:27:16.175 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.033532994, 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.010014818, 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.012570653, 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.007769118, 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 345, 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.011614170, 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000033664 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.176 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 282, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 358, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 9193037, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 300091, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.033577268, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.009295309, 2024-09-16T01:27:16.177 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.014206550, 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.007332614, 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 357, 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.016595222, 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000046485 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 212000 2024-09-16T01:27:16.178 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 495, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 486, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 4805172, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 183666, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.055386734, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.019058220, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.026992997, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.011054028, 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:16.179 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 485, 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.024323258, 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000050151 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 487984, 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 64416 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-16T01:27:16.180 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1709, 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.039986320, 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000023397 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-16T01:27:16.181 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.182 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 4818, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 4818, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 4818, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-16T01:27:16.183 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 1, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-16T01:27:16.184 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:27:16.185 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.186 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-16T01:27:16.187 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:27:16.188 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 9550, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-16T01:27:16.189 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 13, 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 25897513, 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 25896375, 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 9550 2024-09-16T01:27:16.190 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 44, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 3908, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 3864, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 49, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 465, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 416, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 4818, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 8113, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 3295, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-16T01:27:16.191 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 61352, 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 215328 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.193 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.194 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.195 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-16T01:27:16.196 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.196 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.196 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.196 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.196 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-16T01:27:16.196 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.196 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.196 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.196 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.196 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-16T01:27:16.197 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.197 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.197 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.197 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.197 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-16T01:27:16.197 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.197 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.198 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.199 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.200 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.201 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.201 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.201 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-16T01:27:16.201 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.201 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.201 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.201 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.203 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-16T01:27:16.203 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.203 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.204 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.204 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.204 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.205 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-16T01:27:16.206 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:16.207 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 2, 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 1226, 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-16T01:27:16.208 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:16.209 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:16.209 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:16.209 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:16.209 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:16.209 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:16.209 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:16.209 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:16.209 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:16.210 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-16T01:27:16.211 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:16.212 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:16.212 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:16.212 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:16.212 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 206161, 2024-09-16T01:27:16.212 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 58, 2024-09-16T01:27:16.212 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:16.212 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:16.212 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-16T01:27:16.212 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-16T01:27:16.213 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:16.213 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:16.213 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:16.213 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:16.213 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7592, 2024-09-16T01:27:16.213 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 156, 2024-09-16T01:27:16.213 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:16.213 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:16.213 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:16.213 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 3558130, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 24137, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 997, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 21, 2024-09-16T01:27:16.214 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 3, 2024-09-16T01:27:16.215 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 997, 2024-09-16T01:27:16.215 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-16T01:27:16.215 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 997, 2024-09-16T01:27:16.215 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.495989884, 2024-09-16T01:27:16.215 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000497482 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 997, 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 998 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 997, 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 997, 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 585, 2024-09-16T01:27:16.216 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 410, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 1, 2024-09-16T01:27:16.217 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-16T01:27:16.218 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-16T01:27:16.219 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-09-16T01:27:16.220 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-16T01:27:16.220 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 1, 2024-09-16T01:27:16.220 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 7, 2024-09-16T01:27:16.220 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 7, 2024-09-16T01:27:16.220 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-16T01:27:16.220 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-16T01:27:16.220 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-16T01:27:16.220 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-16T01:27:16.220 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-16T01:27:16.220 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:27:16.221 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 1118, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 22366663, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:16.222 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 1118, 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1118, 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 22366663, 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.223 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 997, 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 21703214, 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 997, 2024-09-16T01:27:16.224 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 21703214, 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-16T01:27:16.225 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 997, 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 997, 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 997, 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 997, 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:27:16.226 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.227 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55a1697a6b40": { 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-16T01:27:16.228 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-16T01:27:16.229 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-16T01:27:16.229 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:16.229 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:16.229 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:16.229 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:16.229 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:16.229 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:16.229 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-16T01:27:16.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:16 smithi192 ceph-mon[34775]: pgmap v453: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:16.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:16 smithi162 ceph-mon[34539]: pgmap v453: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:16.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:16 smithi063 ceph-mon[31070]: pgmap v453: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:16.941 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-16T01:27:16.941 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-16T01:27:16.941 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-16T01:27:16.941 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-16T01:27:16.941 DEBUG:tasks.check_counter:Getting stats from h 2024-09-16T01:27:16.941 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-16T01:27:17.192 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:27:17.706 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 692, 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 692, 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 37958936, 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 219242, 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 8, 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.074989404, 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.021340717, 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.031717593, 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.016176921, 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:17.707 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 691, 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.027458052, 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000039736 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 448 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:17.708 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 345, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 336, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 24256304, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 135230, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.043284956, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.010288375, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.031757656, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.004886913, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 335, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.015628075, 2024-09-16T01:27:17.709 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000046650 2024-09-16T01:27:17.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.710 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:17.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.710 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.710 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.710 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 487600, 2024-09-16T01:27:17.710 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 63296 2024-09-16T01:27:17.710 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.710 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 302, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 379, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 25246813, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 307095, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 5, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.040573865, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.009275609, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.020479767, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.008088307, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 377, 2024-09-16T01:27:17.711 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.013044134, 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000034599 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 211376 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-16T01:27:17.712 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1961, 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.042782040, 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000021816 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-16T01:27:17.713 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.714 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 7553, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 7553, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-16T01:27:17.715 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 7552, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 2, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-16T01:27:17.716 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 4, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 234, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-16T01:27:17.717 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-16T01:27:17.718 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:27:17.719 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-16T01:27:17.719 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-16T01:27:17.719 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.719 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-16T01:27:17.719 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-16T01:27:17.719 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-16T01:27:17.719 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-16T01:27:17.719 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-16T01:27:17.719 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-16T01:27:17.719 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-16T01:27:17.720 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-16T01:27:17.721 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 40041, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 54, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 5, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 90816992, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 90812691, 2024-09-16T01:27:17.722 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-16T01:27:17.723 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.723 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.723 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.723 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 40041 2024-09-16T01:27:17.723 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.723 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-16T01:27:17.723 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 27, 2024-09-16T01:27:17.723 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 18377, 2024-09-16T01:27:17.723 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 18350, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 26, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 2246, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 2220, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 7553, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 26443, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 18890, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 75704, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 215328 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.724 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.725 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-16T01:27:17.726 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.727 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.728 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.729 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.729 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-16T01:27:17.729 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.729 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.729 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.730 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.732 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.733 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-16T01:27:17.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.735 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-16T01:27:17.736 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-16T01:27:17.737 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 2, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 1229, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:17.738 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:17.739 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:17.740 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 230401, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 70, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-16T01:27:17.741 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7592, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 156, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 5410859, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 31025, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:17.742 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 1215, 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 26, 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 4, 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 1215, 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1215, 2024-09-16T01:27:17.743 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.713985428, 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000587642 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1215, 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1216 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 1215, 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 1215, 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-16T01:27:17.744 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 737, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 475, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 2, 2024-09-16T01:27:17.745 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-16T01:27:17.746 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-16T01:27:17.747 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 1, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 10, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 10, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-16T01:27:17.748 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:27:17.749 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 1335, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 87332822, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 1335, 2024-09-16T01:27:17.750 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1335, 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 87332822, 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:17.751 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 1215, 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 86633163, 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1215, 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 86633163, 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:17.752 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 1215, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 1215, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1215, 2024-09-16T01:27:17.753 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1215, 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:17.754 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55d517d50b40": { 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-16T01:27:17.755 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:17.756 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:17.757 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:17.757 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-16T01:27:18.430 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-16T01:27:18.430 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-16T01:27:18.430 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-16T01:27:18.430 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-16T01:27:18.430 DEBUG:tasks.check_counter:Getting stats from k 2024-09-16T01:27:18.431 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-16T01:27:18.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:18 smithi192 ceph-mon[34775]: pgmap v454: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:18.675 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.b/config 2024-09-16T01:27:18.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:18 smithi162 ceph-mon[34539]: pgmap v454: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:18.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:18 smithi063 ceph-mon[31070]: pgmap v454: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 4, 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 4, 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 2992, 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 448, 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.003017906, 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000038562, 2024-09-16T01:27:19.293 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.002218860, 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3, 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.004034964, 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001344988 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-16T01:27:19.294 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 448 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 81, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 160, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 92736, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 3, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 2, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.005525182, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.003596667, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000926202, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:19.295 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 79, 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.004465353, 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000056523 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 92736 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.296 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:19.297 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 111, 2024-09-16T01:27:19.297 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 108, 2024-09-16T01:27:19.297 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 448976, 2024-09-16T01:27:19.297 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 65328, 2024-09-16T01:27:19.297 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-09-16T01:27:19.297 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-16T01:27:19.297 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.017137422, 2024-09-16T01:27:19.297 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.007006459, 2024-09-16T01:27:19.297 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.014810364, 2024-09-16T01:27:19.297 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 107, 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.006416089, 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000059963 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 448976, 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 65328 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.298 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:19.299 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:19.300 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:19.301 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 148863, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 28, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-09-16T01:27:19.302 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-16T01:27:19.303 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 112, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 433314, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 112, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 112, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 433314, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-16T01:27:19.304 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-16T01:27:19.305 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:19.305 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-16T01:27:19.305 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-16T01:27:19.980 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-16T01:27:19.981 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-16T01:27:19.981 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-16T01:27:19.981 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-16T01:27:19.981 DEBUG:tasks.check_counter:Getting stats from c 2024-09-16T01:27:19.981 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-16T01:27:20.244 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:27:20.630 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:20 smithi192 ceph-mon[34775]: pgmap v455: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:20.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:20 smithi162 ceph-mon[34539]: pgmap v455: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:20.736 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 29662, 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 26154, 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 13493433, 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 16052258, 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 15, 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 7, 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 1.358133928, 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.535161439, 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.930724639, 2024-09-16T01:27:20.737 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.081343280, 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 26154, 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.618718957, 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000023656 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 48946, 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.006981091, 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000142 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:27:20.738 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 4803, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 4794, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 1679856, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 10828513, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 14, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 7, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.424938100, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.194200184, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.095452010, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.112701519, 2024-09-16T01:27:20.739 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 4792, 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.295809155, 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000061729 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 6, 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000389, 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000064 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 502688, 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 75680 2024-09-16T01:27:20.740 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 26392, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 38478, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 9094808, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 21271414, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 12, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 1.519154075, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.664380956, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.880969540, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.091136897, 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:20.741 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 38476, 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.008775395, 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000026218 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 52430, 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.007586299, 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000144 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 214128 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-16T01:27:20.742 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-16T01:27:20.743 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-16T01:27:20.743 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.743 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-16T01:27:20.743 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-16T01:27:20.743 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-16T01:27:20.743 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 4961, 2024-09-16T01:27:20.743 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 5.487138317, 2024-09-16T01:27:20.743 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001106054 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 6046, 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.659287405, 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000109045 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 7640, 2024-09-16T01:27:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 7605, 2024-09-16T01:27:20.745 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-16T01:27:20.745 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 7605, 2024-09-16T01:27:20.745 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 18.240749440, 2024-09-16T01:27:20.745 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002398520 2024-09-16T01:27:20.745 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.745 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-16T01:27:20.745 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 35, 2024-09-16T01:27:20.746 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-09-16T01:27:20.746 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-16T01:27:20.746 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 11, 2024-09-16T01:27:20.746 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-09-16T01:27:20.746 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-09-16T01:27:20.746 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 117, 2024-09-16T01:27:20.747 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 45, 2024-09-16T01:27:20.747 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 25, 2024-09-16T01:27:20.747 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 47, 2024-09-16T01:27:20.747 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 51, 2024-09-16T01:27:20.747 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 3006, 2024-09-16T01:27:20.747 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 0, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 0, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 4, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 14401, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 11665, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 35, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 1414, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 2, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 15, 2024-09-16T01:27:20.748 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 120, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 15, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 3793, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 5576, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 3343, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 23882834, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 5576, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:27:20.749 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 335, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 335, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 5241, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 10, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 1417, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 4862, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 28, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 2298, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 663, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 51, 2024-09-16T01:27:20.750 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 8456 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 616, 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 4184, 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 2778, 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 2822, 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 1198, 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 31, 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 3877, 2024-09-16T01:27:20.751 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 3810, 2024-09-16T01:27:20.752 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 37, 2024-09-16T01:27:20.752 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-16T01:27:20.752 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-16T01:27:20.752 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:27:20.752 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:27:20.752 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-16T01:27:20.752 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-16T01:27:20.753 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:27:20.753 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:27:20.753 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:27:20.753 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 15, 2024-09-16T01:27:20.753 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-16T01:27:20.753 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:27:20.753 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-16T01:27:20.753 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-09-16T01:27:20.754 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.754 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-16T01:27:20.754 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-09-16T01:27:20.754 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 9550, 2024-09-16T01:27:20.754 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-16T01:27:20.754 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-16T01:27:20.754 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 9550, 2024-09-16T01:27:20.754 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 13, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 13, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 25897513, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 969, 2024-09-16T01:27:20.755 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 2.546081455, 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002627535 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 54, 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 5265, 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 5211, 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 60, 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 1860, 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 1800, 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 117, 2024-09-16T01:27:20.756 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 10859, 2024-09-16T01:27:20.757 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 10742, 2024-09-16T01:27:20.757 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 0, 2024-09-16T01:27:20.757 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 3857, 2024-09-16T01:27:20.757 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 3857, 2024-09-16T01:27:20.757 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 102408, 2024-09-16T01:27:20.757 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 223520 2024-09-16T01:27:20.757 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.757 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 11850, 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 170, 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 7640, 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 9, 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 513, 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 113, 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.131932012, 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001167539 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-16T01:27:20.758 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1456, 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.453104175, 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000311197 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 41, 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.100102304, 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002441519 2024-09-16T01:27:20.759 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1162, 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.486404317, 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000418592 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-16T01:27:20.760 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.761 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.761 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.761 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.761 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-16T01:27:20.761 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.761 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.761 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.761 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.761 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-16T01:27:20.762 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.762 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.762 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.762 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.762 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-16T01:27:20.762 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.762 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.762 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.762 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.763 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-16T01:27:20.763 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.763 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.763 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.763 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.764 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-16T01:27:20.764 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 54, 2024-09-16T01:27:20.764 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.065956442, 2024-09-16T01:27:20.764 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001221415 2024-09-16T01:27:20.764 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.764 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-16T01:27:20.764 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 55, 2024-09-16T01:27:20.764 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.068567446, 2024-09-16T01:27:20.764 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001246680 2024-09-16T01:27:20.765 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.765 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-16T01:27:20.765 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.765 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.765 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.765 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.765 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-16T01:27:20.765 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 114, 2024-09-16T01:27:20.765 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.077455967, 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000679438 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 434, 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.533598059, 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001229488 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 112, 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.583346273, 2024-09-16T01:27:20.766 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.005208448 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.767 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 407, 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 10.709171854, 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.026312461 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.768 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 38, 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.155211347, 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.004084509 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.769 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.770 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 69, 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.073337361, 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001062860 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3550, 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 4.802561883, 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001352834 2024-09-16T01:27:20.771 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.772 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:27:20.772 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:27:20.772 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-16T01:27:20.772 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.772 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.772 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.772 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:20.772 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.772 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-16T01:27:20.772 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 2, 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 1, 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 5010, 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 5010, 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 243, 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-16T01:27:20.773 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:20.774 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:20.775 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:20.775 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:20.775 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:20.775 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:20.775 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:20.775 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:20.775 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:20.776 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:20.776 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:20.776 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:20.776 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:20.776 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:20.776 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:20.776 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:20.776 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:20.776 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 284054, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 114, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:20.777 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:20.778 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-16T01:27:20.778 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-16T01:27:20.778 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:20.778 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:20.778 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:20.778 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:20.778 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7592, 2024-09-16T01:27:20.778 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 156, 2024-09-16T01:27:20.778 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:20.779 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:20.779 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:20.779 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-16T01:27:20.779 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 295362, 2024-09-16T01:27:20.779 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 6294, 2024-09-16T01:27:20.779 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:20.780 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-16T01:27:20.780 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:20.780 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-16T01:27:20.780 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.780 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-16T01:27:20.780 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-16T01:27:20.781 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-16T01:27:20.781 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 10860, 2024-09-16T01:27:20.781 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 22231682, 2024-09-16T01:27:20.781 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 33, 2024-09-16T01:27:20.781 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 10860, 2024-09-16T01:27:20.781 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-16T01:27:20.781 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 10860, 2024-09-16T01:27:20.782 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 15.946682128, 2024-09-16T01:27:20.782 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001468386 2024-09-16T01:27:20.782 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.782 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-16T01:27:20.782 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-16T01:27:20.782 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 10860, 2024-09-16T01:27:20.782 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 10975 2024-09-16T01:27:20.783 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.783 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 10860, 2024-09-16T01:27:20.783 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 5695, 2024-09-16T01:27:20.783 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 5165, 2024-09-16T01:27:20.783 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-16T01:27:20.784 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-16T01:27:20.784 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-09-16T01:27:20.784 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-09-16T01:27:20.784 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 119, 2024-09-16T01:27:20.784 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 1088, 2024-09-16T01:27:20.784 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 63, 2024-09-16T01:27:20.785 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-16T01:27:20.785 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-16T01:27:20.785 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-16T01:27:20.785 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-09-16T01:27:20.785 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 3898, 2024-09-16T01:27:20.785 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-16T01:27:20.786 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-16T01:27:20.786 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-16T01:27:20.786 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 5576, 2024-09-16T01:27:20.786 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-09-16T01:27:20.786 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:27:20.786 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-16T01:27:20.786 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:27:20.786 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-16T01:27:20.786 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 34, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-16T01:27:20.787 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-16T01:27:20.788 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-16T01:27:20.788 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-16T01:27:20.788 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-16T01:27:20.788 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-16T01:27:20.788 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-16T01:27:20.788 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-16T01:27:20.788 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 84, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 2, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 12, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 12, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 117, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 50 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-16T01:27:20.789 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 18, 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 10, 2024-09-16T01:27:20.790 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 3881, 2024-09-16T01:27:20.791 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 3810, 2024-09-16T01:27:20.791 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-16T01:27:20.791 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.791 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:20.791 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:20.791 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-16T01:27:20.791 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:20.791 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 60853, 2024-09-16T01:27:20.791 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 18780152, 2024-09-16T01:27:20.791 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:20.792 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 60853, 2024-09-16T01:27:20.792 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-16T01:27:20.792 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-16T01:27:20.792 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 60853, 2024-09-16T01:27:20.792 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 18780152, 2024-09-16T01:27:20.793 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:20.793 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.793 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.793 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.793 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:20.793 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.794 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-16T01:27:20.794 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:20.794 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-16T01:27:20.794 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:20.794 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-16T01:27:20.794 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-16T01:27:20.795 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:20.795 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:20.795 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 10860, 2024-09-16T01:27:20.796 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 22616508, 2024-09-16T01:27:20.796 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 10860, 2024-09-16T01:27:20.796 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 22616508, 2024-09-16T01:27:20.796 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:20.796 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.796 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-16T01:27:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-16T01:27:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-16T01:27:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-16T01:27:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:20.798 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:20.798 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 10860, 2024-09-16T01:27:20.798 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 10860, 2024-09-16T01:27:20.798 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 10860, 2024-09-16T01:27:20.798 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 10860, 2024-09-16T01:27:20.798 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:20.799 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.799 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.799 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.799 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:20.799 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.799 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:27:20.799 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:20.800 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-16T01:27:20.800 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:20.800 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 3810, 2024-09-16T01:27:20.800 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 384826, 2024-09-16T01:27:20.800 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:20.800 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 3810, 2024-09-16T01:27:20.801 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-16T01:27:20.801 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-16T01:27:20.801 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 119, 2024-09-16T01:27:20.801 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 384826, 2024-09-16T01:27:20.801 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:20.801 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.802 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.802 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.802 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:20.802 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:20.802 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x55723923e960": { 2024-09-16T01:27:20.802 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:20.803 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-16T01:27:20.803 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:20.803 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 9550, 2024-09-16T01:27:20.803 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 21703209, 2024-09-16T01:27:20.803 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:20.803 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 9550, 2024-09-16T01:27:20.804 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-16T01:27:20.804 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-16T01:27:20.804 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 969, 2024-09-16T01:27:20.804 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 21703209, 2024-09-16T01:27:20.804 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:20.804 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:20.804 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:20.805 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:20.805 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:20.805 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:20.805 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-16T01:27:20.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:20 smithi063 ceph-mon[31070]: pgmap v455: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:21.642 INFO:tasks.check_counter:Daemon mds.c mds.exported=15 2024-09-16T01:27:21.642 INFO:tasks.check_counter:Daemon mds.c mds.imported=15 2024-09-16T01:27:21.642 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=616 2024-09-16T01:27:21.642 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=4184 2024-09-16T01:27:21.642 DEBUG:tasks.check_counter:Getting stats from f 2024-09-16T01:27:21.642 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-16T01:27:21.894 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:27:22.396 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-16T01:27:22.396 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:22.396 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 942, 2024-09-16T01:27:22.396 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 944, 2024-09-16T01:27:22.396 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 19893226, 2024-09-16T01:27:22.396 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 299563, 2024-09-16T01:27:22.396 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 7, 2024-09-16T01:27:22.396 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 3, 2024-09-16T01:27:22.396 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.084892992, 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.024333144, 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.029101316, 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.024416038, 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 942, 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.032447488, 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000034445 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.397 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 58, 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 137, 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 8403398, 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 231532, 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 5, 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 4, 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.014239428, 2024-09-16T01:27:22.398 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.004218624, 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.007594280, 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.001251240, 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 135, 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.010057018, 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000074496 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.399 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 213344 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 160, 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 149, 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 4694456, 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 76634, 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 4, 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 3, 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.024125984, 2024-09-16T01:27:22.400 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.007662302, 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.019717202, 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000812113, 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 149, 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.012184819, 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000081777 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.401 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 491248, 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 65504 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1775, 2024-09-16T01:27:22.402 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.043244225, 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000024362 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-16T01:27:22.403 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 0, 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 0, 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 0, 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 0, 2024-09-16T01:27:22.404 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 4149, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 4149, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 4148, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 0, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 0, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 0, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 1, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 0, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 0, 2024-09-16T01:27:22.405 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-09-16T01:27:22.406 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-09-16T01:27:22.407 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 0, 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 0, 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 0, 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 0 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-16T01:27:22.408 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-16T01:27:22.409 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.410 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 0, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 13884, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 0, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 21, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 3, 2024-09-16T01:27:22.411 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 36401125, 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 36399987, 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 13884 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-16T01:27:22.412 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 69, 2024-09-16T01:27:22.413 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 10061, 2024-09-16T01:27:22.413 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 9992, 2024-09-16T01:27:22.413 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 72, 2024-09-16T01:27:22.413 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 1328, 2024-09-16T01:27:22.413 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 1256, 2024-09-16T01:27:22.413 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 4149, 2024-09-16T01:27:22.413 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 13872, 2024-09-16T01:27:22.413 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 9723, 2024-09-16T01:27:22.414 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 0, 2024-09-16T01:27:22.414 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 0, 2024-09-16T01:27:22.414 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 0, 2024-09-16T01:27:22.414 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 64760, 2024-09-16T01:27:22.415 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 215328 2024-09-16T01:27:22.415 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.415 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-16T01:27:22.415 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 0, 2024-09-16T01:27:22.415 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-09-16T01:27:22.415 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 0, 2024-09-16T01:27:22.415 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 0, 2024-09-16T01:27:22.415 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 0, 2024-09-16T01:27:22.416 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-16T01:27:22.416 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.416 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.416 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.416 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.416 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-16T01:27:22.416 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.416 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.417 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.418 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.418 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.419 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.420 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.420 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.420 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-16T01:27:22.420 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.420 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.420 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.420 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.420 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-16T01:27:22.421 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.422 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.422 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.422 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.422 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.423 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.424 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.425 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-16T01:27:22.426 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.428 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.429 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 2, 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 1, 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-09-16T01:27:22.430 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-16T01:27:22.431 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 0, 2024-09-16T01:27:22.431 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 0, 2024-09-16T01:27:22.431 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 1242, 2024-09-16T01:27:22.431 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-16T01:27:22.431 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.431 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-16T01:27:22.431 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:22.431 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:22.431 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:22.432 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:22.433 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 206183, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 58, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:22.434 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7592, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 156, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 3177875, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 27609, 2024-09-16T01:27:22.435 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 1034, 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 21, 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 3, 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 1034, 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-16T01:27:22.436 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1034, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.511989837, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000495154 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1034, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1035 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 1034, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 1034, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 0, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-16T01:27:22.437 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 606, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 426, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-16T01:27:22.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 1, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-16T01:27:22.439 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-16T01:27:22.440 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-16T01:27:22.441 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-16T01:27:22.441 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 84, 2024-09-16T01:27:22.441 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-16T01:27:22.441 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 1, 2024-09-16T01:27:22.441 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 7, 2024-09-16T01:27:22.441 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 7, 2024-09-16T01:27:22.441 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-16T01:27:22.441 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-16T01:27:22.441 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 0, 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 2, 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 0 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 0, 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-09-16T01:27:22.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 0, 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-16T01:27:22.443 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 1156, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 32877849, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 1156, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1156, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 32877849, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.444 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 1034, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 32207558, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1034, 2024-09-16T01:27:22.445 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 32207558, 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 1034, 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 1034, 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1034, 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 1034, 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:22.447 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-16T01:27:22.448 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:22.448 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-16T01:27:22.448 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-16T01:27:22.448 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:22.448 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:22.448 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-16T01:27:22.448 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-16T01:27:22.448 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x5575b20fcb40": { 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-16T01:27:22.449 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:22.450 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:22.451 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:22.451 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-16T01:27:22.451 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:22 smithi192 ceph-mon[34775]: pgmap v456: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:22.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:22 smithi162 ceph-mon[34539]: pgmap v456: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:22.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:22 smithi063 ceph-mon[31070]: pgmap v456: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:23.142 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-16T01:27:23.142 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-16T01:27:23.142 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-16T01:27:23.142 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-16T01:27:23.142 DEBUG:tasks.check_counter:Getting stats from i 2024-09-16T01:27:23.142 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-16T01:27:23.388 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:27:23.877 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-16T01:27:23.877 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:23.877 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 34233, 2024-09-16T01:27:23.877 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 30719, 2024-09-16T01:27:23.877 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 19274412, 2024-09-16T01:27:23.877 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 28698541, 2024-09-16T01:27:23.877 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 19, 2024-09-16T01:27:23.877 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-09-16T01:27:23.877 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 1.634872742, 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.682673124, 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 1.036457835, 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.124151317, 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 30719, 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.673073101, 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000021910 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 53908, 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.008164041, 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000151 2024-09-16T01:27:23.878 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 505904, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 71888 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 21461, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 48086, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 6868559, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 26350577, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 11, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 1.405527505, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.606789207, 2024-09-16T01:27:23.879 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.685606770, 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.130827702, 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 48084, 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.868396799, 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000018059 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 49978, 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.008569668, 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000171 2024-09-16T01:27:23.880 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.881 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-16T01:27:23.881 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 213920 2024-09-16T01:27:23.881 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.881 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:23.881 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 18918, 2024-09-16T01:27:23.881 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 19577, 2024-09-16T01:27:23.881 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 5846298, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 16081159, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 10, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 1.091591287, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.469698035, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.525504206, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.152540252, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 19575, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.529723555, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000027061 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.882 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 25632, 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.003559447, 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000138 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.883 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 9344, 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 7.454532810, 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000797788 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-16T01:27:23.884 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 5362, 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.610097848, 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000113781 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 9781, 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 9661, 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 9661, 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 14.423105438, 2024-09-16T01:27:23.885 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001492920 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 120, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 22, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 1, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 2, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 244, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 120, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 55, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 69, 2024-09-16T01:27:23.886 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 72, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 9242, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 3, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 3, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 4, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 16622, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 14098, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 102, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 1305, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 3, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-16T01:27:23.887 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-16T01:27:23.888 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 18, 2024-09-16T01:27:23.888 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 6628, 2024-09-16T01:27:23.888 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 27, 2024-09-16T01:27:23.888 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 7832, 2024-09-16T01:27:23.888 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 12349, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 3343, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 23882834, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 12349, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 1386, 2024-09-16T01:27:23.889 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 1386, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 10963, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 4, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 2178, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 6466, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 8, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 5968, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 3752, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 39, 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 9669 2024-09-16T01:27:23.890 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 860, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 3894, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 2580, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 2630, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 1743, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 58, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 3507, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 3425, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 25, 2024-09-16T01:27:23.891 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 18, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 3, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-16T01:27:23.892 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 2, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 13884, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 13884, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 21, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 21, 2024-09-16T01:27:23.893 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 3, 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 36401125, 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 824, 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3.541811065, 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.004298314 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.894 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 94, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 11341, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 11247, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 98, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 2664, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 2566, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 244, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 16414, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 16170, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 3, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 10041, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 10038, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 111736, 2024-09-16T01:27:23.895 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 223520 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 14028, 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 305, 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 9781, 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 22, 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 593, 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1997, 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 2.334707266, 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001169107 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.896 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2496, 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.589721261, 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000236266 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 11, 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.022020946, 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002001904 2024-09-16T01:27:23.897 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 525, 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.394915344, 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000752219 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.898 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.899 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.899 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-16T01:27:23.899 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.899 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.899 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.899 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.899 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-16T01:27:23.899 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.899 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.899 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.900 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 447, 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1.191920399, 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.002666488 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 20, 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.018327911, 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000916395 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.901 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 41, 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.025048153, 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000610930 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 490, 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.457704334, 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000934090 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 50, 2024-09-16T01:27:23.902 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.251789572, 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.005035791 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-16T01:27:23.903 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 485, 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 5.217987916, 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.010758737 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.904 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 13, 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.054708414, 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.004208339 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-16T01:27:23.905 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.906 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 30, 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.026266935, 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000875564 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3056, 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 3.837986987, 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001255885 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-16T01:27:23.907 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 2, 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 1, 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 5428, 2024-09-16T01:27:23.908 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 5428, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 244, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:23.909 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:23.910 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:23.911 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 299145, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 117, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7592, 2024-09-16T01:27:23.912 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 156, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 534594, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 12446, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-16T01:27:23.913 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 17033, 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 33146544, 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 30, 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 17033, 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 17033, 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 16.278675820, 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000955713 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 17033, 2024-09-16T01:27:23.914 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 17171 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 17033, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 12443, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 4590, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 94, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 918, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 55, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-16T01:27:23.915 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 1, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 3501, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 12349, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-16T01:27:23.916 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 9, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-16T01:27:23.917 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 84, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 2, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 12, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 12, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-16T01:27:23.918 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 157, 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 57 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: "osd-slow-ops": { 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-09-16T01:27:23.919 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 16, 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 10, 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 3478, 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 3425, 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-16T01:27:23.920 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 74608, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 25263474, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 74608, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 74608, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 25263474, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:23.921 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 17033, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 33492469, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 17033, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 33492469, 2024-09-16T01:27:23.922 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-16T01:27:23.923 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 17033, 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 17033, 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 17033, 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 17033, 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-16T01:27:23.924 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 3425, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 345925, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 3425, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 94, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 345925, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:23.925 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x561717ce4960": { 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 13884, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 32206821, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 13884, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 824, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 32206821, 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:23.926 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:23.927 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:23.927 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:23.927 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:23.927 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:23.927 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-16T01:27:24.651 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:24 smithi192 ceph-mon[34775]: pgmap v457: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:24.677 INFO:tasks.check_counter:Daemon mds.i mds.exported=18 2024-09-16T01:27:24.677 INFO:tasks.check_counter:Daemon mds.i mds.imported=27 2024-09-16T01:27:24.677 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=860 2024-09-16T01:27:24.677 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=3894 2024-09-16T01:27:24.677 DEBUG:tasks.check_counter:Getting stats from l 2024-09-16T01:27:24.678 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-16T01:27:24.684 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:24 smithi162 ceph-mon[34539]: pgmap v457: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:24.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:24 smithi063 ceph-mon[31070]: pgmap v457: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:24.922 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.c/config 2024-09-16T01:27:25.440 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-16T01:27:25.440 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-16T01:27:25.440 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 0, 2024-09-16T01:27:25.440 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 2, 2024-09-16T01:27:25.440 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 0, 2024-09-16T01:27:25.440 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 0, 2024-09-16T01:27:25.440 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 4, 2024-09-16T01:27:25.440 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 0, 2024-09-16T01:27:25.440 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.001064179, 2024-09-16T01:27:25.440 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.000000000, 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.000284831, 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.441 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 0 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 117, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 112, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 452512, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 67056, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 2, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 1, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.019744804, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.007043153, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.016473043, 2024-09-16T01:27:25.442 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 112, 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.010694470, 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000095486 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 452512, 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 67056 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.443 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 1, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 83, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 160, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 93088, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 3, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 2, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.004894659, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.003448254, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.000520185, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 81, 2024-09-16T01:27:25.444 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.005329331, 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000065794 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 93088 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 0, 2024-09-16T01:27:25.445 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-16T01:27:25.446 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-16T01:27:25.447 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 148840, 2024-09-16T01:27:25.448 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 28, 2024-09-16T01:27:25.449 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-16T01:27:25.449 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-16T01:27:25.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-16T01:27:25.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-16T01:27:25.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-16T01:27:25.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-16T01:27:25.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-16T01:27:25.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-16T01:27:25.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 0, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 0, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 928, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 2, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-16T01:27:25.450 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 114, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 433574, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 114, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 114, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 433574, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-16T01:27:25.451 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:25.452 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-16T01:27:25.452 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-16T01:27:26.148 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-16T01:27:26.148 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-16T01:27:26.149 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-16T01:27:26.149 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-16T01:27:26.149 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-16T01:27:26.158 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-16T01:27:26.159 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:27:26.159 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:27:26.182 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:27:26.182 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:27:26.243 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T01:27:26.554 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:26.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:26 smithi063 ceph-mon[31070]: pgmap v458: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:26.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:26 smithi192 ceph-mon[34775]: pgmap v458: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:26.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:26 smithi162 ceph-mon[34539]: pgmap v458: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:27.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.048+0000 7fcb3d534640 1 -- 172.21.15.63:0/2947859605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb381036e0 msgr2=0x7fcb38107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:27.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.048+0000 7fcb3d534640 1 --2- 172.21.15.63:0/2947859605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb381036e0 0x7fcb38107b90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009930 tx=0x7fcb2002a420 comp rx=0 tx=0).stop 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.048+0000 7fcb3d534640 1 -- 172.21.15.63:0/2947859605 shutdown_connections 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.048+0000 7fcb3d534640 1 --2- 172.21.15.63:0/2947859605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb381082a0 0x7fcb3810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.048+0000 7fcb3d534640 1 --2- 172.21.15.63:0/2947859605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb381036e0 0x7fcb38107b90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.048+0000 7fcb3d534640 1 --2- 172.21.15.63:0/2947859605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb38102d30 0x7fcb38103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.048+0000 7fcb3d534640 1 -- 172.21.15.63:0/2947859605 >> 172.21.15.63:0/2947859605 conn(0x7fcb380fc7d0 msgr2=0x7fcb380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.048+0000 7fcb3d534640 1 -- 172.21.15.63:0/2947859605 shutdown_connections 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.048+0000 7fcb3d534640 1 -- 172.21.15.63:0/2947859605 wait complete. 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.048+0000 7fcb3d534640 1 Processor -- start 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb3d534640 1 -- start start 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb3d534640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb38102d30 0x7fcb38100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb3d534640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb381036e0 0x7fcb38100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb3d534640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb381082a0 0x7fcb38101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb3d534640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38111f50 con 0x7fcb381036e0 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb3d534640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb38111dd0 con 0x7fcb381082a0 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb3d534640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb381120d0 con 0x7fcb38102d30 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb367fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb381036e0 0x7fcb38100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb367fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb381036e0 0x7fcb38100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38118/0 (socket says 172.21.15.63:38118) 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb367fc640 1 -- 172.21.15.63:0/1142597093 learned_addr learned my addr 172.21.15.63:0/1142597093 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb36ffd640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb38102d30 0x7fcb38100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb377fe640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb381082a0 0x7fcb38101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb367fc640 1 -- 172.21.15.63:0/1142597093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb38102d30 msgr2=0x7fcb38100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb367fc640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb38102d30 0x7fcb38100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb367fc640 1 -- 172.21.15.63:0/1142597093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb381082a0 msgr2=0x7fcb38101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb367fc640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb381082a0 0x7fcb38101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:27.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb367fc640 1 -- 172.21.15.63:0/1142597093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb381a6910 con 0x7fcb381036e0 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.049+0000 7fcb377fe640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb381082a0 0x7fcb38101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.050+0000 7fcb367fc640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb381036e0 0x7fcb38100ed0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcb20031440 tx=0x7fcb20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.050+0000 7fcb2ffff640 1 -- 172.21.15.63:0/1142597093 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2003f030 con 0x7fcb381036e0 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.050+0000 7fcb2ffff640 1 -- 172.21.15.63:0/1142597093 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb20003aa0 con 0x7fcb381036e0 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.050+0000 7fcb3d534640 1 -- 172.21.15.63:0/1142597093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb381a6ba0 con 0x7fcb381036e0 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.050+0000 7fcb2ffff640 1 -- 172.21.15.63:0/1142597093 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20035070 con 0x7fcb381036e0 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.050+0000 7fcb3d534640 1 -- 172.21.15.63:0/1142597093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb381a7080 con 0x7fcb381036e0 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.051+0000 7fcb3d534640 1 -- 172.21.15.63:0/1142597093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb38103110 con 0x7fcb381036e0 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.052+0000 7fcb2ffff640 1 -- 172.21.15.63:0/1142597093 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcb20042030 con 0x7fcb381036e0 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.053+0000 7fcb2ffff640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb240a3240 0x7fcb240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.053+0000 7fcb2ffff640 1 -- 172.21.15.63:0/1142597093 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fcb200efd90 con 0x7fcb381036e0 2024-09-16T01:27:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.053+0000 7fcb36ffd640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb240a3240 0x7fcb240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:27.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.054+0000 7fcb36ffd640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb240a3240 0x7fcb240a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcb28005fd0 tx=0x7fcb28005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:27.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.057+0000 7fcb2ffff640 1 -- 172.21.15.63:0/1142597093 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb200bcab0 con 0x7fcb381036e0 2024-09-16T01:27:27.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.247+0000 7fcb3d534640 1 -- 172.21.15.63:0/1142597093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcb3810a2b0 con 0x7fcb381036e0 2024-09-16T01:27:27.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.247+0000 7fcb2ffff640 1 -- 172.21.15.63:0/1142597093 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+590 (secure 0 0 0) 0x7fcb200bc3b0 con 0x7fcb381036e0 2024-09-16T01:27:27.250 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3391259049 2024-09-17T01:14:37.096309+0000 2024-09-16T01:27:27.250 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2380375395 2024-09-17T01:14:37.096309+0000 2024-09-16T01:27:27.250 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/1469009490 2024-09-17T01:14:37.096309+0000 2024-09-16T01:27:27.250 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1539909966 2024-09-17T01:14:37.096309+0000 2024-09-16T01:27:27.250 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1391657104 2024-09-17T01:14:12.995809+0000 2024-09-16T01:27:27.250 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/843312492 2024-09-17T01:14:12.995809+0000 2024-09-16T01:27:27.251 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/843312492 2024-09-17T01:14:12.995809+0000 2024-09-16T01:27:27.251 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/1469009490 2024-09-17T01:14:37.096309+0000 2024-09-16T01:27:27.251 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3972146858 2024-09-17T01:14:12.995809+0000 2024-09-16T01:27:27.251 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1773373724 2024-09-17T01:14:12.995809+0000 2024-09-16T01:27:27.251 INFO:teuthology.orchestra.run.smithi063.stderr:listed 10 entries 2024-09-16T01:27:27.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 -- 172.21.15.63:0/1142597093 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb240a3240 msgr2=0x7fcb240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:27.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb240a3240 0x7fcb240a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcb28005fd0 tx=0x7fcb28005850 comp rx=0 tx=0).stop 2024-09-16T01:27:27.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 -- 172.21.15.63:0/1142597093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb381036e0 msgr2=0x7fcb38100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:27.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb381036e0 0x7fcb38100ed0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcb20031440 tx=0x7fcb20004270 comp rx=0 tx=0).stop 2024-09-16T01:27:27.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 -- 172.21.15.63:0/1142597093 shutdown_connections 2024-09-16T01:27:27.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fcb240a3240 0x7fcb240a5700 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:27.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb381082a0 0x7fcb38101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:27.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb381036e0 0x7fcb38100ed0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:27.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 --2- 172.21.15.63:0/1142597093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb38102d30 0x7fcb38100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:27.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 -- 172.21.15.63:0/1142597093 >> 172.21.15.63:0/1142597093 conn(0x7fcb380fc7d0 msgr2=0x7fcb38105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:27.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 -- 172.21.15.63:0/1142597093 shutdown_connections 2024-09-16T01:27:27.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:27.250+0000 7fcb3d534640 1 -- 172.21.15.63:0/1142597093 wait complete. 2024-09-16T01:27:27.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:27 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1142597093' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:27:27.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:27 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1142597093' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:27:27.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:27 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1142597093' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:27:28.092 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-16T01:27:28.092 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:27:28.110 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T01:27:28.420 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:28.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:28 smithi192 ceph-mon[34775]: pgmap v459: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:28.682 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:28 smithi063 ceph-mon[31070]: pgmap v459: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:28.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:28 smithi162 ceph-mon[34539]: pgmap v459: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-16T01:27:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.898+0000 7f0a0963a640 1 -- 172.21.15.63:0/3289503993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a04100100 msgr2=0x7f0a04100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.898+0000 7f0a0963a640 1 --2- 172.21.15.63:0/3289503993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a04100100 0x7f0a04100560 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009900 tx=0x7f09ec02a410 comp rx=0 tx=0).stop 2024-09-16T01:27:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.898+0000 7f0a0963a640 1 -- 172.21.15.63:0/3289503993 shutdown_connections 2024-09-16T01:27:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.898+0000 7f0a0963a640 1 --2- 172.21.15.63:0/3289503993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04100aa0 0x7f0a0410ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.898+0000 7f0a0963a640 1 --2- 172.21.15.63:0/3289503993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a04100100 0x7f0a04100560 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.898+0000 7f0a0963a640 1 --2- 172.21.15.63:0/3289503993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a04106b80 0x7f0a04106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.898+0000 7f0a0963a640 1 -- 172.21.15.63:0/3289503993 >> 172.21.15.63:0/3289503993 conn(0x7f0a04077230 msgr2=0x7f0a040fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.898+0000 7f0a0963a640 1 -- 172.21.15.63:0/3289503993 shutdown_connections 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.898+0000 7f0a0963a640 1 -- 172.21.15.63:0/3289503993 wait complete. 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a0963a640 1 Processor -- start 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a0963a640 1 -- start start 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a0963a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04100100 0x7f0a041984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a0963a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a04100aa0 0x7f0a04198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a0963a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a04106b80 0x7f0a0419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a0963a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0a04111f40 con 0x7f0a04100aa0 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a0963a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0a04111dc0 con 0x7f0a04106b80 2024-09-16T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a0963a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a041120c0 con 0x7f0a04100100 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f09fbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a04100aa0 0x7f0a04198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f09fbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a04100aa0 0x7f0a04198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49198/0 (socket says 172.21.15.63:49198) 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f09fbfff640 1 -- 172.21.15.63:0/2487931736 learned_addr learned my addr 172.21.15.63:0/2487931736 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a02ffd640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04100100 0x7f0a041984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a037fe640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a04106b80 0x7f0a0419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f09fbfff640 1 -- 172.21.15.63:0/2487931736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04100100 msgr2=0x7f0a041984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f09fbfff640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04100100 0x7f0a041984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f09fbfff640 1 -- 172.21.15.63:0/2487931736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a04106b80 msgr2=0x7f0a0419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f09fbfff640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a04106b80 0x7f0a0419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f09fbfff640 1 -- 172.21.15.63:0/2487931736 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0419d470 con 0x7f0a04100aa0 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.899+0000 7f0a037fe640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a04106b80 0x7f0a0419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.900+0000 7f09fbfff640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a04100aa0 0x7f0a04198a00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f09ec005940 tx=0x7f09ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.900+0000 7f0a00ff9640 1 -- 172.21.15.63:0/2487931736 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec03f030 con 0x7f0a04100aa0 2024-09-16T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.900+0000 7f0a00ff9640 1 -- 172.21.15.63:0/2487931736 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f09ec003aa0 con 0x7f0a04100aa0 2024-09-16T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.900+0000 7f0a0963a640 1 -- 172.21.15.63:0/2487931736 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0419d700 con 0x7f0a04100aa0 2024-09-16T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.900+0000 7f0a00ff9640 1 -- 172.21.15.63:0/2487931736 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec035070 con 0x7f0a04100aa0 2024-09-16T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.900+0000 7f0a0963a640 1 -- 172.21.15.63:0/2487931736 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a041a5040 con 0x7f0a04100aa0 2024-09-16T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.901+0000 7f0a0963a640 1 -- 172.21.15.63:0/2487931736 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a04103420 con 0x7f0a04100aa0 2024-09-16T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.903+0000 7f0a00ff9640 1 -- 172.21.15.63:0/2487931736 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f09ec042030 con 0x7f0a04100aa0 2024-09-16T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.903+0000 7f0a00ff9640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f09f00a3240 0x7f09f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.904+0000 7f0a00ff9640 1 -- 172.21.15.63:0/2487931736 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f09ec0f03d0 con 0x7f0a04100aa0 2024-09-16T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.904+0000 7f0a02ffd640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f09f00a3240 0x7f09f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.904+0000 7f0a02ffd640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f09f00a3240 0x7f09f00a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009890 tx=0x7f09f4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:28.907+0000 7f0a00ff9640 1 -- 172.21.15.63:0/2487931736 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09ec0bd0f0 con 0x7f0a04100aa0 2024-09-16T01:27:29.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.099+0000 7f0a0963a640 1 -- 172.21.15.63:0/2487931736 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0a04100560 con 0x7f0a04100aa0 2024-09-16T01:27:29.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.099+0000 7f0a00ff9640 1 -- 172.21.15.63:0/2487931736 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+590 (secure 0 0 0) 0x7f0a04100560 con 0x7f0a04100aa0 2024-09-16T01:27:29.102 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3391259049 2024-09-17T01:14:37.096309+0000 2024-09-16T01:27:29.102 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/2380375395 2024-09-17T01:14:37.096309+0000 2024-09-16T01:27:29.102 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/1469009490 2024-09-17T01:14:37.096309+0000 2024-09-16T01:27:29.102 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1539909966 2024-09-17T01:14:37.096309+0000 2024-09-16T01:27:29.102 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1391657104 2024-09-17T01:14:12.995809+0000 2024-09-16T01:27:29.102 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6801/843312492 2024-09-17T01:14:12.995809+0000 2024-09-16T01:27:29.102 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/843312492 2024-09-17T01:14:12.995809+0000 2024-09-16T01:27:29.102 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6800/1469009490 2024-09-17T01:14:37.096309+0000 2024-09-16T01:27:29.103 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/3972146858 2024-09-17T01:14:12.995809+0000 2024-09-16T01:27:29.103 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:0/1773373724 2024-09-17T01:14:12.995809+0000 2024-09-16T01:27:29.103 INFO:teuthology.orchestra.run.smithi063.stderr:listed 10 entries 2024-09-16T01:27:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.101+0000 7f0a0963a640 1 -- 172.21.15.63:0/2487931736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f09f00a3240 msgr2=0x7f09f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.101+0000 7f0a0963a640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f09f00a3240 0x7f09f00a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009890 tx=0x7f09f4008040 comp rx=0 tx=0).stop 2024-09-16T01:27:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.101+0000 7f0a0963a640 1 -- 172.21.15.63:0/2487931736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a04100aa0 msgr2=0x7f0a04198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.101+0000 7f0a0963a640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a04100aa0 0x7f0a04198a00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f09ec005940 tx=0x7f09ec004270 comp rx=0 tx=0).stop 2024-09-16T01:27:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.101+0000 7f0a0963a640 1 -- 172.21.15.63:0/2487931736 shutdown_connections 2024-09-16T01:27:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.101+0000 7f0a0963a640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f09f00a3240 0x7f09f00a5700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.101+0000 7f0a0963a640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a04106b80 0x7f0a0419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.101+0000 7f0a0963a640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0a04100aa0 0x7f0a04198a00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.101+0000 7f0a0963a640 1 --2- 172.21.15.63:0/2487931736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a04100100 0x7f0a041984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.101+0000 7f0a0963a640 1 -- 172.21.15.63:0/2487931736 >> 172.21.15.63:0/2487931736 conn(0x7f0a04077230 msgr2=0x7f0a04104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:29.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.102+0000 7f0a0963a640 1 -- 172.21.15.63:0/2487931736 shutdown_connections 2024-09-16T01:27:29.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:29.102+0000 7f0a0963a640 1 -- 172.21.15.63:0/2487931736 wait complete. 2024-09-16T01:27:29.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:29 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/2487931736' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:27:29.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:29 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/2487931736' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:27:29.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:29 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/2487931736' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-16T01:27:29.959 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2024-09-16T01:27:29.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:27:29.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-16T01:27:29.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi063.stderr:ceph-fuse[82135]: fuse finished with error 0 and tester_r 0 2024-09-16T01:27:29.989 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:27:30.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:30 smithi192 ceph-mon[34775]: pgmap v460: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:30.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:30 smithi162 ceph-mon[34539]: pgmap v460: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:30.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:30 smithi063 ceph-mon[31070]: pgmap v460: 97 pgs: 97 active+clean; 136 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-16T01:27:32.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:32 smithi192 ceph-mon[34775]: pgmap v461: 97 pgs: 97 active+clean; 136 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-16T01:27:32.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:32 smithi162 ceph-mon[34539]: pgmap v461: 97 pgs: 97 active+clean; 136 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-16T01:27:32.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:32 smithi063 ceph-mon[31070]: pgmap v461: 97 pgs: 97 active+clean; 136 MiB data, 617 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-16T01:27:34.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:34 smithi192 ceph-mon[34775]: pgmap v462: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:27:34.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:34 smithi162 ceph-mon[34539]: pgmap v462: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:27:34.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:34 smithi063 ceph-mon[31070]: pgmap v462: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:27:36.091 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-16T01:27:36.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:27:36.091 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:27:36.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:27:36.138 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-16T01:27:36.158 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:27:36.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:27:36.159 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:27:36.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:27:36.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-16T01:27:36.332 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-16T01:27:36.342 INFO:tasks.cephadm:Teardown begin 2024-09-16T01:27:36.343 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:27:36.343 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:27:36.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:36 smithi063 ceph-mon[31070]: pgmap v463: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:27:36.610 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:36.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:36 smithi192 ceph-mon[34775]: pgmap v463: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:27:36.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:36 smithi162 ceph-mon[34539]: pgmap v463: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:27:37.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.115+0000 7f963f6c2640 1 -- 172.21.15.63:0/1794730513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9638102790 msgr2=0x7f96381067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:37.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.115+0000 7f963f6c2640 1 --2- 172.21.15.63:0/1794730513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9638102790 0x7f96381067e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f962c009900 tx=0x7f962c02a410 comp rx=0 tx=0).stop 2024-09-16T01:27:37.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.115+0000 7f963f6c2640 1 -- 172.21.15.63:0/1794730513 shutdown_connections 2024-09-16T01:27:37.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.115+0000 7f963f6c2640 1 --2- 172.21.15.63:0/1794730513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9638106f10 0x7f963810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:37.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.115+0000 7f963f6c2640 1 --2- 172.21.15.63:0/1794730513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9638102790 0x7f96381067e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:37.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.115+0000 7f963f6c2640 1 --2- 172.21.15.63:0/1794730513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9638101de0 0x7f96381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:37.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.115+0000 7f963f6c2640 1 -- 172.21.15.63:0/1794730513 >> 172.21.15.63:0/1794730513 conn(0x7f96380fd8c0 msgr2=0x7f96380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:37.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.115+0000 7f963f6c2640 1 -- 172.21.15.63:0/1794730513 shutdown_connections 2024-09-16T01:27:37.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.115+0000 7f963f6c2640 1 -- 172.21.15.63:0/1794730513 wait complete. 2024-09-16T01:27:37.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963f6c2640 1 Processor -- start 2024-09-16T01:27:37.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963f6c2640 1 -- start start 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963f6c2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9638101de0 0x7f96380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963f6c2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9638102790 0x7f9638074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963f6c2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9638106f10 0x7f9638074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963f6c2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9638111e20 con 0x7f9638101de0 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963f6c2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9638111ca0 con 0x7f9638102790 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963f6c2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9638111fa0 con 0x7f9638106f10 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963d45e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9638101de0 0x7f96380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963d45e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9638101de0 0x7f96380744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49216/0 (socket says 172.21.15.63:49216) 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963d45e640 1 -- 172.21.15.63:0/562224765 learned_addr learned my addr 172.21.15.63:0/562224765 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963cc5d640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9638102790 0x7f9638074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963dc5f640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9638106f10 0x7f9638074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:37.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963d45e640 1 -- 172.21.15.63:0/562224765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9638106f10 msgr2=0x7f9638074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963d45e640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9638106f10 0x7f9638074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.116+0000 7f963d45e640 1 -- 172.21.15.63:0/562224765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9638102790 msgr2=0x7f9638074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.117+0000 7f963d45e640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9638102790 0x7f9638074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.117+0000 7f963d45e640 1 -- 172.21.15.63:0/562224765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96381a6880 con 0x7f9638101de0 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.117+0000 7f963cc5d640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9638102790 0x7f9638074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.117+0000 7f963dc5f640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9638106f10 0x7f9638074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.117+0000 7f963d45e640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9638101de0 0x7f96380744f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f963000d770 tx=0x7f963000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.117+0000 7f96367fc640 1 -- 172.21.15.63:0/562224765 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630017070 con 0x7f9638101de0 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.117+0000 7f96367fc640 1 -- 172.21.15.63:0/562224765 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96300054d0 con 0x7f9638101de0 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.117+0000 7f96367fc640 1 -- 172.21.15.63:0/562224765 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630004cf0 con 0x7f9638101de0 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.117+0000 7f963f6c2640 1 -- 172.21.15.63:0/562224765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96381a6b70 con 0x7f9638101de0 2024-09-16T01:27:37.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.117+0000 7f963f6c2640 1 -- 172.21.15.63:0/562224765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96381a7030 con 0x7f9638101de0 2024-09-16T01:27:37.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.118+0000 7f963f6c2640 1 -- 172.21.15.63:0/562224765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96381021c0 con 0x7f9638101de0 2024-09-16T01:27:37.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.119+0000 7f96367fc640 1 -- 172.21.15.63:0/562224765 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9630004e90 con 0x7f9638101de0 2024-09-16T01:27:37.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.120+0000 7f96367fc640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f96200a32c0 0x7f96200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:37.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.120+0000 7f963cc5d640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f96200a32c0 0x7f96200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:37.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.120+0000 7f96367fc640 1 -- 172.21.15.63:0/562224765 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f96300cf3b0 con 0x7f9638101de0 2024-09-16T01:27:37.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.120+0000 7f963cc5d640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f96200a32c0 0x7f96200a5780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f962c031440 tx=0x7f962c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:37.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.124+0000 7f96367fc640 1 -- 172.21.15.63:0/562224765 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f963009c0d0 con 0x7f9638101de0 2024-09-16T01:27:37.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.337+0000 7f963f6c2640 1 -- 172.21.15.63:0/562224765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9638075a20 con 0x7f9638101de0 2024-09-16T01:27:37.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.338+0000 7f96367fc640 1 -- 172.21.15.63:0/562224765 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11918 (secure 0 0 0) 0x7f963009b9d0 con 0x7f9638101de0 2024-09-16T01:27:37.340 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:27:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"btime":"2024-09-16T01:25:54:073139+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:25:53.917460+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24467,24460,24445]},"id":1}]} 2024-09-16T01:27:37.341 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 29 2024-09-16T01:27:37.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 -- 172.21.15.63:0/562224765 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f96200a32c0 msgr2=0x7f96200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:37.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f96200a32c0 0x7f96200a5780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f962c031440 tx=0x7f962c005a20 comp rx=0 tx=0).stop 2024-09-16T01:27:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 -- 172.21.15.63:0/562224765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9638101de0 msgr2=0x7f96380744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9638101de0 0x7f96380744f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f963000d770 tx=0x7f963000dc30 comp rx=0 tx=0).stop 2024-09-16T01:27:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 -- 172.21.15.63:0/562224765 shutdown_connections 2024-09-16T01:27:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f96200a32c0 0x7f96200a5780 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9638106f10 0x7f9638074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9638102790 0x7f9638074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 --2- 172.21.15.63:0/562224765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9638101de0 0x7f96380744f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 -- 172.21.15.63:0/562224765 >> 172.21.15.63:0/562224765 conn(0x7f96380fd8c0 msgr2=0x7f96380fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 -- 172.21.15.63:0/562224765 shutdown_connections 2024-09-16T01:27:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:37.340+0000 7f963f6c2640 1 -- 172.21.15.63:0/562224765 wait complete. 2024-09-16T01:27:37.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:37 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/562224765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:27:37.674 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:37 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/562224765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:27:37.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:37 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/562224765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:27:38.171 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T01:27:38.441 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:38.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:38 smithi162 ceph-mon[34539]: pgmap v464: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-16T01:27:38.709 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:38 smithi063 ceph-mon[31070]: pgmap v464: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-16T01:27:38.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:38 smithi192 ceph-mon[34775]: pgmap v464: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-16T01:27:38.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.923+0000 7ff520620640 1 -- 172.21.15.63:0/1286042676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5181036e0 msgr2=0x7ff518107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:38.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.923+0000 7ff520620640 1 --2- 172.21.15.63:0/1286042676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5181036e0 0x7ff518107b90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff508009930 tx=0x7ff50802a420 comp rx=0 tx=0).stop 2024-09-16T01:27:38.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.923+0000 7ff520620640 1 -- 172.21.15.63:0/1286042676 shutdown_connections 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.923+0000 7ff520620640 1 --2- 172.21.15.63:0/1286042676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5181082a0 0x7ff51810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.923+0000 7ff520620640 1 --2- 172.21.15.63:0/1286042676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5181036e0 0x7ff518107b90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.923+0000 7ff520620640 1 --2- 172.21.15.63:0/1286042676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff518102d30 0x7ff518103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.923+0000 7ff520620640 1 -- 172.21.15.63:0/1286042676 >> 172.21.15.63:0/1286042676 conn(0x7ff5180fc7d0 msgr2=0x7ff5180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.924+0000 7ff520620640 1 -- 172.21.15.63:0/1286042676 shutdown_connections 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.924+0000 7ff520620640 1 -- 172.21.15.63:0/1286042676 wait complete. 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.924+0000 7ff520620640 1 Processor -- start 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.924+0000 7ff520620640 1 -- start start 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.924+0000 7ff520620640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff518102d30 0x7ff518100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.924+0000 7ff520620640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5181036e0 0x7ff518100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.924+0000 7ff520620640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5181082a0 0x7ff518101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:38.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.924+0000 7ff520620640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff518111f50 con 0x7ff5181082a0 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.924+0000 7ff520620640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff518111dd0 con 0x7ff5181036e0 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.924+0000 7ff520620640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff5181120d0 con 0x7ff518102d30 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51ebbd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5181082a0 0x7ff518101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51e3bc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff518102d30 0x7ff518100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51ebbd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5181082a0 0x7ff518101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33138/0 (socket says 172.21.15.63:33138) 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51ebbd640 1 -- 172.21.15.63:0/475587946 learned_addr learned my addr 172.21.15.63:0/475587946 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51dbbb640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5181036e0 0x7ff518100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51ebbd640 1 -- 172.21.15.63:0/475587946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff518102d30 msgr2=0x7ff518100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51ebbd640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff518102d30 0x7ff518100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51ebbd640 1 -- 172.21.15.63:0/475587946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5181036e0 msgr2=0x7ff518100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51ebbd640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5181036e0 0x7ff518100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:38.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51ebbd640 1 -- 172.21.15.63:0/475587946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5181a6a20 con 0x7ff5181082a0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51e3bc640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff518102d30 0x7ff518100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff51ebbd640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5181082a0 0x7ff518101410 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff51000eaa0 tx=0x7ff51000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff50f7fe640 1 -- 172.21.15.63:0/475587946 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51000cdb0 con 0x7ff5181082a0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff50f7fe640 1 -- 172.21.15.63:0/475587946 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff510005020 con 0x7ff5181082a0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff520620640 1 -- 172.21.15.63:0/475587946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5181a6d10 con 0x7ff5181082a0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff50f7fe640 1 -- 172.21.15.63:0/475587946 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5100116d0 con 0x7ff5181082a0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.925+0000 7ff520620640 1 -- 172.21.15.63:0/475587946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5181a71d0 con 0x7ff5181082a0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.927+0000 7ff520620640 1 -- 172.21.15.63:0/475587946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff518103110 con 0x7ff5181082a0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.929+0000 7ff50f7fe640 1 -- 172.21.15.63:0/475587946 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff5100051d0 con 0x7ff5181082a0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.929+0000 7ff50f7fe640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff5040a3240 0x7ff5040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.929+0000 7ff50f7fe640 1 -- 172.21.15.63:0/475587946 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff5100cfd40 con 0x7ff5181082a0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.929+0000 7ff51e3bc640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff5040a3240 0x7ff5040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:38.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.930+0000 7ff51e3bc640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff5040a3240 0x7ff5040a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff5140058c0 tx=0x7ff51400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:38.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:38.932+0000 7ff50f7fe640 1 -- 172.21.15.63:0/475587946 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff510016030 con 0x7ff5181082a0 2024-09-16T01:27:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.148+0000 7ff520620640 1 -- 172.21.15.63:0/475587946 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff51810a2b0 con 0x7ff5181082a0 2024-09-16T01:27:39.152 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:27:39.152 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"btime":"2024-09-16T01:25:54:073139+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/2088156309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2088156309},{"type":"v1","addr":"172.21.15.63:6835","nonce":2088156309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/888614929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6836","nonce":888614929},{"type":"v1","addr":"172.21.15.63:6837","nonce":888614929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6839/37939833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6838","nonce":37939833},{"type":"v1","addr":"172.21.15.63:6839","nonce":37939833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6841/1202342156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6840","nonce":1202342156},{"type":"v1","addr":"172.21.15.63:6841","nonce":1202342156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24395,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/4134893055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":4134893055},{"type":"v1","addr":"172.21.15.162:6833","nonce":4134893055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/3923088697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":3923088697},{"type":"v1","addr":"172.21.15.192:6833","nonce":3923088697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-16T01:21:28.777744+0000","modified":"2024-09-16T01:25:53.917460+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24467,"mds_1":24460,"mds_2":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24419":{"gid":24419,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/1954173887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1954173887},{"type":"v1","addr":"172.21.15.162:6835","nonce":1954173887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6835/383563245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":383563245},{"type":"v1","addr":"172.21.15.192:6835","nonce":383563245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/1959030818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1959030818},{"type":"v1","addr":"172.21.15.162:6837","nonce":1959030818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/3521040095","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3521040095},{"type":"v1","addr":"172.21.15.192:6837","nonce":3521040095}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/82939697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":82939697},{"type":"v1","addr":"172.21.15.192:6839","nonce":82939697}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.162:6839/2919019351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2919019351},{"type":"v1","addr":"172.21.15.162:6839","nonce":2919019351}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24467,"qdb_cluster":[24467,24460,24445]},"id":1}]} 2024-09-16T01:27:39.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.149+0000 7ff50f7fe640 1 -- 172.21.15.63:0/475587946 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11918 (secure 0 0 0) 0x7ff51009c410 con 0x7ff5181082a0 2024-09-16T01:27:39.153 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 29 2024-09-16T01:27:39.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 -- 172.21.15.63:0/475587946 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff5040a3240 msgr2=0x7ff5040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:39.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff5040a3240 0x7ff5040a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff5140058c0 tx=0x7ff51400a2d0 comp rx=0 tx=0).stop 2024-09-16T01:27:39.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 -- 172.21.15.63:0/475587946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5181082a0 msgr2=0x7ff518101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:39.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5181082a0 0x7ff518101410 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff51000eaa0 tx=0x7ff51000ef60 comp rx=0 tx=0).stop 2024-09-16T01:27:39.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 -- 172.21.15.63:0/475587946 shutdown_connections 2024-09-16T01:27:39.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7ff5040a3240 0x7ff5040a5700 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:39.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5181082a0 0x7ff518101410 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:39.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5181036e0 0x7ff518100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:39.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 --2- 172.21.15.63:0/475587946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff518102d30 0x7ff518100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:39.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 -- 172.21.15.63:0/475587946 >> 172.21.15.63:0/475587946 conn(0x7ff5180fc7d0 msgr2=0x7ff518105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:39.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 -- 172.21.15.63:0/475587946 shutdown_connections 2024-09-16T01:27:39.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:39.152+0000 7ff520620640 1 -- 172.21.15.63:0/475587946 wait complete. 2024-09-16T01:27:39.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:39 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/475587946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:27:39.859 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:39 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/475587946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:27:39.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:39 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/475587946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T01:27:39.977 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T01:27:40.237 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:40.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:40 smithi063 ceph-mon[31070]: pgmap v465: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:27:40.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:40 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:27:40.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:40 smithi162 ceph-mon[34539]: pgmap v465: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:27:40.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:40 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:27:40.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.727+0000 7fc36f907640 1 -- 172.21.15.63:0/1852290411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc368105ec0 msgr2=0x7fc368106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:40.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.727+0000 7fc36f907640 1 --2- 172.21.15.63:0/1852290411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc368105ec0 0x7fc368106340 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc360009ca0 tx=0x7fc36002a8c0 comp rx=0 tx=0).stop 2024-09-16T01:27:40.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.728+0000 7fc36f907640 1 -- 172.21.15.63:0/1852290411 shutdown_connections 2024-09-16T01:27:40.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.728+0000 7fc36f907640 1 --2- 172.21.15.63:0/1852290411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc368105ec0 0x7fc368106340 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:40.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.728+0000 7fc36f907640 1 --2- 172.21.15.63:0/1852290411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc3681011e0 0x7fc368105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:40.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.728+0000 7fc36f907640 1 --2- 172.21.15.63:0/1852290411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3681008c0 0x7fc368100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:40.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.728+0000 7fc36f907640 1 -- 172.21.15.63:0/1852290411 >> 172.21.15.63:0/1852290411 conn(0x7fc3680fc7d0 msgr2=0x7fc3680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:40.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.728+0000 7fc36f907640 1 -- 172.21.15.63:0/1852290411 shutdown_connections 2024-09-16T01:27:40.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.728+0000 7fc36f907640 1 -- 172.21.15.63:0/1852290411 wait complete. 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.728+0000 7fc36f907640 1 Processor -- start 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36f907640 1 -- start start 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36f907640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3681008c0 0x7fc3681a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36f907640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3681011e0 0x7fc3681a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36f907640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc368105ec0 0x7fc36819e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36f907640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc3681184c0 con 0x7fc3681011e0 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36f907640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc368118340 con 0x7fc3681008c0 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36f907640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc368118640 con 0x7fc368105ec0 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36cea2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3681011e0 0x7fc3681a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36cea2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3681011e0 0x7fc3681a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33168/0 (socket says 172.21.15.63:33168) 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36cea2640 1 -- 172.21.15.63:0/1053914057 learned_addr learned my addr 172.21.15.63:0/1053914057 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:40.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36d6a3640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3681008c0 0x7fc3681a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36dea4640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc368105ec0 0x7fc36819e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36cea2640 1 -- 172.21.15.63:0/1053914057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc368105ec0 msgr2=0x7fc36819e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36cea2640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc368105ec0 0x7fc36819e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36cea2640 1 -- 172.21.15.63:0/1053914057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3681008c0 msgr2=0x7fc3681a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36cea2640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3681008c0 0x7fc3681a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36cea2640 1 -- 172.21.15.63:0/1053914057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36819efd0 con 0x7fc3681011e0 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36dea4640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc368105ec0 0x7fc36819e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.729+0000 7fc36cea2640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3681011e0 0x7fc3681a4bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc35800d950 tx=0x7fc35800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.730+0000 7fc35e7fc640 1 -- 172.21.15.63:0/1053914057 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358017070 con 0x7fc3681011e0 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.730+0000 7fc35e7fc640 1 -- 172.21.15.63:0/1053914057 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc358009c30 con 0x7fc3681011e0 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.730+0000 7fc36f907640 1 -- 172.21.15.63:0/1053914057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36819f2c0 con 0x7fc3681011e0 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.730+0000 7fc35e7fc640 1 -- 172.21.15.63:0/1053914057 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35800f620 con 0x7fc3681011e0 2024-09-16T01:27:40.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.730+0000 7fc36f907640 1 -- 172.21.15.63:0/1053914057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3681ab510 con 0x7fc3681011e0 2024-09-16T01:27:40.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.731+0000 7fc36f907640 1 -- 172.21.15.63:0/1053914057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc36806a850 con 0x7fc3681011e0 2024-09-16T01:27:40.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.732+0000 7fc35e7fc640 1 -- 172.21.15.63:0/1053914057 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc3580109a0 con 0x7fc3681011e0 2024-09-16T01:27:40.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.733+0000 7fc35e7fc640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3540a32c0 0x7fc3540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:40.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.733+0000 7fc35e7fc640 1 -- 172.21.15.63:0/1053914057 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc3580cf420 con 0x7fc3681011e0 2024-09-16T01:27:40.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.733+0000 7fc36d6a3640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3540a32c0 0x7fc3540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:40.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.733+0000 7fc36d6a3640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3540a32c0 0x7fc3540a5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc36400bbe0 tx=0x7fc36400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:40.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.736+0000 7fc35e7fc640 1 -- 172.21.15.63:0/1053914057 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc358009de0 con 0x7fc3681011e0 2024-09-16T01:27:40.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.913+0000 7fc36f907640 1 -- 172.21.15.63:0/1053914057 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3681ab740 con 0x7fc3681011e0 2024-09-16T01:27:40.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.915+0000 7fc35e7fc640 1 -- 172.21.15.63:0/1053914057 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22710 (secure 0 0 0) 0x7fc35809c1c0 con 0x7fc3681011e0 2024-09-16T01:27:40.918 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-16T01:27:40.925 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":84,"fsid":"c42394ec-73c8-11ef-bceb-c7b262605968","created":"2024-09-16T01:13:51.098958+0000","modified":"2024-09-16T01:21:39.083854+0000","last_up_change":"2024-09-16T01:20:36.442132+0000","last_in_change":"2024-09-16T01:20:13.070690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:16:51.610676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:24.729872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:27.006661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39d7f320-babf-4ba5-86c8-9cd4c9ffa030","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6803","nonce":2972213449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6805","nonce":2972213449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6809","nonce":2972213449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2972213449},{"type":"v1","addr":"172.21.15.63:6807","nonce":2972213449}]},"public_addr":"172.21.15.63:6803/2972213449","cluster_addr":"172.21.15.63:6805/2972213449","heartbeat_back_addr":"172.21.15.63:6809/2972213449","heartbeat_front_addr":"172.21.15.63:6807/2972213449","state":["exists","up"]},{"osd":1,"uuid":"0a7a8f9d-2b87-41ec-8781-b2ece64566ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6801","nonce":94832668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6803","nonce":94832668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6807","nonce":94832668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":94832668},{"type":"v1","addr":"172.21.15.162:6805","nonce":94832668}]},"public_addr":"172.21.15.162:6801/94832668","cluster_addr":"172.21.15.162:6803/94832668","heartbeat_back_addr":"172.21.15.162:6807/94832668","heartbeat_front_addr":"172.21.15.162:6805/94832668","state":["exists","up"]},{"osd":2,"uuid":"073915c9-5d6f-40db-9720-fd0bd7e8522b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6801","nonce":166209023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6803","nonce":166209023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6807","nonce":166209023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":166209023},{"type":"v1","addr":"172.21.15.192:6805","nonce":166209023}]},"public_addr":"172.21.15.192:6801/166209023","cluster_addr":"172.21.15.192:6803/166209023","heartbeat_back_addr":"172.21.15.192:6807/166209023","heartbeat_front_addr":"172.21.15.192:6805/166209023","state":["exists","up"]},{"osd":3,"uuid":"d565129a-d24c-4262-a024-993dad3c27e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6811","nonce":913316325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6813","nonce":913316325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6817","nonce":913316325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":913316325},{"type":"v1","addr":"172.21.15.63:6815","nonce":913316325}]},"public_addr":"172.21.15.63:6811/913316325","cluster_addr":"172.21.15.63:6813/913316325","heartbeat_back_addr":"172.21.15.63:6817/913316325","heartbeat_front_addr":"172.21.15.63:6815/913316325","state":["exists","up"]},{"osd":4,"uuid":"1b40f769-2023-43f4-a415-27ba2acf8624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6809","nonce":3400523772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6811","nonce":3400523772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6815","nonce":3400523772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3400523772},{"type":"v1","addr":"172.21.15.162:6813","nonce":3400523772}]},"public_addr":"172.21.15.162:6809/3400523772","cluster_addr":"172.21.15.162:6811/3400523772","heartbeat_back_addr":"172.21.15.162:6815/3400523772","heartbeat_front_addr":"172.21.15.162:6813/3400523772","state":["exists","up"]},{"osd":5,"uuid":"cae53db9-bbae-4a94-8e71-843209fc8204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6809","nonce":88086565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6811","nonce":88086565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6815","nonce":88086565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":88086565},{"type":"v1","addr":"172.21.15.192:6813","nonce":88086565}]},"public_addr":"172.21.15.192:6809/88086565","cluster_addr":"172.21.15.192:6811/88086565","heartbeat_back_addr":"172.21.15.192:6815/88086565","heartbeat_front_addr":"172.21.15.192:6813/88086565","state":["exists","up"]},{"osd":6,"uuid":"46244e9b-0619-42f1-8f8a-815f21ab4e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6819","nonce":558859237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6821","nonce":558859237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6825","nonce":558859237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":558859237},{"type":"v1","addr":"172.21.15.63:6823","nonce":558859237}]},"public_addr":"172.21.15.63:6819/558859237","cluster_addr":"172.21.15.63:6821/558859237","heartbeat_back_addr":"172.21.15.63:6825/558859237","heartbeat_front_addr":"172.21.15.63:6823/558859237","state":["exists","up"]},{"osd":7,"uuid":"1c588431-8c7a-4d8f-b02b-22e2adabc3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6817","nonce":4217268335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6819","nonce":4217268335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6823","nonce":4217268335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":4217268335},{"type":"v1","addr":"172.21.15.162:6821","nonce":4217268335}]},"public_addr":"172.21.15.162:6817/4217268335","cluster_addr":"172.21.15.162:6819/4217268335","heartbeat_back_addr":"172.21.15.162:6823/4217268335","heartbeat_front_addr":"172.21.15.162:6821/4217268335","state":["exists","up"]},{"osd":8,"uuid":"51d7f064-3b9d-4556-bc0d-1275eaef7ea0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6817","nonce":2030889502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6819","nonce":2030889502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6823","nonce":2030889502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":2030889502},{"type":"v1","addr":"172.21.15.192:6821","nonce":2030889502}]},"public_addr":"172.21.15.192:6817/2030889502","cluster_addr":"172.21.15.192:6819/2030889502","heartbeat_back_addr":"172.21.15.192:6823/2030889502","heartbeat_front_addr":"172.21.15.192:6821/2030889502","state":["exists","up"]},{"osd":9,"uuid":"85070701-b935-4fc2-9add-9c0bcd2896f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6827","nonce":2226037893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6829","nonce":2226037893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6833","nonce":2226037893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":2226037893},{"type":"v1","addr":"172.21.15.63:6831","nonce":2226037893}]},"public_addr":"172.21.15.63:6827/2226037893","cluster_addr":"172.21.15.63:6829/2226037893","heartbeat_back_addr":"172.21.15.63:6833/2226037893","heartbeat_front_addr":"172.21.15.63:6831/2226037893","state":["exists","up"]},{"osd":10,"uuid":"d7568686-adaf-46b9-8fc6-544ed2265715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6825","nonce":3603743801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6827","nonce":3603743801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6831","nonce":3603743801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3603743801},{"type":"v1","addr":"172.21.15.162:6829","nonce":3603743801}]},"public_addr":"172.21.15.162:6825/3603743801","cluster_addr":"172.21.15.162:6827/3603743801","heartbeat_back_addr":"172.21.15.162:6831/3603743801","heartbeat_front_addr":"172.21.15.162:6829/3603743801","state":["exists","up"]},{"osd":11,"uuid":"c7c12f12-3089-459f-a85d-17699c95a7f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6825","nonce":508338152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6827","nonce":508338152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6831","nonce":508338152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":508338152},{"type":"v1","addr":"172.21.15.192:6829","nonce":508338152}]},"public_addr":"172.21.15.192:6825/508338152","cluster_addr":"172.21.15.192:6827/508338152","heartbeat_back_addr":"172.21.15.192:6831/508338152","heartbeat_front_addr":"172.21.15.192:6829/508338152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:58.591630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:23.626356+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:16:48.741448+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:13.885211+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:17:38.507874+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:03.700692+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:28.561022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:18:53.045112+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:18.094042+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:19:44.338624+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:09.401668+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:20:34.691030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:0/3391259049":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/2380375395":"2024-09-17T01:14:37.096309+0000","172.21.15.63:6801/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1539909966":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/1391657104":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6801/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/843312492":"2024-09-17T01:14:12.995809+0000","172.21.15.63:6800/1469009490":"2024-09-17T01:14:37.096309+0000","172.21.15.63:0/3972146858":"2024-09-17T01:14:12.995809+0000","172.21.15.63:0/1773373724":"2024-09-17T01:14:12.995809+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:27:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 -- 172.21.15.63:0/1053914057 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3540a32c0 msgr2=0x7fc3540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3540a32c0 0x7fc3540a5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc36400bbe0 tx=0x7fc36400b390 comp rx=0 tx=0).stop 2024-09-16T01:27:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 -- 172.21.15.63:0/1053914057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3681011e0 msgr2=0x7fc3681a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:40.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3681011e0 0x7fc3681a4bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc35800d950 tx=0x7fc35800de10 comp rx=0 tx=0).stop 2024-09-16T01:27:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 -- 172.21.15.63:0/1053914057 shutdown_connections 2024-09-16T01:27:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7fc3540a32c0 0x7fc3540a5780 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc368105ec0 0x7fc36819e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3681011e0 0x7fc3681a4bf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 --2- 172.21.15.63:0/1053914057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3681008c0 0x7fc3681a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 -- 172.21.15.63:0/1053914057 >> 172.21.15.63:0/1053914057 conn(0x7fc3680fc7d0 msgr2=0x7fc36810f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 -- 172.21.15.63:0/1053914057 shutdown_connections 2024-09-16T01:27:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:40.918+0000 7fc36f907640 1 -- 172.21.15.63:0/1053914057 wait complete. 2024-09-16T01:27:40.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:40 smithi192 ceph-mon[34775]: pgmap v465: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-16T01:27:40.928 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:40 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T01:27:41.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:41 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1053914057' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:27:41.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:27:41.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:27:41.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:41 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:27:41.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-16T01:27:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:41 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1053914057' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:27:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:27:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:27:41.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:41 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:27:41.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:41 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1053914057' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T01:27:41.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T01:27:41.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T01:27:41.933 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:41 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' 2024-09-16T01:27:41.971 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:42.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.591+0000 7f6222d5e640 1 -- 172.21.15.63:0/3625911173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c100e20 msgr2=0x7f621c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:42.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.591+0000 7f6222d5e640 1 --2- 172.21.15.63:0/3625911173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c100e20 0x7f621c101200 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6204009900 tx=0x7f620402a480 comp rx=0 tx=0).stop 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.591+0000 7f6222d5e640 1 -- 172.21.15.63:0/3625911173 shutdown_connections 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.591+0000 7f6222d5e640 1 --2- 172.21.15.63:0/3625911173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c102ef0 0x7f621c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.591+0000 7f6222d5e640 1 --2- 172.21.15.63:0/3625911173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f621c102570 0x7f621c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.591+0000 7f6222d5e640 1 --2- 172.21.15.63:0/3625911173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c100e20 0x7f621c101200 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.591+0000 7f6222d5e640 1 -- 172.21.15.63:0/3625911173 >> 172.21.15.63:0/3625911173 conn(0x7f621c0fc7d0 msgr2=0x7f621c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.591+0000 7f6222d5e640 1 -- 172.21.15.63:0/3625911173 shutdown_connections 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.591+0000 7f6222d5e640 1 -- 172.21.15.63:0/3625911173 wait complete. 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f6222d5e640 1 Processor -- start 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f6222d5e640 1 -- start start 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f6222d5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c100e20 0x7f621c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:42.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f6222d5e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c102570 0x7f621c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f6222d5e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f621c102ef0 0x7f621c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f6222d5e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f621c111f50 con 0x7f621c102570 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f6222d5e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f621c111dd0 con 0x7f621c100e20 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f6222d5e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f621c1120d0 con 0x7f621c102ef0 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f621bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c102570 0x7f621c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f621bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c102570 0x7f621c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33198/0 (socket says 172.21.15.63:33198) 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f621bfff640 1 -- 172.21.15.63:0/3990926341 learned_addr learned my addr 172.21.15.63:0/3990926341 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f6220afa640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c100e20 0x7f621c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f621bfff640 1 -- 172.21.15.63:0/3990926341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f621c102ef0 msgr2=0x7f621c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f621bfff640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f621c102ef0 0x7f621c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f621bfff640 1 -- 172.21.15.63:0/3990926341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c100e20 msgr2=0x7f621c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f621bfff640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c100e20 0x7f621c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f621bfff640 1 -- 172.21.15.63:0/3990926341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c19d3e0 con 0x7f621c102570 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.592+0000 7f621bfff640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c102570 0x7f621c198970 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f620c00cce0 tx=0x7f620c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.593+0000 7f6219ffb640 1 -- 172.21.15.63:0/3990926341 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c004b20 con 0x7f621c102570 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.593+0000 7f6219ffb640 1 -- 172.21.15.63:0/3990926341 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f620c004cc0 con 0x7f621c102570 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.593+0000 7f6222d5e640 1 -- 172.21.15.63:0/3990926341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621c19d6d0 con 0x7f621c102570 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.593+0000 7f6219ffb640 1 -- 172.21.15.63:0/3990926341 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c00f850 con 0x7f621c102570 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.593+0000 7f6222d5e640 1 -- 172.21.15.63:0/3990926341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621c1a4fb0 con 0x7f621c102570 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.594+0000 7f6222d5e640 1 -- 172.21.15.63:0/3990926341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621c101200 con 0x7f621c102570 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.595+0000 7f6219ffb640 1 -- 172.21.15.63:0/3990926341 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f620c005020 con 0x7f621c102570 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.596+0000 7f6219ffb640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f62080a3240 0x7f62080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.596+0000 7f6220afa640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f62080a3240 0x7f62080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:42.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.596+0000 7f6219ffb640 1 -- 172.21.15.63:0/3990926341 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f620c0cfa80 con 0x7f621c102570 2024-09-16T01:27:42.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.596+0000 7f6220afa640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f62080a3240 0x7f62080a5700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6204006010 tx=0x7f6204000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:42.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.600+0000 7f6219ffb640 1 -- 172.21.15.63:0/3990926341 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f620c014030 con 0x7f621c102570 2024-09-16T01:27:42.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.810+0000 7f6222d5e640 1 -- 172.21.15.63:0/3990926341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f621c109090 con 0x7f621c102570 2024-09-16T01:27:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.812+0000 7f6219ffb640 1 -- 172.21.15.63:0/3990926341 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f620c09c7a0 con 0x7f621c102570 2024-09-16T01:27:42.815 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:27:42.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 -- 172.21.15.63:0/3990926341 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f62080a3240 msgr2=0x7f62080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:42.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f62080a3240 0x7f62080a5700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6204006010 tx=0x7f6204000bc0 comp rx=0 tx=0).stop 2024-09-16T01:27:42.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 -- 172.21.15.63:0/3990926341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c102570 msgr2=0x7f621c198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:42.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c102570 0x7f621c198970 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f620c00cce0 tx=0x7f620c00a620 comp rx=0 tx=0).stop 2024-09-16T01:27:42.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 -- 172.21.15.63:0/3990926341 shutdown_connections 2024-09-16T01:27:42.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f62080a3240 0x7f62080a5700 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:42.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f621c102ef0 0x7f621c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:42.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c102570 0x7f621c198970 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:42.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 --2- 172.21.15.63:0/3990926341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f621c100e20 0x7f621c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:42.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 -- 172.21.15.63:0/3990926341 >> 172.21.15.63:0/3990926341 conn(0x7f621c0fc7d0 msgr2=0x7f621c0fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:42.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.815+0000 7f6222d5e640 1 -- 172.21.15.63:0/3990926341 shutdown_connections 2024-09-16T01:27:42.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:42.816+0000 7f6222d5e640 1 -- 172.21.15.63:0/3990926341 wait complete. 2024-09-16T01:27:43.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:42 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a[31066]: 2024-09-16T01:27:42.811+0000 7f650e233640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:27:43.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:42 smithi063 ceph-mon[31070]: pgmap v466: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-16T01:27:43.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:42 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3990926341' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-16T01:27:43.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:42 smithi063 ceph-mon[31070]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T01:27:43.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:42 smithi063 ceph-mon[31070]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:27:43.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:42 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/3990926341' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-16T01:27:43.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:42 smithi063 ceph-mon[31070]: osdmap e85: 12 total, 12 up, 12 in 2024-09-16T01:27:43.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:42 smithi063 ceph-mon[31070]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-16T01:27:43.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mon[34775]: pgmap v466: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-16T01:27:43.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3990926341' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-16T01:27:43.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mon[34775]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T01:27:43.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mon[34775]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:27:43.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/3990926341' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-16T01:27:43.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mon[34775]: osdmap e85: 12 total, 12 up, 12 in 2024-09-16T01:27:43.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mon[34775]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-16T01:27:43.175 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f[64234]: ignoring --setuser ceph since I am not root 2024-09-16T01:27:43.175 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f[64234]: ignoring --setgroup ceph since I am not root 2024-09-16T01:27:43.176 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mds[64238]: -- 172.21.15.192:0/2278942225 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5625c5964680 con 0x5625c5939000 2024-09-16T01:27:43.176 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mds[64238]: -- 172.21.15.192:0/2278942225 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5625c595b860 con 0x5625c5939000 2024-09-16T01:27:43.176 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f[64234]: starting mds.f at 2024-09-16T01:27:43.176 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c[64533]: ignoring --setuser ceph since I am not root 2024-09-16T01:27:43.176 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c[64533]: ignoring --setgroup ceph since I am not root 2024-09-16T01:27:43.176 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mds[64537]: -- 172.21.15.192:0/1076216258 <== mon.0 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b63236dc20 con 0x55b63234b000 2024-09-16T01:27:43.176 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c[64533]: starting mds.c at 2024-09-16T01:27:43.177 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i[64833]: ignoring --setuser ceph since I am not root 2024-09-16T01:27:43.177 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i[64833]: ignoring --setgroup ceph since I am not root 2024-09-16T01:27:43.177 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-mds[64837]: -- 172.21.15.192:0/1141723781 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e53fdb5860 con 0x55e53fd92800 2024-09-16T01:27:43.181 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:27:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i[64833]: starting mds.i at 2024-09-16T01:27:43.183 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e[64052]: ignoring --setuser ceph since I am not root 2024-09-16T01:27:43.183 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e[64052]: ignoring --setgroup ceph since I am not root 2024-09-16T01:27:43.184 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-mds[64056]: -- 172.21.15.162:0/2793581020 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5584d3f63c20 con 0x5584d3f41400 2024-09-16T01:27:43.184 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e[64052]: starting mds.e at 2024-09-16T01:27:43.184 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h[64353]: ignoring --setuser ceph since I am not root 2024-09-16T01:27:43.184 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h[64353]: ignoring --setgroup ceph since I am not root 2024-09-16T01:27:43.184 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-mds[64357]: -- 172.21.15.162:0/1536294121 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5597ef793860 con 0x5597ef770800 2024-09-16T01:27:43.184 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h[64353]: starting mds.h at 2024-09-16T01:27:43.184 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b[64651]: ignoring --setuser ceph since I am not root 2024-09-16T01:27:43.185 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b[64651]: ignoring --setgroup ceph since I am not root 2024-09-16T01:27:43.185 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-mds[64655]: -- 172.21.15.162:0/3384071536 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c9bcfcdc20 con 0x55c9bcfaa800 2024-09-16T01:27:43.185 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b[64651]: starting mds.b at 2024-09-16T01:27:43.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-mon[34539]: pgmap v466: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-16T01:27:43.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3990926341' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-16T01:27:43.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-mon[34539]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T01:27:43.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-mon[34539]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:27:43.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/3990926341' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-16T01:27:43.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-mon[34539]: osdmap e85: 12 total, 12 up, 12 in 2024-09-16T01:27:43.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:42 smithi162 ceph-mon[34539]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-16T01:27:43.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:27:43.815 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:44.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 -- 172.21.15.63:0/730730423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c102ef0 msgr2=0x7f9c0c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 --2- 172.21.15.63:0/730730423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c10da40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009ca0 tx=0x7f9c0402a950 comp rx=0 tx=0).stop 2024-09-16T01:27:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 -- 172.21.15.63:0/730730423 shutdown_connections 2024-09-16T01:27:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 --2- 172.21.15.63:0/730730423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c10da40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 --2- 172.21.15.63:0/730730423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c0c102570 0x7f9c0c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 --2- 172.21.15.63:0/730730423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c0c100e20 0x7f9c0c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 -- 172.21.15.63:0/730730423 >> 172.21.15.63:0/730730423 conn(0x7f9c0c0fc7d0 msgr2=0x7f9c0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 -- 172.21.15.63:0/730730423 shutdown_connections 2024-09-16T01:27:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 -- 172.21.15.63:0/730730423 wait complete. 2024-09-16T01:27:44.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 Processor -- start 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.307+0000 7f9c12b6a640 1 -- start start 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c12b6a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c0c100e20 0x7f9c0c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c12b6a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c0c102570 0x7f9c0c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c12b6a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c12b6a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c110e30 con 0x7f9c0c102ef0 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c12b6a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c110cb0 con 0x7f9c0c102570 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c12b6a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c110fb0 con 0x7f9c0c100e20 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c11107640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c11107640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33220/0 (socket says 172.21.15.63:33220) 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c11107640 1 -- 172.21.15.63:0/852485249 learned_addr learned my addr 172.21.15.63:0/852485249 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:44.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c10906640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c0c100e20 0x7f9c0c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c0bfff640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c0c102570 0x7f9c0c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c11107640 1 -- 172.21.15.63:0/852485249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c0c100e20 msgr2=0x7f9c0c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c11107640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c0c100e20 0x7f9c0c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c11107640 1 -- 172.21.15.63:0/852485249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c0c102570 msgr2=0x7f9c0c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c11107640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c0c102570 0x7f9c0c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c11107640 1 -- 172.21.15.63:0/852485249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c1a6870 con 0x7f9c0c102ef0 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c11107640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c0fd700 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9c0402ae70 tx=0x7f9c0402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c09ffb640 1 -- 172.21.15.63:0/852485249 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04034040 con 0x7f9c0c102ef0 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.308+0000 7f9c09ffb640 1 -- 172.21.15.63:0/852485249 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c040308f0 con 0x7f9c0c102ef0 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.309+0000 7f9c12b6a640 1 -- 172.21.15.63:0/852485249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0c1a6b00 con 0x7f9c0c102ef0 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.309+0000 7f9c09ffb640 1 -- 172.21.15.63:0/852485249 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04004750 con 0x7f9c0c102ef0 2024-09-16T01:27:44.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.309+0000 7f9c12b6a640 1 -- 172.21.15.63:0/852485249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0c1a6fe0 con 0x7f9c0c102ef0 2024-09-16T01:27:44.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.310+0000 7f9c12b6a640 1 -- 172.21.15.63:0/852485249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0c101200 con 0x7f9c0c102ef0 2024-09-16T01:27:44.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.311+0000 7f9c09ffb640 1 -- 172.21.15.63:0/852485249 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9c04037020 con 0x7f9c0c102ef0 2024-09-16T01:27:44.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.311+0000 7f9c09ffb640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9bfc0a3240 0x7f9bfc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:44.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.312+0000 7f9c10906640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9bfc0a3240 0x7f9bfc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:44.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.312+0000 7f9c09ffb640 1 -- 172.21.15.63:0/852485249 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8498+0+0 (secure 0 0 0) 0x7f9c040f0bf0 con 0x7f9c0c102ef0 2024-09-16T01:27:44.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.312+0000 7f9c10906640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9bfc0a3240 0x7f9bfc0a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000bbe0 tx=0x7f9c0000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:44.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.315+0000 7f9c09ffb640 1 -- 172.21.15.63:0/852485249 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9c040bd7a0 con 0x7f9c0c102ef0 2024-09-16T01:27:44.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.528+0000 7f9c12b6a640 1 -- 172.21.15.63:0/852485249 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9c0c10a0a0 con 0x7f9c0c102ef0 2024-09-16T01:27:44.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.952+0000 7f9c09ffb640 1 -- 172.21.15.63:0/852485249 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f9c040bd0a0 con 0x7f9c0c102ef0 2024-09-16T01:27:44.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 -- 172.21.15.63:0/852485249 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9bfc0a3240 msgr2=0x7f9bfc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9bfc0a3240 0x7f9bfc0a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000bbe0 tx=0x7f9c0000b390 comp rx=0 tx=0).stop 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 -- 172.21.15.63:0/852485249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c102ef0 msgr2=0x7f9c0c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c0fd700 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9c0402ae70 tx=0x7f9c0402f5d0 comp rx=0 tx=0).stop 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 -- 172.21.15.63:0/852485249 shutdown_connections 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f9bfc0a3240 0x7f9bfc0a5700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c0fd700 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c0c102570 0x7f9c0c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 --2- 172.21.15.63:0/852485249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c0c100e20 0x7f9c0c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 -- 172.21.15.63:0/852485249 >> 172.21.15.63:0/852485249 conn(0x7f9c0c0fc7d0 msgr2=0x7f9c0c06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 -- 172.21.15.63:0/852485249 shutdown_connections 2024-09-16T01:27:44.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:44.956+0000 7f9c12b6a640 1 -- 172.21.15.63:0/852485249 wait complete. 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: pgmap v468: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.162:6834/2922617297,v1:172.21.15.162:6836/2922617297] up:boot 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.192:6834/1971765683,v1:172.21.15.192:6837/1971765683] up:boot 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.162:6835/1660712933,v1:172.21.15.162:6837/1660712933] up:boot 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.192:6835/3531818686,v1:172.21.15.192:6839/3531818686] up:boot 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.192:6836/3483256458,v1:172.21.15.192:6838/3483256458] up:boot 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: mds.? [v2:172.21.15.162:6838/575310225,v1:172.21.15.162:6839/575310225] up:boot 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:27:45.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:27:45.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:27:45.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:27:45.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:27:45.111 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:44 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/852485249' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: pgmap v468: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-16T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.162:6834/2922617297,v1:172.21.15.162:6836/2922617297] up:boot 2024-09-16T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.192:6834/1971765683,v1:172.21.15.192:6837/1971765683] up:boot 2024-09-16T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.162:6835/1660712933,v1:172.21.15.162:6837/1660712933] up:boot 2024-09-16T01:27:45.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.192:6835/3531818686,v1:172.21.15.192:6839/3531818686] up:boot 2024-09-16T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.192:6836/3483256458,v1:172.21.15.192:6838/3483256458] up:boot 2024-09-16T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: mds.? [v2:172.21.15.162:6838/575310225,v1:172.21.15.162:6839/575310225] up:boot 2024-09-16T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-16T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:27:45.175 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:44 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/852485249' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:27:45.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: pgmap v468: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.162:6834/2922617297,v1:172.21.15.162:6836/2922617297] up:boot 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.192:6834/1971765683,v1:172.21.15.192:6837/1971765683] up:boot 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.162:6835/1660712933,v1:172.21.15.162:6837/1660712933] up:boot 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.192:6835/3531818686,v1:172.21.15.192:6839/3531818686] up:boot 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.192:6836/3483256458,v1:172.21.15.192:6838/3483256458] up:boot 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: mds.? [v2:172.21.15.162:6838/575310225,v1:172.21.15.162:6839/575310225] up:boot 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-16T01:27:45.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-16T01:27:45.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: from='mgr.14150 172.21.15.63:0/2744409080' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-16T01:27:45.185 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:44 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/852485249' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T01:27:45.785 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:27:46.050 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:46.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:45 smithi063 ceph-mon[31070]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T01:27:46.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:45 smithi063 ceph-mon[31070]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T01:27:46.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:45 smithi063 ceph-mon[31070]: Cluster is now healthy 2024-09-16T01:27:46.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:45 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/852485249' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:27:46.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:45 smithi063 ceph-mon[31070]: fsmap 12 up:standby 2024-09-16T01:27:46.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:45 smithi192 ceph-mon[34775]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T01:27:46.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:45 smithi192 ceph-mon[34775]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T01:27:46.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:45 smithi192 ceph-mon[34775]: Cluster is now healthy 2024-09-16T01:27:46.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:45 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/852485249' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:27:46.174 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:45 smithi192 ceph-mon[34775]: fsmap 12 up:standby 2024-09-16T01:27:46.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:45 smithi162 ceph-mon[34539]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T01:27:46.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:45 smithi162 ceph-mon[34539]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T01:27:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:45 smithi162 ceph-mon[34539]: Cluster is now healthy 2024-09-16T01:27:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:45 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/852485249' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-16T01:27:46.184 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:45 smithi162 ceph-mon[34539]: fsmap 12 up:standby 2024-09-16T01:27:46.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.546+0000 7f54d97c3640 1 -- 172.21.15.63:0/1479516354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54d41002f0 msgr2=0x7f54d41006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:46.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.546+0000 7f54d97c3640 1 --2- 172.21.15.63:0/1479516354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54d41002f0 0x7f54d41006d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009930 tx=0x7f54c402a420 comp rx=0 tx=0).stop 2024-09-16T01:27:46.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.546+0000 7f54d97c3640 1 -- 172.21.15.63:0/1479516354 shutdown_connections 2024-09-16T01:27:46.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.546+0000 7f54d97c3640 1 --2- 172.21.15.63:0/1479516354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d4106f50 0x7f54d410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.546+0000 7f54d97c3640 1 --2- 172.21.15.63:0/1479516354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54d4100ca0 0x7f54d4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.546+0000 7f54d97c3640 1 --2- 172.21.15.63:0/1479516354 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54d41002f0 0x7f54d41006d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.546+0000 7f54d97c3640 1 -- 172.21.15.63:0/1479516354 >> 172.21.15.63:0/1479516354 conn(0x7f54d4077210 msgr2=0x7f54d40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.546+0000 7f54d97c3640 1 -- 172.21.15.63:0/1479516354 shutdown_connections 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.546+0000 7f54d97c3640 1 -- 172.21.15.63:0/1479516354 wait complete. 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.546+0000 7f54d97c3640 1 Processor -- start 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d97c3640 1 -- start start 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d97c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54d41002f0 0x7f54d4101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d97c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d4100ca0 0x7f54d41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d97c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54d4106f50 0x7f54d4101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d97c3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4111e50 con 0x7f54d41002f0 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d97c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4111cd0 con 0x7f54d4106f50 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d97c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4111fd0 con 0x7f54d4100ca0 2024-09-16T01:27:46.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54d41002f0 0x7f54d4101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54d41002f0 0x7f54d4101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33238/0 (socket says 172.21.15.63:33238) 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d2ffd640 1 -- 172.21.15.63:0/1364073972 learned_addr learned my addr 172.21.15.63:0/1364073972 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d27fc640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d4100ca0 0x7f54d41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d37fe640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54d4106f50 0x7f54d4101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d2ffd640 1 -- 172.21.15.63:0/1364073972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d4100ca0 msgr2=0x7f54d41017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d2ffd640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d4100ca0 0x7f54d41017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d2ffd640 1 -- 172.21.15.63:0/1364073972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54d4106f50 msgr2=0x7f54d4101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d2ffd640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54d4106f50 0x7f54d4101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d2ffd640 1 -- 172.21.15.63:0/1364073972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d41a68d0 con 0x7f54d41002f0 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d37fe640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54d4106f50 0x7f54d4101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.547+0000 7f54d27fc640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d4100ca0 0x7f54d41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:46.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.548+0000 7f54d2ffd640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54d41002f0 0x7f54d4101270 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f54c4005940 tx=0x7f54c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.548+0000 7f54cbfff640 1 -- 172.21.15.63:0/1364073972 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c403f030 con 0x7f54d41002f0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.548+0000 7f54d97c3640 1 -- 172.21.15.63:0/1364073972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d41a6b60 con 0x7f54d41002f0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.548+0000 7f54cbfff640 1 -- 172.21.15.63:0/1364073972 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54c40318a0 con 0x7f54d41002f0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.548+0000 7f54cbfff640 1 -- 172.21.15.63:0/1364073972 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4035070 con 0x7f54d41002f0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.548+0000 7f54d97c3640 1 -- 172.21.15.63:0/1364073972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d41a7090 con 0x7f54d41002f0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.549+0000 7f54d97c3640 1 -- 172.21.15.63:0/1364073972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d41006d0 con 0x7f54d41002f0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.550+0000 7f54cbfff640 1 -- 172.21.15.63:0/1364073972 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f54c4042030 con 0x7f54d41002f0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.551+0000 7f54cbfff640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54c00a3240 0x7f54c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.551+0000 7f54d27fc640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54c00a3240 0x7f54c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.551+0000 7f54cbfff640 1 -- 172.21.15.63:0/1364073972 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8498+0+0 (secure 0 0 0) 0x7f54c40f0250 con 0x7f54d41002f0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.551+0000 7f54d27fc640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54c00a3240 0x7f54c00a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54d4102d00 tx=0x7f54bc00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:46.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.555+0000 7f54cbfff640 1 -- 172.21.15.63:0/1364073972 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54c40bce60 con 0x7f54d41002f0 2024-09-16T01:27:46.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.731+0000 7f54d97c3640 1 -- 172.21.15.63:0/1364073972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f54d410a1a0 con 0x7f54d41002f0 2024-09-16T01:27:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.962+0000 7f54cbfff640 1 -- 172.21.15.63:0/1364073972 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) ==== 181+0+0 (secure 0 0 0) 0x7f54c40bc760 con 0x7f54d41002f0 2024-09-16T01:27:46.964 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:27:46.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.965+0000 7f54d97c3640 1 -- 172.21.15.63:0/1364073972 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54c00a3240 msgr2=0x7f54c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.965+0000 7f54d97c3640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54c00a3240 0x7f54c00a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54d4102d00 tx=0x7f54bc00a5c0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.965+0000 7f54d97c3640 1 -- 172.21.15.63:0/1364073972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54d41002f0 msgr2=0x7f54d4101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.965+0000 7f54d97c3640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54d41002f0 0x7f54d4101270 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f54c4005940 tx=0x7f54c40042f0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.966+0000 7f54d97c3640 1 -- 172.21.15.63:0/1364073972 shutdown_connections 2024-09-16T01:27:46.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.966+0000 7f54d97c3640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f54c00a3240 0x7f54c00a5700 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.966+0000 7f54d97c3640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54d4106f50 0x7f54d4101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.966+0000 7f54d97c3640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54d4100ca0 0x7f54d41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.966+0000 7f54d97c3640 1 --2- 172.21.15.63:0/1364073972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54d41002f0 0x7f54d4101270 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:46.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.966+0000 7f54d97c3640 1 -- 172.21.15.63:0/1364073972 >> 172.21.15.63:0/1364073972 conn(0x7f54d4077210 msgr2=0x7f54d40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:46.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.966+0000 7f54d97c3640 1 -- 172.21.15.63:0/1364073972 shutdown_connections 2024-09-16T01:27:46.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:46.966+0000 7f54d97c3640 1 -- 172.21.15.63:0/1364073972 wait complete. 2024-09-16T01:27:47.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:46 smithi063 ceph-mon[31070]: pgmap v469: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-16T01:27:47.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:46 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1364073972' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:27:47.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:46 smithi192 ceph-mon[34775]: pgmap v469: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-16T01:27:47.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:46 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1364073972' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:27:47.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:46 smithi162 ceph-mon[34539]: pgmap v469: 97 pgs: 97 active+clean; 136 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-16T01:27:47.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:46 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1364073972' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:27:47.752 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid c42394ec-73c8-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:27:48.012 INFO:teuthology.orchestra.run.smithi063.stderr:Inferring config /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/mon.a/config 2024-09-16T01:27:48.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:47 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/1364073972' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:27:48.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:47 smithi063 ceph-mon[31070]: osdmap e86: 12 total, 12 up, 12 in 2024-09-16T01:27:48.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:47 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/1364073972' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:27:48.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:47 smithi192 ceph-mon[34775]: osdmap e86: 12 total, 12 up, 12 in 2024-09-16T01:27:48.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:47 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/1364073972' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:27:48.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:47 smithi162 ceph-mon[34539]: osdmap e86: 12 total, 12 up, 12 in 2024-09-16T01:27:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.621+0000 7f08739fb640 1 -- 172.21.15.63:0/1055486337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086c100e20 msgr2=0x7f086c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.621+0000 7f08739fb640 1 --2- 172.21.15.63:0/1055486337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086c100e20 0x7f086c101200 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0868009900 tx=0x7f086802a480 comp rx=0 tx=0).stop 2024-09-16T01:27:48.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.621+0000 7f08739fb640 1 -- 172.21.15.63:0/1055486337 shutdown_connections 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.621+0000 7f08739fb640 1 --2- 172.21.15.63:0/1055486337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c102ef0 0x7f086c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.621+0000 7f08739fb640 1 --2- 172.21.15.63:0/1055486337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c102570 0x7f086c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.621+0000 7f08739fb640 1 --2- 172.21.15.63:0/1055486337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086c100e20 0x7f086c101200 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.621+0000 7f08739fb640 1 -- 172.21.15.63:0/1055486337 >> 172.21.15.63:0/1055486337 conn(0x7f086c0fc7d0 msgr2=0x7f086c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.621+0000 7f08739fb640 1 -- 172.21.15.63:0/1055486337 shutdown_connections 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.621+0000 7f08739fb640 1 -- 172.21.15.63:0/1055486337 wait complete. 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f08739fb640 1 Processor -- start 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f08739fb640 1 -- start start 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f08739fb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086c100e20 0x7f086c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f08739fb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c102570 0x7f086c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:48.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f08739fb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c102ef0 0x7f086c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f08739fb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f086c110e30 con 0x7f086c100e20 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f08739fb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f086c110cb0 con 0x7f086c102570 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f08739fb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f086c110fb0 con 0x7f086c102ef0 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f0871797640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086c100e20 0x7f086c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f0871797640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086c100e20 0x7f086c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59788/0 (socket says 172.21.15.63:59788) 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.622+0000 7f0871797640 1 -- 172.21.15.63:0/397901235 learned_addr learned my addr 172.21.15.63:0/397901235 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f0871f98640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c102ef0 0x7f086c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f0870f96640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c102570 0x7f086c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f0871797640 1 -- 172.21.15.63:0/397901235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c102ef0 msgr2=0x7f086c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f0871797640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c102ef0 0x7f086c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f0871797640 1 -- 172.21.15.63:0/397901235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c102570 msgr2=0x7f086c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f0871797640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c102570 0x7f086c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:48.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f0871797640 1 -- 172.21.15.63:0/397901235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c1a6930 con 0x7f086c100e20 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f0871f98640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c102ef0 0x7f086c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f0870f96640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c102570 0x7f086c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f0871797640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086c100e20 0x7f086c0fcc80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0868006010 tx=0x7f08680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f08627fc640 1 -- 172.21.15.63:0/397901235 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086803f030 con 0x7f086c100e20 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f08739fb640 1 -- 172.21.15.63:0/397901235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f086c1a6bc0 con 0x7f086c100e20 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f08627fc640 1 -- 172.21.15.63:0/397901235 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0868003cb0 con 0x7f086c100e20 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f08627fc640 1 -- 172.21.15.63:0/397901235 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0868035070 con 0x7f086c100e20 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.623+0000 7f08739fb640 1 -- 172.21.15.63:0/397901235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f086c1a70a0 con 0x7f086c100e20 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.624+0000 7f08739fb640 1 -- 172.21.15.63:0/397901235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f086c101200 con 0x7f086c100e20 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.626+0000 7f08627fc640 1 -- 172.21.15.63:0/397901235 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0868042030 con 0x7f086c100e20 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.626+0000 7f08627fc640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f08580a3240 0x7f08580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.627+0000 7f0870f96640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f08580a3240 0x7f08580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:27:48.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.627+0000 7f08627fc640 1 -- 172.21.15.63:0/397901235 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7944+0+0 (secure 0 0 0) 0x7f08680efdc0 con 0x7f086c100e20 2024-09-16T01:27:48.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.627+0000 7f0870f96640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f08580a3240 0x7f08580a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f086c0fe710 tx=0x7f085c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:27:48.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.631+0000 7f08627fc640 1 -- 172.21.15.63:0/397901235 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08680bcbb0 con 0x7f086c100e20 2024-09-16T01:27:48.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.811+0000 7f08739fb640 1 -- 172.21.15.63:0/397901235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f086c10a0a0 con 0x7f086c100e20 2024-09-16T01:27:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.976+0000 7f08627fc640 1 -- 172.21.15.63:0/397901235 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) ==== 169+0+0 (secure 0 0 0) 0x7f08680bc4b0 con 0x7f086c100e20 2024-09-16T01:27:48.978 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2024-09-16T01:27:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 -- 172.21.15.63:0/397901235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f08580a3240 msgr2=0x7f08580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f08580a3240 0x7f08580a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f086c0fe710 tx=0x7f085c005e50 comp rx=0 tx=0).stop 2024-09-16T01:27:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 -- 172.21.15.63:0/397901235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086c100e20 msgr2=0x7f086c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:27:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086c100e20 0x7f086c0fcc80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0868006010 tx=0x7f08680042f0 comp rx=0 tx=0).stop 2024-09-16T01:27:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 -- 172.21.15.63:0/397901235 shutdown_connections 2024-09-16T01:27:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.63:6800/3860332424,v1:172.21.15.63:6801/3860332424] conn(0x7f08580a3240 0x7f08580a5700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:48.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c102ef0 0x7f086c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:48.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f086c102570 0x7f086c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:48.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 --2- 172.21.15.63:0/397901235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f086c100e20 0x7f086c0fcc80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:27:48.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 -- 172.21.15.63:0/397901235 >> 172.21.15.63:0/397901235 conn(0x7f086c0fc7d0 msgr2=0x7f086c06a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:27:48.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 -- 172.21.15.63:0/397901235 shutdown_connections 2024-09-16T01:27:48.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-16T01:27:48.979+0000 7f08739fb640 1 -- 172.21.15.63:0/397901235 wait complete. 2024-09-16T01:27:49.074 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:48 smithi063 ceph-mon[31070]: pgmap v471: 65 pgs: 65 active+clean; 577 KiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:27:49.074 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:48 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/397901235' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:27:49.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:48 smithi192 ceph-mon[34775]: pgmap v471: 65 pgs: 65 active+clean; 577 KiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:27:49.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:48 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/397901235' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:27:49.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:48 smithi162 ceph-mon[34539]: pgmap v471: 65 pgs: 65 active+clean; 577 KiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-16T01:27:49.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:48 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/397901235' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T01:27:49.841 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:27:49.871 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:27:49.905 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:27:49.937 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-16T01:27:49.938 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:27:49.955 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:27:49.973 DEBUG:teuthology.orchestra.run.smithi192:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T01:27:49.995 INFO:tasks.cephadm:Stopping all daemons... 2024-09-16T01:27:49.996 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-16T01:27:49.996 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.a 2024-09-16T01:27:50.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:49 smithi063 ceph-mon[31070]: from='client.? 172.21.15.63:0/397901235' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:27:50.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:49 smithi063 ceph-mon[31070]: osdmap e87: 12 total, 12 up, 12 in 2024-09-16T01:27:50.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:50 smithi063 systemd[1]: Stopping Ceph mon.a for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:27:50.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:49 smithi162 ceph-mon[34539]: from='client.? 172.21.15.63:0/397901235' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:27:50.183 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:49 smithi162 ceph-mon[34539]: osdmap e87: 12 total, 12 up, 12 in 2024-09-16T01:27:50.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:49 smithi192 ceph-mon[34775]: from='client.? 172.21.15.63:0/397901235' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T01:27:50.424 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:49 smithi192 ceph-mon[34775]: osdmap e87: 12 total, 12 up, 12 in 2024-09-16T01:27:50.609 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:50 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a[31066]: 2024-09-16T01:27:50.319+0000 7f6513a3e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:27:50.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:50 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a[31066]: 2024-09-16T01:27:50.319+0000 7f6513a3e640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-16T01:27:50.610 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:50 smithi063 podman[90972]: 2024-09-16 01:27:50.492955897 +0000 UTC m=+0.297361902 container died e7f7588f496820f800005998a850385fd5115cabc787b9754aad5cf0af97378c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T01:27:51.109 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:50 smithi063 podman[90972]: 2024-09-16 01:27:50.9735488 +0000 UTC m=+0.777954803 container cleanup e7f7588f496820f800005998a850385fd5115cabc787b9754aad5cf0af97378c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-16T01:27:51.110 INFO:journalctl@ceph.mon.a.smithi063.stdout:Sep 16 01:27:50 smithi063 bash[90972]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-a 2024-09-16T01:27:51.413 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.a.service' 2024-09-16T01:27:51.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:27:51.459 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-16T01:27:51.460 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-16T01:27:51.460 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.b 2024-09-16T01:27:51.795 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:51 smithi162 systemd[1]: Stopping Ceph mon.b for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:27:52.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:51 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-b[34535]: 2024-09-16T01:27:51.794+0000 7f722e4cf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:27:52.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:51 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-b[34535]: 2024-09-16T01:27:51.794+0000 7f722e4cf640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-16T01:27:52.130 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:51 smithi162 podman[67767]: 2024-09-16 01:27:51.814843136 +0000 UTC m=+0.152059521 container died cead7c419158c43b2793d27fc93ee6bd9b56f0c39fe412cd2e50133b4c42fb7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-b, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS) 2024-09-16T01:27:52.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:52 smithi162 podman[67767]: 2024-09-16 01:27:52.219942425 +0000 UTC m=+0.557158853 container cleanup cead7c419158c43b2793d27fc93ee6bd9b56f0c39fe412cd2e50133b4c42fb7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-16T01:27:52.433 INFO:journalctl@ceph.mon.b.smithi162.stdout:Sep 16 01:27:52 smithi162 bash[67767]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-b 2024-09-16T01:27:52.591 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.b.service' 2024-09-16T01:27:52.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:27:52.638 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-16T01:27:52.639 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-16T01:27:52.639 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.c 2024-09-16T01:27:52.924 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:52 smithi192 systemd[1]: Stopping Ceph mon.c for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:27:53.332 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:52 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-c[34770]: 2024-09-16T01:27:52.961+0000 7fe6a0b12640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:27:53.333 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:52 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-c[34770]: 2024-09-16T01:27:52.961+0000 7fe6a0b12640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-16T01:27:53.333 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:53 smithi192 podman[67935]: 2024-09-16 01:27:53.014203991 +0000 UTC m=+0.175663224 container died 75f8e12764a29af622c9f9510443cf7de7578b68f26692cf12def997e0f16f3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True) 2024-09-16T01:27:53.657 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:53 smithi192 podman[67935]: 2024-09-16 01:27:53.430238727 +0000 UTC m=+0.591697949 container cleanup 75f8e12764a29af622c9f9510443cf7de7578b68f26692cf12def997e0f16f3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:27:53.658 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:53 smithi192 bash[67935]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-c 2024-09-16T01:27:53.915 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 16 01:27:53 smithi192 podman[67948]: 2024-09-16 01:27:53.657039979 +0000 UTC m=+0.633228683 container remove 75f8e12764a29af622c9f9510443cf7de7578b68f26692cf12def997e0f16f3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-16T01:27:53.919 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mon.c.service' 2024-09-16T01:27:53.968 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:27:53.968 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-16T01:27:53.968 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-16T01:27:53.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.x 2024-09-16T01:27:54.275 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:27:54 smithi063 systemd[1]: Stopping Ceph mgr.x for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:27:54.609 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:27:54 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x[31299]: 2024-09-16T01:27:54.273+0000 7f563a35b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:27:54.610 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:27:54 smithi063 podman[91093]: 2024-09-16 01:27:54.305174853 +0000 UTC m=+0.132174283 container died e4adc27e8257cc724885f40d738bf355122094df2f092390c0d37c75ff2092eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=) 2024-09-16T01:27:55.052 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:27:54 smithi063 podman[91093]: 2024-09-16 01:27:54.82486106 +0000 UTC m=+0.651860533 container cleanup e4adc27e8257cc724885f40d738bf355122094df2f092390c0d37c75ff2092eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-16T01:27:55.053 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:27:54 smithi063 bash[91093]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x 2024-09-16T01:27:55.307 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Sep 16 01:27:55 smithi063 podman[91105]: 2024-09-16 01:27:55.051709593 +0000 UTC m=+0.743646361 container remove e4adc27e8257cc724885f40d738bf355122094df2f092390c0d37c75ff2092eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T01:27:55.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-16T01:27:55.366 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:27:55.367 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-16T01:27:55.367 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-16T01:27:55.367 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.y 2024-09-16T01:27:55.683 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:27:55 smithi162 systemd[1]: Stopping Ceph mgr.y for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:27:56.027 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:27:55 smithi162 podman[67906]: 2024-09-16 01:27:55.723569521 +0000 UTC m=+0.164835278 container died 2e427d1d05f2137dc3086771b709542f46428b43ce5e706e663e0b5f2779c7f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-16T01:27:56.394 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:27:56 smithi162 podman[67906]: 2024-09-16 01:27:56.125264222 +0000 UTC m=+0.566530021 container cleanup 2e427d1d05f2137dc3086771b709542f46428b43ce5e706e663e0b5f2779c7f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-16T01:27:56.394 INFO:journalctl@ceph.mgr.y.smithi162.stdout:Sep 16 01:27:56 smithi162 bash[67906]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-y 2024-09-16T01:27:56.556 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-16T01:27:56.593 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:27:56.593 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-16T01:27:56.593 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-16T01:27:56.593 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.z 2024-09-16T01:27:56.924 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:27:56 smithi192 systemd[1]: Stopping Ceph mgr.z for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:27:57.330 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:27:56 smithi192 podman[68068]: 2024-09-16 01:27:56.931334906 +0000 UTC m=+0.151736537 container died 0846615ad3430d7871a8c5ff0c30f907823eb741e8eec1414503c6150f946eca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-16T01:27:57.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:27:57 smithi192 podman[68068]: 2024-09-16 01:27:57.427777385 +0000 UTC m=+0.648179016 container cleanup 0846615ad3430d7871a8c5ff0c30f907823eb741e8eec1414503c6150f946eca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-16T01:27:57.674 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 16 01:27:57 smithi192 bash[68068]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mgr-z 2024-09-16T01:27:57.859 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-16T01:27:57.896 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:27:57.896 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-16T01:27:57.896 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-16T01:27:57.897 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.0 2024-09-16T01:27:58.281 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:27:57 smithi063 systemd[1]: Stopping Ceph osd.0 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:27:58.609 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:27:58 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0[44659]: 2024-09-16T01:27:58.279+0000 7f5be7a48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:27:58.609 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:27:58 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0[44659]: 2024-09-16T01:27:58.279+0000 7f5be7a48640 -1 osd.0 87 *** Got signal Terminated *** 2024-09-16T01:27:58.609 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:27:58 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0[44659]: 2024-09-16T01:27:58.279+0000 7f5be7a48640 -1 osd.0 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:28:03.923 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:28:03 smithi063 podman[91214]: 2024-09-16 01:28:03.614721386 +0000 UTC m=+5.524712824 container died 428b8e861014889953ced7a4b7afab4a8c9e8213f0b73a570c5d948488c17263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2) 2024-09-16T01:28:04.359 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:28:04 smithi063 podman[91214]: 2024-09-16 01:28:04.121714971 +0000 UTC m=+6.031706424 container cleanup 428b8e861014889953ced7a4b7afab4a8c9e8213f0b73a570c5d948488c17263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-16T01:28:04.359 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:28:04 smithi063 bash[91214]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0 2024-09-16T01:28:04.754 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:28:04 smithi063 podman[91229]: 2024-09-16 01:28:04.393840292 +0000 UTC m=+0.773462932 container remove 428b8e861014889953ced7a4b7afab4a8c9e8213f0b73a570c5d948488c17263 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:28:05.061 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:28:04 smithi063 podman[91318]: 2024-09-16 01:28:04.656261274 +0000 UTC m=+0.016493548 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:28:05.061 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:28:04 smithi063 podman[91318]: 2024-09-16 01:28:04.802099074 +0000 UTC m=+0.162331347 container create 41c5f931727c929851659aa7ce6afc32805320bfa729b689e2107e72cd25d202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-16T01:28:05.345 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:28:05 smithi063 podman[91318]: 2024-09-16 01:28:05.060609595 +0000 UTC m=+0.420841868 container init 41c5f931727c929851659aa7ce6afc32805320bfa729b689e2107e72cd25d202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2) 2024-09-16T01:28:05.345 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:28:05 smithi063 podman[91318]: 2024-09-16 01:28:05.064493246 +0000 UTC m=+0.424725522 container start 41c5f931727c929851659aa7ce6afc32805320bfa729b689e2107e72cd25d202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:28:05.345 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:28:05 smithi063 podman[91318]: 2024-09-16 01:28:05.169037026 +0000 UTC m=+0.529269317 container attach 41c5f931727c929851659aa7ce6afc32805320bfa729b689e2107e72cd25d202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-16T01:28:05.345 INFO:journalctl@ceph.osd.0.smithi063.stdout:Sep 16 01:28:05 smithi063 podman[91318]: 2024-09-16 01:28:05.265087944 +0000 UTC m=+0.625320227 container died 41c5f931727c929851659aa7ce6afc32805320bfa729b689e2107e72cd25d202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-16T01:28:05.971 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.0.service' 2024-09-16T01:28:06.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:28:06.012 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-16T01:28:06.012 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-16T01:28:06.012 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.1 2024-09-16T01:28:06.330 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:06 smithi162 systemd[1]: Stopping Ceph osd.1 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:28:06.683 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:06 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1[39002]: 2024-09-16T01:28:06.328+0000 7fe514366640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:28:06.683 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:06 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1[39002]: 2024-09-16T01:28:06.328+0000 7fe514366640 -1 osd.1 87 *** Got signal Terminated *** 2024-09-16T01:28:06.683 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:06 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1[39002]: 2024-09-16T01:28:06.328+0000 7fe514366640 -1 osd.1 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:28:12.106 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:11 smithi162 podman[68032]: 2024-09-16 01:28:11.792718994 +0000 UTC m=+5.577357087 container died 0ea3ae7f008f5c6e3bce6f2a5a154cbd2d14eb8edfa6b4dedaa6063b41a9d39a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-16T01:28:12.422 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:12 smithi162 podman[68032]: 2024-09-16 01:28:12.204234196 +0000 UTC m=+5.988872286 container cleanup 0ea3ae7f008f5c6e3bce6f2a5a154cbd2d14eb8edfa6b4dedaa6063b41a9d39a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-16T01:28:12.423 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:12 smithi162 bash[68032]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1 2024-09-16T01:28:12.683 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:12 smithi162 podman[68047]: 2024-09-16 01:28:12.422157395 +0000 UTC m=+0.626780704 container remove 0ea3ae7f008f5c6e3bce6f2a5a154cbd2d14eb8edfa6b4dedaa6063b41a9d39a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e) 2024-09-16T01:28:13.135 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:12 smithi162 podman[68136]: 2024-09-16 01:28:12.728112761 +0000 UTC m=+0.016155048 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:28:13.135 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:12 smithi162 podman[68136]: 2024-09-16 01:28:12.864638627 +0000 UTC m=+0.152680900 container create d75ceb9e608ac965e12f3dc3c8857d0e20bdbde2a463afada18d53a29168318b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-16T01:28:13.413 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:13 smithi162 podman[68136]: 2024-09-16 01:28:13.134152319 +0000 UTC m=+0.422194602 container init d75ceb9e608ac965e12f3dc3c8857d0e20bdbde2a463afada18d53a29168318b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-16T01:28:13.413 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:13 smithi162 podman[68136]: 2024-09-16 01:28:13.1381097 +0000 UTC m=+0.426151974 container start d75ceb9e608ac965e12f3dc3c8857d0e20bdbde2a463afada18d53a29168318b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-16T01:28:13.413 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:13 smithi162 podman[68136]: 2024-09-16 01:28:13.219430808 +0000 UTC m=+0.507473084 container attach d75ceb9e608ac965e12f3dc3c8857d0e20bdbde2a463afada18d53a29168318b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:28:13.413 INFO:journalctl@ceph.osd.1.smithi162.stdout:Sep 16 01:28:13 smithi162 podman[68136]: 2024-09-16 01:28:13.340263388 +0000 UTC m=+0.628305662 container died d75ceb9e608ac965e12f3dc3c8857d0e20bdbde2a463afada18d53a29168318b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-16T01:28:14.057 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.1.service' 2024-09-16T01:28:14.095 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:28:14.096 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-16T01:28:14.096 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-16T01:28:14.096 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.2 2024-09-16T01:28:14.424 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:14 smithi192 systemd[1]: Stopping Ceph osd.2 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:28:14.924 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:14 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2[39749]: 2024-09-16T01:28:14.473+0000 7fb6f2965640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:28:14.924 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:14 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2[39749]: 2024-09-16T01:28:14.473+0000 7fb6f2965640 -1 osd.2 87 *** Got signal Terminated *** 2024-09-16T01:28:14.924 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:14 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2[39749]: 2024-09-16T01:28:14.473+0000 7fb6f2965640 -1 osd.2 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:28:20.101 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:19 smithi192 podman[68191]: 2024-09-16 01:28:19.806063226 +0000 UTC m=+5.518437697 container died 88fa0d109e72f2f6658c65f53d3371f0120c6cf9fdcbfa6a4fb926d816542ccd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-16T01:28:20.424 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:20 smithi192 podman[68191]: 2024-09-16 01:28:20.190887402 +0000 UTC m=+5.903261873 container cleanup 88fa0d109e72f2f6658c65f53d3371f0120c6cf9fdcbfa6a4fb926d816542ccd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-16T01:28:20.424 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:20 smithi192 bash[68191]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2 2024-09-16T01:28:20.768 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:20 smithi192 podman[68205]: 2024-09-16 01:28:20.459203271 +0000 UTC m=+0.647036269 container remove 88fa0d109e72f2f6658c65f53d3371f0120c6cf9fdcbfa6a4fb926d816542ccd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-09-16T01:28:21.039 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:20 smithi192 podman[68293]: 2024-09-16 01:28:20.671053221 +0000 UTC m=+0.015798505 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:28:21.039 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:20 smithi192 podman[68293]: 2024-09-16 01:28:20.785164899 +0000 UTC m=+0.129910180 container create 05a6e3241a725e94f8f5f48f697a55db62b4736cef692606ead8f1cf85e12f13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:28:21.039 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:21 smithi192 podman[68293]: 2024-09-16 01:28:21.038251457 +0000 UTC m=+0.382996732 container init 05a6e3241a725e94f8f5f48f697a55db62b4736cef692606ead8f1cf85e12f13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:28:21.424 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:21 smithi192 podman[68293]: 2024-09-16 01:28:21.041947436 +0000 UTC m=+0.386692716 container start 05a6e3241a725e94f8f5f48f697a55db62b4736cef692606ead8f1cf85e12f13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T01:28:21.424 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:21 smithi192 podman[68293]: 2024-09-16 01:28:21.155301508 +0000 UTC m=+0.500046793 container attach 05a6e3241a725e94f8f5f48f697a55db62b4736cef692606ead8f1cf85e12f13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-16T01:28:21.424 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 16 01:28:21 smithi192 podman[68293]: 2024-09-16 01:28:21.22916626 +0000 UTC m=+0.573911535 container died 05a6e3241a725e94f8f5f48f697a55db62b4736cef692606ead8f1cf85e12f13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-16T01:28:21.899 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.2.service' 2024-09-16T01:28:21.936 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:28:21.936 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-16T01:28:21.936 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-16T01:28:21.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.3 2024-09-16T01:28:22.261 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:21 smithi063 systemd[1]: Stopping Ceph osd.3 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:28:22.609 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:22 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3[51270]: 2024-09-16T01:28:22.259+0000 7f3d8616a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:28:22.610 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:22 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3[51270]: 2024-09-16T01:28:22.259+0000 7f3d8616a640 -1 osd.3 87 *** Got signal Terminated *** 2024-09-16T01:28:22.610 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:22 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3[51270]: 2024-09-16T01:28:22.259+0000 7f3d8616a640 -1 osd.3 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:28:24.710 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:24 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:24.381+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:25.109 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:24 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3[51270]: 2024-09-16T01:28:24.709+0000 7f3d7e778640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.397253+0000 front 2024-09-16T01:27:58.397280+0000 (oldest deadline 2024-09-16T01:28:24.297427+0000) 2024-09-16T01:28:25.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:25.120+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:25.688 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:25 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:25.361+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:26.109 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:25 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3[51270]: 2024-09-16T01:28:25.686+0000 7f3d7e778640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.397253+0000 front 2024-09-16T01:27:58.397280+0000 (oldest deadline 2024-09-16T01:28:24.297427+0000) 2024-09-16T01:28:26.114 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:25.857+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:26.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:26 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:26.113+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:26.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:26 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:26.331+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:26.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:26 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:26.400+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:27.109 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:26 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3[51270]: 2024-09-16T01:28:26.641+0000 7f3d7e778640 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.397253+0000 front 2024-09-16T01:27:58.397280+0000 (oldest deadline 2024-09-16T01:28:24.297427+0000) 2024-09-16T01:28:27.174 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:27 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:27.087+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:27.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:26 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:26.872+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:27.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:27 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:27.286+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:27.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:27 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:27.439+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:28.078 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:27 smithi063 podman[91443]: 2024-09-16 01:28:27.765056018 +0000 UTC m=+5.627442384 container died 735979cd4a501f522f1b6d8755396f41ecb0dc372edd55532ff54e14649f7167 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-16T01:28:28.174 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:28.105+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:28.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:27 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:27.896+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:28.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:27 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:27.886+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:28.359 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:28 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:28.325+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:28.360 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:28 smithi063 podman[91443]: 2024-09-16 01:28:28.301764019 +0000 UTC m=+6.164150424 container cleanup 735979cd4a501f522f1b6d8755396f41ecb0dc372edd55532ff54e14649f7167 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-16T01:28:28.360 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:28 smithi063 bash[91443]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3 2024-09-16T01:28:28.859 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:28 smithi063 podman[91460]: 2024-09-16 01:28:28.645402355 +0000 UTC m=+0.873981716 container remove 735979cd4a501f522f1b6d8755396f41ecb0dc372edd55532ff54e14649f7167 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-16T01:28:28.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:28 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:28.481+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:28.912 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:28.456+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:29.174 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:29.079+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:29.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:28.911+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:29.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:28 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:28.900+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:29.352 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:29 smithi063 podman[91546]: 2024-09-16 01:28:28.976675501 +0000 UTC m=+0.016516279 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:28:29.353 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:29 smithi063 podman[91546]: 2024-09-16 01:28:29.121410185 +0000 UTC m=+0.161250992 container create c6858050e0e69f33954df6e18aab6470d97193d56835ca3c4e6bf9303139b81b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:28:29.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:29 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:29.350+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:29.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:29 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:29.442+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:29.610 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:29 smithi063 podman[91546]: 2024-09-16 01:28:29.399142931 +0000 UTC m=+0.438983696 container init c6858050e0e69f33954df6e18aab6470d97193d56835ca3c4e6bf9303139b81b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-16T01:28:29.610 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:29 smithi063 podman[91546]: 2024-09-16 01:28:29.402695441 +0000 UTC m=+0.442536216 container start c6858050e0e69f33954df6e18aab6470d97193d56835ca3c4e6bf9303139b81b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-16T01:28:29.610 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:29 smithi063 podman[91546]: 2024-09-16 01:28:29.52424855 +0000 UTC m=+0.564089321 container attach c6858050e0e69f33954df6e18aab6470d97193d56835ca3c4e6bf9303139b81b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-16T01:28:29.610 INFO:journalctl@ceph.osd.3.smithi063.stdout:Sep 16 01:28:29 smithi063 podman[91546]: 2024-09-16 01:28:29.593679659 +0000 UTC m=+0.633520438 container died c6858050e0e69f33954df6e18aab6470d97193d56835ca3c4e6bf9303139b81b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-16T01:28:29.880 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:29.501+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:30.174 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:30 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:30.070+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:30.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:29.879+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:30.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.3.service' 2024-09-16T01:28:30.276 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:28:30.276 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-16T01:28:30.277 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-16T01:28:30.277 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.4 2024-09-16T01:28:30.305 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:29 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:29.942+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:30.593 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:30 smithi162 systemd[1]: Stopping Ceph osd.4 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:28:30.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:30 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:30.313+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:30.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:30 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:30.412+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:30.923 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:30 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:30.500+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:30.933 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:30 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4[45575]: 2024-09-16T01:28:30.591+0000 7f920740d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:28:30.933 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:30 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4[45575]: 2024-09-16T01:28:30.592+0000 7f920740d640 -1 osd.4 87 *** Got signal Terminated *** 2024-09-16T01:28:30.933 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:30 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4[45575]: 2024-09-16T01:28:30.592+0000 7f920740d640 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:28:31.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:31 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:31.084+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:31.424 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:30 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:30.923+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:31.433 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:30 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:30.949+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:31.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:31 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:31.336+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:31.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:31 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:31.462+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:31.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:31 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:31.530+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:32.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:31 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:31.899+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:32.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:32 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:32.123+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:32.424 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:31 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:31.926+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:32.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:32 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:32.335+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:32.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:32 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:32.507+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:32.903 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:32 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:32.520+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:33.174 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:33 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:33.146+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:33.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:32 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:32.902+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:33.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:32 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:32.902+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:33.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:32 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:32.882+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:33.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:33 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:33.312+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:33.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:33 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:33.514+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:33.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:33 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:33.514+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:33.908 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:33 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:33.569+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:34.174 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:34 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:34.155+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:34.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:33 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:33.907+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:34.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:33 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:33.907+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:34.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:34 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:34.056+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:34.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:33 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:33.842+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:34.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:34 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:34.333+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:34.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:34 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:34.333+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:34.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:34 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:34.473+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:34.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:34 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:34.473+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:34.908 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:34 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:34.584+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:35.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:34 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:34.908+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:35.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:34 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:34.908+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:35.183 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:34 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4[45575]: 2024-09-16T01:28:34.983+0000 7f9203a23640 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415657+0000 front 2024-09-16T01:28:10.415676+0000 (oldest deadline 2024-09-16T01:28:34.515903+0000) 2024-09-16T01:28:35.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:35 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:35.048+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:35.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:34 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:34.891+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:35.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:35.351+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:35.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:35.351+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:35.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:35.512+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:35.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:35 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:35.512+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:35.625 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:35.201+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:35.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:35.624+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:36.026 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:35 smithi162 podman[68262]: 2024-09-16 01:28:35.921919253 +0000 UTC m=+5.439253682 container died 6e0028ff1c8d46413c07083472037d1db9867f13b03474e6eea1d832c4d1593c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-16T01:28:36.027 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:35 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:35.918+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:36.027 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:35 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:35.918+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:36.252 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:35.930+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:36.253 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:35 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:35.930+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:36.342 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:36 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:36.025+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:36.657 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:36 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:36.249+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:36.660 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:36 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:36.249+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.627334+0000 front 2024-09-16T01:28:10.627363+0000 (oldest deadline 2024-09-16T01:28:35.927352+0000) 2024-09-16T01:28:36.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:36 smithi162 podman[68262]: 2024-09-16 01:28:36.341763659 +0000 UTC m=+5.859098098 container cleanup 6e0028ff1c8d46413c07083472037d1db9867f13b03474e6eea1d832c4d1593c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-16T01:28:36.683 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:36 smithi162 bash[68262]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4 2024-09-16T01:28:36.684 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:36 smithi162 podman[68278]: 2024-09-16 01:28:36.576564475 +0000 UTC m=+0.649870428 container remove 6e0028ff1c8d46413c07083472037d1db9867f13b03474e6eea1d832c4d1593c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:28:36.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:36 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:36.512+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:36.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:36 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:36.512+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:36.860 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:36 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:36.360+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:36.860 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:36 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:36.360+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:36.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:36 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:36.656+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:36.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:36 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:36.881+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:36.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:36 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:36.881+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:37.173 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:37 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:37.055+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:37.173 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:36 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:36.874+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:37.173 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:36 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:36.874+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:37.174 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:37 smithi162 podman[68366]: 2024-09-16 01:28:36.917092248 +0000 UTC m=+0.015688111 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:28:37.174 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:37 smithi162 podman[68366]: 2024-09-16 01:28:37.052388313 +0000 UTC m=+0.150984175 container create e012cf6d22d78aca521114a04e8ca898289f9d51a8140020caa1ba79dc9e9cf6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-16T01:28:37.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:37 smithi162 podman[68366]: 2024-09-16 01:28:37.305079867 +0000 UTC m=+0.403675730 container init e012cf6d22d78aca521114a04e8ca898289f9d51a8140020caa1ba79dc9e9cf6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-16T01:28:37.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:37 smithi162 podman[68366]: 2024-09-16 01:28:37.308286488 +0000 UTC m=+0.406882352 container start e012cf6d22d78aca521114a04e8ca898289f9d51a8140020caa1ba79dc9e9cf6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-16T01:28:37.433 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:37 smithi162 podman[68366]: 2024-09-16 01:28:37.405108976 +0000 UTC m=+0.503704842 container attach e012cf6d22d78aca521114a04e8ca898289f9d51a8140020caa1ba79dc9e9cf6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T01:28:37.674 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:37 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:37.236+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:37.674 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:37 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:37.237+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.627334+0000 front 2024-09-16T01:28:10.627363+0000 (oldest deadline 2024-09-16T01:28:35.927352+0000) 2024-09-16T01:28:37.784 INFO:journalctl@ceph.osd.4.smithi162.stdout:Sep 16 01:28:37 smithi162 podman[68389]: 2024-09-16 01:28:37.518192926 +0000 UTC m=+0.016733202 container died e012cf6d22d78aca521114a04e8ca898289f9d51a8140020caa1ba79dc9e9cf6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-16T01:28:37.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:37 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:37.529+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:37.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:37 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:37.529+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:37.860 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:37 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:37.388+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:37.860 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:37 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:37.388+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:38.085 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:37 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:37.923+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:38.088 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:37 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:37.923+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:38.114 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.4.service' 2024-09-16T01:28:38.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:37 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:37.702+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:38.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:37 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:37.856+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:38.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:37 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:37.856+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:38.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:28:38.193 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-16T01:28:38.193 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-16T01:28:38.193 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.5 2024-09-16T01:28:38.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:38 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:38.084+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:38.497 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:38.194+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:38.497 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:38.194+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.627334+0000 front 2024-09-16T01:28:10.627363+0000 (oldest deadline 2024-09-16T01:28:35.927352+0000) 2024-09-16T01:28:38.497 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:38 smithi192 systemd[1]: Stopping Ceph osd.5 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:28:38.497 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:38.494+0000 7f541f016640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:28:38.497 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:38.494+0000 7f541f016640 -1 osd.5 87 *** Got signal Terminated *** 2024-09-16T01:28:38.497 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:38.494+0000 7f541f016640 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:28:38.859 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:38 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:38.424+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:38.859 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:38 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:38.424+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:38.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:38 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:38.538+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:38.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:38 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:38.538+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:38.896 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:38.692+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:39.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:38.894+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:39.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:38 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:38.894+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:39.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:39 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:39.129+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:39.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:38 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:38.911+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:39.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:38 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:38.911+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:39.674 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:39 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:39.242+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:39.674 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:39 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:39.242+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.627334+0000 front 2024-09-16T01:28:10.627363+0000 (oldest deadline 2024-09-16T01:28:35.927352+0000) 2024-09-16T01:28:39.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:39.490+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:39.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:39.490+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:39.860 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:39.415+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:39.860 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:39 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:39.415+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:40.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:39 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:39.679+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:40.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:39 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:39.877+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:40.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:39 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:39.877+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:40.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:40.130+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:40.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:39 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:39.946+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:40.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:39 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:39.946+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:40.674 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:40 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:40.265+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:40.674 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:40 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:40.265+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.627334+0000 front 2024-09-16T01:28:10.627363+0000 (oldest deadline 2024-09-16T01:28:35.927352+0000) 2024-09-16T01:28:40.859 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:40 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:40.388+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:40.859 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:40 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:40.388+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:40.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:40 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:40.525+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:40.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:40 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:40.525+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:41.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:40 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:40.866+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:41.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:40 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:40.866+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:41.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:40 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:40.699+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:41.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:40 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:40.699+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:41.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:41 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:41.127+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:41.433 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:40.979+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:41.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:40 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:40.979+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:41.652 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:41 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:41.223+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:41.653 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:41 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:41.223+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.627334+0000 front 2024-09-16T01:28:10.627363+0000 (oldest deadline 2024-09-16T01:28:35.927352+0000) 2024-09-16T01:28:41.653 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:41 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:41.223+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.228316+0000 front 2024-09-16T01:28:18.228342+0000 (oldest deadline 2024-09-16T01:28:41.128514+0000) 2024-09-16T01:28:41.859 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:41.361+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:41.859 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:41.361+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:41.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:41.560+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:41.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:41.560+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:41.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:41 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:41.651+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:41.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:41 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:41.651+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:41.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:41 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:41.837+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:41.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:41 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:41.837+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:42.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:42.090+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:42.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:41 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:41.956+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:42.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:41 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:41.956+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:42.652 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:42.180+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:42.652 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:42.180+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.627334+0000 front 2024-09-16T01:28:10.627363+0000 (oldest deadline 2024-09-16T01:28:35.927352+0000) 2024-09-16T01:28:42.652 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:42.180+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.228316+0000 front 2024-09-16T01:28:18.228342+0000 (oldest deadline 2024-09-16T01:28:41.128514+0000) 2024-09-16T01:28:42.859 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:42 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:42.364+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:42.860 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:42 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:42.364+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:42.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:42 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:42.530+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:42.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:42 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:42.530+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:42.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:42.650+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:42.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:42.650+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:42.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:42.844+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:42.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:42 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:42.844+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:43.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:43 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:43.121+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:43.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:42.908+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:43.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:42.908+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:43.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:42 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:42.908+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:43.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:43 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:43.157+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:01.325892+0000 front 2024-09-16T01:28:01.325734+0000 (oldest deadline 2024-09-16T01:28:24.225778+0000) 2024-09-16T01:28:43.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:43 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:43.157+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.627334+0000 front 2024-09-16T01:28:10.627363+0000 (oldest deadline 2024-09-16T01:28:35.927352+0000) 2024-09-16T01:28:43.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:43 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5[46172]: 2024-09-16T01:28:43.157+0000 7f541b62c640 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.228316+0000 front 2024-09-16T01:28:18.228342+0000 (oldest deadline 2024-09-16T01:28:41.128514+0000) 2024-09-16T01:28:43.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:43 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:43.542+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:43.707 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:43 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:43.542+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:43.707 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:43 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:43.320+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:43.707 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:43 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:43.320+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:43.707 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:43 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:43.320+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:19.282070+0000 front 2024-09-16T01:28:19.282231+0000 (oldest deadline 2024-09-16T01:28:42.781843+0000) 2024-09-16T01:28:44.167 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:43 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:43.860+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:44.167 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:43 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:43.860+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:44.167 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:43 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:43.860+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:44.174 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:43 smithi192 podman[68409]: 2024-09-16 01:28:43.897511633 +0000 UTC m=+5.511734956 container died 1c5e6313dd289a1d8643a9162cd1f2e89cc30b652807e9731d9622009a2462c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:28:44.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:43 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:43.698+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:44.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:43 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:43.698+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:44.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:43 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:43.854+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:44.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:43 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:43.854+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:44.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:43 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:43.854+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:44.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:44 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:44.166+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:44.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:44 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:44.166+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:44.506 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:44 smithi192 podman[68409]: 2024-09-16 01:28:44.270661779 +0000 UTC m=+5.884885097 container cleanup 1c5e6313dd289a1d8643a9162cd1f2e89cc30b652807e9731d9622009a2462c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-16T01:28:44.506 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:44 smithi192 bash[68409]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5 2024-09-16T01:28:44.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:44 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:44.354+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:44.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:44 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:44.354+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:44.609 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:44 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:44.354+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:19.282070+0000 front 2024-09-16T01:28:19.282231+0000 (oldest deadline 2024-09-16T01:28:42.781843+0000) 2024-09-16T01:28:44.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:44 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:44.535+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:44.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:44 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:44.535+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:44.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:44 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:44.535+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:44.811 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:44 smithi192 podman[68425]: 2024-09-16 01:28:44.50549763 +0000 UTC m=+0.601577294 container remove 1c5e6313dd289a1d8643a9162cd1f2e89cc30b652807e9731d9622009a2462c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-16T01:28:44.811 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:44 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:44.690+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:44.811 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:44 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:44.690+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:45.077 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:44 smithi192 podman[68515]: 2024-09-16 01:28:44.729290071 +0000 UTC m=+0.015778872 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:28:45.077 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:44 smithi192 podman[68515]: 2024-09-16 01:28:44.844079815 +0000 UTC m=+0.130568601 container create 4e0ea3f5b5f146e0381508ee56db7cd26e224d10dd12f284ddc7d36694984c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:28:45.077 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:45 smithi192 podman[68515]: 2024-09-16 01:28:45.076665341 +0000 UTC m=+0.363154139 container init 4e0ea3f5b5f146e0381508ee56db7cd26e224d10dd12f284ddc7d36694984c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-16T01:28:45.078 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:44 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:44.809+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:45.078 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:44 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:44.809+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:45.078 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:44 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:44.809+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:45.175 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:44 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:44.854+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:45.176 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:44 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:44.854+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:45.176 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:44 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:44.854+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:45.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:45 smithi192 podman[68515]: 2024-09-16 01:28:45.080384951 +0000 UTC m=+0.366873737 container start 4e0ea3f5b5f146e0381508ee56db7cd26e224d10dd12f284ddc7d36694984c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-16T01:28:45.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:45 smithi192 podman[68515]: 2024-09-16 01:28:45.151061043 +0000 UTC m=+0.437549837 container attach 4e0ea3f5b5f146e0381508ee56db7cd26e224d10dd12f284ddc7d36694984c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:28:45.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 16 01:28:45 smithi192 podman[68515]: 2024-09-16 01:28:45.270207066 +0000 UTC m=+0.556695853 container died 4e0ea3f5b5f146e0381508ee56db7cd26e224d10dd12f284ddc7d36694984c2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-16T01:28:45.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:45 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:45.175+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:45.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:45 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:45.175+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:45.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:45 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:45.355+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:45.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:45 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:45.355+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:45.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:45 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:45.355+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:19.282070+0000 front 2024-09-16T01:28:19.282231+0000 (oldest deadline 2024-09-16T01:28:42.781843+0000) 2024-09-16T01:28:45.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:45 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:45.559+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:45.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:45 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:45.559+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:45.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:45 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:45.559+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:45.889 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:45 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:45.711+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:45.889 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:45 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:45.711+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:45.889 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:45 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:45.767+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:45.889 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:45 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:45.767+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:45.889 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:45 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:45.767+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:45.908 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.5.service' 2024-09-16T01:28:45.951 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:28:45.951 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-16T01:28:45.951 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-16T01:28:45.951 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.6 2024-09-16T01:28:46.173 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:45 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:45.904+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:46.174 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:45 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:45.904+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:46.174 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:45 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:45.904+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:46.240 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:45 smithi063 systemd[1]: Stopping Ceph osd.6 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:28:46.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:46 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:46.173+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:46.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:46 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:46.173+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:46.507 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:46 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:46.238+0000 7ff502f7c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:28:46.507 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:46 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:46.238+0000 7ff502f7c640 -1 osd.6 87 *** Got signal Terminated *** 2024-09-16T01:28:46.507 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:46 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:46.238+0000 7ff502f7c640 -1 osd.6 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:28:46.507 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:46 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:46.332+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:46.508 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:46 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:46.332+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:46.508 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:46 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:46.332+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:19.282070+0000 front 2024-09-16T01:28:19.282231+0000 (oldest deadline 2024-09-16T01:28:42.781843+0000) 2024-09-16T01:28:46.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:46 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:46.555+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:46.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:46 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:46.555+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:46.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:46 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:46.555+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:47.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:46 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:46.756+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:47.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:46 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:46.756+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:47.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:46 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:46.786+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:47.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:46 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:46.786+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:47.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:46 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:46.786+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:47.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:47 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:47.134+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:47.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:47 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:47.134+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:47.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:46 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:46.927+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:47.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:46 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:46.927+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:47.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:46 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:46.927+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:47.590 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:47 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:47.294+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:47.590 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:47 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:47.294+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:47.590 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:47 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:47.294+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:19.282070+0000 front 2024-09-16T01:28:19.282231+0000 (oldest deadline 2024-09-16T01:28:42.781843+0000) 2024-09-16T01:28:47.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:47 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:47.589+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:47.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:47 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:47.589+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:47.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:47 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:47.589+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:48.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:47 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:47.795+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:48.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:47 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:47.795+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:48.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:47 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:47.759+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:48.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:47 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:47.759+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:48.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:47 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:47.759+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:48.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:48 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:48.098+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:48.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:48 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:48.098+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:48.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:47 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:47.896+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:48.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:47 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:47.896+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:48.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:47 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:47.896+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:48.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:48 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:48.550+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:48.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:48 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:48.551+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:48.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:48 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:48.551+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:48.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:48 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:48.551+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:48.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:48 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:48.344+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:48.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:48 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:48.344+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:48.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:48 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:48.344+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:19.282070+0000 front 2024-09-16T01:28:19.282231+0000 (oldest deadline 2024-09-16T01:28:42.781843+0000) 2024-09-16T01:28:49.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:48 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:48.755+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:49.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:48 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:48.755+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:49.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:48 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:48.795+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:49.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:48 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:48.795+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:49.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:48 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:48.795+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:49.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:49 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:49.107+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:49.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:49 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:49.107+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:49.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:48 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:48.868+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:49.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:48 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:48.868+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:49.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:48 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:48.868+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:49.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:49 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:49.539+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:49.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:49 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:49.539+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:49.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:49 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:49.539+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:49.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:49 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:49.539+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:49.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:49 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:49.308+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:49.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:49 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:49.308+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:49.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:49 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:49.308+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:19.282070+0000 front 2024-09-16T01:28:19.282231+0000 (oldest deadline 2024-09-16T01:28:42.781843+0000) 2024-09-16T01:28:50.090 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:49 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:49.828+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:50.090 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:49 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:49.828+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:50.090 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:49 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:49.828+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:50.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:49 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:49.762+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:50.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:49 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:49.762+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:50.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:49 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:49.790+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:50.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:49 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:49.790+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:50.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:49 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:49.790+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:50.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:50 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:50.088+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:50.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:50 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:50.088+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:50.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:50 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:50.523+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:50.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:50 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:50.523+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:50.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:50 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:50.523+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:50.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:50 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:50.523+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:50.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:50 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:50.306+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:58.179046+0000 front 2024-09-16T01:27:58.179219+0000 (oldest deadline 2024-09-16T01:28:24.079162+0000) 2024-09-16T01:28:50.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:50 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:50.306+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:11.081169+0000 front 2024-09-16T01:28:11.080898+0000 (oldest deadline 2024-09-16T01:28:33.980815+0000) 2024-09-16T01:28:50.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:50 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:50.306+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:19.282070+0000 front 2024-09-16T01:28:19.282231+0000 (oldest deadline 2024-09-16T01:28:42.781843+0000) 2024-09-16T01:28:50.610 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:50 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6[58187]: 2024-09-16T01:28:50.306+0000 7ff4fb58a640 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.183184+0000 front 2024-09-16T01:28:26.183232+0000 (oldest deadline 2024-09-16T01:28:50.283288+0000) 2024-09-16T01:28:51.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:50 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:50.743+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:51.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:50 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:50.743+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:51.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:50 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:50.800+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:51.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:50 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:50.800+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:51.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:50 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:50.800+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:51.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:51 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:51.071+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:51.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:51 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:51.071+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:51.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:51 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:51.071+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.823050+0000 front 2024-09-16T01:28:26.822966+0000 (oldest deadline 2024-09-16T01:28:50.923056+0000) 2024-09-16T01:28:51.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:50 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:50.852+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:51.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:50 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:50.852+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:51.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:50 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:50.852+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:51.860 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:51 smithi063 podman[91648]: 2024-09-16 01:28:51.68691087 +0000 UTC m=+5.535395651 container died a6877ee0ed9010e93e6b67712ba49c8fb7a5a81ffcce0ee570a836683d6fff32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:28:51.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:51 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:51.511+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:51.861 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:51 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:51.511+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:51.861 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:51 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:51.511+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:51.861 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:51 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:51.511+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:52.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:51 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:51.789+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:52.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:51 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:51.789+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:52.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:51 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:51.789+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:28:52.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:51 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:51.797+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:52.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:51 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:51.797+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:52.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:51 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:51.797+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:52.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:52 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:52.076+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:52.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:52 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:52.076+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:52.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:52 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:52.076+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.823050+0000 front 2024-09-16T01:28:26.822966+0000 (oldest deadline 2024-09-16T01:28:50.923056+0000) 2024-09-16T01:28:52.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:51 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:51.892+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:52.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:51 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:51.892+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:52.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:51 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:51.892+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:52.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:51 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:51.892+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:28:52.216 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:52 smithi063 podman[91648]: 2024-09-16 01:28:52.030609097 +0000 UTC m=+5.879093921 container cleanup a6877ee0ed9010e93e6b67712ba49c8fb7a5a81ffcce0ee570a836683d6fff32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T01:28:52.216 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:52 smithi063 bash[91648]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6 2024-09-16T01:28:52.509 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:52 smithi063 podman[91677]: 2024-09-16 01:28:52.215303166 +0000 UTC m=+0.522426758 container remove a6877ee0ed9010e93e6b67712ba49c8fb7a5a81ffcce0ee570a836683d6fff32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-16T01:28:52.849 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:52 smithi063 podman[91766]: 2024-09-16 01:28:52.56091846 +0000 UTC m=+0.016045030 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:28:52.850 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:52 smithi063 podman[91766]: 2024-09-16 01:28:52.722317847 +0000 UTC m=+0.177444419 container create 01673fb56b82e8558688ca1c955a988cfd67698051c1daf3dce7eb4c4f1bbe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:28:52.850 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:52 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:52.507+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:52.850 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:52 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:52.507+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:52.850 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:52 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:52.507+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:52.850 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:52 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:52.507+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:53.109 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:52 smithi063 podman[91766]: 2024-09-16 01:28:52.969109212 +0000 UTC m=+0.424235796 container init 01673fb56b82e8558688ca1c955a988cfd67698051c1daf3dce7eb4c4f1bbe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T01:28:53.110 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:52 smithi063 podman[91766]: 2024-09-16 01:28:52.97271937 +0000 UTC m=+0.427845946 container start 01673fb56b82e8558688ca1c955a988cfd67698051c1daf3dce7eb4c4f1bbe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-16T01:28:53.110 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:53 smithi063 podman[91766]: 2024-09-16 01:28:53.060688003 +0000 UTC m=+0.515814588 container attach 01673fb56b82e8558688ca1c955a988cfd67698051c1daf3dce7eb4c4f1bbe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-16T01:28:53.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:52 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:52.745+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:53.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:52 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:52.745+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:53.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:52 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:52.745+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:28:53.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:52 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:52.823+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:53.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:52 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:52.823+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:53.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:52 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:52.823+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:53.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:53 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:53.124+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:53.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:53 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:53.124+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:53.183 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:53 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:53.124+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.823050+0000 front 2024-09-16T01:28:26.822966+0000 (oldest deadline 2024-09-16T01:28:50.923056+0000) 2024-09-16T01:28:53.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:52 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:52.888+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:53.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:52 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:52.888+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:53.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:52 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:52.888+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:53.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:52 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:52.888+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:28:53.464 INFO:journalctl@ceph.osd.6.smithi063.stdout:Sep 16 01:28:53 smithi063 podman[91789]: 2024-09-16 01:28:53.194281372 +0000 UTC m=+0.017091172 container died 01673fb56b82e8558688ca1c955a988cfd67698051c1daf3dce7eb4c4f1bbe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-16T01:28:53.731 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:53 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:53.525+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:53.731 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:53 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:53.525+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:53.732 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:53 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:53.525+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:53.732 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:53 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:53.525+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:53.757 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.6.service' 2024-09-16T01:28:53.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:28:53.797 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-16T01:28:53.797 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-16T01:28:53.797 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.7 2024-09-16T01:28:54.075 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:53 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:53.781+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:54.075 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:53 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:53.781+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:54.075 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:53 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:53.781+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:28:54.076 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:53 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:53.795+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:54.076 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:53 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:53.795+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:54.076 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:53 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:53.795+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:54.085 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:53 smithi162 systemd[1]: Stopping Ceph osd.7 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:28:54.085 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:53 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:53.925+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:54.086 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:53 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:53.925+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:54.086 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:53 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:53.925+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:54.086 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:53 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:53.925+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:28:54.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:54.117+0000 7fddd95ea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:28:54.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:54.117+0000 7fddd95ea640 -1 osd.7 87 *** Got signal Terminated *** 2024-09-16T01:28:54.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:54.117+0000 7fddd95ea640 -1 osd.7 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:28:54.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:54.164+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:54.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:54.164+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:54.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:54.164+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.823050+0000 front 2024-09-16T01:28:26.822966+0000 (oldest deadline 2024-09-16T01:28:50.923056+0000) 2024-09-16T01:28:54.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:54 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:54.475+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:54.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:54 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:54.475+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:54.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:54 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:54.475+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:54.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:54 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:54.475+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:55.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:54 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:54.801+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:55.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:54 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:54.801+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:55.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:54 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:54.801+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:28:55.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:54 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:54.764+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:55.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:54 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:54.764+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:55.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:54 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:54.764+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:55.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:54.914+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:55.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:54.914+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:55.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:54.914+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:55.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:54 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:54.914+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:28:55.556 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:55 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:55.195+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:55.556 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:55 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:55.195+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:55.556 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:55 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:55.195+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.823050+0000 front 2024-09-16T01:28:26.822966+0000 (oldest deadline 2024-09-16T01:28:50.923056+0000) 2024-09-16T01:28:55.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:55 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:55.470+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:55.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:55 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:55.470+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:55.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:55 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:55.470+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:55.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:55 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:55.470+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:56.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:55 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:55.791+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:56.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:55 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:55.791+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:56.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:55 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:55.791+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:28:56.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:55 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:55.810+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:56.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:55 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:55.810+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:56.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:55 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:55.810+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:56.182 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:55 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:55.911+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:56.182 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:55 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:55.911+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:56.182 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:55 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:55.911+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:56.182 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:55 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:55.911+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:28:56.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:56 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:56.180+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:56.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:56 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:56.180+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:56.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:56 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:56.180+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.823050+0000 front 2024-09-16T01:28:26.822966+0000 (oldest deadline 2024-09-16T01:28:50.923056+0000) 2024-09-16T01:28:56.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:56 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:56.180+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:33.124171+0000 front 2024-09-16T01:28:33.124232+0000 (oldest deadline 2024-09-16T01:28:56.024253+0000) 2024-09-16T01:28:56.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:56 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:56.422+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:56.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:56 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:56.422+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:56.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:56 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:56.422+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:56.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:56 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:56.422+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:57.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:56 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:56.774+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:57.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:56 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:56.774+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:57.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:56 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:56.774+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:28:57.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:56 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:56.831+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:57.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:56 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:56.831+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:57.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:56 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:56.831+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:57.193 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:56 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:56.933+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:57.194 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:56 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:56.933+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:57.194 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:56 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:56.933+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:57.194 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:56 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:56.933+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:28:57.683 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:57 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:57.192+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:57.684 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:57 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:57.192+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:57.684 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:57 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:57.192+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.823050+0000 front 2024-09-16T01:28:26.822966+0000 (oldest deadline 2024-09-16T01:28:50.923056+0000) 2024-09-16T01:28:57.684 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:57 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:57.192+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:33.124171+0000 front 2024-09-16T01:28:33.124232+0000 (oldest deadline 2024-09-16T01:28:56.024253+0000) 2024-09-16T01:28:57.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:57 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:57.402+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:57.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:57 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:57.402+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:57.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:57 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:57.402+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:57.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:57 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:57.402+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:58.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:57 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:57.765+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:58.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:57 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:57.765+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:58.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:57 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:57.765+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:28:58.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:57 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:57.788+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:58.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:57 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:57.788+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:58.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:57 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:57.788+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:58.433 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:57 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:57.947+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:58.433 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:57 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:57.947+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:58.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:57 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:57.947+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:58.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:57 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:57.947+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:28:58.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:57 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:57.947+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:28:58.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:58 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:58.149+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.520306+0000 front 2024-09-16T01:28:10.520334+0000 (oldest deadline 2024-09-16T01:28:33.420444+0000) 2024-09-16T01:28:58.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:58 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:58.149+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.021782+0000 front 2024-09-16T01:28:18.021813+0000 (oldest deadline 2024-09-16T01:28:43.321848+0000) 2024-09-16T01:28:58.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:58 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:58.149+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.823050+0000 front 2024-09-16T01:28:26.822966+0000 (oldest deadline 2024-09-16T01:28:50.923056+0000) 2024-09-16T01:28:58.434 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:58 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7[52472]: 2024-09-16T01:28:58.149+0000 7fddd5c00640 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:33.124171+0000 front 2024-09-16T01:28:33.124232+0000 (oldest deadline 2024-09-16T01:28:56.024253+0000) 2024-09-16T01:28:58.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:58 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:58.370+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:58.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:58 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:58.370+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:58.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:58 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:58.370+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:58.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:58 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:58.370+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:59.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:58 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:58.789+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:28:59.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:58 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:58.789+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:28:59.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:58 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:58.789+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:28:59.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:58 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:58.782+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:28:59.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:58 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:58.782+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:28:59.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:58 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:58.782+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:28:59.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:58 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:58.782+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:32.076557+0000 front 2024-09-16T01:28:32.076481+0000 (oldest deadline 2024-09-16T01:28:57.976479+0000) 2024-09-16T01:28:59.433 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:58 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:58.963+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:28:59.433 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:58 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:58.963+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:28:59.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:58 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:58.963+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:28:59.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:58 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:58.963+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:28:59.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:58 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:58.963+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:28:59.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:59.335+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:28:59.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:59.335+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:28:59.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:59.335+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:28:59.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:59.335+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:28:59.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:28:59 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:28:59.335+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:28:59.828 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:59 smithi162 podman[68467]: 2024-09-16 01:28:59.527247304 +0000 UTC m=+5.533062746 container died c76ca93da3d201fe8f1a889cbbac32dd690c9b3fb484e5d4314264f90deeb75f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:29:00.104 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:59 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:59.924+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:00.104 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:59 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:59.924+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:00.104 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:59 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:59.924+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:00.104 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:59 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:59.924+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:00.104 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:28:59 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:28:59.924+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:00.105 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:59 smithi162 podman[68467]: 2024-09-16 01:28:59.926882841 +0000 UTC m=+5.932698288 container cleanup c76ca93da3d201fe8f1a889cbbac32dd690c9b3fb484e5d4314264f90deeb75f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-16T01:29:00.105 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:28:59 smithi162 bash[68467]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7 2024-09-16T01:29:00.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:59 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:59.743+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:29:00.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:59 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:59.743+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:29:00.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:59 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:59.743+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:29:00.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:28:59 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:28:59.743+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:32.076557+0000 front 2024-09-16T01:28:32.076481+0000 (oldest deadline 2024-09-16T01:28:57.976479+0000) 2024-09-16T01:29:00.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:59 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:59.769+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:00.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:59 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:59.769+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:00.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:59 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:59.769+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:00.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:28:59 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:28:59.769+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:00.433 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:29:00 smithi162 podman[68496]: 2024-09-16 01:29:00.103011453 +0000 UTC m=+0.571089739 container remove c76ca93da3d201fe8f1a889cbbac32dd690c9b3fb484e5d4314264f90deeb75f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-16T01:29:00.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:00 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:00.306+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:00.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:00 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:00.306+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:00.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:00 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:00.306+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:00.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:00 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:00.306+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:00.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:00 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:00.306+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:00.807 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:29:00 smithi162 podman[68584]: 2024-09-16 01:29:00.442130518 +0000 UTC m=+0.015877104 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:29:00.807 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:29:00 smithi162 podman[68584]: 2024-09-16 01:29:00.578990594 +0000 UTC m=+0.152737205 container create d8ecd7a8bf297ff81d9398ddde120ed0a1b1b02d21196d9223955829a0c6c0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-16T01:29:00.807 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:29:00 smithi162 podman[68584]: 2024-09-16 01:29:00.806186846 +0000 UTC m=+0.379933414 container init d8ecd7a8bf297ff81d9398ddde120ed0a1b1b02d21196d9223955829a0c6c0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-16T01:29:01.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:00 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:00.741+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:29:01.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:00 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:00.741+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:29:01.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:00 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:00.741+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:29:01.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:00 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:00.741+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:32.076557+0000 front 2024-09-16T01:28:32.076481+0000 (oldest deadline 2024-09-16T01:28:57.976479+0000) 2024-09-16T01:29:01.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:00 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:00.728+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:01.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:00 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:00.728+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:01.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:00 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:00.728+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:01.176 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:00 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:00.728+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:01.184 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:29:00 smithi162 podman[68584]: 2024-09-16 01:29:00.81003695 +0000 UTC m=+0.383783523 container start d8ecd7a8bf297ff81d9398ddde120ed0a1b1b02d21196d9223955829a0c6c0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-16T01:29:01.184 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:29:00 smithi162 podman[68584]: 2024-09-16 01:29:00.939909576 +0000 UTC m=+0.513656147 container attach d8ecd7a8bf297ff81d9398ddde120ed0a1b1b02d21196d9223955829a0c6c0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-16T01:29:01.184 INFO:journalctl@ceph.osd.7.smithi162.stdout:Sep 16 01:29:01 smithi162 podman[68584]: 2024-09-16 01:29:01.010772192 +0000 UTC m=+0.584518769 container died d8ecd7a8bf297ff81d9398ddde120ed0a1b1b02d21196d9223955829a0c6c0f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e) 2024-09-16T01:29:01.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:00 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:00.932+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:01.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:00 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:00.932+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:01.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:00 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:00.932+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:01.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:00 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:00.932+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:01.185 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:00 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:00.932+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:01.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:01 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:01.298+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:01.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:01 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:01.298+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:01.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:01 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:01.298+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:01.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:01 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:01.298+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:01.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:01 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:01.298+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:01.694 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.7.service' 2024-09-16T01:29:01.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:01.737 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-16T01:29:01.737 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-16T01:29:01.737 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.8 2024-09-16T01:29:02.041 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:01 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:01.720+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:29:02.041 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:01 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:01.720+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:29:02.042 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:01 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:01.720+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:29:02.042 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:01 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:01.720+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:32.076557+0000 front 2024-09-16T01:28:32.076481+0000 (oldest deadline 2024-09-16T01:28:57.976479+0000) 2024-09-16T01:29:02.042 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:01 smithi192 systemd[1]: Stopping Ceph osd.8 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:02.042 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:01 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:01.686+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:02.042 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:01 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:01.686+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:02.042 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:01 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:01.686+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:02.042 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:01 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:01.686+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:02.424 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:02.040+0000 7f3571c50640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:02.425 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:02.040+0000 7f3571c50640 -1 osd.8 87 *** Got signal Terminated *** 2024-09-16T01:29:02.425 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:02.040+0000 7f3571c50640 -1 osd.8 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:29:02.433 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:01 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:01.932+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:02.433 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:01 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:01.932+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:02.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:01 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:01.932+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:02.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:01 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:01.932+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:02.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:01 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:01.932+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:02.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:02.320+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:02.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:02.320+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:02.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:02.320+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:02.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:02.320+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:02.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:02 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:02.320+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:03.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:02.711+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:03.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:02.711+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:03.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:02.711+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:03.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:02.711+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:03.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:02.690+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:29:03.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:02.691+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:29:03.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:02.691+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:29:03.175 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:02.691+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:32.076557+0000 front 2024-09-16T01:28:32.076481+0000 (oldest deadline 2024-09-16T01:28:57.976479+0000) 2024-09-16T01:29:03.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:02 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:02.887+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:03.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:02 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:02.887+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:03.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:02 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:02.887+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:03.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:02 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:02.887+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:03.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:02 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:02.887+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:03.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:03 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:03.316+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:03.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:03 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:03.316+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:03.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:03 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:03.316+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:03.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:03 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:03.316+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:03.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:03 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:03.316+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:03.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:03.657+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:29:03.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:03.657+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:29:03.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:03.657+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:29:03.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:03.657+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:32.076557+0000 front 2024-09-16T01:28:32.076481+0000 (oldest deadline 2024-09-16T01:28:57.976479+0000) 2024-09-16T01:29:03.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:03.678+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:03.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:03.678+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:03.925 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:03.678+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:03.925 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:03 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:03.678+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:04.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:03 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:03.878+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:04.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:03 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:03.878+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:04.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:03 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:03.878+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:04.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:03 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:03.878+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:04.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:03 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:03.878+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:04.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:04 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:04.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:04.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:04 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:04.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:04.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:04 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:04.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:04.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:04 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:04.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:04.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:04 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:04.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:04.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:04 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:04.711+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:04.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:04 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:04.711+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:04.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:04 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:04.711+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:04.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:04 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:04.711+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:04.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:04 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:04.611+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:29:04.925 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:04 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:04.611+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:29:04.925 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:04 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:04.611+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:29:04.925 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:04 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:04.611+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:32.076557+0000 front 2024-09-16T01:28:32.076481+0000 (oldest deadline 2024-09-16T01:28:57.976479+0000) 2024-09-16T01:29:05.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:04 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:04.838+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:05.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:04 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:04.838+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:05.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:04 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:04.838+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:05.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:04 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:04.838+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:05.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:04 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:04.838+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:05.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:04 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:04.838+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:05.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:05 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:05.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:05.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:05 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:05.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:05.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:05 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:05.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:05.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:05 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:05.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:05.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:05 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:05.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:05.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:05 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:05.332+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:39.019864+0000 front 2024-09-16T01:28:39.019973+0000 (oldest deadline 2024-09-16T01:29:04.919678+0000) 2024-09-16T01:29:05.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:05 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:05.661+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:29:05.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:05 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:05.661+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:29:05.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:05 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:05.661+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:29:05.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:05 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:05.661+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:32.076557+0000 front 2024-09-16T01:28:32.076481+0000 (oldest deadline 2024-09-16T01:28:57.976479+0000) 2024-09-16T01:29:05.924 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:05 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:05.661+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:42.677219+0000 front 2024-09-16T01:28:42.677265+0000 (oldest deadline 2024-09-16T01:29:05.577335+0000) 2024-09-16T01:29:05.925 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:05 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:05.667+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:05.925 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:05 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:05.667+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:05.925 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:05 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:05.667+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:05.925 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:05 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:05.667+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:05.925 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:05 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:05.667+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:06.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:05 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:05.842+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:06.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:05 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:05.842+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:06.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:05 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:05.842+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:06.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:05 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:05.842+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:06.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:05 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:05.842+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:06.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:05 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:05.842+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:06.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:06 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:06.369+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:06.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:06 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:06.369+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:06.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:06 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:06.369+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:06.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:06 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:06.369+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:06.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:06 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:06.369+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:06.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:06 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:06.369+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:39.019864+0000 front 2024-09-16T01:28:39.019973+0000 (oldest deadline 2024-09-16T01:29:04.919678+0000) 2024-09-16T01:29:06.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:06 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:06.628+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:06.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:06 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:06.628+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:06.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:06 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:06.628+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:06.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:06 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:06.628+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:06.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:06 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:06.628+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:06.925 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:06 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:06.668+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.471465+0000 front 2024-09-16T01:28:02.471388+0000 (oldest deadline 2024-09-16T01:28:27.771465+0000) 2024-09-16T01:29:06.925 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:06 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:06.668+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.972842+0000 front 2024-09-16T01:28:18.972862+0000 (oldest deadline 2024-09-16T01:28:40.672892+0000) 2024-09-16T01:29:06.925 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:06 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:06.668+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:26.275188+0000 front 2024-09-16T01:28:26.275299+0000 (oldest deadline 2024-09-16T01:28:50.975200+0000) 2024-09-16T01:29:06.925 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:06 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:06.668+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:32.076557+0000 front 2024-09-16T01:28:32.076481+0000 (oldest deadline 2024-09-16T01:28:57.976479+0000) 2024-09-16T01:29:06.925 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:06 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8[52627]: 2024-09-16T01:29:06.668+0000 7f356e266640 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:42.677219+0000 front 2024-09-16T01:28:42.677265+0000 (oldest deadline 2024-09-16T01:29:05.577335+0000) 2024-09-16T01:29:07.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:06 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:06.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:07.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:06 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:06.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:07.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:06 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:06.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:07.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:06 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:06.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:07.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:06 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:06.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:07.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:06 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:06.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:07.809 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:07 smithi192 podman[68629]: 2024-09-16 01:29:07.557611684 +0000 UTC m=+5.621545344 container died 15702c0cefc627554dd1ffe398431c0072754f39624aaa935ecf13c8fb2cab07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-16T01:29:07.809 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:07 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:07.662+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:07.809 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:07 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:07.662+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:07.809 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:07 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:07.662+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:07.809 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:07 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:07.662+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:07.809 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:07 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:07.662+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:07.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:07 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:07.397+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:07.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:07 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:07.397+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:07.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:07 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:07.397+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:07.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:07 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:07.397+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:07.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:07 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:07.397+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:07.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:07 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:07.397+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:39.019864+0000 front 2024-09-16T01:28:39.019973+0000 (oldest deadline 2024-09-16T01:29:04.919678+0000) 2024-09-16T01:29:08.084 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:07 smithi192 podman[68629]: 2024-09-16 01:29:07.898895765 +0000 UTC m=+5.962829409 container cleanup 15702c0cefc627554dd1ffe398431c0072754f39624aaa935ecf13c8fb2cab07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-16T01:29:08.084 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:07 smithi192 bash[68629]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8 2024-09-16T01:29:08.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:07 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:07.862+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:08.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:07 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:07.862+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:08.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:07 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:07.862+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:08.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:07 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:07.862+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:08.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:07 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:07.862+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:08.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:07 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:07.862+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:08.424 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:08 smithi192 podman[68645]: 2024-09-16 01:29:08.083662555 +0000 UTC m=+0.520179894 container remove 15702c0cefc627554dd1ffe398431c0072754f39624aaa935ecf13c8fb2cab07 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:29:08.796 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:08 smithi192 podman[68732]: 2024-09-16 01:29:08.407270629 +0000 UTC m=+0.015764868 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:29:08.796 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:08 smithi192 podman[68732]: 2024-09-16 01:29:08.51781194 +0000 UTC m=+0.126306167 container create 6c1ca1fc5a8da0963d9402d508c4d4fc9adab98529bf1c5de9811b66479d1412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-16T01:29:08.796 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:08 smithi192 podman[68732]: 2024-09-16 01:29:08.737019582 +0000 UTC m=+0.345513812 container init 6c1ca1fc5a8da0963d9402d508c4d4fc9adab98529bf1c5de9811b66479d1412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-16T01:29:08.796 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:08 smithi192 podman[68732]: 2024-09-16 01:29:08.740235371 +0000 UTC m=+0.348729600 container start 6c1ca1fc5a8da0963d9402d508c4d4fc9adab98529bf1c5de9811b66479d1412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-16T01:29:08.796 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:08 smithi192 podman[68732]: 2024-09-16 01:29:08.795370726 +0000 UTC m=+0.403864955 container attach 6c1ca1fc5a8da0963d9402d508c4d4fc9adab98529bf1c5de9811b66479d1412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-16T01:29:08.796 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:08 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:08.685+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:08.796 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:08 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:08.685+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:08.797 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:08 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:08.685+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:08.797 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:08 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:08.685+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:08.797 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:08 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:08.685+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:08.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:08.387+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:08.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:08.387+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:08.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:08.387+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:08.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:08.387+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:08.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:08.387+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:08.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:08 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:08.387+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:39.019864+0000 front 2024-09-16T01:28:39.019973+0000 (oldest deadline 2024-09-16T01:29:04.919678+0000) 2024-09-16T01:29:09.174 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 16 01:29:08 smithi192 podman[68732]: 2024-09-16 01:29:08.928729035 +0000 UTC m=+0.537223269 container died 6c1ca1fc5a8da0963d9402d508c4d4fc9adab98529bf1c5de9811b66479d1412 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-16T01:29:09.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:08 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:08.815+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:09.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:08 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:08.815+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:09.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:08 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:08.815+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:09.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:08 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:08.815+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:09.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:08 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:08.815+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:09.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:08 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:08.815+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:09.549 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.8.service' 2024-09-16T01:29:09.590 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:09.590 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-16T01:29:09.590 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-16T01:29:09.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.9 2024-09-16T01:29:09.609 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:09.340+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:09.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:09.340+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:09.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:09.340+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:09.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:09.340+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:09.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:09.340+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:09.610 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:09.340+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:39.019864+0000 front 2024-09-16T01:28:39.019973+0000 (oldest deadline 2024-09-16T01:29:04.919678+0000) 2024-09-16T01:29:09.801 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:09 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:09.676+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:09.801 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:09 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:09.676+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:09.801 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:09 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:09.676+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:09.802 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:09 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:09.676+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:09.802 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:09 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:09.676+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:09.893 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:09 smithi063 systemd[1]: Stopping Ceph osd.9 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:10.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:09 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:09.852+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:10.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:09 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:09.852+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:10.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:09 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:09.852+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:10.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:09 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:09.852+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:10.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:09 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:09.852+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:10.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:09 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:09.852+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:10.359 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:09.890+0000 7fcae825c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:10.359 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:09.890+0000 7fcae825c640 -1 osd.9 87 *** Got signal Terminated *** 2024-09-16T01:29:10.359 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:09 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:09.890+0000 7fcae825c640 -1 osd.9 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:29:10.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:10 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:10.386+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:10.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:10 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:10.386+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:10.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:10 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:10.386+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:10.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:10 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:10.386+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:10.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:10 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:10.386+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:10.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:10 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:10.386+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:39.019864+0000 front 2024-09-16T01:28:39.019973+0000 (oldest deadline 2024-09-16T01:29:04.919678+0000) 2024-09-16T01:29:11.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:10 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:10.682+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:11.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:10 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:10.682+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:11.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:10 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:10.682+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:11.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:10 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:10.682+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:11.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:10 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:10.682+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:11.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:10 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:10.900+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:11.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:10 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:10.900+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:11.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:10 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:10.900+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:11.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:10 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:10.900+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:11.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:10 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:10.900+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:11.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:10 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:10.900+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:11.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:11.390+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:11.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:11.390+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:11.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:11.390+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:11.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:11.390+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:11.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:11.390+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:11.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:11 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:11.390+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:39.019864+0000 front 2024-09-16T01:28:39.019973+0000 (oldest deadline 2024-09-16T01:29:04.919678+0000) 2024-09-16T01:29:11.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:11 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:11.640+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:11.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:11 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:11.640+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:11.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:11 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:11.640+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:11.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:11 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:11.640+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:11.924 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:11 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:11.640+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:12.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:11 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:11.851+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:12.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:11 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:11.851+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:12.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:11 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:11.851+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:12.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:11 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:11.851+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:12.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:11 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:11.851+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:12.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:11 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:11.851+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:12.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:12.419+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:12.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:12.419+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:12.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:12.419+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:12.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:12.419+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:12.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:12.419+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:12.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:12.419+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:39.019864+0000 front 2024-09-16T01:28:39.019973+0000 (oldest deadline 2024-09-16T01:29:04.919678+0000) 2024-09-16T01:29:12.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:12 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:12.419+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:46.020489+0000 front 2024-09-16T01:28:46.020453+0000 (oldest deadline 2024-09-16T01:29:11.920532+0000) 2024-09-16T01:29:13.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:12 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:12.678+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:13.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:12 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:12.678+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:13.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:12 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:12.678+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:13.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:12 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:12.678+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:13.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:12 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:12.678+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:13.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:12 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:12.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:13.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:12 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:12.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:13.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:12 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:12.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:13.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:12 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:12.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:13.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:12 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:12.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:13.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:12 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:12.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:13.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:12 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:12.835+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:49.455826+0000 front 2024-09-16T01:28:49.455911+0000 (oldest deadline 2024-09-16T01:29:12.355618+0000) 2024-09-16T01:29:13.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:13 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:13.424+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:13.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:13 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:13.424+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:13.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:13 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:13.424+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:13.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:13 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:13.424+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:13.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:13 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:13.424+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:13.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:13 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:13.424+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:39.019864+0000 front 2024-09-16T01:28:39.019973+0000 (oldest deadline 2024-09-16T01:29:04.919678+0000) 2024-09-16T01:29:13.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:13 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:13.424+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:46.020489+0000 front 2024-09-16T01:28:46.020453+0000 (oldest deadline 2024-09-16T01:29:11.920532+0000) 2024-09-16T01:29:14.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:13 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:13.703+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:14.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:13 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:13.703+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:14.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:13 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:13.703+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:14.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:13 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:13.703+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:14.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:13 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:13.703+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:14.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:13 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:13.861+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:14.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:13 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:13.861+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:14.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:13 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:13.861+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:14.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:13 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:13.861+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:14.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:13 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:13.861+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:14.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:13 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:13.861+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:14.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:13 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:13.861+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:49.455826+0000 front 2024-09-16T01:28:49.455911+0000 (oldest deadline 2024-09-16T01:29:12.355618+0000) 2024-09-16T01:29:14.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:14 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:14.435+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:28:02.813807+0000 front 2024-09-16T01:28:02.813980+0000 (oldest deadline 2024-09-16T01:28:25.714049+0000) 2024-09-16T01:29:14.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:14 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:14.435+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.415294+0000 front 2024-09-16T01:28:10.415321+0000 (oldest deadline 2024-09-16T01:28:33.215565+0000) 2024-09-16T01:29:14.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:14 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:14.435+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:18.516697+0000 front 2024-09-16T01:28:18.516932+0000 (oldest deadline 2024-09-16T01:28:43.816654+0000) 2024-09-16T01:29:14.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:14 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:14.435+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:23.817080+0000 front 2024-09-16T01:28:23.817150+0000 (oldest deadline 2024-09-16T01:28:48.517361+0000) 2024-09-16T01:29:14.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:14 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:14.435+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.519346+0000 front 2024-09-16T01:28:35.519422+0000 (oldest deadline 2024-09-16T01:28:59.019293+0000) 2024-09-16T01:29:14.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:14 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:14.435+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:39.019864+0000 front 2024-09-16T01:28:39.019973+0000 (oldest deadline 2024-09-16T01:29:04.919678+0000) 2024-09-16T01:29:14.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:14 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9[64999]: 2024-09-16T01:29:14.435+0000 7fcae4872640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:46.020489+0000 front 2024-09-16T01:28:46.020453+0000 (oldest deadline 2024-09-16T01:29:11.920532+0000) 2024-09-16T01:29:15.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:14 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:14.746+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:15.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:14 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:14.746+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:15.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:14 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:14.746+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:15.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:14 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:14.746+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:15.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:14 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:14.746+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:15.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:14 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:14.746+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:15.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:14 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:14.843+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:15.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:14 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:14.843+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:15.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:14 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:14.843+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:15.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:14 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:14.843+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:15.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:14 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:14.843+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:15.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:14 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:14.843+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:15.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:14 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:14.843+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:49.455826+0000 front 2024-09-16T01:28:49.455911+0000 (oldest deadline 2024-09-16T01:29:12.355618+0000) 2024-09-16T01:29:15.521 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:15 smithi063 podman[91868]: 2024-09-16 01:29:15.266560023 +0000 UTC m=+5.475971439 container died c19fea07869a41c0f520f99a8cb726dc0921738835747a0b91a70e9f6f2d430f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-16T01:29:15.859 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:15 smithi063 podman[91868]: 2024-09-16 01:29:15.727327932 +0000 UTC m=+5.936739338 container cleanup c19fea07869a41c0f520f99a8cb726dc0921738835747a0b91a70e9f6f2d430f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True) 2024-09-16T01:29:15.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:15 smithi063 bash[91868]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9 2024-09-16T01:29:16.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:15 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:15.764+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:16.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:15 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:15.764+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:16.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:15 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:15.764+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:16.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:15 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:15.764+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:16.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:15 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:15.764+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:16.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:15 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:15.764+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:16.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:15 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:15.882+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:16.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:15 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:15.882+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:16.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:15 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:15.882+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:16.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:15 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:15.882+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:16.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:15 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:15.882+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:16.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:15 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:15.882+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:16.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:15 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:15.882+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:49.455826+0000 front 2024-09-16T01:28:49.455911+0000 (oldest deadline 2024-09-16T01:29:12.355618+0000) 2024-09-16T01:29:16.347 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:15 smithi063 podman[91883]: 2024-09-16 01:29:15.986975201 +0000 UTC m=+0.720246890 container remove c19fea07869a41c0f520f99a8cb726dc0921738835747a0b91a70e9f6f2d430f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-16T01:29:16.598 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:16 smithi063 podman[91971]: 2024-09-16 01:29:16.249026103 +0000 UTC m=+0.016104179 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:29:16.599 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:16 smithi063 podman[91971]: 2024-09-16 01:29:16.379353156 +0000 UTC m=+0.146431287 container create 8dfd43407bb5383e9cf491061c3c7048831a77155ddc54df6ee9efa260267452 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-16T01:29:16.599 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:16 smithi063 podman[91971]: 2024-09-16 01:29:16.598120364 +0000 UTC m=+0.365198431 container init 8dfd43407bb5383e9cf491061c3c7048831a77155ddc54df6ee9efa260267452 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-16T01:29:16.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:16 smithi063 podman[91971]: 2024-09-16 01:29:16.601698933 +0000 UTC m=+0.368777005 container start 8dfd43407bb5383e9cf491061c3c7048831a77155ddc54df6ee9efa260267452 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-16T01:29:16.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:16 smithi063 podman[91971]: 2024-09-16 01:29:16.681354974 +0000 UTC m=+0.448433053 container attach 8dfd43407bb5383e9cf491061c3c7048831a77155ddc54df6ee9efa260267452 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-16T01:29:16.860 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:16 smithi063 podman[91971]: 2024-09-16 01:29:16.795924494 +0000 UTC m=+0.563002561 container died 8dfd43407bb5383e9cf491061c3c7048831a77155ddc54df6ee9efa260267452 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T01:29:17.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:16 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:16.781+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:17.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:16 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:16.781+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:17.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:16 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:16.781+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:17.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:16 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:16.781+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:17.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:16 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:16.781+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:17.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:16 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:16.781+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:17.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:16 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:16.906+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:17.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:16 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:16.906+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:17.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:16 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:16.906+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:17.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:16 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:16.906+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:17.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:16 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:16.906+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:17.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:16 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:16.906+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:17.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:16 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:16.906+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:49.455826+0000 front 2024-09-16T01:28:49.455911+0000 (oldest deadline 2024-09-16T01:29:12.355618+0000) 2024-09-16T01:29:17.385 INFO:journalctl@ceph.osd.9.smithi063.stdout:Sep 16 01:29:17 smithi063 podman[91994]: 2024-09-16 01:29:17.367685334 +0000 UTC m=+0.561482356 container remove 8dfd43407bb5383e9cf491061c3c7048831a77155ddc54df6ee9efa260267452 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-16T01:29:17.389 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.9.service' 2024-09-16T01:29:17.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:17.471 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-16T01:29:17.472 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-16T01:29:17.472 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.10 2024-09-16T01:29:17.795 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 systemd[1]: Stopping Ceph osd.10 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:18.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:17 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:17.805+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:18.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:17 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:17.805+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:18.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:17 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:17.805+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:18.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:17 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:17.805+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:18.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:17 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:17.805+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:18.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:17 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:17.805+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:18.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:17.794+0000 7f06a2522640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:18.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:17.794+0000 7f06a2522640 -1 osd.10 87 *** Got signal Terminated *** 2024-09-16T01:29:18.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:17.794+0000 7f06a2522640 -1 osd.10 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:29:18.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:17.941+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:18.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:17.941+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:18.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:17.941+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:18.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:17.941+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:18.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:17.941+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:18.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:17.941+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:18.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:17 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:17.941+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:49.455826+0000 front 2024-09-16T01:28:49.455911+0000 (oldest deadline 2024-09-16T01:29:12.355618+0000) 2024-09-16T01:29:19.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:18 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:18.819+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:19.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:18 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:18.819+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:19.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:18 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:18.819+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:19.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:18 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:18.819+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:19.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:18 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:18.819+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:19.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:18 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:18.819+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:19.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:18 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:18.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:19.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:18 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:18.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:19.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:18 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:18.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:19.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:18 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:18.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:19.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:18 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:18.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:19.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:18 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:18.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:19.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:18 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:18.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:49.455826+0000 front 2024-09-16T01:28:49.455911+0000 (oldest deadline 2024-09-16T01:29:12.355618+0000) 2024-09-16T01:29:20.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:19 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:19.855+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:20.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:19 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:19.855+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:20.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:19 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:19.855+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:20.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:19 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:19.855+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:20.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:19 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:19.855+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:20.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:19 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:19.855+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:20.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:19 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:19.902+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:20.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:19 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:19.902+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:20.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:19 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:19.902+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:20.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:19 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:19.902+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:20.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:19 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:19.902+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:20.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:19 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:19.902+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:20.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:19 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:19.902+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:49.455826+0000 front 2024-09-16T01:28:49.455911+0000 (oldest deadline 2024-09-16T01:29:12.355618+0000) 2024-09-16T01:29:21.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:20 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:20.901+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:21.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:20 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:20.901+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:21.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:20 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:20.901+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:21.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:20 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:20.901+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:21.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:20 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:20.901+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:21.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:20 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:20.901+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:21.433 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:20 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:20.950+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:21.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:20 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:20.950+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:21.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:20 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:20.950+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:21.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:20 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:20.950+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:21.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:20 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:20.950+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:21.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:20 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:20.950+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:21.434 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:20 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:20.950+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:49.455826+0000 front 2024-09-16T01:28:49.455911+0000 (oldest deadline 2024-09-16T01:29:12.355618+0000) 2024-09-16T01:29:22.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:21 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:21.878+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:22.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:21 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:21.878+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:22.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:21 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:21.878+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:22.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:21 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:21.878+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:22.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:21 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:21.878+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:22.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:21 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:21.878+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:22.183 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:21 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:21.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:59.348311+0000 front 2024-09-16T01:27:59.348421+0000 (oldest deadline 2024-09-16T01:28:27.548919+0000) 2024-09-16T01:29:22.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:21 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:21.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.350463+0000 front 2024-09-16T01:28:10.350583+0000 (oldest deadline 2024-09-16T01:28:35.050569+0000) 2024-09-16T01:29:22.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:21 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:21.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.951759+0000 front 2024-09-16T01:28:17.951626+0000 (oldest deadline 2024-09-16T01:28:42.051564+0000) 2024-09-16T01:29:22.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:21 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:21.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6814 osd.3 since back 2024-09-16T01:28:25.552606+0000 front 2024-09-16T01:28:25.552651+0000 (oldest deadline 2024-09-16T01:28:51.452586+0000) 2024-09-16T01:29:22.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:21 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:21.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:31.452945+0000 front 2024-09-16T01:28:31.452992+0000 (oldest deadline 2024-09-16T01:28:57.353056+0000) 2024-09-16T01:29:22.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:21 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:21.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:40.654782+0000 front 2024-09-16T01:28:40.654757+0000 (oldest deadline 2024-09-16T01:29:04.754707+0000) 2024-09-16T01:29:22.184 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:21 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10[59036]: 2024-09-16T01:29:21.920+0000 7f069ab30640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:49.455826+0000 front 2024-09-16T01:28:49.455911+0000 (oldest deadline 2024-09-16T01:29:12.355618+0000) 2024-09-16T01:29:23.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:22 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:22.876+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:23.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:22 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:22.876+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:23.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:22 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:22.876+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:23.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:22 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:22.876+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:23.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:22 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:22.876+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:23.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:22 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:22.876+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:23.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:22 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:22.876+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-16T01:28:58.834867+0000 front 2024-09-16T01:28:58.834771+0000 (oldest deadline 2024-09-16T01:29:22.334643+0000) 2024-09-16T01:29:23.395 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:23 smithi162 podman[68688]: 2024-09-16 01:29:23.136316946 +0000 UTC m=+5.471119783 container died fb5d0268bb8ffd2c6dcd447980939b271da045b3e21abd0f9108197ce58f3b36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-16T01:29:23.683 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:23 smithi162 podman[68688]: 2024-09-16 01:29:23.485488728 +0000 UTC m=+5.820291566 container cleanup fb5d0268bb8ffd2c6dcd447980939b271da045b3e21abd0f9108197ce58f3b36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-16T01:29:23.683 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:23 smithi162 bash[68688]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10 2024-09-16T01:29:24.097 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:23 smithi162 podman[68703]: 2024-09-16 01:29:23.78661707 +0000 UTC m=+0.646767703 container remove fb5d0268bb8ffd2c6dcd447980939b271da045b3e21abd0f9108197ce58f3b36 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-16T01:29:24.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:23 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:23.838+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:24.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:23 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:23.838+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:24.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:23 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:23.838+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:24.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:23 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:23.838+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:24.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:23 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:23.838+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:24.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:23 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:23.838+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:24.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:23 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:23.838+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-16T01:28:58.834867+0000 front 2024-09-16T01:28:58.834771+0000 (oldest deadline 2024-09-16T01:29:22.334643+0000) 2024-09-16T01:29:24.401 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:24 smithi162 podman[68793]: 2024-09-16 01:29:23.999758439 +0000 UTC m=+0.015930426 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:29:24.401 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:24 smithi162 podman[68793]: 2024-09-16 01:29:24.112236035 +0000 UTC m=+0.128408012 container create 1385a58e662100f3240a910bee2d6d7cc14ae04b200e7e1f12f4a7177e4931c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:29:24.401 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:24 smithi162 podman[68793]: 2024-09-16 01:29:24.323210515 +0000 UTC m=+0.339382497 container init 1385a58e662100f3240a910bee2d6d7cc14ae04b200e7e1f12f4a7177e4931c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-16T01:29:24.401 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:24 smithi162 podman[68793]: 2024-09-16 01:29:24.326561579 +0000 UTC m=+0.342733557 container start 1385a58e662100f3240a910bee2d6d7cc14ae04b200e7e1f12f4a7177e4931c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:29:24.401 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:24 smithi162 podman[68793]: 2024-09-16 01:29:24.398084608 +0000 UTC m=+0.414256608 container attach 1385a58e662100f3240a910bee2d6d7cc14ae04b200e7e1f12f4a7177e4931c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-16T01:29:24.683 INFO:journalctl@ceph.osd.10.smithi162.stdout:Sep 16 01:29:24 smithi162 podman[68793]: 2024-09-16 01:29:24.523578916 +0000 UTC m=+0.539750893 container died 1385a58e662100f3240a910bee2d6d7cc14ae04b200e7e1f12f4a7177e4931c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-16T01:29:25.094 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:24 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:24.822+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:25.095 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:24 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:24.822+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:25.095 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:24 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:24.822+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:25.095 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:24 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:24.822+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:25.095 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:24 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:24.822+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:25.095 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:24 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:24.822+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:25.096 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:24 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:24.822+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-16T01:28:58.834867+0000 front 2024-09-16T01:28:58.834771+0000 (oldest deadline 2024-09-16T01:29:22.334643+0000) 2024-09-16T01:29:25.139 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.10.service' 2024-09-16T01:29:25.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:25.178 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-16T01:29:25.178 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-16T01:29:25.179 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.11 2024-09-16T01:29:25.360 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 systemd[1]: Stopping Ceph osd.11 for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:25.674 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:25.467+0000 7f68c86f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:25.674 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:25.467+0000 7f68c86f7640 -1 osd.11 87 *** Got signal Terminated *** 2024-09-16T01:29:25.674 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:25.467+0000 7f68c86f7640 -1 osd.11 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T01:29:26.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:25.834+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:26.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:25.834+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:26.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:25.834+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:26.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:25.834+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:26.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:25.834+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:26.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:25.834+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:26.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:25 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:25.834+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-16T01:28:58.834867+0000 front 2024-09-16T01:28:58.834771+0000 (oldest deadline 2024-09-16T01:29:22.334643+0000) 2024-09-16T01:29:27.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:26 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:26.879+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:27.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:26 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:26.879+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:27.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:26 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:26.879+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:27.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:26 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:26.879+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:27.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:26 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:26.879+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:27.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:26 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:26.879+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:27.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:26 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:26.879+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-16T01:28:58.834867+0000 front 2024-09-16T01:28:58.834771+0000 (oldest deadline 2024-09-16T01:29:22.334643+0000) 2024-09-16T01:29:28.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:27 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:27.897+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:28.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:27 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:27.897+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:28.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:27 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:27.897+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:28.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:27 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:27.897+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:28.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:27 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:27.897+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:28.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:27 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:27.897+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:28.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:27 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:27.897+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-16T01:28:58.834867+0000 front 2024-09-16T01:28:58.834771+0000 (oldest deadline 2024-09-16T01:29:22.334643+0000) 2024-09-16T01:29:28.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:27 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:27.897+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6820 osd.8 since back 2024-09-16T01:29:02.335271+0000 front 2024-09-16T01:29:02.335241+0000 (oldest deadline 2024-09-16T01:29:27.635169+0000) 2024-09-16T01:29:29.424 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:28.930+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:29.424 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:28.930+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:29.424 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:28.930+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:29.424 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:28.930+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:29.424 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:28.930+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:29.425 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:28.930+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:29.425 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:28.930+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-16T01:28:58.834867+0000 front 2024-09-16T01:28:58.834771+0000 (oldest deadline 2024-09-16T01:29:22.334643+0000) 2024-09-16T01:29:29.425 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:28 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:28.930+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6820 osd.8 since back 2024-09-16T01:29:02.335271+0000 front 2024-09-16T01:29:02.335241+0000 (oldest deadline 2024-09-16T01:29:27.635169+0000) 2024-09-16T01:29:30.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:29.919+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6806 osd.0 since back 2024-09-16T01:27:57.426533+0000 front 2024-09-16T01:27:57.426452+0000 (oldest deadline 2024-09-16T01:28:25.027154+0000) 2024-09-16T01:29:30.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:29.919+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.1 since back 2024-09-16T01:28:10.928208+0000 front 2024-09-16T01:28:10.928125+0000 (oldest deadline 2024-09-16T01:28:32.028138+0000) 2024-09-16T01:29:30.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:29.919+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-16T01:28:17.829757+0000 front 2024-09-16T01:28:17.829772+0000 (oldest deadline 2024-09-16T01:28:43.129880+0000) 2024-09-16T01:29:30.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:29.919+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.4 since back 2024-09-16T01:28:35.431934+0000 front 2024-09-16T01:28:35.431952+0000 (oldest deadline 2024-09-16T01:28:59.531802+0000) 2024-09-16T01:29:30.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:29.919+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-16T01:28:41.232834+0000 front 2024-09-16T01:28:41.232900+0000 (oldest deadline 2024-09-16T01:29:05.332874+0000) 2024-09-16T01:29:30.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:29.919+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.63:6822 osd.6 since back 2024-09-16T01:28:48.833935+0000 front 2024-09-16T01:28:48.833898+0000 (oldest deadline 2024-09-16T01:29:14.133836+0000) 2024-09-16T01:29:30.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:29.919+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6820 osd.7 since back 2024-09-16T01:28:58.834867+0000 front 2024-09-16T01:28:58.834771+0000 (oldest deadline 2024-09-16T01:29:22.334643+0000) 2024-09-16T01:29:30.175 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:29 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11[59309]: 2024-09-16T01:29:29.919+0000 7f68c0d05640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.192:6820 osd.8 since back 2024-09-16T01:29:02.335271+0000 front 2024-09-16T01:29:02.335241+0000 (oldest deadline 2024-09-16T01:29:27.635169+0000) 2024-09-16T01:29:31.174 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:30 smithi192 podman[68846]: 2024-09-16 01:29:30.889994347 +0000 UTC m=+5.523119832 container died a94b0cef3c9ea67d94b8183163e5764ca048da4a4e0ea21db14ae36034711113 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T01:29:31.674 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:31 smithi192 podman[68846]: 2024-09-16 01:29:31.20112827 +0000 UTC m=+5.834253754 container cleanup a94b0cef3c9ea67d94b8183163e5764ca048da4a4e0ea21db14ae36034711113 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:29:31.674 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:31 smithi192 bash[68846]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11 2024-09-16T01:29:31.674 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:31 smithi192 podman[68873]: 2024-09-16 01:29:31.419394435 +0000 UTC m=+0.525511124 container remove a94b0cef3c9ea67d94b8183163e5764ca048da4a4e0ea21db14ae36034711113 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T01:29:32.090 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:31 smithi192 podman[68959]: 2024-09-16 01:29:31.719215607 +0000 UTC m=+0.015665139 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-16T01:29:32.090 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:31 smithi192 podman[68959]: 2024-09-16 01:29:31.820085468 +0000 UTC m=+0.116534996 container create a5fbf6974dd7eda5f6306037d1ba979438a6c6581da1d058b94546a36897b885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-16T01:29:32.090 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:32 smithi192 podman[68959]: 2024-09-16 01:29:32.006336331 +0000 UTC m=+0.302785863 container init a5fbf6974dd7eda5f6306037d1ba979438a6c6581da1d058b94546a36897b885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:29:32.090 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:32 smithi192 podman[68959]: 2024-09-16 01:29:32.009891309 +0000 UTC m=+0.306340837 container start a5fbf6974dd7eda5f6306037d1ba979438a6c6581da1d058b94546a36897b885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:29:32.090 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:32 smithi192 podman[68959]: 2024-09-16 01:29:32.089095238 +0000 UTC m=+0.385544776 container attach a5fbf6974dd7eda5f6306037d1ba979438a6c6581da1d058b94546a36897b885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-16T01:29:32.424 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 16 01:29:32 smithi192 podman[68959]: 2024-09-16 01:29:32.202771077 +0000 UTC m=+0.499220610 container died a5fbf6974dd7eda5f6306037d1ba979438a6c6581da1d058b94546a36897b885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T01:29:32.801 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@osd.11.service' 2024-09-16T01:29:32.839 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:32.840 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-16T01:29:32.840 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-16T01:29:32.841 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.a 2024-09-16T01:29:33.155 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:29:32 smithi063 systemd[1]: Stopping Ceph mds.a for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:33.609 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:29:33 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-a[72004]: 2024-09-16T01:29:33.153+0000 7ff4d4087640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:33.609 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:29:33 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-a[72004]: 2024-09-16T01:29:33.153+0000 7ff4d4087640 -1 mds.a *** got signal Terminated *** 2024-09-16T01:29:35.796 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:29:35 smithi063 podman[92084]: 2024-09-16 01:29:35.475130183 +0000 UTC m=+2.427621592 container died 48e95a2d27554468856bf291235aeaff1d1c0266e07eacb227eb676a92628d03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-16T01:29:36.087 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:29:35 smithi063 podman[92084]: 2024-09-16 01:29:35.893777622 +0000 UTC m=+2.846269033 container cleanup 48e95a2d27554468856bf291235aeaff1d1c0266e07eacb227eb676a92628d03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-16T01:29:36.087 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:29:35 smithi063 bash[92084]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-a 2024-09-16T01:29:36.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.a.service' 2024-09-16T01:29:36.358 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:29:36 smithi063 podman[92095]: 2024-09-16 01:29:36.086673988 +0000 UTC m=+0.605995364 container remove 48e95a2d27554468856bf291235aeaff1d1c0266e07eacb227eb676a92628d03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-16T01:29:36.359 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:29:36 smithi063 systemd[1]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-16T01:29:36.359 INFO:journalctl@ceph.mds.a.smithi063.stdout:Sep 16 01:29:36 smithi063 systemd[1]: Stopped Ceph mds.a for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:29:36.372 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:36.373 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-16T01:29:36.373 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-16T01:29:36.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.d 2024-09-16T01:29:36.609 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:29:36 smithi063 systemd[1]: Stopping Ceph mds.d for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:37.109 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:29:36 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-d[70791]: 2024-09-16T01:29:36.689+0000 7ff36431a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:37.109 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:29:36 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-d[70791]: 2024-09-16T01:29:36.689+0000 7ff36431a640 -1 mds.d *** got signal Terminated *** 2024-09-16T01:29:40.464 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:29:40 smithi063 podman[92205]: 2024-09-16 01:29:40.140552611 +0000 UTC m=+3.535630315 container died 9af031d7390e4426a6d9b116800f5d0ae2e755979793dc02a28c82f4fee97466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:29:40.464 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:29:40 smithi063 podman[92205]: 2024-09-16 01:29:40.463754934 +0000 UTC m=+3.858832627 container cleanup 9af031d7390e4426a6d9b116800f5d0ae2e755979793dc02a28c82f4fee97466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:29:40.859 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:29:40 smithi063 bash[92205]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-d 2024-09-16T01:29:40.860 INFO:journalctl@ceph.mds.d.smithi063.stdout:Sep 16 01:29:40 smithi063 podman[92217]: 2024-09-16 01:29:40.682010935 +0000 UTC m=+0.538407770 container remove 9af031d7390e4426a6d9b116800f5d0ae2e755979793dc02a28c82f4fee97466 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-16T01:29:40.920 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.d.service' 2024-09-16T01:29:40.954 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:40.954 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-16T01:29:40.954 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-16T01:29:40.955 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.g 2024-09-16T01:29:41.294 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:29:41 smithi063 systemd[1]: Stopping Ceph mds.g for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:41.609 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:29:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-g[71681]: 2024-09-16T01:29:41.293+0000 7f6a58ca0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:41.610 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:29:41 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-g[71681]: 2024-09-16T01:29:41.293+0000 7f6a58ca0640 -1 mds.g *** got signal Terminated *** 2024-09-16T01:29:44.736 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:29:44 smithi063 podman[92326]: 2024-09-16 01:29:44.383114922 +0000 UTC m=+3.200155604 container died 5b68f36a484931d5ed9a093dd4f6f088f7b331bacd3865a7d32a2b29989653fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e) 2024-09-16T01:29:45.110 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:29:44 smithi063 podman[92326]: 2024-09-16 01:29:44.909488963 +0000 UTC m=+3.726529642 container cleanup 5b68f36a484931d5ed9a093dd4f6f088f7b331bacd3865a7d32a2b29989653fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-16T01:29:45.110 INFO:journalctl@ceph.mds.g.smithi063.stdout:Sep 16 01:29:44 smithi063 bash[92326]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-g 2024-09-16T01:29:45.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.g.service' 2024-09-16T01:29:45.378 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:45.378 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-16T01:29:45.378 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-16T01:29:45.378 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.j 2024-09-16T01:29:45.698 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:29:45 smithi063 systemd[1]: Stopping Ceph mds.j for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:46.109 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:29:45 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-j[70396]: 2024-09-16T01:29:45.696+0000 7f026a8ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:46.109 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:29:45 smithi063 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-j[70396]: 2024-09-16T01:29:45.696+0000 7f026a8ce640 -1 mds.j *** got signal Terminated *** 2024-09-16T01:29:48.790 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:29:48 smithi063 podman[92447]: 2024-09-16 01:29:48.512748083 +0000 UTC m=+2.915964815 container died 39662097d50c0b48ed05e623da88ee92414dedb5dd29d1e3af922623cf91244b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-16T01:29:49.109 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:29:48 smithi063 podman[92447]: 2024-09-16 01:29:48.963757663 +0000 UTC m=+3.366974446 container cleanup 39662097d50c0b48ed05e623da88ee92414dedb5dd29d1e3af922623cf91244b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T01:29:49.109 INFO:journalctl@ceph.mds.j.smithi063.stdout:Sep 16 01:29:48 smithi063 bash[92447]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-j 2024-09-16T01:29:49.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.j.service' 2024-09-16T01:29:49.583 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:49.583 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-16T01:29:49.583 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-16T01:29:49.583 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.b 2024-09-16T01:29:49.876 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:29:49 smithi162 systemd[1]: Stopping Ceph mds.b for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:50.183 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:29:49 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b[64651]: 2024-09-16T01:29:49.874+0000 7fc5ea511640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:50.249 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:29:49 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b[64651]: 2024-09-16T01:29:49.874+0000 7fc5ea511640 -1 mds.b *** got signal Terminated *** 2024-09-16T01:29:51.159 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:29:50 smithi162 podman[68894]: 2024-09-16 01:29:50.888783522 +0000 UTC m=+1.104727830 container died bb65176f48e69b5042910bbc268895737eb52a87f25b02d9af9074e5da3f42d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-16T01:29:51.433 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:29:51 smithi162 podman[68894]: 2024-09-16 01:29:51.241808188 +0000 UTC m=+1.457752484 container cleanup bb65176f48e69b5042910bbc268895737eb52a87f25b02d9af9074e5da3f42d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-16T01:29:51.434 INFO:journalctl@ceph.mds.b.smithi162.stdout:Sep 16 01:29:51 smithi162 bash[68894]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-b 2024-09-16T01:29:51.669 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.b.service' 2024-09-16T01:29:51.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:51.703 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-16T01:29:51.704 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-16T01:29:51.704 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.e 2024-09-16T01:29:51.933 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:29:51 smithi162 systemd[1]: Stopping Ceph mds.e for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:52.433 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:29:52 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e[64052]: 2024-09-16T01:29:52.019+0000 7f478c49f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:52.434 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:29:52 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e[64052]: 2024-09-16T01:29:52.019+0000 7f478c49f640 -1 mds.e *** got signal Terminated *** 2024-09-16T01:29:55.137 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:29:54 smithi162 podman[69011]: 2024-09-16 01:29:54.878632993 +0000 UTC m=+2.958828796 container died 086ea1b0f9623cb459729ce848104e0f60d1ab5ad70091011426e92a2f48c215 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-16T01:29:55.433 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:29:55 smithi162 podman[69011]: 2024-09-16 01:29:55.237026185 +0000 UTC m=+3.317221987 container cleanup 086ea1b0f9623cb459729ce848104e0f60d1ab5ad70091011426e92a2f48c215 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e) 2024-09-16T01:29:55.433 INFO:journalctl@ceph.mds.e.smithi162.stdout:Sep 16 01:29:55 smithi162 bash[69011]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-e 2024-09-16T01:29:55.718 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.e.service' 2024-09-16T01:29:55.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:55.751 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-16T01:29:55.751 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-16T01:29:55.751 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.h 2024-09-16T01:29:56.083 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:29:55 smithi162 systemd[1]: Stopping Ceph mds.h for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:29:56.433 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:29:56 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h[64353]: 2024-09-16T01:29:56.081+0000 7f6adf9f6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:29:56.433 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:29:56 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h[64353]: 2024-09-16T01:29:56.081+0000 7f6adf9f6640 -1 mds.h *** got signal Terminated *** 2024-09-16T01:29:59.159 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:29:58 smithi162 podman[69134]: 2024-09-16 01:29:58.881072014 +0000 UTC m=+2.914546680 container died 485d109b5814b216c645bc44b18ac754c7aaf83822c5fb7cfe613cf025801cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-16T01:29:59.433 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:29:59 smithi162 podman[69134]: 2024-09-16 01:29:59.26590088 +0000 UTC m=+3.299375545 container cleanup 485d109b5814b216c645bc44b18ac754c7aaf83822c5fb7cfe613cf025801cf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-16T01:29:59.433 INFO:journalctl@ceph.mds.h.smithi162.stdout:Sep 16 01:29:59 smithi162 bash[69134]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-h 2024-09-16T01:29:59.645 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.h.service' 2024-09-16T01:29:59.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:29:59.680 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-16T01:29:59.680 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-16T01:29:59.680 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.k 2024-09-16T01:30:00.012 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:29:59 smithi162 systemd[1]: Stopping Ceph mds.k for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:30:00.433 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:30:00 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-k[63750]: 2024-09-16T01:30:00.010+0000 7f27e99a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:30:00.434 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:30:00 smithi162 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-k[63750]: 2024-09-16T01:30:00.010+0000 7f27e99a4640 -1 mds.k *** got signal Terminated *** 2024-09-16T01:30:01.504 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:30:01 smithi162 podman[69267]: 2024-09-16 01:30:01.226951391 +0000 UTC m=+1.323443741 container died a940b68fa6053dda096b7c5fbd2fbb05699aec66b9bdb3520fd1fbfbcf07ef80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-16T01:30:01.754 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:30:01 smithi162 podman[69267]: 2024-09-16 01:30:01.57766927 +0000 UTC m=+1.674161614 container cleanup a940b68fa6053dda096b7c5fbd2fbb05699aec66b9bdb3520fd1fbfbcf07ef80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-k, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-16T01:30:01.754 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:30:01 smithi162 bash[69267]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-k 2024-09-16T01:30:02.005 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.k.service' 2024-09-16T01:30:02.027 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:30:01 smithi162 podman[69281]: 2024-09-16 01:30:01.753631812 +0000 UTC m=+0.516483984 container remove a940b68fa6053dda096b7c5fbd2fbb05699aec66b9bdb3520fd1fbfbcf07ef80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-16T01:30:02.027 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:30:02 smithi162 systemd[1]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.k.service: Deactivated successfully. 2024-09-16T01:30:02.027 INFO:journalctl@ceph.mds.k.smithi162.stdout:Sep 16 01:30:02 smithi162 systemd[1]: Stopped Ceph mds.k for c42394ec-73c8-11ef-bceb-c7b262605968. 2024-09-16T01:30:02.040 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:30:02.040 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-16T01:30:02.040 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-16T01:30:02.040 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.c 2024-09-16T01:30:02.319 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:30:02 smithi192 systemd[1]: Stopping Ceph mds.c for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:30:02.674 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:30:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c[64533]: 2024-09-16T01:30:02.317+0000 7f9613a38640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:30:02.674 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:30:02 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c[64533]: 2024-09-16T01:30:02.317+0000 7f9613a38640 -1 mds.c *** got signal Terminated *** 2024-09-16T01:30:06.602 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:30:06 smithi192 podman[69063]: 2024-09-16 01:30:06.325474214 +0000 UTC m=+4.100454630 container died 71abd1eea68b744961de07181f875b7c50ca2847341c8d0e5f1c5d6c181924b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-16T01:30:06.924 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:30:06 smithi192 podman[69063]: 2024-09-16 01:30:06.692169387 +0000 UTC m=+4.467149794 container cleanup 71abd1eea68b744961de07181f875b7c50ca2847341c8d0e5f1c5d6c181924b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-16T01:30:06.924 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 16 01:30:06 smithi192 bash[69063]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-c 2024-09-16T01:30:07.094 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.c.service' 2024-09-16T01:30:07.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:30:07.132 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-16T01:30:07.132 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-16T01:30:07.132 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.f 2024-09-16T01:30:07.424 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:30:07 smithi192 systemd[1]: Stopping Ceph mds.f for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:30:07.924 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:30:07 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f[64234]: 2024-09-16T01:30:07.445+0000 7fd73e7ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:30:07.924 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:30:07 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f[64234]: 2024-09-16T01:30:07.445+0000 7fd73e7ac640 -1 mds.f *** got signal Terminated *** 2024-09-16T01:30:11.174 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:30:10 smithi192 podman[69196]: 2024-09-16 01:30:10.882441926 +0000 UTC m=+3.536413564 container died 2b9e97fb37a864717791729c65e808772335f3b2a9fb18d31551c1b3e266eab9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-16T01:30:11.506 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:30:11 smithi192 podman[69196]: 2024-09-16 01:30:11.287348262 +0000 UTC m=+3.941319900 container cleanup 2b9e97fb37a864717791729c65e808772335f3b2a9fb18d31551c1b3e266eab9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T01:30:11.506 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 16 01:30:11 smithi192 bash[69196]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-f 2024-09-16T01:30:11.660 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.f.service' 2024-09-16T01:30:11.693 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:30:11.694 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-16T01:30:11.694 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-16T01:30:11.694 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.i 2024-09-16T01:30:12.174 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:30:11 smithi192 systemd[1]: Stopping Ceph mds.i for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:30:12.174 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:30:12 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i[64833]: 2024-09-16T01:30:11.999+0000 7f0fb05c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:30:12.174 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:30:12 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i[64833]: 2024-09-16T01:30:11.999+0000 7f0fb05c4640 -1 mds.i *** got signal Terminated *** 2024-09-16T01:30:15.151 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:30:14 smithi192 podman[69317]: 2024-09-16 01:30:14.878899271 +0000 UTC m=+2.974348177 container died fbc85ec88b9c39a867af178943d8fdf9136e15001d53b973a3340442e25e13c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-16T01:30:15.424 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:30:15 smithi192 podman[69317]: 2024-09-16 01:30:15.249614509 +0000 UTC m=+3.345063461 container cleanup fbc85ec88b9c39a867af178943d8fdf9136e15001d53b973a3340442e25e13c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-16T01:30:15.424 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 16 01:30:15 smithi192 bash[69317]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-i 2024-09-16T01:30:15.669 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.i.service' 2024-09-16T01:30:15.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:30:15.702 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-16T01:30:15.702 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-16T01:30:15.702 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.l 2024-09-16T01:30:16.174 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:30:15 smithi192 systemd[1]: Stopping Ceph mds.l for c42394ec-73c8-11ef-bceb-c7b262605968... 2024-09-16T01:30:16.174 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:30:16 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-l[63932]: 2024-09-16T01:30:16.028+0000 7f3633d66640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T01:30:16.174 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:30:16 smithi192 ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-l[63932]: 2024-09-16T01:30:16.028+0000 7f3633d66640 -1 mds.l *** got signal Terminated *** 2024-09-16T01:30:18.822 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:30:18 smithi192 podman[69439]: 2024-09-16 01:30:18.485520056 +0000 UTC m=+2.562647947 container died 408d776c38a2d4bfaf79c04f1a754fec1ec6da4cf5dfd67c38e911aaaf44bd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-16T01:30:19.088 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:30:18 smithi192 podman[69439]: 2024-09-16 01:30:18.928710862 +0000 UTC m=+3.005838744 container cleanup 408d776c38a2d4bfaf79c04f1a754fec1ec6da4cf5dfd67c38e911aaaf44bd05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-16T01:30:19.088 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 16 01:30:18 smithi192 bash[69439]: ceph-c42394ec-73c8-11ef-bceb-c7b262605968-mds-l 2024-09-16T01:30:19.301 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c42394ec-73c8-11ef-bceb-c7b262605968@mds.l.service' 2024-09-16T01:30:19.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T01:30:19.333 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-16T01:30:19.334 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c42394ec-73c8-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:30:19.548 INFO:teuthology.orchestra.run.smithi063.stdout:Deleting cluster with fsid: c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:30:22.029 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c42394ec-73c8-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:30:22.230 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:30:24.709 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c42394ec-73c8-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T01:30:24.910 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:30:27.286 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:30:27.321 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:30:27.349 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T01:30:27.377 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-16T01:30:27.379 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448/remote/smithi063/crash 2024-09-16T01:30:27.380 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:30:27.409 INFO:teuthology.orchestra.run.smithi063.stderr:tar: /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:30:27.409 INFO:teuthology.orchestra.run.smithi063.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:30:27.411 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448/remote/smithi162/crash 2024-09-16T01:30:27.412 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:30:27.449 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:30:27.449 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:30:27.451 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448/remote/smithi192/crash 2024-09-16T01:30:27.452 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/crash -- . 2024-09-16T01:30:27.494 INFO:teuthology.orchestra.run.smithi192.stderr:tar: /var/lib/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T01:30:27.494 INFO:teuthology.orchestra.run.smithi192.stderr:tar: Error is not recoverable: exiting now 2024-09-16T01:30:27.495 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-16T01:30:27.496 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-16T01:30:27.539 INFO:tasks.cephadm:Compressing logs... 2024-09-16T01:30:27.539 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:30:27.582 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:30:27.584 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:30:27.630 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-16T01:30:27.631 INFO:teuthology.orchestra.run.smithi162.stderr:: No such file or directory 2024-09-16T01:30:27.631 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-16T01:30:27.631 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-16T01:30:27.631 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:30:27.631 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-16T01:30:27.631 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-16T01:30:27.631 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-16T01:30:27.631 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:30:27.632 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:30:27.632 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.audit.log: 94.8% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-16T01:30:27.632 INFO:teuthology.orchestra.run.smithi162.stderr: 90.4% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:30:27.632 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-16T01:30:27.632 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- 83.0% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:30:27.632 INFO:teuthology.orchestra.run.smithi162.stderr: /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:30:27.632 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-16T01:30:27.632 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.log: /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mgr.y.log: 86.5% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:30:27.632 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-16T01:30:27.632 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.h.log: 92.2% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-16T01:30:27.633 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-16T01:30:27.633 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:30:27.638 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:30:27.641 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:30:27.641 INFO:teuthology.orchestra.run.smithi192.stderr:: No such file or directory 2024-09-16T01:30:27.641 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:30:27.641 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-16T01:30:27.641 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-16T01:30:27.641 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:30:27.641 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-16T01:30:27.641 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-16T01:30:27.641 INFO:teuthology.orchestra.run.smithi192.stderr: 82.9% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr: 90.5% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.l.log: 86.5% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.7% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-16T01:30:27.642 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-16T01:30:27.643 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.c.log: 91.0% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:30:27.643 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:30:27.645 INFO:teuthology.orchestra.run.smithi063.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory 2024-09-16T01:30:27.645 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-16T01:30:27.645 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-16T01:30:27.645 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T01:30:27.645 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T01:30:27.645 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mon.a.log: 82.8% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.log 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.6.log: /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr: 94.7% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr: 94.6% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-16T01:30:27.646 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mgr.x.log: 86.5% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T01:30:27.647 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-16T01:30:27.647 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.7% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-16T01:30:27.647 INFO:teuthology.orchestra.run.smithi063.stderr: 94.8% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-16T01:30:27.647 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-16T01:30:27.647 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T01:30:27.647 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.log: 91.1% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T01:30:27.647 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cephadm.log: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:30:27.647 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:30:27.650 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T01:30:27.829 INFO:teuthology.orchestra.run.smithi063.stderr: 90.0% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-16T01:30:27.908 INFO:teuthology.orchestra.run.smithi192.stderr: 91.9% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-16T01:30:27.923 INFO:teuthology.orchestra.run.smithi162.stderr: 91.8% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-16T01:30:28.455 INFO:teuthology.orchestra.run.smithi063.stderr: 90.5% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-16T01:30:28.670 INFO:teuthology.orchestra.run.smithi162.stderr: 95.3% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-16T01:30:28.747 INFO:teuthology.orchestra.run.smithi192.stderr: 95.4% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-16T01:30:30.348 INFO:teuthology.orchestra.run.smithi063.stderr: 92.1% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-16T01:30:31.386 INFO:teuthology.orchestra.run.smithi063.stderr: 92.1% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-16T01:30:31.399 INFO:teuthology.orchestra.run.smithi192.stderr: 92.2% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-16T01:30:31.426 INFO:teuthology.orchestra.run.smithi162.stderr: 92.3% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-16T01:30:31.476 INFO:teuthology.orchestra.run.smithi162.stderr: 92.0% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-16T01:30:31.485 INFO:teuthology.orchestra.run.smithi162.stderr: 95.4% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-16T01:30:31.628 INFO:teuthology.orchestra.run.smithi192.stderr: 91.9% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-16T01:30:32.022 INFO:teuthology.orchestra.run.smithi063.stderr: 92.1% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-16T01:30:32.124 INFO:teuthology.orchestra.run.smithi192.stderr: 92.0% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-16T01:30:32.512 INFO:teuthology.orchestra.run.smithi063.stderr: 92.2% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-16T01:30:32.533 INFO:teuthology.orchestra.run.smithi162.stderr: 92.2% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-16T01:30:32.730 INFO:teuthology.orchestra.run.smithi192.stderr: 91.7% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-16T01:30:32.806 INFO:teuthology.orchestra.run.smithi162.stderr: 91.5% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-16T01:30:39.223 INFO:teuthology.orchestra.run.smithi192.stderr: 93.7% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-16T01:30:43.272 INFO:teuthology.orchestra.run.smithi192.stderr: 93.9% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-16T01:30:43.275 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-16T01:30:43.275 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m15.674s 2024-09-16T01:30:43.275 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m44.703s 2024-09-16T01:30:43.275 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m1.359s 2024-09-16T01:30:44.624 INFO:teuthology.orchestra.run.smithi063.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-16T01:30:44.626 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-16T01:30:44.626 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m17.030s 2024-09-16T01:30:44.626 INFO:teuthology.orchestra.run.smithi063.stderr:user 0m32.856s 2024-09-16T01:30:44.626 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m1.037s 2024-09-16T01:31:03.330 INFO:teuthology.orchestra.run.smithi162.stderr: 93.6% -- replaced with /var/log/ceph/c42394ec-73c8-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-16T01:31:03.332 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-16T01:31:03.332 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m35.735s 2024-09-16T01:31:03.332 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m56.807s 2024-09-16T01:31:03.332 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m1.867s 2024-09-16T01:31:03.332 INFO:tasks.cephadm:Archiving logs... 2024-09-16T01:31:03.333 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448/remote/smithi063/log 2024-09-16T01:31:03.334 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:31:08.266 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448/remote/smithi162/log 2024-09-16T01:31:08.268 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:31:16.321 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448/remote/smithi192/log 2024-09-16T01:31:16.322 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:31:22.276 INFO:tasks.cephadm:Removing cluster... 2024-09-16T01:31:22.276 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c42394ec-73c8-11ef-bceb-c7b262605968 --force 2024-09-16T01:31:22.490 INFO:teuthology.orchestra.run.smithi063.stdout:Deleting cluster with fsid: c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:31:22.773 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c42394ec-73c8-11ef-bceb-c7b262605968 --force 2024-09-16T01:31:22.976 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:31:23.297 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c42394ec-73c8-11ef-bceb-c7b262605968 --force 2024-09-16T01:31:23.502 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: c42394ec-73c8-11ef-bceb-c7b262605968 2024-09-16T01:31:23.808 INFO:tasks.cephadm:Removing cephadm ... 2024-09-16T01:31:23.808 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:31:23.827 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:31:23.844 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T01:31:23.865 INFO:tasks.cephadm:Teardown complete 2024-09-16T01:31:23.866 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T01:31:23.881 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T01:31:23.881 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:31:23.884 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:31:23.887 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:31:23.989 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T01:31:23.999 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T01:31:23.999 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:31:24.003 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:31:24.005 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:31:24.017 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:31:24.018 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:31:24.019 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:31:24.021 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:31:24.021 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-16T01:31:24.021 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 -478us[ -478us] +/- 56ms 2024-09-16T01:31:24.021 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -48us[ -48us] +/- 53ms 2024-09-16T01:31:24.022 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +645us[ +645us] +/- 65ms 2024-09-16T01:31:24.022 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:31:24.024 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:31:24.024 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-16T01:31:24.024 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 -485us[ -487us] +/- 56ms 2024-09-16T01:31:24.024 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 53 -6872ns[-6872ns] +/- 53ms 2024-09-16T01:31:24.024 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +630us[ +630us] +/- 65ms 2024-09-16T01:31:24.025 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:31:24.025 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:31:24.025 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-16T01:31:24.025 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 -468us[ -460us] +/- 56ms 2024-09-16T01:31:24.025 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -40us[ -40us] +/- 53ms 2024-09-16T01:31:24.025 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +647us[ +647us] +/- 65ms 2024-09-16T01:31:24.025 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:31:24.025 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T01:31:24.037 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T01:31:24.038 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T01:31:24.062 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:31:24.146 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:31:24.214 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:31:24.281 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:31:24.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:31:24.312 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:31:24.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:31:24.340 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:31:24.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:31:24.368 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T01:31:24.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T01:31:24.403 INFO:teuthology.task.internal:Duration was 1452.855595 seconds 2024-09-16T01:31:24.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T01:31:24.446 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T01:31:24.446 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:31:24.449 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:31:24.451 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:31:24.488 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:31:24.489 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:31:24.490 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:31:24.978 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T01:31:24.978 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-09-16T01:31:24.979 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:31:25.003 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-16T01:31:25.003 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:31:25.041 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-09-16T01:31:25.041 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:31:25.065 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T01:31:25.065 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:31:25.068 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:31:25.084 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:31:25.132 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T01:31:25.132 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:31:25.140 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:31:25.151 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:31:25.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T01:31:25.799 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T01:31:25.800 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:31:25.825 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:31:25.850 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:31:25.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T01:31:25.888 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:31:25.890 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:31:25.893 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:31:25.911 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-09-16T01:31:25.914 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-16T01:31:25.941 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-09-16T01:31:25.974 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:31:25.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:31:25.989 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:31:26.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:31:26.003 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:31:26.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:31:26.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T01:31:26.040 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T01:31:26.041 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448/remote/smithi063 2024-09-16T01:31:26.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:31:26.090 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448/remote/smithi162 2024-09-16T01:31:26.090 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:31:26.128 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906448/remote/smithi192 2024-09-16T01:31:26.128 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:31:26.165 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T01:31:26.166 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:31:26.168 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:31:26.171 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:31:26.214 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T01:31:26.226 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T01:31:26.226 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T01:31:26.255 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T01:31:26.255 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:31:26.257 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:31:26.260 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:31:26.270 INFO:teuthology.orchestra.run.smithi063.stdout: 265613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:31 /home/ubuntu/cephtest 2024-09-16T01:31:26.272 INFO:teuthology.orchestra.run.smithi162.stdout: 265380 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:31 /home/ubuntu/cephtest 2024-09-16T01:31:26.275 INFO:teuthology.orchestra.run.smithi192.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:31 /home/ubuntu/cephtest 2024-09-16T01:31:26.276 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T01:31:26.297 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T01:31:26.383 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/fsstress}} duration: 1452.8555953502655 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T01:31:26.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T01:31:26.471 INFO:teuthology.run:pass